Crawling data for the first timeThe first time that you crawl the IBM Connections data, crawl all content, so it takes longer to perform this operation than it takes to perform subsequent crawls.
ProcedureTo crawl the data for the first time...
- Send a GET request to the seedlist feed for the application whose data you want to crawl. Do not specify any parameters on the request.
The activities seedlist also contains content from community activities.
The blogs seedlist also contains content from community blogs.
The wikis seedlist also contains content from community wikis.
- Process the returned feed. Find the rel=next link and send a GET request to the web address specified by its href attribute.
- Repeat the previous two steps until the response includes a <wplc:timestamp> element in its body.
- Store the value of the <wplc:timestamp> element; pass that value as a parameter when you perform a subsequent crawl of the data.
Parent topicCrawling data