Crawling data for the first time
The first time that you crawl the IBM Connections data, crawl all content, so it takes longer to perform this operation than it takes to perform subsequent crawls.
Procedure
To crawl the data for the first time...
- Send a GET request to the seedlist feed for the application whose data you want to crawl. Do not specify any parameters on the request.
http://<servername>/activities/seedlist/myserverThe activities seedlist also contains content from community activities.
Blogs
http://<servername>/blogs/seedlist/myserverThe blogs seedlist also contains content from community blogs.
Bookmarks
http://<servername>/dogear/seedlist/myserver
Communities
http://<servername>/communities/seedlist/myserver
Files
http://<servername>/files/seedlist/myserver
Forums
http://<servername>/forums/seedlist/myserver
Profiles
http://<servername>/profiles/seedlist/myserver
Wikis
http://<servername>/wikis/seedlist/myserverThe wikis seedlist also contains content from community wikis.
For example:
https://enterprise.example.com/files/seedlist/myserver
- Process the returned feed. Find the rel=next link and send a GET request to the web address specified by its href attribute.
- Repeat the previous two steps until the response includes a <wplc:timestamp> element in its body.
- Store the value of the <wplc:timestamp> element; pass that value as a parameter when you perform a subsequent crawl of the data.
Parent topic
Crawling dataRelated reference
Seedlist response
});