Skip to main content
1-Visitor
August 27, 2016
Solved

content Crawler?

  • August 27, 2016
  • 1 reply
  • 1425 views

Hii,

I am trying to understand "content Crawler". Is it for retrieving information from the external sites? .Could any body please  give glimpses on this and how to use it.

Thanks,

Manohar

Best answer by mchehaibi

Hi Manohar,

Content Crawler is an object meant to store data (similar to a DataTable) that you have scraped or periodically scraped from another system using the Content Service (Name)

This service is meant to return an Infotable whose values are mapped into the ContentCrawler DataShape

via the Field to Field Mappings and/or Field to Tag Mappings. The Index Settings is the same implementation

as a DataTable and allows you to create secondary indexes on the data you're persisting beyond

the index of the DataShape.


I hope this helps.


Best Regards,

Amine

1 reply

mchehaibi5-Regular MemberAnswer
5-Regular Member
September 1, 2016

Hi Manohar,

Content Crawler is an object meant to store data (similar to a DataTable) that you have scraped or periodically scraped from another system using the Content Service (Name)

This service is meant to return an Infotable whose values are mapped into the ContentCrawler DataShape

via the Field to Field Mappings and/or Field to Tag Mappings. The Index Settings is the same implementation

as a DataTable and allows you to create secondary indexes on the data you're persisting beyond

the index of the DataShape.


I hope this helps.


Best Regards,

Amine