What are Spiders, Robots and Crawlers and what are their functions?

[Keerti]

What are Spiders, Robots and Crawlers and what are their functions?

 

[smitharetha]

These three are same.They are programs which search engines use to crawl web pages for indexing.

 

[burly]

Spider , Crawler , or Bot are all terms used to describe a tool ( software ) to crawl for search engines - Search Engine , collectively called Web Crawler . This software is designed to be able to browse websites on the World Wide Web a systematic way , with the purpose of collecting information on those sites for search engines ( crawl data ) , aims to save indexing those sites to the database of Search engine. At the same time , help the search engines that offer the most accurate assessment of data collection website .

 

[seomarqetrix]

There is three are same and that is search engine robot to crawling and indexing on a web page.

 

[hoamuoigio]

Spiders (or crawlers, or bots) are the means through which search engines download the content that is on your website's pages.