0

9) What are Spiders, Robots and Crawlers and what are their functions?

Spiders, robot and crawler, they are all same and referred by different names. It is a software program that follows, or “Crawls” different links throughout the internet, and then grabs the content from the sites and adds to the search engine indexes.

Leave a Reply

Your email address will not be published. Required fields are marked *