Correct Answer is : Crawler
Explanation:
What is crawler in search engines and how it is work ?
- Almost every search engine use a program or automated script called to systematically browse the world wide web and index them in a local repository called crawler.
- Crawlers automatically discover and scan websites by following links from one web page to another.
- A crawler is a computer program that automatically searches for information on the internet. Crawlers are also known as “robots”, “spiders”, or “spiderbots”. They are typically operated by search engines to create entries for a search engine index
