What is the work of Crawler?

Please tell me what is the work of Crawler?

 

Crawler is the spider or robot of google search enigne which crawled every single website on the web & give rank to it..Got it??

 

When a web crawler visits one of your pages, it loads the site’s content into a database. Once a page has been fetched, the text of your page is loaded into the search engine’s index, which is a massive database of words, and where they occur on different web pages.

 

Crawler means to identifying web pages faster to reach all search engines.

 

it is a google spider

 

Web crawlers use a process called crawling the web or web crawling. They start with the web servers that have heavy traffic and most popular web pages.

 

The work of a crawler is to visit the website and crawls the webpage and their information and stores in the search engine database.

 

When a web crawler visits one of your pages, it loads the site’s content into a database. Once a page has been fetched, the text of your page is loaded into the search engine’s index, which is a massive database of words, and where they occur on different web pages.

 

Crawler is a program that automatically follows all of the links on each web page.

 

Google’s web crawler is known as GoogleBot.spider” crawls from one website to another.Search engines may run thousands of instances of their web crawling programs simultaneously, on multiple servers. When a web crawler visits one of your pages, it loads the site’s content into a database. Once a page has been fetched, the text of your page is loaded into the search engine’s index, which is a massive database of words, and where they occur on different web pages

 

Crawler is Google Robot/spider which is crawl your site and whenever some body throw query regarding to the your keyword than it will represent your site in search result.

 

The functions of crawler is, it reads the entire contents in a website by the help of spider.

 

And check what are the modification in a sit and saves all the modified data in its datebase called caching for fastest achieving..