Wednesday, December 3, 2008

Architecture Of search Engines

Spider - a browser-like program that downloads web pages.

Crawler – a program that automatically follows all of the links on each web page.
Indexer - a program that analyzes web pages downloaded by the spider and the crawler.

Database– storage for downloaded and processed pages.
Results engine – extracts search results from the database.

Web server – a server that is responsible for interaction between the user and other search engine components.

No comments: