How Search Engines work?

How Search Engines work?

Search Engines use automated software programmes (called spiders or robots) that crawl the web looking for webpages and related information.

These spiders find and classify websites and keep references to these indexed in its search engine databases.

And when you search for information using a search engine, it will look through its database and display all the matching ones.


How Serach Engines find information on the web?

The spiders while crawling the web look for links within websites. It goes from one link to another visiting several/many websites on and on. From each of these sites, it collects or updates the information relevant to the website. The crawlers will locate your website soon or later, but one can never say when.

Alternatly, the presence of a new website can be told to the crawler by submitting details of the website to the search engine. Once submitted to a search engine, its crawler will visit your site and collect the necessary information.


How Search Engines store all the information?

The information that is relevant to accessing a website is classified and indexed in a database. This is constantly updated to include information on new sites, to take care of changes in existing websites and to remove from its list dead websites.


How Search Engines respond to search request?

The Search Engines have a software programme that can sort through information on millions of websites that it has indexed in its database, find the matching ones and display it in a sequence such that the most relevant ones appear in the beginning. All this in a flash.


How different Search Engines give different results?

Search Engines differ in the way they collect, store and display information. The number of websites indexed in its database can also vary. In addition, the search engines have different criteria for sequencing/ranking the websites. All these add on to give different results on different search engines.


How to submit to Search Engines?

One needs to submit the details of your website as required by the search engine through its 'add a site or suggest a site' facility. Usually for submitting a website to search engines, one needs to just give the website address. The crawler does the rest by visting your website and collecting all the relevant information it needs for listing and ranking.


How many pages of the website to submit?

Usually one does not need to submit all the pages of the website. The crawlers of search engines usually locate inside pages through links. And directories normally do not list individual pages of the website. However, if yours is website that has sections or sub-sections in it that are important and unique, then its best to submit these individually/seperately.


How Search Engines sequence/rank websites?

Factors: Frequency, Location, Number of Links, Meta Tags

When the search engine presents its results, the most relevant one are displayed in the beginning of the list. The search engine determines this by looking for keywords that repeat themselves within the web document. The assumption being the frequency of the keyword determines its importance/relation to the topic of the website.

They also see if these keyword appear in the title of the web page and in the beginning of the body text. The assumption being that the keywords located in these important/prominant places would be more relevant to the subject of the website. Some search engines give importance to the number of links on a given page or to the number of links that are pointing towards it. The assumption again being - more the number of links the more comprehensive and important the website is.

Few search engines pick up information provided as keywords and description from the metatags on your website. This is off course verified for its use in the inside contents of your website.


How to make the website Search Engine sauvy/friendly?

Internet users use a word or a phrase as keywords to search for information on the web. This means that you need to identify the most important words and phrases associated with identifying/locating a website like yours. Once a list is made, it is essential that these are integrated in the title, listed as keywords in the metatags, included in the description and comes as part the initial body text of the website. And then just hope the search engines will be able to pick up these as the proper keywords connected with locating and ranking your website.


How to submit to Directories?

One needs to submit the details of your website as required by the directory through its 'add a site or suggest a site' facility. Usually in a directory, one needs to first locate the relevant category suitable for the subject of your website and submit the details of your site under this category. After submission, the details of your website will remain in queue untill it is reviewed by an editor. Just hope the editor likes your website and feels that it is important. Usually a site with good content, design and purpose will find its way into getting reviewed and listed in directories. But there is no way to ensure a listing. The only choice is to submit again after a period of time. If you can make improvements, it will help for sure.


How many pages of the website to submit?

Directories normally do not list individual pages of the website. However, if yours is website that has sections or sub-sections in it that are important and unique, then its best to submit these individually/seperately.