We've all been there. You've been given an assignment you need help with, or maybe you're researching a new product or looking up a competitor's spec sheet. Regardless of the reason, at some point you will opt for the dreaded Internet search engine only to find ... more frustration. Internet search engines all work differently and provide varying results. Learning how they work can help you choose the right path and be more productive in your effort.
Crawler-based search engines. Crawler-based search engines, such as HotBot, create their listings automatically. They "crawl" or "spider" the Web, then listings are based on what they have found. If a webpage is changed, crawler-based search engines eventually find these changes, and that can affect how a page is listed. Page titles, body copy, and other elements all play a role.