What is a spider or a robot, and how is my site found?
When a site is originally created, most designers will do a simple submission to the main search engines. This causes the search engine to send an automated robot (also known as a spider) to examine the web site. Depending on the search engine, that spider is looking for various clues to help categorize and rank the relevance of your site. (history note: the term spider was adopted as a nickname when the internet became commonly known as the “web”) These robots are looking for relevant and fresh information. When they find it, search engine spiders are instructed to analyze how often the information is refreshed and how relevant it is (often identified by how many times it is mentioned on other sites.
