Computer robot programs, referred to sometimes as “crawlers” or “knowledge-bots” or “knowbots” that are used by search engines to roam the World Wide Web via the Internet, visit sites and databases, and keep the search engine database of web pages up to date.
They obtain new pages, update known pages, and delete obsolete ones. Their findings are then integrated into the “home” database.
Most large search engines operate several robots all the time. Even so, the Web is so enormous that it can take six months for spiders to cover it, resulting in a certain degree of “out-of-datedness” (link rot) in all the search engines.
Link to this articule from your own website; just copy/paste this HTML:
Temas Relacionados:
interesting info 
Thanks, you have a nice website
[Reply]