Your source for the most up-to-date terms, definitions, and acronyms for and about internet service providers.
Search for an ISP term
robot
Last modified: Tuesday, March 12, 2002
(1) A device that responds to sensory input. See under robotics.
(2) A program that runs automatically without human intervention. Typically, a robot is endowed with some artificial intelligence so that it can react to different situations it may encounter. Two common types of robots are agents and spiders.
Robots.txt Information Information about the ROBOTS.TXT file. The ROBOTS.TXT file is used to prevent Web robots from indexing some or all of a Web site. This is useful to exclude anything which is felt does not need to be included in search engines.