|
|
» Marketing Terms |
|
Spider - A program that automatically fetches Web pages. Spiders are used to feed pages to search engines. Because most Web pages contain links to other pages, a spider can start almost anywhere. As soon as it sees a link to another page, it goes off and fetches it. Spiders are software used to periodically explore your web site, download the HTML content of your pages, strip out whatever it considers superfluous and redundant out of the HTML, and store the rest in a database . Large search engines have many spiders working in parallel. Also known as a bot, robot, or crawler.
Back to list of marketing terms |
|
|
|