|
|
» Marketing Terms |
| |
Crawling the Web. Search engines use crawlers to move from web page to web page by following the links on the pages.
The pages "found" are then ranked using an algorithm
and indexed into the search engine database.
Distributed web crawling is a
distributed computing technique whereby Internet search engines employ many computers to index the
Internet via web crawling. The idea is to spread out the required resources of computation and
bandwidth to many computers and networks.
Back to list of marketing terms |
|
|
|