基于搜索引擎的网络蜘蛛实现原理的研究

The research on the practical principle of the web spider based on searching engine

随着信息时代的到来,网络已成为我们生活中不可缺少的一部分。我们经常需要在网上查找资料,也就是用到搜索引擎,而网络蜘蛛又为它的核心——决定了搜索引擎数据容量的大小。本文对网络蜘蛛的实现原理及方法作了详细的论述。

Along with the arrival of information ages, the network has become us living medium indispensability of a part. We usually need to check to seek the data on the net, also be use search the engine, but the web spider again is its core——Come to a decision the size of search the engine data capacity. This text carries out the principle and methods to make the detailed treatise to the web spider.