摘要
随着互联网的快速发展,搜索引擎的应用越来越重要,作为搜索引擎的首要组成部分网络爬虫一直备受人们的关注。主题爬虫作为网络爬虫的重要种类使用越来越广泛,深入分析的网络主题爬虫关键性原理有助于根据需求设计出科学合理的爬虫。
With the rapid development of Internet, the application of search engines is becoming more important. Web crawler has always been of concernas the essential part of the search engine. Topical crawler is an important kind of crawler and is widely used in network. Analysis of the key principles ofWeb topical crawler is done in this paper, which is very important for the design of an efficient crawler as required.
出处
《微型电脑应用》
2011年第7期32-34,70,共4页
Microcomputer Applications
关键词
网络爬虫
主题爬虫
爬虫算法
Web Crawler
Topical Crawler
Crawler Algorithm