摘要
分析了万维网不良网络信息对网络文化安全带来的挑战,提出了Web信息搜索与数据挖掘体系结构,并介绍了该体系结构中的关键技术和运行原理。分析了普通爬虫所实现的功能和不足之后,重点论述了该爬虫的工作原理、实现方式和性能分析以及该爬虫不同于其它爬虫的功能和在Web信息搜索与数据挖掘体系中应用。通过试验测试表明,该爬虫能够很好地获取万维网上的各种信息资源,有助于网络文化内容监测与管理。
The challenges are analyzed,which that the adverse information on world wide web has brought to network security and web culture.The key technical and operational principles of the architecture in web information search and data-mining are introduced.After the analysis of the functions and disabilities of ordinary reptiles,the principle,implementation,functions,and performance of WebCrawler are elaborated.In addition,the application of WebCrawler in web information search and data-mining system are discussed in detail.Passed tests show that the WebCrawler can access a good range of information on the world wide web resources and contribute to network monitoring and management of cultural content.
出处
《计算机工程与设计》
CSCD
北大核心
2009年第24期5658-5662,共5页
Computer Engineering and Design
基金
"十一五"国家科技支撑计划重点基金项目(2006BAK11B01)
