期刊文献+

一种面向BBS信息检索的主题网络爬虫算法 被引量:13

Focused Crawling Algorithm for BBS Information Retrieval
下载PDF
导出
摘要 对BBS的数据结构进行了分析研究,并根据BBS特点设计了一种用于BBS信息检索的主题网络爬虫算法.通过主题网络爬虫能够提高抓取网页的效率,同时又可以保证较高的召回率.实验表明,该算法大幅提高了信息检索的效率,改善了信息检索的效果. The architecture of BBS is analyzed. And a suitable focused crawling algorithm is proposed, which improves the efficiency. A BBS search engine is designed based on the proposed algorithm. Practical experiments have been carried out, which show that the recall ratio as well as the accuracy of searching has been enhanced.
出处 《郑州大学学报(理学版)》 CAS 北大核心 2010年第2期22-25,共4页 Journal of Zhengzhou University:Natural Science Edition
基金 国家973重大基础研究发展规划项目 编号2007CB310806
关键词 BBS主题网络爬虫 信息检索 BBS focused crawling information retrieval
  • 相关文献

参考文献3

二级参考文献34

  • 1赫枫龄,左万利.利用超链接信息改进网页爬行器的搜索策略[J].吉林大学学报(信息科学版),2005,23(1):59-63. 被引量:8
  • 2SuGuiyang LiJianhua MaYinghua LiShenghong SongJuping.New focused crawling algorithm[J].Journal of Systems Engineering and Electronics,2005,16(1):199-203. 被引量:1
  • 3李卫,刘建毅,何华灿,王枞.基于主题的智能Web信息采集系统的研究与实现[J].计算机应用研究,2006,23(2):163-166. 被引量:15
  • 4MURRAY B,MOORE A.Sizing the Internet[M].[S.l.]:Cyveillance Inc,2000.
  • 5LAWRENCE S,GILES L.Accessibility and distribution of information on the Web[J].Nature,1999,400(8):107-109.
  • 6CHO J,CARCIA M H.The evolution of the Web and implication for an incremental crawler[C]//Proc of the 26th International Conference on Very Large Databases (NVLDB-00).2000.
  • 7BREWINGTON B E,CYBENKO C.How dynamic is the Web[C]//Proc of the 9th International World Wide Web Conference.2000.
  • 8MENCZER F,PANT C,RUIZ M E.Evaluating topic-driven Web crawlers[C]//Proc of SIGIR'01.New Orleans,Louisiana:[s.n.],2001:241-249.
  • 9MENCZER F,PANT C,SRINIVASAN P.Topic-driven crawlers:machine learning issues[EB/OL].(2002-05-15).http://dollar.biz.uiowa.edu/-fil/papers.html.
  • 10CHO J,GARCIA M H,PAGE L.Efficient crawling through URL ordering[J].Computer Networks and ISDN Systems,1998,30(1-7):161-172.

共引文献133

同被引文献57

引证文献13

二级引证文献19

相关作者

内容加载中请稍等...

相关机构

内容加载中请稍等...

相关主题

内容加载中请稍等...

浏览历史

内容加载中请稍等...
;
使用帮助 返回顶部