期刊文献+

基于布隆过滤器的网页搜索去重方法 被引量:4

A Method for URL Duplicate Removal Based on Bloom Filter
下载PDF
导出
摘要 介绍布隆过滤器的相关理论,对MD5哈希算法进行较为详细的分析,对GPU和CPU的结构及运算特点进行分析比较,提出一种基于布隆过滤器并使用GPU进行URL的MD5计算的网页搜索去重方法。 Introduces the related Bloom Filter and analyzes the algorithm of MDS, and compares the structure of CPU & GPU. Introduces a method for URL duplicate removal with GPU based on Bloom Filter.
作者 黄恩博
出处 《现代计算机》 2013年第14期7-10,共4页 Modern Computer
关键词 布隆过滤器 MD5 网页搜索去重 Bloom Filter MD5 URL Duplicate Removal
  • 相关文献

参考文献6

  • 1http://news.netcraft.com/,2nd April, 2013.
  • 2Introduction to Automata Theory. Languages, and Computa- tion[M]. JE Hopcroft, R Motwani 2007 - Addison-wesley.
  • 3http://userpages.umbc.edu/mabzugl/cs/mdS/mdS.html, lst April,2002.
  • 4RFC 1321[S],R.Rivest. MIT Laboratory for Computer Science and RSA Data Security Inc. April 1992.
  • 5ETSI ES 201 S73-1 v2.2.1(2003-02)[S]. Methods for Re- hash(MTS). Control Notation version 3;Partl:TrCN-3 Core Language,27-28.
  • 6Pagh. An Optimal Bloom Filter Replacement. In: Proceedings of the Sixteenth Annual ACM-SIAM Symposium on Discrete Algorithms [C]. SIAM, Society for Industrial and Applied Mathematics, 2005 : 823-829.

同被引文献23

  • 1徐娜,刘四维,汪翔,倪卫明.基于Bloom Filter的网页去重算法[J].微型电脑应用,2011(3):48-51. 被引量:6
  • 2赵沁平.虚拟现实综述[J].中国科学(F辑:信息科学),2009,39(1):2-46. 被引量:658
  • 3Burton H. Bloom.Space/time trade-offs in hash coding with allowable errors[J].Communications of the ACM.1970(7)
  • 4Manber U.Finding similar files in a large file system. Proceedings of USENIX Winter Technical Conference . 1994
  • 5Netcraft.November 2015 Web Server Survey(OL)http://news.netcraft.com/archives/2015/11/16/november-2015-web-server-survey.html . 2015
  • 6Rafael P. Laufer,Pedro B. Velloso,Otto Carlos M.B. Duarte.??A Generalized Bloom Filter to Secure Distributed Network Applications(J)Computer Networks . 2011 (8)
  • 7Narayanan Shivakumar,Hector Garcia-Molina.SCAM: A copy detection mechanism for digital documents. Proceedings of 2nd International Conference in Theory and Practice of Digital Libraries (DL’95) . 1995
  • 8Jing C,Zhengang N,Liying L,et al.Research and Applicat ion on Bloom Filter in Routing Planning for Indoor Robot Navigation System. 2009 Pacific-Asia Conference on Circui ts,Communications and Systems.IEEE . 2009
  • 9Si A,Leong H V,Lau R W H.CHECK:a document plagiar ism detection.system. Proceedings of the 1997 ACM symp osium on Applied computing . 1997
  • 10胡静.浅析黑盒测试与白盒测试[J].衡水学院学报,2008,10(1):30-32. 被引量:17

引证文献4

二级引证文献3

相关作者

内容加载中请稍等...

相关机构

内容加载中请稍等...

相关主题

内容加载中请稍等...

浏览历史

内容加载中请稍等...
;
使用帮助 返回顶部