期刊文献+

分布式存储系统的哈希算法研究 被引量:17

Research on hash algorithm for distributed storage system
下载PDF
导出
摘要 针对分布式存储系统中如何实现数据在物理存储上的均匀分布和高效定位的问题,对多种哈希算法展开研究,提出了衡量分布式存储系统哈希算法优劣的标准;从散列分布性、哈希冲突和计算效率等多个维度对这些哈希算法进行分析比较,指出各种哈希算法的应用场景;结合分布式存储系统的应用,给出最优的哈希算法选择。实验结果证明,Davies-Meyer算法具有很好的均匀分布性和很高的计算效率,很适合分布式存储系统的应用。 Considering the uniform data distribution in physical storage and efficient data positioning in distributed storage system, this paper studies different hash algorithms and proposes how to measure the merits of hash algorithm in distributed storage system. Based on experiments, the detail comparative analysis of various hash algorithms are shown in aspect of hash value distribution, hash conflict and computational efficiency and application scenarios of those algorithms are pointed out. In addition, the optimal scheme combining with distributed storage file system is demonstrated. Experimental results show that Davies-Meyer algorithm has a good uniform distribution and high computational efficiency which is suitable for distributed storage systems.
出处 《计算机工程与应用》 CSCD 2014年第1期1-4,77,共5页 Computer Engineering and Applications
基金 国家自然科学基金(No.11205179) 中国科学院知识创新工程基金重大项目(No.KJCX1-YW-17)
关键词 分布式存储系统 哈希算法 散列分布性 哈希冲突 Davies-Meyer算法 distributed storage system hash algorithm hash distribution hash conflict Davies-Meyer algorithm
  • 相关文献

参考文献13

二级参考文献50

  • 1云存储[EB/OL].(2008-02-14)[2008-01-10].http://baike.baidu.com/view/2044736.htm?fr=alaO-1.
  • 2Robert Devine.Design and Implementation of DDH:A Distributed Dynamic Hashing Algorithm[C].Proceedings of 4th International Con- ference on Foundations of Data Organizations and Algorithms,1993.
  • 3http://blog.sina.com.cn/s/blog_56fc158ab0100oe5c.html.
  • 4Storage Networking Industry Association (SNIA).Cloud storage reference model:Version 0.3 rev[S/OL].[2011-07-18].http://www.snia.org/sites/default/files/CloudStorageReferenceModelV03.pdf.
  • 5Amazon.com Inc.Amazon simple storage service (Amazon S3)[EB/OL].[2011-07-18].http://aws.amazon.com/s3.
  • 6BORTHAKU D.The Hadoop distributed file system:Architecture and design[EB/OL].[2011-07-05].http://hadoop.apache.org/common/docs/r0.18.0/hdfs_design.pdf.
  • 7Hbase Development Team.HBase:Bigtable-like structured storage for Hadoop HDFS[EB/OL].[2011-06-12].http://wiki.apache.org/hadoop/Hbase.
  • 8盛大网络.盛大云——云硬盘[EB/OL].[2011-05-18].http://www.grandcloud.cn/index.php?m=content&c=index&a=lists&catid=29.
  • 9盛大网络.盛大云——云存储[EB/OL].[2011-05-28].http://www.grandcloud.cn/index.php? m =content&c =index&a =lists&catid =18.
  • 10ZENG WENYING,ZHAO YUELONG,OU KAIRI,et al.Research on cloud storage architecture and key technologies[C]//ICIS '09:Proceedings of the 2nd International Conference on Interaction Sciences:Information Technology,Culture and Human.New York:ACM,2009:1044-1048.

共引文献72

同被引文献135

引证文献17

二级引证文献58

相关作者

内容加载中请稍等...

相关机构

内容加载中请稍等...

相关主题

内容加载中请稍等...

浏览历史

内容加载中请稍等...
;
使用帮助 返回顶部