期刊文献+

分布式存储中的再生码综述 被引量:7

Survey for regenerating codes for distributed storage
原文传递
导出
摘要 分布式存储系统中通过引入冗余提高系统的可靠性,纠删码作为重要的冗余策略在分布式存储中得到越来越多的重视。分布式存储系统中,当某个存储节点失效后,需要引入新的节点来修复失效节点的数据。传统纠删码冗余策略在修复失效节点时需要传输的数据量较大。近年来出现的再生码对传统纠删码进行改进以减少修复失效节点的带宽消耗。再生码引入网络编码的思想,在修复失效节点时,参与修复过程的节点首先将本节点内的数据作线性组合后再上传,最终修复带宽消耗最小。介绍了再生码的基本概念,然后介绍单节点修复再生码和合作修复再生码的编码策略,最后总结再生码的发展和研究方向。 Distributed storage system introduces redundancy to increase reliability,and erasure code is used widely in distributed storage system.When a node fails in the distributed storage system,a new node is introduced to repair the failed one.When using erasure code,repairing the failed node often requires a large amount of data transfer.Regenerating Code was proposed to reduce the cost of repair bandwidth.Regenerating Code reduces the amount of data uploaded by each helping node by transferring a linear combination of the data it stores to the failed node in the repair process.In this paper we first review the basic idea of regenerating code.Then we summarize the code constructions of both the one-by-one and cooperative regenerating code.At last we talk about the future research direction.
出处 《重庆邮电大学学报(自然科学版)》 CSCD 北大核心 2013年第1期30-38,共9页 Journal of Chongqing University of Posts and Telecommunications(Natural Science Edition)
基金 国家重点基础研究发展计划("973"计划)(2012CB315803) 高校博士点基金(20100002110033) 东南大学移动通信国家重点实验室开放课题(2011D11)~~
关键词 分布式存储 网络编码 再生码 修复带宽 distributed storage network coding regenerating code repair cost
  • 相关文献

参考文献24

  • 1DIMAKIS A G,GODFREY P B,WAINWRIGHT M. Network coding for distributed storage systems[A].Anchorage,USA,2007.2000-2008.
  • 2AHLSWEDE R,CAI N,LI S Y. Network information flow[J].IEEE Transactions on Information theory,2000,(04):1204-1216.doi:10.1109/18.850663.
  • 3DIMAKIS A G,GODFREY P B,WAINWRIGHT M. Network coding for distributed storage systems[J].IEEE Transactions on Information theory,2012,(09):4539-4551.
  • 4DIMAKIS A G,KANNAN R,WU Y. A survey on network codes for distributed storage[J].Proceedings of the IEEE,2011,(03):476-489.
  • 5SHAHNB,RASHMIKV,KUMARPV. Interference alignment in regenerating codes for distributed storage:Necessity and code constructions[J].IEEE Transactions on Information theory,2011,(04):2134-2158.
  • 6SHAH N B,RASHMI K V,KUMAR P V. Explicit codes minimizing repair bandwidth for distributed storage[A].Cairo,2010.1-5.
  • 7CADAMBE V R,HUANG C,LI J. Permutation codes:optimal exact repair of a single failed node in MDS code based distributed storage systems[A].St.Petersburg,USA,2011.1225-1229.
  • 8ITZHAK T,WANG Z Y,BRUCK J. MDS array codes with optimal rebuilding[A].St.Petersburg,USA,2011.1240-1244.
  • 9ITZHAK T,WANG Z Y,BRUCK J. Zigzag codes:MDS array codes with optimal rebuilding[J].IEEE Transactions on Information theory,2012.
  • 10DANIEL C,DIMAKIS A G,TRACEY H. Searching for minimum storage regenerating codes[A].UrbanaChampaign,USA,2009.1-10.

同被引文献38

  • 1TOM White. Hadoop: The Definitive Guide [ M]. 2nd ed. O' Reilly Media,lnc,2011.
  • 2ARMBRUST M, FOX A, GRIFFITH R, et al. Above the Clouds: A Berkeley View of Cloud Computing [ D ]. Berkeley: UCB/EECS-2009-28, EECS Department, Uni- versity of California, Berkeley, 2009.
  • 3TOM White. The Small Files Problem[ EB/OL]. (2009- 02-02) [2013-12-10]. http://www, cloudera, com/ blog/2009/02/02/the-small-files-problem/.
  • 4HADOOP. Hadoop Archives [ EB/OL]. (2013-04-01) [ 2013-12-10 ]. http ://hadoop. apache, org/docs/r-l. 2. 1/hadoop_arehives. htrnl.
  • 5HADOOP. Sequence File Wiki [ EB/OL ]. ( 2009-09-05 ) [2013-12-10 ].http://wiki. apache, org/had-oop /Se- quenceFile.
  • 6CARPE Diem. Combine File Input Format [ EB/OL] (2009-10-05) [ 2013-12-10 ]. http://ww-w, idryman org/blog/2013/09/22/process-small-files-on-hadoop-u- sing-combinefileinputformat- 1/.
  • 7HADOOP. Map files [ EB/OL ]. (2013-04-15) [ 2013- 12-10]. http.//hadoop, apache, org/does/cu-rrent/api/ org/apache/hadoop/io/MapFile, html.
  • 8LIU Xuhui, HAN Jizhong, ZHONG Yunqin, et al. hn- plementing WebGIS on Hadoop: A Case Study of Impro- ving Small File I/O Performance on HDFS [ C ]//2009 IEEE International Conference on Cluster Computing and Work-shops. New Orleans : IEEE Press,2009 : 1-8.
  • 9DONG Bo, QIU Jie, ZHENG Qinghua, et al. A Novel Approach to Improving the Efficiency of Storing and Ac- cessing Small Files on Hadoop: a Case Study by Power- Point Files [ C ]//2010 IEEE International Conference on Services Computing (SCC). Miami, FL: IEEE Press, 2010 : 65-72.
  • 10CHANDRASEKAR S, DAKSHINAMURTHY R, SESHA- KUMAR P G, et al. A novel indexing scheme for effi- cient handling of small files in Hadoop Distributed File System [ C]//2013 IEEE International Conference on Computer Communication and |nfolnatics (ICCCI). Co- imbatore: IEEE Press, 2013 : 1-8.

引证文献7

二级引证文献19

相关作者

内容加载中请稍等...

相关机构

内容加载中请稍等...

相关主题

内容加载中请稍等...

浏览历史

内容加载中请稍等...
;
使用帮助 返回顶部