期刊文献+

基于STAR码的HDFS失效数据恢复研究

HDFS Failure Data Recovery Research Based on the STAR Code
下载PDF
导出
摘要 针对数据失效、丢失等存储问题,提出了基于STAR码对HDFS中的丢失数据进行恢复,在文件读取过程中,通过对读取失败的数据块所在组的其他可用数据块采用分片、解码和聚合操作,对本组读取失败的数据块进行恢复.给出了基于STAR码与分片聚合编码的数据存储方案,采用了分片聚合解码的数据恢复策略对数据进行恢复,实现了分片聚合解码的数据块动态恢复和数据块持久性恢复. According to a series of storage problem, such as data failure, data lost, the HDFS lost data recovery has been put forward based on the STAR code strategy. The failure data block can be recovered dynamically by subdivision, decoding and polymerization operation of the other available data block in the group in the process of reading file. The dynamic and persistent recovery of data block have been realized through dividing polymerization decoding data recovery strategy.
出处 《南开大学学报(自然科学版)》 CAS CSCD 北大核心 2014年第1期47-54,共8页 Acta Scientiarum Naturalium Universitatis Nankaiensis
基金 国家科技支撑计划(2012BAF12B00) 天津市科技支撑计划(13ZCDZDGX02500) 天津市科技支撑计划(12ZCDZGX446700)
关键词 STAR码 数据恢复 HDFS存储 解码 数据冗余 STAR code data recovery HDFS storage decoding data redundance
  • 引文网络
  • 相关文献

参考文献8

  • 1王意洁,孙伟东,周松,裴晓强,李小勇.云计算环境下的分布存储关键技术[J].软件学报,2012,23(4):962-986. 被引量:279
  • 2Wan S G, Cao Q, Xie C S, et al. Code-M: A non-mds erasure code scheme to support fast recovery from up to two- disk failures in storage systems[C/OLd//2010 IEEE/IFIP International Conference on Dependable Systems and Net- works, chicago, IL, June 28-]uly 1, 2010. :2012- 08- 131. http ://ieeexplore. ieee. org/xpl/articIeDetails, jsp? ar number : 5545009.
  • 3Kubiatowicz J, Bindel D, Chen Y, et al. Oceanstore: An architecture for global-scale persistent storage[J]. ACM Sigplan Notices, 2000, 35(11): 190-201.
  • 4Harihara S G, Janakiram B, Chandra M G, et al. Spreadstore: A LDPC Erasure Code Scheme for Distributed Stor- age SystemiC/OLd// 2010 International Conference on Data Storage and Data Engineering, Bangalore, India, Feb 9 - 10, 2010. [2012- 08- 141. http ://ieeexplore. ieee. org/xpl/articleDetails, jsp?relord = true:arnumber : 5452613.
  • 5Rashmi K V, Shah N B, Kumar P V. Enabling node repair in any erasure code for distributed storage[C://2011 IEEE International Sysposium on Information Theory Proceedings, St petersburg, July 31-Aug 5, 2011. [2012- 08- 141. http ://ieeexplore. ieee. org/xpls/abs _ all. jsp? arnumber = 6033732.
  • 6Bharti A K, Dwivedi S K. E-Governance in public transportation: UPSRTC-A case studyEC:. //IACSIT: Interna- tional Conference on Software and Computer Applications, July 8-10, 2011, Kathmandu, Nepal. Singapore, IAC- ST Press, 2011, 9:7-12.
  • 7Zhang L, Zhang Y, Lu G H. First-principles investigation of site preference and bonding properties of neutral H in 3C-Sic[J:. Nuclear Instruments and Methods in Physics Research Section B: Beam Interactions with Materials and Atoms, 2009, 267(18): 3 087-3 O89.
  • 8Zhan T, Wei Z, Ge Q, et al. Brain MR image segmentation and bias field correction using adaptive fuzzy C means modeI[C/OL://IEEE: 2010 International Conference on Computer, Mechatronics, Control and Electronic Engineer- ing, Changchun, Jilin, China, 24-26 Aug, 2010. F2012-08-15:. http://ieeexplore, ieee. org/xpls/abs _ all. jsp? arnumber = 56103838:tag = 1.

二级参考文献1

共引文献278

;
使用帮助 返回顶部