期刊文献+

面向内存云的数据块索引方法 被引量:14

Strategy for object index based on RAMCloud
下载PDF
导出
摘要 内存云(RAMCloud)通常通过移动数据的位置来解决内存利用率低的问题,致使Hash表数据定位失效,查询数据效率低下;另一方面,在数据恢复过程中由于不能快速定位到需要的数据,每台备份服务器返回的数据段不能更好地组织起来。针对以上问题,提出内存云全局键(RGK)及二叉树索引。RGK分为三部分:定位到主服务器、定位到段以及定位到数据块。前两部分构成协调器索引键(CIK),在恢复中借助构造的协调器索引树(CIT)能够定位到段所在的主服务器;后两部分构成主服务器索引键(MIK),数据在内存中位移后也能通过主服务器索引树(MIT)快速获取到数据。与传统内存云集群相比,主服务器获取数据块的时间随数据吞吐量的增大而明显减少;协调器在闲散时间、重组日志时间等方面均有下降。实验结果表明,全局键在构造的二叉索引树的支持下能有效缩短获取数据及快速恢复的时间。 In order to solve the problem of low using rate,RAMCloud would change the positions of objects,which would cause the failure for Hash to localize the object,and the low efficiency of data search. On the other hand,since the needed data could not be positioned rapidly in the recovery process of the data,the returned segments from every single backup could not be organized perfectly. Due to such problems,RAMCloud Global Key( RGK) and binary index tree,as solutions,were proposed. RGK can be divided into three parts: positioned on master,on segment,and on object. The first two parts constituted Coordinator Index Key( CIK),which means in the recovery process,Coordinator Index Tree( CIT) could position the master of segments. The last two parts constituted Master Index Key( MIK),and Master Index Tree( MIT) could obtain objects quickly,even though the data was shifted the position in the memory. Compared with the traditional RAMCloud cluster,the time of obtaining objects can obviously reduce when the data throughput is increasing. Also,the idle time of coordinator and recombined time of log are both declining. The experimental results show that the global key with the support of the binary index tree can reduce the time of obtaining objects and recovering.
出处 《计算机应用》 CSCD 北大核心 2016年第5期1222-1227,共6页 journal of Computer Applications
基金 国家自然科学基金资助项目(61462079 61363083 61262088) 新疆自治区青年博士科技人才创新项目(2013731004)~~
关键词 内存云 日志结构 二叉索引树 数据块定位 快速恢复 RAMCloud log-structure binary index tree object localization fast recovery
  • 相关文献

参考文献16

  • 1FOX A, GRIBBLE S D, CHAWATHE Y, et al. Cluster-based scalable network services[C]//Proceedings of the 16th ACM Symposium on Operating Systems Principles. New York:ACM, 1997:78-91.
  • 2ARMBRUST M, FOX A, GRIFFITH R, et al. A view of cloud computing[J]. Communications of the ACM, 2010, 53(4):50-58.
  • 3OUSTERHOUT J, AGRAWAL P, ERICKSON D, et al. The case for RAMClouds:scalable high-performance storage entirely in DRAM[J]. ACM SIGOPS Operating Systems Review, 2010, 43(4):92-105.
  • 4BORTHAKUR D. The hadoop distributed file system:architecture and design[EB/OL].[2015-05-05]. http://hadoop.apache.org/common/docs/r0.18.2/hdfs_design.pdf.
  • 5RUMBLE S. Memory and object management in RAMCloud[D]. Stanford:Stanford University, 2014:17-44.
  • 6STUTSMAN R. Durability and crash recovery in distributed in-memory storage systems[D]. Stanford:Stanford University, 2013:49-53.
  • 7RUMBLE S, KEJRIWAL A, OUSTERHOUT J. Log-structed memory for DRAM-based storage[C]//Proceedings of the 12th USENIX Conference on File and Storage Technologies. Berkeley:USENIX, 2014:1-16.
  • 8CHANG F, DEAN J, GHEMAWAT S, et al. Bigtable:a distributed storage system for structured data[J]. ACM Transactions on Computer Systems, 2008, 26(2):4.
  • 9MITCHELL C, GENG Y, LI J. Using one-sided RDMA reads to build a fast, CPU-efficient key-value store[C]//Proceedings of the 2013 USENIX Annual Technical Conference. Berkeley:USENIX, 2013:103-114.
  • 10KIM W, CHO I, MIN D, et al. Design of data backup on distributed memory system based on key-value store using hot/cold data management[C]//Proceedings of the 2014 Conference on Research in Adaptive and Convergent Systems. New York:ACM, 2014:359-361.

同被引文献73

引证文献14

二级引证文献75

相关作者

内容加载中请稍等...

相关机构

内容加载中请稍等...

相关主题

内容加载中请稍等...

浏览历史

内容加载中请稍等...
;
使用帮助 返回顶部