期刊文献+

基于生存期的云存储元数据缓存算法 被引量:2

Metadata caching algorithm of cloud storage based on life cycle
下载PDF
导出
摘要 针对元数据管理子系统成为云存储中性能瓶颈的问题,研究了云存储元数据缓存算法.在分析元数据被访问特性的基础上,提出了元数据缓存生存期的概念;依据云存储的特性设计了元数据缓存生存期的计算规则,给出了基于生存期的元数据调出策略和元数据缓存写回策略,提高了云存储元数据管理的效率;分析了基于生存期元数据缓存算法适应用户访问特性的能力,讨论了使用基于生存期元数据缓存算法后如何保证元数据一致性的问题;使用基于生存期元数据缓存算法,实现了云存储元数据缓存原型系统,并使用通用数据集和测试工具进行了测试与分析.结果表明,该算法能提高云存储15%的I/O速度和16%的操作处理速度. To solve the bottle-neck caused by metadata management subsystem in cloud storage,a metadata ca-ching algorithm of cloud storage was proposed.Based on the characteristics analysis of accessed metadata,the concept of metadata caching life cycle was determined.The calculating rules of metadata caching life cycle was designed,and the metadata caching algorithms of metadata substitution and write-back were presented based on the life cycle definition.The metadata management efficiency of cloud storage was greatly improved by the caching algorithms.The metadata caching algorithms adaptability to user accessing characteristics was analyzed,and the metadata consistency guaranteed by the algorithms was discussed.A metadata caching prototype was realized based on the proposed algorithms.Analysis and experiments were completed on the benchmark dataset by general test tools.The results show that the proposed algorithms can effectively enhance I/O rate by 15% and operation processing rate by 16% in cloud storage,respectively.
出处 《江苏大学学报(自然科学版)》 EI CAS 北大核心 2012年第6期678-683,689,共7页 Journal of Jiangsu University:Natural Science Edition
基金 广东省自然科学基金资助项目(S2011010006118) 江苏省高校自然科学基金资助项目(09KJB520001) 江苏大学高级人才启动基金资助项目(09JDG038) 江苏省研究生创新基金资助项目(1221170029)
关键词 元数据 云计算 分布式计算 文件组织 缓存 metadata cloud computing distributed computing file organization cache memory
  • 相关文献

参考文献12

  • 1Roselli D, Lorch J R, Anderson T E. A comparison of file system workloads [ C ] //Proceedings of the 2000 USENIX Annual Technical Conference. Berkeley: USE- NIX Association, 2000:41 - 54.
  • 2Satyanarayanan M, Kistler J J, Kumar P, et al. Coda: a highly available file system for distributed workstation environment [ J ]. IEEE Transactions on Computers, 1990, 39(4) : 447 -459.
  • 3Riedel E, Kallahalla M, Swaminathan R. A framework for evaluating storage system security [ C ]//Proceedings of the 1st Conference on File and Storage Technologies. Berkeley: USENIX Association, 2002 : 15 - 30.
  • 4Weil S A, Pollack K T, Brandt S A, et al. Dynamic meta- data management for petabyte-scale file systems [ C ] // Proceedings of IEEE/ACM SC2004 Conference. Piscataway: IEEE, 2004:523-534.
  • 5Brandt S A, Miller E L, Long D D E, et al. Efficient metadata management in large distributed storage sys- tems[ C] // Proceedings of the 20th IEEE/llth NASA Goddard Conference on Mass Storage Systems and Tech- nologies. Piscataway: IEEE, 2003:290 - 298.
  • 6Li Weijia, Xue Wei, Shu Jiwu, et al. Dynamic has- hing: adaptive metadata management for petabyte-scale file systems [ C ] //Proceedings of IEEE MSST' 2006. Piscataway: IEEE Computer Society, 2006 : 93 - 98.
  • 7Zhu Yifeng, Jiang Hong, Wang Jun, et al. HBA- dis- tributed metadata management for large cluster-based storage systems[ J ]. IEEE Transactions on Parallel and Distributed Systems, 2008, 19(6): 750-763.
  • 8Leung A W, Shao Minglong, Bisson T, et al. Spyglass: fast, scalable metadata search for large-scale storage systems[ C ]//Proceedings of the 7th Conference on File and Storage Technologies. Berkeley, CA : USENIX Asso- ciation, 2009 : 153 - 166.
  • 9穆飞,薛巍,舒继武,郑纬民.基于定位目录的元数据管理方法[J].清华大学学报(自然科学版),2009(8):1229-1232. 被引量:6
  • 10陈卓,熊劲,马灿.基于SSD的机群文件系统元数据存储系统[J].计算机研究与发展,2012,49(S1):269-275. 被引量:8

二级参考文献21

  • 1黄九鸣,罗宇.SAN环境下高性能集群文件系统研究与实现[J].计算机研究与发展,2007,44(z1):69-74. 被引量:3
  • 2杨德志,黄华,张建刚,许鲁.大容量、高性能、高扩展能力的蓝鲸分布式文件系统[J].计算机研究与发展,2005,42(6):1028-1033. 被引量:28
  • 3Roselli D, Lorch J, Anderson T. A comparison of file system workloads [C]// Proceedings of the 2000 USENIX Annual Technical Conference. San Diego, California, USA, 2000:41 - 54.
  • 4Ji M, Felten E, Wang R, et al. An island-based file system for highly available and scalable Internet services [C]// Proceedings of the 4th USENIX Windows Systems Symposium. Seattle, Washington, USA, 2000: 37-48.
  • 5Memik G, Kandemir M, Choudhary A. Exploiting inter-file access patterns using multi-collective I/O [C]// Proc of USENIX Conference on File and Storage Technologies (FAST). Monterey, CA, USA, 2002: 245-258.
  • 6LI Weijia, XUE Wei, SHU Jiwu, et al. Dynamic hashing: Adaptive metadata management for Petabyte-scale file systems [C]// Proceedings of the 23th IEEE / 14th NASA Goddard Conference on Mass Storage Systems and Technologies. Washington, DC, USA: IEEE Computer Society, 2006:51 - 56.
  • 7Weil S, Pollack K, Brandt S, et al. Dynamic metadata management for Petabyte-scale file systems [C]// Proceedings of the 2004 ACM/IEEE Conference on Supercomputing (SC'04). Washington, DC, USA: IEEE Computer Society, 2004:47-54.
  • 8Well S, Brandt S, Miller E, et al. Ceph; A scalable, high-performance distributed file system [C]// Proceedings of the 7th Conference on Operating Systems Design and Implementation (OSDI'06). Seattle, Washington, USA, 2006; 307 - 320.
  • 9Roselli D, Lorch J, Anderson T. A comparison of file system workloads [C]// Proceedings of the 2000 USENIX Annual Technical Conference. 2000:41 -54.
  • 10Wang F, Xin Q, Hong B, et al. File system workload analysis for large scientific computing applications [C]//NASA/IEEE Conference on Mass Storage Systems and Technologies (MSST 2004). Adelphi, MD, USA, 2004: 139 - 152.

共引文献13

同被引文献7

引证文献2

二级引证文献9

相关作者

内容加载中请稍等...

相关机构

内容加载中请稍等...

相关主题

内容加载中请稍等...

浏览历史

内容加载中请稍等...
;
使用帮助 返回顶部