期刊文献+

基于SSD的机群文件系统元数据存储系统 被引量:8

SSD-Based Metadata Storage System for Cluster File System
下载PDF
导出
摘要 随着数据量的增加和元数据操作性能需求的提高,传统基于磁盘(HDD)存储架构的机群文件系统元数据存储系统由于HDD成为性能瓶颈而无法满足需求.将SSD应用到元数据存储中,设计实现了一个基于SSD+HDD的异构元数据存储系统Hybrid MDSL.针对SSD的I/O特性设计了基于追加写的元数据存储组织,并通过基于访问热度的数据迁移机制提高SSD空间利用率.测试结果表明,Hybrid MDSL明显提高了元数据I/O的性能. 随着数据量的增加和元数据操作性能需求的提高,传统基于磁盘(HDD)存储架构的机群文件系统元数据存储系统由于HDD成为性能瓶颈而无法满足需求.将SSD应用到元数据存储中,设计实现了一个基于SSD+HDD的异构元数据存储系统Hybrid MDSL.针对SSD的I/O特性设计了基于追加写的元数据存储组织,并通过基于访问热度的数据迁移机制提高SSD空间利用率.测试结果表明,Hybrid MDSL明显提高了元数据I/O的性能.
出处 《计算机研究与发展》 EI CSCD 北大核心 2012年第S1期269-275,共7页 Journal of Computer Research and Development
基金 国家自然科学基金项目(60970025) 国家"九七三"重点基础研究计划基金项目(2011CB302502) 国家"八六三"高技术研究发展计划基金项目(2009AA01A129)
关键词 机群文件系统 SSD 元数据存储系统 数据热度 cluster file system SSD metadata storage system data heat
  • 相关文献

参考文献11

  • 1XtreemFS:An open source distributed and replicated file system for the cloud. http://www.xtreemfs.org/faq.php . 2012
  • 2Soundararajan G,Prabhakaran V,Balakrishan M,et al.Extending SSD lifetimes with disk-based Write caches. Proc of the8th USENIX Conf on File and Storage Technologies . 2010
  • 3Anand A,Muthukrishnan C,Kappes S,et al.Cheap and large CAMs for high performance data-intensive networked systems. Proc of the7th USENIX Conf on Networked Systems Design and Implementation . 2010
  • 4Park D,Du D.Hot Data identification for flash-base storage system using multiple bloom filters. Proc of IEEE27th Symp on Mass Storage Systems and Technologies . 2011
  • 5Cao M.Hot and cold data management in filesystem. http://linuxplumbersconf.org/2010/ocw/sessions/219 . 2010
  • 6Weil S,,Brandt S A,Miller E L,et al.Long,Carlos Maltzahn,Ceph:A Scalable,High-Performance Distributed File System. Proc of the7th Conf on Operating Systems Design and Implementation . 2006
  • 7S. Jiang,and X. Zhang.LIRS: an efficient low interreference set replacement policy to improve buffer cache performance. Proc. ACM SIG-METRICS . 2002
  • 8Wang A I,Reiher P L,Popek G J, et al.Conquest: Better performance through a disk/persistent-ram hybrid file system. USENIX Annual Technical Conference . 2006
  • 9Jen-Wei Hsieh,Li-Pin Chang,Tei-Wei Kuo.Efficient On-line Identification of Hot Data for Flash-memory Management. Proceedings of the 2005 ACM symposium on applied computing . 2005
  • 10Youngwoo P,Seung H L,Chul L, et al.PFFS: A Scalable Flash Memory File System for the Hybrid Architecture of Phasechange RAM and NAND Flash. Proc of the 23rd ACM Symp on Applied Computing (SAC 2008) . 2008

同被引文献66

  • 1刘金垒,李琼.新型非易失相变存储器PCM应用研究[J].计算机研究与发展,2012,49(S1):90-93. 被引量:5
  • 2许祥,罗宇.一种SAN环境下集群文件系统的元数据缓存研究[J].计算机研究与发展,2012,49(S1):240-244. 被引量:3
  • 3杨德志,黄华,张建刚,许鲁.大容量、高性能、高扩展能力的蓝鲸分布式文件系统[J].计算机研究与发展,2005,42(6):1028-1033. 被引量:28
  • 4刘仲,周兴铭.基于目录路径的元数据管理方法[J].软件学报,2007,18(2):236-245. 被引量:21
  • 5Roselli D, Lorch J R, Anderson T E. A comparison of file system workloads [ C ] //Proceedings of the 2000 USENIX Annual Technical Conference. Berkeley: USE- NIX Association, 2000:41 - 54.
  • 6Satyanarayanan M, Kistler J J, Kumar P, et al. Coda: a highly available file system for distributed workstation environment [ J ]. IEEE Transactions on Computers, 1990, 39(4) : 447 -459.
  • 7Riedel E, Kallahalla M, Swaminathan R. A framework for evaluating storage system security [ C ]//Proceedings of the 1st Conference on File and Storage Technologies. Berkeley: USENIX Association, 2002 : 15 - 30.
  • 8Weil S A, Pollack K T, Brandt S A, et al. Dynamic meta- data management for petabyte-scale file systems [ C ] // Proceedings of IEEE/ACM SC2004 Conference. Piscataway: IEEE, 2004:523-534.
  • 9Brandt S A, Miller E L, Long D D E, et al. Efficient metadata management in large distributed storage sys- tems[ C] // Proceedings of the 20th IEEE/llth NASA Goddard Conference on Mass Storage Systems and Tech- nologies. Piscataway: IEEE, 2003:290 - 298.
  • 10Li Weijia, Xue Wei, Shu Jiwu, et al. Dynamic has- hing: adaptive metadata management for petabyte-scale file systems [ C ] //Proceedings of IEEE MSST' 2006. Piscataway: IEEE Computer Society, 2006 : 93 - 98.

引证文献8

二级引证文献49

相关作者

内容加载中请稍等...

相关机构

内容加载中请稍等...

相关主题

内容加载中请稍等...

浏览历史

内容加载中请稍等...
;
使用帮助 返回顶部