期刊文献+

基于Ceph存储系统的小文件存储优化方案 被引量:4

Optimization of Small File Storage Algorithm Based on Ceph Storage System
下载PDF
导出
摘要 针对Ceph存储系统面对小文件存储时存在元数据服务器性能瓶颈、文件读取效率低等问题.本文从小文件之间固有的数据关联性出发,通过轻量级模式匹配算法,提取出关联特征并以此为依据对小文件进行合并,提高了合并文件之间的合理性,并在文件读取时将同一合并文件内的小文件存入客户端缓存来提高缓存读取命中率,经过实验验证本文的方案有效的提高了小文件的访问效率. The Ceph storage system suffers from the metadata server performance bottleneck and low file reading efficiency during small file storage.In view of this,the study takes advantage of the inherent data relevance between small files to extract related features with a lightweight pattern matching algorithm.On this basis,small files are merged,as a result of which the rationality of file merging is improved.The small files in the same merged file are stored in the client cache to improve the cache read hit rate.Experiments have verified that the proposed scheme can effectively enhance the access efficiency of small files.
作者 陈法河 柴小丽 CHEN Fa-He;CHAI Xiao-Li(The 32nd Research Institute,China Electronics Technology Group Corporation,Shanghai 201808,China)
出处 《计算机系统应用》 2022年第2期108-113,共6页 Computer Systems & Applications
关键词 分布式存储 小文件存储 数据关联性 文件合并 distributed storage small file storage data relevance file merging
  • 相关文献

参考文献4

二级参考文献18

  • 1金海,罗飞,章勤,张浩.一个基于P2P高性能计算的高效数据传输协议[J].计算机研究与发展,2006,43(9):1543-1549. 被引量:4
  • 2Baker M G,Hartman J H,Kupfer M D. Measurement of a distributed file system[A].New York:ACM,1991.198-212.
  • 3Carns P H,Ligon W B,Ross B R. PVFS:A parallel file system for Linux clusters[A].Berkeley,CA:USENIX Association,2000.28-38.
  • 4Ahn W H,Kim K,Choi Y. DFS:A de-fragmented file system[A].Piscataway,NJ:IEEE,2002.71-80.doi:10.1093/brain/awp141.
  • 5McKusick M K,Joy W N,Leffler S J. A fast file system for UNIX[J].ACM Transactions on Computer Systems,1984,(03):181-197.doi:10.1145/989.990.
  • 6Brandt S A,Miller E L,Long D D E. Efficient metadata management in large distributed storage systems[A].Piseataway,NJ:IEEE,2003.290-298.doi:10.1002/mus.22123.
  • 7Luo Min,Yokota H. Comparing Hadoop and fat-btree based access method for small file I/O applications[A].Beilin:Springer-Verlag,2010.182193.
  • 8Wang Feng. Storage management in large distributed objectbased storage system[D].Santa Cruz:University of California Santa Cruz,2006.
  • 9Carns P,Lang S,Ross R. Small-file access in parallel file systems[A].Piscataway,NJ:IEEE,2009.1-11.
  • 10Ganger G R,Kaashoek M F. Embedded inodes and explicit grouping:exploiting disk bandwidth for small files[A].Berkeley,CA:USENIX Association,1997.1-17.doi:10.1007/s10333-011-0289-8.

共引文献33

同被引文献40

引证文献4

二级引证文献2

相关作者

内容加载中请稍等...

相关机构

内容加载中请稍等...

相关主题

内容加载中请稍等...

浏览历史

内容加载中请稍等...
;
使用帮助 返回顶部