期刊文献+

基于动态混合分片机制的云存储系统I/O性能优化算法 被引量:1

Optimizing Algorithm for I/O Performance of Cloud Storage System Based on Dynamic Hybrid Range Mechanism
下载PDF
导出
摘要 为了解决云存储系统中存储I/O性能优化的问题,从数据分布的角度进行研究,建立了存储分片性能模型,并以此为基础给出了以I/O性能最优为目标的分片决策算法以及最优分片数的计算方法,提出了基于动态混合分片机制的数据分布算法(DADH).DHAH能充分考虑各存储节点和客户机的实际性能,动态地进行文件分片决策和最优分片数的计算,并且能根据存储节点的实际性能优化数据分布.实验结果表明:DADH较传统数据分布算法具有最优的I/O性能,并且算法性能提升效果在各种带宽下平均达到18%~44%. In the aim of optimizing the I/O performance in the cloud storage system, the partitioning decision algorithm and the computational method of the best partitioning number based on the partitioning storage model of I/O performance were put forward. An algorithm called DADH was proposed to make partitioning decision and compute the best number of partitioning dynamically by taking each storage node's and client's actual performance into account, and to optimize data distribution according to the storage nodes' actual performance. Results show that DADH has the higher I/O performance than traditional data distribution algorithm with the advance from 18% to 44%.
出处 《北京工业大学学报》 CAS CSCD 北大核心 2013年第5期707-712,共6页 Journal of Beijing University of Technology
基金 国家自然科学基金资助项目(61070174)
关键词 云存储 数据分布 动态混合分片 I O性能 cloud storage data distribution dynamic hybrid range I/O performance
  • 相关文献

参考文献10

  • 1BLAS J, ISAILA F, CARRETERO J, et al.Implementation and evaluation of file write-back andprefetching for MPI-IO over GPFS [ J ]. InternationalJournal of High Performance Computing Applications,2010, 24(1) : 78-92.
  • 2CAVALLI A, CIOCCA C,AGNELLO L, et al. Onenhancing GridFTP and GPFS performances [ J ]. Journal ofPhysics, 2010,219(5) : 1-10.
  • 3WELCH B, UNANGST M,ABBASI Z, et al. Scalableperformance of the Panasas parallel file system [ C ] //Proceedings of the 6th USENIX Conference on File andStorage Technologies. San Jose : USENIX AssociationBerkeley, 2008: 1-17.
  • 4DICKENS P, LOGAN J. A high performanceimplementation of MPI-IO for a Lustre file systemenvironment [ J ]. Concurrency and Computation : Practiceand Experience, 2010,22(11) : 1433-1449.
  • 5WANG F,ORAL S, SHIPMAN G,et al. UnderstandingLustre filesystem internals [ EB/OL ]. [ 2011 -02 -11 ].http : // wiki. lustre, org/images/d/da/Understanding _Lustre_Filesystem_Internals. pdf.
  • 6KUHN M, KUNKEL J,LUDWIG T. Dynamic file systemsemantics to enable metadata optimizations in PVFS [ J ].Concurrency and Computation : Practice and Experience,2009,21(14) : 1775-1788.
  • 7MCKUSICK M, QUINLAN S. GFS: evolution on fast-forward [J]. Queue, 2009, 7(7): 10-20.
  • 8DUBNICKI C, GRYZ L,HELDT L,et al. HYDRAstor: ascalable secondary storage [ C ] // Proceedings of the 7 thConference on File and Storage Technologies. SanFrancisco : USENIX Association Berkeley, 2009 : 197-210.
  • 9UNGUREANU C, ATKIN B, ARANYA A,et al.HydraFS : a high-throughput file system for the HYDRAstorcontent-addressable storage system [ C ] // Proceedings ofthe 8 th USENIX Conference on File and StorageTechnologies. San Jose : USENIX Association Berkeley,2010: 17-20.
  • 10王芳,张顺达,冯丹,曾令仿.对象存储系统中的柔性对象分布策略[J].华中科技大学学报(自然科学版),2007,35(3):46-48. 被引量:5

二级参考文献10

  • 1Wang Feng,Brandt S A,Miller E L,et al.OBFS:a file system for object-based storage devices[C]∥21st IEEE/12th NASA Goddard Conference on Mass Storage Systems and Technologies.Los Alamitos:IEEE Comput Soc,2004:283-300.
  • 2Satyanarayanan M,Kistler J J,Kumar P,et al.Coda:a highly available file system for a distributed workstation environment[J].IEEE Transactions on Computers,1990,39(4):447-459.
  • 3Schmuck F,Haskin R.GPFS:a shared-disk file-system for large computing clusters[C]∥Proceedings of the FAST'02 Conference on File and Storage Technologies.Berkeley:USENIX Assoc,2002:231-244.
  • 4Roselli D,Lorch J R,Anderson T E.A comparison of file system workloads[C]∥Proc of the 2000 USENIX Annual Technical Conference.Berkeley:USENIX Assoc,2000:41-54.
  • 5Soltis S R,Ruwart T M,O′Keefe M T.The global file system[C]∥Proceedings of the 5th NASA Goddard Conference on Mass Storage Systems and Technologies.College Park:[s.n.],1996:188-203.
  • 6Braam P J.The coda distributed file system[J].Linux Journal,1998,6(2):46-51.
  • 7Hennessy J L,Patterson D A.Computer architecture:a quantitative approach[M].3rd ed.San Francisco:Morgan Kaufmann Publisher,Inc,2002.
  • 8Gilbson G A,Meter R V.Network attached storage architecture[J].Communications of the ACM,2000,43(11):37-45.
  • 9Farley M.SAN存储区域网络[M].2版.孙功星,译.北京:机械工业出版社,2001:179-182.
  • 10Seigle M.Storage area networks in video applications[J].SMPTE Journal,2001,110(4):236-239.

共引文献4

同被引文献8

引证文献1

二级引证文献1

相关作者

内容加载中请稍等...

相关机构

内容加载中请稍等...

相关主题

内容加载中请稍等...

浏览历史

内容加载中请稍等...
;
使用帮助 返回顶部