期刊文献+

面向并行文件系统的性能评估及相对预测模型 被引量:7

Performance Evaluation and Relative Predictive Model of Parallel File System
下载PDF
导出
摘要 基于Lustre文件系统,对并行文件系统的性能评估和性能建模进行了研究.通过对性能因子的调研,进行了一系列性能评估实验,并提出性能相关性模~(PRModel).在实验评估和PRModel分析中发现,在不同的性能因子之间存在着紧密的性能相关性,为了挖掘并利用这种相关性信息,提出了一种相对性能预测模(RPPModel)来预测不同性能因子条件下的性能.为了验证RPPModel的有效性,设计了大量实验用例.结果表明,预测结果的平均相对误差能够控制在170/o---28%的范围内,易于使用且具有较好的预测准确度. In this paper, the performance evaluation and modeling of parallel file system based on Lustre file system is studied. After performing a survey on performance factors, a series of performance evaluations via experimental approaches and propose a performance relational model (PRModel). In the experimental and PRModel analysis, it is found that different performance factors have closed performance correlations. In order to mime the relational information, a novel relative performance predictive model (RPPModel) is proposed. This model can be used to predict the overhead over different performance factors. The model is validated through a series of experiments over a variety of performance factors. The experimental results show that the average relative errors results can be controlled within 17%-28%. This model is easy to use and can obtain better prediction accuracy.
出处 《软件学报》 EI CSCD 北大核心 2011年第9期2206-2221,共16页 Journal of Software
基金 国家自然科学基金(10805019) 国家重点基础研究发展计划(973)(2009CB320505) 国家发改委CNGI项目(CNGI2008-109/122)
关键词 并行文件系统 性能评估 性能模型 LUSTRE文件系统 parallel file system performance evaluation performance model Lustre file system
  • 相关文献

参考文献4

  • 1Sun Microsystems, Inc., Oak Ridge National Laboratory (ORNL). Peta-Scale IO with the Lustre File System. 2008. 1-18.
  • 2DataDirect Networks, Inc. Best Practices for Archit~cting a Lustre-Based Storage Environment. 2008.4-26.
  • 3Anderson E. Simple table-based modeling of storage devices. SSP Technical Report, HPL-SSP-2001-4, 2001.1-4.
  • 4Xie Naiming Liu Sifeng.Research on evaluations of several grey relational models adapt to grey relational axioms[J].Journal of Systems Engineering and Electronics,2009,20(2):304-309. 被引量:35

二级参考文献4

共引文献34

同被引文献56

  • 1王博,李先国,张晓.Lustre文件系统的性能优化研究[J].微型电脑应用,2011(5):31-33. 被引量:4
  • 2BOKHARI S, RUT1" B, WYCKOFF P, et al. Experimental analysis of a mass storage system [ J]. Concurrency and Computation: Practice and Experience, 2006, 18(4) : 1929-1950.
  • 3WANG FANG, YUE YINLIANG, FENF DAN, et al. High availability storage system based on two-level metadata management [ C]// FCST 2007: Proceedings of the 2007 Japan-China Joint Workshop on Frontier of Computer Science and Technology. Piscataway, N J: IEEE, 2007:41 -48.
  • 4LI HUAIYANG, LIU YAN, CAO QIANG. Approximate parameters analysis of a closed fork-join queue model in an object-based storage system [ C] // Proceedings of the Eighth International Symposium on Optical Storage and 2008 International Workshop on Information Data Storage, SPIE 7125. IS. 1. ] : SPIE, 2008:1 -6.
  • 5ZHAO TIEZHU, VERDI M, DONG SHOUBIN, et d. Evaluation of a performance model Lustre file system [ C]// Proceedings tff the fifth Annual ChinaGfid Conference. Piscataway, NJ: IIElZ.; 2010:. 191 -196.
  • 6ZHAO TIEZHU, HU JINLONG. Performance evaluation of parallel file system based on Lustre and grey theory [ C]//Proceedings of the 2010 Ninth International Conference on Grid and Cloud Computing. Washington, DC: IEEE Computer Society, 2010:118 -122.
  • 7KONSTANTIN S, HAIRONG K, SANJAY R, et al. The Hadoop distributed file system [ C]// Proceedings of the 2010 IEEE 26th Symposium on Mass Storage Systems and Technologies. Piseataway, NJ: IEEE, 2010:1-10.
  • 8Apache Hadoop Project. SequenceFile Class [ EB/OL]. [ 2011-02-17 ]. http://hadoop, apache, org/common/docs/current/api/ org/apache/hadoop/io/SequenceFile, html.
  • 9吴宗坤.基于Fuse的资源搜索文件系统设计与实现[D].广州:华南理工大学,2011.
  • 10Oracle Corp. Lustre File System[ EB/OL]. http://wiki, lustre, org/index, php/Main_Page.

引证文献7

二级引证文献23

相关作者

内容加载中请稍等...

相关机构

内容加载中请稍等...

相关主题

内容加载中请稍等...

浏览历史

内容加载中请稍等...
;
使用帮助 返回顶部