期刊文献+

分布式文件系统在线性能测试平台研究与实现

An Online Benchmarking Platform for Distributed File Systems
原文传递
导出
摘要 目前由于缺乏针对分布式文件系统的性能测试工具,在很多研究中依然照搬传统的文件系统性能测试工具和方法,很难满足分布式文件系统性能测试的需求(如避免缓存的影响、多客户端并发测试等)。因此,我们研发了一个分布式文件系统在线性能测试平台,此平台通过提供多种大数据量测试负载,有效地避免了系统缓存和系统老化对测试结果的影响,同时支持在线对分布式文件系统执行性能测试,支持多客户端并发测试,并能够对测试结果进行可视化展示和分析。此外,平台也提供了很好的扩展性,满足多种测试需求。 Due to the lack of benchmarking tools for distributed file systems (DFS), researchers have to use benchmarks that designed for local file systems. However, these benchmarks are hardly suitable to DFS, for example, it cannot avoid the effect of cache and is not suitable doing concurrency tests, etc. According to the characteristics of DFS, we design a benchmarking platform particularly for DFS. This platform can easily solve the problem of cache using large test data. Also it can provides many other functions, such as online benchmarking, request concurrency testing as well as online result analytics and visualization. Moreover, this platform is good at extensibility, thus can meet a variety of future benchmarking requirements.
出处 《科研信息化技术与应用》 2015年第2期11-18,共8页 E-science Technology & Application
基金 中国科学院战略性先导科技专项(XDA06010307) 国家自然科学基金(91224006) "十二五"国家科技支撑计划项目(2013BAD15B02)
关键词 分布式文件系统 大测试数据 在线测试平台 Distributed File Systems (DFS) large test data online test platform
  • 相关文献

参考文献11

  • 1Liu J, Chen J, Tong W, et al. Design and Implementation of Metadata Cache Management Strategy for the Distributed File System[J]. International Journal of Grid & Distributed Computing, 2014, 7(3).
  • 2孙丰,张福新.YAFFS文件系统的研究与改进[J].计算机工程,2008,34(5):257-259. 被引量:8
  • 3Seltzer M I, Tarasov V, Bhanage S, et al. Benchmarking File System Benchmarking: It IS Rocket Science[J]. 2011.
  • 4Traeger A, Zadok E, Joukov N, et al. A nine year study of file system and storage benchmarking[J]. ACM Transactions on Storage (TOS), 2008, 4(2): 5.
  • 5Aranya A, Wright C P, Zadok E. Tracers: A File System to Trace Them All[C]//FAST. 2004: 129-145.
  • 6Kahanwal B, Singh T P. Towards the Framework of the File Systems Performance Evaluation Techniques and the Taxonomy of Replay Traces[J]. arXiv preprint arXiv:1312.1822, 2013.
  • 7Wang F, Nelson M, Oral S, et al. Performance and scalability evaluation of the Ceph parallel file system[C]// Proceedings of the 8th Parallel Data Storage Workshop. ACM, 2013: 14-19.
  • 8熊文,喻之斌,须成忠.几个常见分布式文件系统特征分析和性能对比(英文)[J].集成技术,2012,1(4):58-63. 被引量:4
  • 9吕毅,马捷,唐荣锋.FSbench:一个机群文件系统基准程序[J].计算机工程,2004,30(2):49-51. 被引量:2
  • 10Shan H, Shalf J. Using IOR to Analyze the I/O performance for HPC Platforms[J]. Lawrence Berkeley National Laboratory, 2007.

二级参考文献12

  • 1毛勇强,黄光明.YAFFS文件系统在嵌入式Linux上的实现[J].电子设计应用,2006(1):96-98. 被引量:13
  • 2[1]IEEE/ANSI Std. 1003. 1 .Portable Operating System Interface ( POSIX)Part I :System Application Program Interface (API) [C Language]. 1996
  • 3[2]Mcvoy L. Lmbench:Portable Tools for Performance Analysis. Proceedings of the USENIX 1996 Annual Technical Conference, San Diego,California, USA, 1996-01
  • 4[3]Wittle M,Keith B E. LADDIS: The Next Generation In NFS File Server Benchmarking. Prceeedings of the USENIX Summer Technical Conference, Cincinnati, Ohio, USA, 1993-06
  • 5[4]Standard Performance Evaluation Corporation. SPEC SFS97_RI V3.0Documentation. U R L:http://www.specbench.org/osg/sfs97r l/,2001 - 12
  • 6[5]Cams P H,Ligon W B, Ross R B, et al.PVFS:A Parallel File System for Linux Clusters. In Proceedings of the 4th Annual Linux Showcase and Conference, USENIX Association, Atlanta, GA, 2000:317-327
  • 7[6]Bray T. Bonnie: Unix Disk I/O Bench mark. URL:http://www.textuality.com/bonnie/index.html.
  • 8[7]Norcott W,Capps D.IOzone Filesystem Benchmark.URL:http://www.iozone.org/
  • 9[8]Arunachalam M,Choudhary A, Rullman B.A Prefetching Prototype for the Parallel File System on the Paragon. In Proceedings of the 1995ACM SIGMETRICS Conference on Measurement and Modeling of Computer Systems, 1995-05:321-323
  • 10Rosenblum M, Ousterhout J K. The Design and Implementation of a Log-structured File System[J]. ACM Transactions on Computer Systems, 1992, 10(1): 26-56.

共引文献11

相关作者

内容加载中请稍等...

相关机构

内容加载中请稍等...

相关主题

内容加载中请稍等...

浏览历史

内容加载中请稍等...
;
使用帮助 返回顶部