期刊文献+

面向对象存储的文件系统Lustre 被引量:7

Lustre file system based on object storage
下载PDF
导出
摘要 针对Lustre文件系统主要运用在高性能计算集群系统上的情况,分析Lustre文件系统的系统结构及其内部实现机制,测试系统在不同参数影响下的性能,认为Lustre可以运用在高性能集群系统上,也能运用在由普通计算机和TCP/IP网络构建的集群系统上。实验结果表明,在TCP/IP协议和千兆交换机下,Lustre的并发性很难发挥,但设置合适的客户端数和系统参数可以优化其性能,相对本地磁盘系统,Lustre系统仍有较大的性能提高和实用价值。 Lustre file system is mainly used in high‐performance computing cluster system .Its system structure and internal im‐plementation mechanism were analyzed ,and the system performance was tested through different parameters .Lustre can not on‐ly be used in high performance cluster system ,but in the cluster system built on the general use of computers and TCP/IP net‐work .Experimental results show that ,if Lustre is connected via TCP/IP protocols and gigabit switch ,its performance can be opti‐mized when the number of clients and some system parameters are properly set .Although its concurrency is depressed ,Lustre system still has large improvement on the performance comparing to local disk system .So it has practical value in this condition .
作者 梁军 聂瑞华
出处 《计算机工程与设计》 北大核心 2015年第6期1666-1670,共5页 Computer Engineering and Design
基金 国家自然科学基金项目(61370718) 教育部-中移动基金项目(MCM20130651) 广州市科技和信息化局基金项目(2014Y2-00006) 华南师范大学青年教师科研培育基金项目(2012KJ006)
关键词 LUSTRE 面向对象 TCP/IP 性能优化 测试 Lustre object-oriented TCP/IP performance optimization test
  • 相关文献

参考文献10

  • 1Marshall Kirk McKusick, Sean Quinlan. GFS; Evolution on fastforward [J]. ACMQueue, 2009, 7 (7).. 10-20.
  • 2Mohamad Sindi. Evaluating MPI implementations using HPL on an infiniband Nehalem Linux cluster [C] //Seventh Interna- tional Conference on Information Technology: New Genera- tions, 2010: 19-25.
  • 3Olson M. HAIXX)P: Scalable, flexible data storage and anal- ysis [J]. IQTQuarterly, 2010, 1 (3): 14-18.
  • 4Oracle. LustreTM 1.8 operations manuaL [EB/0L]. http:// wiki. lustre, org/images/0/09/821-0035_vl. 3. pdf, 2010.
  • 5Sun microsystems, lustre file system datasheet [R]. Santa Clara: Sun Microsystems, 2008.
  • 6Swapnil Patil, Garth Gibson. Scale and concurrency of GIGA +: File system directories with millions of files [C] //Pro- ceedings of the 9th USENIX Conference on File and Storage Technologies, 2011.
  • 7周江,王伟平,孟丹,马灿,古晓艳,蒋杰.面向大数据分析的分布式文件系统关键技术[J].计算机研究与发展,2014,51(2):382-394. 被引量:73
  • 8Cams P, Lang S, Ross R, et al. Small-file access in parallel file systems [C] //Processdings of the 23rd IEEE International Parallel and Distributed Processing Symposium, 2009.
  • 9战科宇,李小勇,刘海涛.分布式文件系统元数据服务器高可用性设计[J].小型微型计算机系统,2013,34(4):801-805. 被引量:3
  • 10程煜,李小勇,董晓明,焦圣品.分布式存储系统中高并发客户端的设计与实现[J].小型微型计算机系统,2014,35(1):24-29. 被引量:2

二级参考文献41

  • 1冯幼乐,朱六璋.CEPH动态元数据管理方法分析与改进[J].电子技术(上海),2010(9):1-3. 被引量:6
  • 2熊劲,范志华,马捷,唐荣锋,李晖,孟丹.DCFS2的元数据一致性策略[J].计算机研究与发展,2005,42(6):1019-1027. 被引量:11
  • 3杨德志,黄华,张建刚,许鲁.大容量、高性能、高扩展能力的蓝鲸分布式文件系统[J].计算机研究与发展,2005,42(6):1028-1033. 被引量:28
  • 4Bhide A, Elnozahy E N, Morgan S P. A highly available network file server[ C]. Proceedings of the USENIX Conference, Dallas,TX, 1991 : 199-205.
  • 5MarzuUo K, Schmuck F. Supplying high availability with a standard network file system[ C]. Proceedings of the 8th International Con- ferenee on Distributed Computing Systems, Amsterdam, The Neth- erlands, IEEE Computer Society Press, 1988:447-453.
  • 6] Siegel A, Birman K, Marzullo K. Deceit: a flexible distributed file system [ C ]. Management of Replicated Data, Houston, Texas, USA. IEEE Computer Society Press, 1990:15-17.
  • 7Braam P J. Lustre: a scalable, high-performance file system C[ EB/ OL]. Cluster File Systems, Inc. ftp://ftp, uni-duisburg, de/linux/ filesys/Lustre/whitepaper, pdf,2003 -05 -09/2011-10-24.
  • 8Ghemawat S, Gobioff H, Leung S T. The google file system [ C ]. 19th ACM Symposium on Operating Systems Principles ,2003.
  • 9Shvachko K,Kuang H,Radia S. The hadoop distribuw.d file system [ C]. IEEE 26th Symposium on Mass Storage Systems and Tech- nologies, 2010.
  • 10Swart G, Birrel A, Hisgen A. Availability in the echo file system [ R/OL ]. Systems Research Center, Digital Equipment Corpora- tion,Tech Report: SRC-RR-112,http ://www. hpl. hp. com/techre- ports/Compaq-DEC/SRC-RR-112, hind, 1993 -09 -10/2011 10 -24.

共引文献74

同被引文献53

引证文献7

二级引证文献14

相关作者

内容加载中请稍等...

相关机构

内容加载中请稍等...

相关主题

内容加载中请稍等...

浏览历史

内容加载中请稍等...
;
使用帮助 返回顶部