摘要
高能物理计算是一种典型的数据密集型高性能计算。随着计算规模的扩大,传统的分布式文件系统日益表现出管理复杂、扩展困难和低可用性等问题。近年来,云存储技术在商业计算领域取得了长足的发展。本文设计和实现了高能物理计算软件ROOT的S3 I/O插件,调研并测试了兼容文件系统用户使用习惯的两个方案:虚拟文件系统和图形化客户端。测试结果说明,在云存储系统上进行高能物理计算是可行的。在局域网环境下,这种配置能够获得与传统分布式文件系统可比较的性能。
HEP (High Energy physics) computing is a typical data intensive high performance computing. With the growth of computing scale, traditional distributed file system has showed its limits in complexity, scalability and availability. Cloud storage has been substantially developing in the commercial venue for its scale-out, high availability, durability, elasticity and low TCO (Total Cost of Ownership) in recent years. This paper has firstly implemented an S3 plugin for HEP analysis software ROOT, and then researched both virtual S3 file system and graphical S3 client interface, the two technologies which provide compatibility with file system access patterns. The test result shows that in a local area network, HEP analysis over cloud storage is feasible, while parallel performance with traditional distributed file systems can be achieved.
出处
《科研信息化技术与应用》
2013年第6期55-63,共9页
E-science Technology & Application
基金
国家自然科学基金(11205177)