期刊文献+

云存储技术在高能物理计算中的应用研究

Application of Cloud Storage in High Energy Physics Computing
原文传递
导出
摘要 高能物理计算是一种典型的数据密集型高性能计算。随着计算规模的扩大,传统的分布式文件系统日益表现出管理复杂、扩展困难和低可用性等问题。近年来,云存储技术在商业计算领域取得了长足的发展。本文设计和实现了高能物理计算软件ROOT的S3 I/O插件,调研并测试了兼容文件系统用户使用习惯的两个方案:虚拟文件系统和图形化客户端。测试结果说明,在云存储系统上进行高能物理计算是可行的。在局域网环境下,这种配置能够获得与传统分布式文件系统可比较的性能。 HEP (High Energy physics) computing is a typical data intensive high performance computing. With the growth of computing scale, traditional distributed file system has showed its limits in complexity, scalability and availability. Cloud storage has been substantially developing in the commercial venue for its scale-out, high availability, durability, elasticity and low TCO (Total Cost of Ownership) in recent years. This paper has firstly implemented an S3 plugin for HEP analysis software ROOT, and then researched both virtual S3 file system and graphical S3 client interface, the two technologies which provide compatibility with file system access patterns. The test result shows that in a local area network, HEP analysis over cloud storage is feasible, while parallel performance with traditional distributed file systems can be achieved.
出处 《科研信息化技术与应用》 2013年第6期55-63,共9页 E-science Technology & Application
基金 国家自然科学基金(11205177)
关键词 云存储 S3协议 高能物理计算 S3FS Cyberduck cloud storage S3 protocol high energy physics computing S3FS Cyberduck
  • 相关文献

参考文献8

  • 1Bird, Ian. "Computing for the Large Hadron Collider.' Annual Review of Nuclear and Particle Science 61 (2011) 99-118.
  • 2Gantz, John, and David Reinsel. "Extracting value from chaos." White Paper, IDC (2011).
  • 3Amazon Web Services, Inc. Amazon Simple Storage Service (Amazon S3). http://aws.amazon.comJcn/s3/.
  • 4Windows Azure:Microsoft的云平台云承载云服务.http://www.windowsazure.corn/zh.cn/.
  • 5Antcheva I, Ballintijn M, Bellenot B, et al. ROOT-A C++ framework for petabyte data storage, statistical analysis and visualization [J]. Computer Physics Communications, 2009, 180(12): 2499-2512.
  • 6S3fS.FUSE-based file system backed by AmazonS3. https://code.google.com/p/s3 fs/wiki/FuseOverAmazon.
  • 7CloudBerry. CloudBerry Lab - Cloud Backup & Free Amazon S3 Client. http://www.cloudberrylab.com/.
  • 8CyberDuck. Cyberduck - FTP, SFTP, WebDAV, Cloud Files, Google Drive & Amazon S3 Browser for Mac & Windows. http://cyberduck.ch/.

相关作者

内容加载中请稍等...

相关机构

内容加载中请稍等...

相关主题

内容加载中请稍等...

浏览历史

内容加载中请稍等...
;
使用帮助 返回顶部