高性能计算环境中间件的优化设计与实现

Design and implementation of high performance computing environment middleware

步入大数据时代之后,致力于解决大规模科学计算问题的高性能计算技术,得到了越来越广泛的关注与应用。随着高性能计算机制造产业的蓬勃发展,具有每秒上亿亿次浮点运算速度的高性能计算集群对高性能计算环境中间件的性能提出了更高的要求。现有的高性能计算环境中间件中,资源信息服务无法满足海量信息快速更新的需求。为了提高高性能计算环境中间件的性能,通过借鉴ETL技术,将资源信息传输方式优化为信息同步模式。优化后的信息同步模式在处理2 000条作业状态更新时,延迟时间缩短90%、系统负载降低98%、网络连接数减少90%,为系统维护人员、环境用户带来更好的用户体验。

Ever since the arrival of big data era,high performance computing technology which committed to solving largescale scientific computing problems,has been more and more extensively focused and widely applied. As the booming of high performance computer manufacturing industry,high performance computer cluster with float computing speed up to several quintillion times per second requires further optimization of the high performance computing environment middleware. In current high-performance computing environment middleware,the information transmission mode of resource information service cannot meet the requirement of rapid updating of massive information. In order to improve the performance of high performance computing environment middleware,this paper used ETL technology to optimize the information transmission mode to information synchronization mode. After optimizing the processing of 2 000 pieces of resource information,it reduced the latency by90%,reduced the system load by 98%,and reduced the number of network connections by 90%,which provided enhanced user experience to the system maintenance personnel and users.