高性能计算多层次不连续非线性可扩展现象研究

Multi-Level Discontinuous and Nonlinear Scalability Phenomenon in High Performance Computing

高性能计算是计算科学的具体实践,极大地促进了各领域的科学进展,也对国家的经济建设起到了无法替代的基础性作用.从几十年发展的时间尺度和十万至百万核量级并行规模尺度研究大规模并行软件的研制发展历史来看,发现大规模并行应用软件的开发中物理模型、并行算法、并行软件实现以及底层硬件多个层次中存在的可扩展性的两种有趣现象,即不连续性和非线性现象.本文总结分析这一普遍存在现象,系统梳理计算机软硬件发展,特别是高性能计算发展中的可扩展问题,为未来并行计算领域发展提供方法论层面的借鉴和指导.

High Performance Computing(HPC)is the practice of computational science.It promotes the scienctific progress of many fields and serves as an irreplaceable foundation for national economic development.From the perspective of the large-scale parallel software development with a timescale of decades and the scalabilities of thousands and millions cores,we observe two interesting phenomena in multi-level of HPC including physical models,parallel algorithms,parallel software implementations and underlying hardware architectures:discountinuous and nonlinear.This paper presents a detailed study of this phenomenon especially the scalability development in HPC.This paper also provides a methodology guidance for future parallel computing progress.