通过部分页迁移实现CPU-GPU高效透明的数据通信

Efficient and transparent CPU-GPU data communication through partial page migration

尽管对集成GPU和下一代互连的研究投入日益增加,但由PCI Express连接的独立GPU仍占据市场的主导地位,CPU和GPU之间的数据通信管理仍在不断发展。最初,程序员显式控制CPU和GPU之间的数据传输。为了简化编程,GPU供应商开发了一种编程模型,为“CPU+GPU”异构系统提供单个虚拟地址空间。此模型中的页迁移机制会自动根据需要在CPU和GPU之间迁移页面。为了满足高性能工作负载的需求,页面大小有增大趋势。受低带宽和高延迟互连的限制,较大的页面迁移延迟时间较长,这可能会影响计算和传输的重叠并导致严重的性能下降。提出了部分页迁移机制,它只迁移页面的所需部分,以缩短迁移延迟并避免页面变大时整页迁移的性能下降。实验表明,当页面大小为2MB且PCI Express带宽为16GB/s时,部分页迁移可以显著隐藏整页迁移的性能开销,相比于程序员控制数据传输,整页迁移有平均98.62%倍的减速,而部分页迁移可以实现平均1.29倍的加速。此外,我们测试了页面大小对快表缺失率的影响以及迁移单元大小对性能的影响,使设计人员能够基于这些信息做出决策。

Despite the increasing investment in integrated GPUs and next-generation interconnect research,discrete GPUs connected by PCI Express still dominate the market,and the management of data communication between CPUs and GPUs continues to evolve.Initially,the programmers control the data transfer between CPUs and GPUs explicitly.To simplify programming,GPU vendors have developed a programming model to provide a single virtual address space for“CPU+GPU”heterogeneous systems.The page migration engine in this model transfers pages between CPUs and GPUs on demand automatically.To meet the needs of high-performance workloads,the page size tends to be larger.Limited by low bandwidth and high latency interconnections,larger page migration has longer delay,which can reduce the overlap of computation and transmission and cause severe performance degradation.We propose a partial page migration mechanism that only transfers the requested part of a page to shorten the migration latency and avoid performance degradation of the whole page migration when the page becomes larger.Experiments show that the proposed partial page migration can well hide the performance overheads of the whole page migration when the page size is 2MB and the PCI Express bandwidth is 16GB/sec.Compared with data transmission controlled by the programmers,the whole page migration degrades the performance by 98.62 on average,while the partial page migration upgrades the performance by 1.29 on average.Additionally,we examine the impact of page size on TLB miss rate and the impact of migration unit size on execution time,enabling designers to make informed decisions based on this information.