高性能的云端推理AI加速器设计

Design of High-performance Cloud Inference AI Accelerator

阐述云推理服务需要高性能和高功耗效率的人工智能(AI)加速器。Cloudblazer i20加速器通过精心的硬件-软件协同设计,具有高带宽的大容量多级内存层次结构、高效的矩阵计算和内存访问的并行性,并通过动态功耗管理,对功耗进行优化,降低了功耗。

This paper expounds that Cloud inference services require high-performance and power-efficient artificial intelligence(AI)accelerators.Our product,the Cloudblazer i20 accelerator,provides excellent performance and power efficiency through careful hardware-software co-design.The Cloudblazer i20 features a high-bandwidth,large-capacity multi-level memory hierarchy,efficient parallelism in matrix computations and memory access,and optimized power management through dynamic power optimization to minimize power consumption.