基于DPDK的边缘集群内低成本高速通信方案

Low-cost and High-speed Communication Scheme in Edge Cluster Based on DPDK

边缘计算作为云计算的协同与补充,未来需要应对物联网50%的细小、实时的数据.同时,边缘AI的兴起,对成本受限的边缘节点的计算资源、存储资源和网络资源提出了更高的要求.如何以较低的成本为边缘集群提供较高的网络带宽和通信效率是本文的研究目标.鉴于传统OS对多网卡带宽叠加技术实现的不够友好以及单条连接最大带宽的限制,本文基于Intel DPDK技术,提出一种新颖的多网卡带宽叠加方案.该方案充分发挥DPDK对多核多网卡的支持,不仅能够实现多张网卡的带宽叠加,而且单条连接能够达到多张网卡的叠加带宽.最后利用操作系统的Socket本地回环机制,为用户提供语言无关的调用接口.在万兆带宽连接的边缘集群内,使用该方案能够将成本缩减到原来的1/3,并且提供相同的连接带宽.相比于传统的通信机制通信效率的到了极大的提高,不仅延时降低了10%,丢包率也降低了60%.

As the collaboration and supplement of cloud computing,edge computing needs to deal with 50%of the small,real-time data of the Internet of Things in the future.At the same time,the rise of edge AI has put forward higher requirements on the computing resources,storage resources and network resources of cost-constrained edge nodes.How to provide edge clusters with higher network bandwidth and communication efficiency at a lower cost is the research goal of this paper.In view of the lack of friendliness in the implementation of the multi-NIC bandwidth overlay technology and the limitation of the maximum bandwidth of a single connection on traditional os,this paper proposes a novel multi-NIC bandwidth stacking scheme based on the Intel DPDK technology.This solution makes full use of DPDK’s support for multi-core and multi-NIC,not only can achieve the bandwidth overlay of multiple network cards,but also a single connection can achieve the overlay bandwidth of multiple network cards.Finally,the operating system’s Socket local loop-back mechanism is used to provide users with a language-independent calling interface.Within the edge cluster that required10 Gigabit bandwidth connections,using this solution can reduce the cost to 1/3 of the original,and provide the same connection bandwidth.Compared with the traditional communication mechanism,the communication efficiency has been greatly improved.Not only the delay is reduced by 10%,but also the packet loss rate is reduced by 60%.