高速网络环境中适合大数据传输的改进UDT协议

ADVANCED UDT PROTOCOL FOR BIG DATA TRANSFER IN HIGH-SPEED NETWORK

大数据时代的到来,数据快速增长,数据集合规模已经从TB级增长到PB级。而现有的网络传输带宽低,严重阻碍各地区机构之间的数据信息交流。UDT在广域网传输有着巨大的优势,在千兆网的环境中UDT具有传输速度快、传输稳定等优势。然而随着网络带宽的升级,10 Gbps乃至40 Gbps带宽的出现,UDT在这些环境中存在传输性能低、带宽占用率低、持续丢包等问题。通过分析10 Gbps带宽下UDT的传输瓶颈,提出了优化系统参数、增强UDT可靠性和减少系统调用代价的解决方案,提升了大数据的传输速度,增强了UDT在高速广域网的可适用性。

With the arrival of the big data era,data has grown rapidly. The data collection scale has grown from terabytes to petabytes,while the existing network transmission bandwidth is low,which severely hinders the exchange of data information between regional agencies. UDT has great advantages in wide area network transmission. In the environment of Gigabit network,UDT has the advantages of high transmission speed and stable transmission. However,with the upgrading of network bandwidth and the emergence of 10 Gbps and even 40 Gbps bandwidth,UDT has problems such as low transmission performance,low bandwidth occupancy,and continuous packet loss in these environments. By analyzing the transmission bottleneck of UDT with 10 Gbps bandwidth,a solution was proposed to optimize system parameters,enhance UDT reliability and reduce system call cost. The speed of transmission of big data had been improved,and the applicability of UDT to high-speed wide area networks had been enhanced.