集群内高效可靠的数据文件分发方案的设计

Design of Efficient and Reliable Data File Distribution Solution in Cluster

为了实现局域网集群内数据文件的高效和可靠的分发,设计了数据流和控制流相结合的数据文件分发方案。在数据流方面,以ZeroMQ为基础设计了UDP协议下的多播数据文件传输方案。在控制流方面,基于TCP协议设计了多播数据文件传输控制方案。传输控制方案包括监控模块、检测模块、调速模块和计速模块,监控模块和检测模块实现了对数据文件传输开关的控制,调速模块和计速模块实现了对数据文件传输速率的控制,两方面结合实现了对多播数据文件传输的有效调度,达到了数据文件分发过程中的高效和可靠的双重目的。工程实践表明,在保证一定的多播传输速率的基础上,可以提升数据文件分发的一次多播成功率,减少多播传输的轮次,能够实现集群内高效可靠的数据文件分发。

In order to achieve efficient and reliable data file distribution in cluster,a data file distribution solution combining data flow and control flow is designed.In the data flow,based on ZeroMQ,the multicast data file transmission scheme based on UDP is designed,and in the control flow,a multicast data file transmission control scheme based on TCP is designed.The transmission control scheme includes monitor module,check module,shift module and meter module.The monitor module and check module realize the control of the data file transmission switch,the shift module and the meter module realize the control of the data file transmission rate,and the combination of the two aspects realizes the effective scheduling of the multicast data file transmission,achieving the dual purpose of high efficiency and reliability in the data file distribution.Engineering practice shows that,on the basis of guaranteeing a certain multicast transmission rate,the success rate of one multicast for data file distribution can be improved,the round of multicast transmission can be reduced,and the efficient and reliable data file distribution within the cluster can be realized.