分组一致性哈希数据分割方法

Data segmentation method of grouping consistent hash

针对分布式入侵检测系统进行数据分割时面临的数据完整性和负载均衡问题,提出一种分组一致性哈希数据分割方法。采用TCP流重组技术保证数据的完整性;在对数据进行分割时,采用改进的分组一致性哈希算法,将具有相近计算能力的结点分为一组,根据组的计算能力,将各组按比例交替映射到整个数据哈希值计算对应的空间;在数据分配时,对结点的负载进行检测和动态调整。仿真测试结果表明,该方法具有较高的检测率,算法所需虚拟结点数量减少,降低了内存占用,提高了系统的负载均衡性。

Aiming at data integrity and load balance problem of distributed intrusion detection system for data segmentation,a data segmentation method of grouping consistent hash was proposed.TCP stream reassembly technology was used to ensure data integrity.When data were divided,the improved grouping consistent hash algorithm was used,and nodes with similar computing capacity were divided into a group.According to the computing capacity of group and proportion,each group was mapped alternately in the space corresponding to the hash value calculated.And the load of the node was detected and dynamically adjusted when data were assigned to the node.Results of simulation show that,the method has higher detection rate,the number of required virtual node and the memory consumption are reduced,and load balance of the system is improved.