高性能IP网络流量采集系统设计与实现

Design and Implementation of High Performance IP Network Traffic Capture System

提出一种高性能IP网络流量采集系统体系结构,采用分层的方法解决全线速、高可靠、无丢包采集网络流量数据包,利用采集卡API接口程序和计算机程序过滤流量和提取特征,并将流量样本或特征字段高效地存储到磁盘阵列。经过测试,原型机网络采集速率最高达18 Gbps,传输和存储速率达到8 Gbps,存储空间达到40 TB,在实际网络中存储时长可以达到18~24 h。

This paper presents a high - performance IP network traffic capture system which adopts layered approach to capture network traffic with line -rate flow processing,high reliability and non -packet loss. We utilizes capture card API and computer programs to filtrate the flow and extract the flow characteristics, and write the flow sample or information feature fields into Redundant Array of Inexpensive Disks （ RAID ） efficiently. After testing, Prototype machine network capture rate reached of up to 18 Gbps,the transmission and storage rate of up to 8Gbps, the storage space 40TB, and the storage time can reach 18 -- 24 hours in reality.