大数据视阈下网络信息采集系统优化设计

Optimization Design of Network Information Acquisition System Based on Big Data Viewpoint

传统大数据网络信息采集系统内存重合严重,导致网络信息采集速率较低。因此,从大数据视阈下,对网络信息采集系统进行优化设计,提出一种改进后的网络信息采集系统。摒弃传统一体化结构,将信息采集控制区划分为中央处理器模块、传输链路模块以及模拟量驱动模块三部分。平衡系统内存,对网络数据进行初步存储收集,采用WINsock控件编写系统服务端,保证数据和传输链路配对,辅助控制区收集网络数据,使网络数据快速从内核位置到用户位置,实现网路数据的采集。实验数据表明,优化后的网络信息采集系统可以有效提高数据采集效率。

The memory of the traditional big data network information collection system is seriously coincident, resulting in a low rate of network information collection. In this regard, from the perspective of big data, the network information collection system is optimized and an improved network information collection system is proposed. Abandoning the traditional integrated structure, the information collection control area is divided into three parts： the central processor module, the transmission link module and the analog drive module. The system memory is balanced, the network data is initially stored and collected, and the system server is written by the WINsock control. Ensure that the data is paired with the transmission link, and the auxiliary control area collects the network data, so that the network data can be quickly collected from the kernel location to the user location to realize network data collection. Experimental data shows that the optimized network information collection system can effectively improve data collection efficiency.