大规模网络数据存储系统的设计与实现

Design and implementation of large-scale network data storage system

当前的网络数据存储系统在处理大规模数据时需要较长时间,增加了网络数据存储周期,存储性能较差。因此设计并实现一种大规模网络数据存储系统,该系统主要包括A/D高速采集模块、FLASH存储模块和FPGA数据接收模块。A/D高速采集模块采集大规模网络数据,采用FPGA数据接收模块对采集到的网络数据进行接收和处理,过滤其中的噪声因素,再将处理好的网络数据保存在FLASH存储模块中。依据三层架构模式设计大规模网络数据存储系统软件架构,并给出了业务逻辑层完成数据传递的关键代码。实验结果表明,所设计的大规模网络数据存储系统具有较高的数据存储和读取速度,能够实现网络数据的负载均衡存储。

The current network data storage systems need a long time to process the large-scale data,prolong the network data storage cycle,and have poor storage performance,so a large- scale network data storage system was designed and implemented. This system mainly includes the A/D high-speed acquisition module,FLASH storage module and FPGA data receiving module. The A/D high-speed acquisition module is used to collect the large-scale network data. The FPGA data receiving module is adopted to receive and process the collected network data,filter out the noise factor produced in the above process,and then store the processed network data in FLASH storage module. The software architecture of the large-scale network data storage system was designed based on three-layer architecture mode. The key code of using business logic layer to transmit the data is given.The experimental results show that the designed large- scale network data storage system has the high data storage and read speed,and can realize the load balance storage of the network data.