工业现场传感器实时数据存储系统设计与实现

Design and Implementation of the Data Storage System for Industrial Field Sensor Real-time Data

针对工业现场中大量的传感器以连续高并发的方式所产生的海量实时数据难以高效可靠存储的问题,设计了基于Hadoop与HBase的工业现场传感器实时数据存储系统,并利用5台服务器和1个磁盘阵列构建了数据存储系统原型,最后通过仿真程序模拟工业现场传感器实时数据的高并发特性,对所提出的数据存储系统性能进行了验证。实验表明,所提出的工业现场传感器实时数据存储系统数据存储可靠、运行稳定、并发处理能力强。

For the problem to store mass real-time data efficiently and reliably which are produced continuously and concurrently by a large number of sensors in the industrial field,a data storage system based on Hadoop and HBase for industrial field sensor real-time data is designed.The data storage system prototype is constructed with 5 servers and 1 disk array. Finally,the performance of the proposed data storage system is verified with the simulation program which simulates the high concurrency of the real-time data of industrial field sensors. The experimental results show that the real-time data storage system of the industrial field sensor in this paper is reliable in data storage,stable in operation and has a high concurrent processing capability.