基于HBase的污染源监控数据存储系统实现方法研究

RESEARCH ON REALISATION METHOD OF POLLUTION SOURCE MONITORING DATA STORAGE SYSTEM BASED ON HBASE

污染源监控系统中需要存储大规模监测数据,现有基于关系的数据库存储系统在数据存储和检索效率上不能很好地满足要求。为提高污染源监控数据存储系统使用性能,提出一个基于HBase的分布式三层数据存储架构,给出该存储架构下数据通信机制和实现方法。深入讨论HBase下数据存储表的设计过程和数据写入技术,并给出相应的实验分析。实验结果验证了基于HBase的污染监控数据存储系统的有效性。

Pollution source monitoring system needs to store massive monitoring data.But existing relationship-based database storage system can not well satisfy the requirements on data storage and retrieval efficiency.In order to improve the usage performance of pollution source monitoring data storage system,the paper proposes an HBase-based tri-layer distributed storage architecture,in which the data communication principle and realisation method are analysed.The data storage table design process in HBase and the data writing technology are deeply discussed.Corresponding experimental analysis is given as well,which verifies the validity of HBase-based pollution source monitoring data storage system.