铁路通信数据HBase分布式查询系统设计

Design of HBase distributed query system for railway communication data

目前设计的铁路通信数据分布式查询系统响应时间存在较大延迟,不具备实时性。为了解决上述问题,基于HBase设计了一种新的铁路通信数据分布式查询系统。配备三台主机,构建分布式查询模式,通过Linux组件和HDFS目录构建集群,同时建立数据存储模块和数据查询模块。利用HBase存储算法设定存储模型,得到逻辑片段集合,通过分析逻辑关系实现存储调度。实验结果表明,设计的基于HBase的铁路通信数据分布式查询系统数据写入性能响应延迟时间低于0.2 ms,缓冲性能写入延迟时间低于0.1 ms,能够很好地保证查询实时性。

The response time of the currently designed distributed query system for railway communication data has a large delay and is not real-time.In order to solve the above problems,a new distributed query system for railway communication data is designed based on HBase.It is equipped with three hosts,builds a distributed query mode,builds a cluster through Linux components and HDFS directory,and establishes a data storage module and a data query module at the same time.The storage model is set by using the HBase storage algorithm,and the logical fragment set is obtained,and the storage scheduling is realized by analyzing the logical relationship.The experimental results show that the designed HBase-based railway communication data distributed query system data write performance response delay time is less than 0.2 ms,buffer performance write delay time is less than 0.1 ms,which can well ensure the real-time query.