基于InfluxDB的城市交通基础设施感知系统设计与实现

Design and Implementation of Urban Traffic Infrastructure Sensing System Based on InfluxDB

针对实时、海量、高频率的城市交通基础设施感知时序数据的存储需求,设计并开发了一种基于InfluxDB时序数据库的城市交通基础设施感知系统平台。开发数据收集和缓存模块、数据转换和自动续传模块、数据解析和处理模块、时序数据存储模块,重点解决了断电持久化缓存、断网自动续传、数据加密传输、大规模时序数据存储和高效查询问题。基于RabbitMQ消息队列,实现外场感知数据的持久化缓存,防止掉电数据丢失。基于MQTT传输协议和TLS数据加密协议,实现互联网环境下的数据安全传输。基于Kafka集群的消息队列,实现分布式可扩展的消息处理,提高系统吞吐量、可靠性,为大数据处理提供数据管道。基于InfluxDB时序数据库,实现海量时序数据的高效存储和查询。该平台已成功应用于南方某省智慧道路项目,运行效果良好,为后续类似平台设计和开发提供了有效的参考。

Regarding the storage requirements of urban traffic infrastructure sensing time series data that being real-time,massive and high frequency,in this paper a urban traffic infrastructure sensing system platform is designed and developed based on InfluxDB time series database.In this study,the data collection and cache module,data conversion and automatic transmission module,data analysis and processing module,as well as timing data storage module are developed,and power outage persistence cache,automatic transmission,data encryption transmission,large-scale timing data storage and efficient query are realized.Based on RabbitMQ message queue,the persistent cache of collected data is realized to prevent the data loss in case of power-off.Based on MQTT transmission protocol and TLS data encryption protocol,data transmission on internet is realized safely.The message queue based on Kafka cluster can realize distributed expandable message processing,improve system throughput and reliability,and provide data pipelines for big data processing.Based on InfluxDB time series database,efficient storage and query of massive timing data is realized.The system platform has been successfully applied to a smart road project in a southern province of China with good operation effect,which provides effective reference for the design and development of similar platforms in the future.