基于Greenplum的城轨信号系统车载日志大数据分析平台

Big data analysis platform for on-board log of urban rail signal systembased on Greenplum

针对城市轨道交通中信号系统车载设备维护现状,提出了一种基于Greenplum的车载日志大数据分析的解决方案,以改善海量车载日志的分析与运用过程中存在的效率低下、过程繁琐等问题。通过搭建Greenplum的大数据平台,利用FTP传输工具、Kafka+Zookeeper中间件和MySQL脚本,实现了海量车载日志的采集与存储、列车运维决策数据的统计与分析。通过对平台关键性能指标的测试,验证了系统方案的合理性。

According to the current situation of on-board equipment maintenance of signal system in urban rail transit,this article proposed a solution of big data analysis of on-board log based on the Greenplumto improve problems of low ef ficiency and tedious process in the analysis and application of massive on-board log.By building Greenplum's big data platform,using FTP transmission tool,Kafka+zookeeper middleware and MySQL script,it was implemented the collection and storage of massive on-board logs,statistics and analysis of train operation and maintenance decision data.Through the test of the key performance indexes of the platform,the rationality of the system scheme was veri fied.