基于Hadoop的城市交通碳排放数据挖掘研究

Research of urban traffic carbon emission data mining based on Hadoop

针对交通数据大吞吐量及时效性等特点,为了更高效地处理该类型数据,探索了一种基于云计算服务模式的、利用Hadoop技术架构可扩展的交通数据处理、发布、服务实现方法,并实现了原型系统。该方法的主要思想是利用Hadoop所提供的分布式文件处理能力对海量的交通数据进行并行处理,该过程效率较高,且运行可靠性强,与传统方法相比具有较为突出的优势。相关实验测试结果显示,该方法大大提高了该类型数据处理时效,取得了较为理想的实验效果,进一步论证了此方法对于处理该类数据的可靠性和有效性。

According to the characteristics of traffic data are big throughput and timeliness,and in order to more efficient processing this type data,this paper explored a kind of extensible traffic data processing,release,service method which based on cloud computing service mode,used Hadoop technical architecture,and the prototype system had been implemented.The main idea of the method was to make use of the distributed file handling ability provided by Hadoop,to make parallel processing for the massive traffic data,this process had high efficiency,and the operation reliability,compared with traditional methods,had relatively outstanding advantages.The result of related experiments test shows,this method has greatly increased the data of this type processing limitation,achieved ideal experimental results,and it further demonstrates the reliability and validity of this method.