基于Flink的工业大数据平台研究与应用

Research and application of industrial big data platform based on Flink

随着工业4.0的到来,互联网与工业结合愈发紧密,但工业大数据规模大、类型杂、质量低的特点导致大量设备数据无效且企业人员无法正确监测到设备信息。针对这一问题,提出一种基于Flink的工业大数据平台。以企业传感器数据为基础,用Flink将不同类型的数据发送至消息管道Kafka中暂存数据,用Flink对Kafka中的数据进行处理,实现工业大数据的查询与预警,与当前典型的两个大数据平台进行比较。实验结果表明,由Flink和Kafka集成的工业大数据平台,能更清晰高效地查询到设备数据且能够更快速地实现对企业设备的预警。

With the advent of industry 4.0,the combination of Internet and industry has become increasingly close.However,the characteristics of industrial big data,such as large scale,miscellaneous types and low quality,lead to a large number of invalid equipment data,and enterprise personnel can not correctly monitor the equipment information.To solve this problem,an industrial big data platform based on Flink was proposed.Based on enterprise sensor data,Flink was used to send different types of data to Kafka message pipeline for temporary storage,and Flink was used to process the data temporarily stored in Kafka.Industrial big data query and early warning were realized.It was compared with the current two typical big data platforms.Experimental results show that the industrial big data platform integrated by Flink and Kafka can query the equipment data more clearly and efficiently,and realize the early warning of enterprise equipment more quickly.