基于Spark的制造企业分析系统设计与实现

Design and Implementation of Manufacturing Enterprise Analysis System Based on Spark

针对企业现有的信息化系统存在由于数据共享不及时、信息不对称和反馈滞后导致无法动态识别数据和实时响应的问题,给出了一种基于Spark的制造企业分析系统。文章详细阐述了大数据系统架构组成和整体架构中的数据来源、数据采集传输、数据处理、数据分析、数据存储以及数据应用所涉及的技术,以具体的制造企业为例,完成制造企业分析系统的环境搭建,并实现实时数据的数据可视化结果展示。以期通过设计系统为具有相同属性的企业实现数据全流程共享系统的设计提供指引和参考。

Aiming at the problems that the existing information system of enterprises can not dynamically identify and respond to data due to untimely data sharing,information asymmetry and feedback lag,this paper presents the design and implementation of a manufacturing enterprise analysis system based on Spark.The composition of the big data system architecture and the technologies involved in the data source,data acquisition and transmission,data processing,data analysis,data storage and data application in the overall architecture are described in detail.Taking a specific manufacturing enterprise as an example,the environment of the manufacturing enterprise analysis system is built,and finally the data visualization results of real-time data are displayed.This is used as a guide and reference for the design and implementation of the wholeprocess data sharing system for enterprises with the same attributes.