企业大数据分析平台设计与实现

Design and Implementation of Enterprise Data Analysis Platform

随着数据规模的扩大以及集团公司对数据分析需求的不断提升,传统的单业务模式分析及对数据的串行处理模式已无法满足实际需求,而大数据技术在快速处理海量化、多样化的数据方面具有天然的优势。因此,笔者提出了一种大数据分析平台架构方案,涵盖了对数据的采集、处理、分析、展现等全生命周期的管理,并改进开源技术,较好提升了数据分析的性能,在集团公司实际应用中取得了良好的效果。

The demand for data analysis is continuously increasing. However, the traditional analysis mode and the serial processing mode for data cannot satisfy the actual needs. In contrary, the technology of big data has natural advantages in rapidly processing for large amount quantifying data. Therefore, an architecture scheme of a big data analysis platform has been proposed, which covers the entire lifecycle management for data including data collection, data processing, data analysis and data presentation. Meanwhile, based on open source technologies, the scheme is implemented in company＇s data analysis, which improves the performance of data analysis and is widely used.