面向大型装备状态分析的分布式实时数据仓库构建技术

Distributed real-time data warehouse building technology for condition analysis in equipment industry

面向大型装备状态分析的数据仓库建设需求,在数据仓库维度建模理论、分布式消息队列、分布式流式计算的基础上,提出一种快速构建分布式实时数据仓库的方法。相比于传统数据仓库,提出了分布式实时数据仓库在数据生命周期的改进方法。研究提出一种面向多数据场景的、可快速迭代的、具有高扩展性与数据可靠性的分布式实时数据仓库构建方法。为支撑分布式实时数据仓库的数据云平台管理,总结了现有的三种集群自动化运维方法,并提出了对多种数据云平台集成的方法。

To fulfill the requirement of data warehouse construction for equipment status analysis, an efficient con- struction technology for distributed real-time data warehouse was proposed based on dimensional modeling theory, distributed message queue service and distributed streaming computation frame. Compared to the traditional data warehouse, an improved method of data life-cycle for distributed real-time data warehouse was proposed. The con- struction technology for distributed real-time data warehouse with features of multi-scenario, efficient iteration, high expansibility of performance and high availability of data was addressed. To support the management of data cloud platform in distributed real-time data warehouse, three current solutions of automatic operation and maintenance were evaluated, and the integration technology of data cloud platform was discussed.