盾构施工数据的ETL设计与应用

Design and Application of Shield Construction Data ETL

文章介绍了数据仓库和ETL相关概念,结合盾构施工行业中数据的要求和特点,对盾构施工数据进行ETL研究,设计了一套适合各种类型盾构机的ETL框架,并使用Kettle实现该ETL框架,将分布在全国各地的盾构施工数据进行转换、清洗、整理到数据仓库中,并提供可视化展示、数据查询和分析等服务。通过实际工程应用表明,ETL和数据仓库运行正常,可以满足用户的信息服务需求,也可为企业提供分析和辅助决策。

This paper introduces concepts of data warehouse and ETL,describes the requests and features of data in shield construction industry,and designs an ETL frame suitable for various types of shield machines.The shield construction data distributed throughout the country is extracted,transformed and loaded into data warehouses by the ETL framework which is implemented by Kettle,and it can provide services such as visual display,data query and analysis.The ETL and data warehouse are proven to be operating normally through engineering applications,can meet the uscr’s information scrvicc needs,and provide the analysis and decision support.