高职院校数据清洗仓湖一体架构的研究

Research the Architecture of Integrated Warehouse and Lake by Data Cleaning in Vocational College

为了有效地应对多元化应用对于数据实时性新需求,构建一个适应数据实时性新需求的数据清洗新架构十分必要。ETL和ELT是常用的数据清洗架构,二者在处理数据质量和实时性方面各有其优势和不足。本文设计一种更适应多元化数据应用需求的清洗架构,以解决高职院校在数据治理工作中面临的数据质量和数据实时性的平衡问题,为高职院校数据治理提供一个新尝试。

In order to effectively respond to the new demand for real-time data in diversified applications,it is necessary to build a new data cleaning architecture that adapts to the new demand for real-time data.ETL and ELT are commonly used data cleansing architectures,each with its own advantages and disadvantages in handling data quality and real-time performance.This article designs a cleaning architecture that is more suitable for diversified data application needs,in order to solve the balance problem of data quality and real-time data faced by vocational colleges in data governance work,and provide a new attempt for data governance in vocational colleges.