基于大数据数仓的高校数据治理探索——以同济大学为例

Exploration of University Data Governance Based on Big Data Warehouse--Taking Tongji University as an Example

开展高校数据治理,能科学地提高数据质量,促进教育运行机制由传统管理向智能化服务转变,是高校教育数字化转型的关键。而大数据数仓是数据治理的核心组件,承担着落实数据治理工作及其相关流程贯彻的重任。基于此,文章分析了国内高校数据治理现状与存在的问题,提出基于大数据数仓的高校数据治理目标,并设计了高校数据治理流程。之后,文章以同济大学为例,介绍了大数据数仓架构,并按照高校数据治理流程呈现了基于大数据数仓的数据治理过程:首先,通过采集组件实现全格式数据采集;其次,通过数据确权和数据精准鉴别,得到较大价值数据;再次,结合业务理解对数据加工,构建专题库;从次,采用大数据数仓视图授权的方式和数据开放平台接口的方式,对采集的数据进行共享,并通过管理制度完善与技术手段并举,加大数据安全保障力度;最后,以丰富的数据服务支撑各类应用,形成数据闭环治理体系。基于大数据数仓进行高校数据治理,可以实现数据全面流转,促使师生与各部门深度参与数据治理过程,从而持续地提升数据质量。

Implementing data governance in universities can scientifically improve data quality,promote the transformation of education operation mechanism from traditional management to intelligent services,and is the key to the digital transformation of university education.While the big data warehouse is the core component of data governance,which undertakes the heavy responsibility of implementing data governance work and its related processes.Based on this,the paper analyzed the current situation and existing problems of data governance in domestic universities,proposed the goal of university data governance based on big data warehouses,and designed the governance process of university data.Afterwards,taking Tongji University as an example,this paper introduced the big data warehouse architecture and presented the data governance process based on the big data warehouse according to the governance process of university data.Firstly,the full format data collection was achieved through collection components,and secondly,the data with significant value were obtained through data validation and accurate data identification,and subject databases were thirdly constructed through combining business understanding to process data,and the collected data were fourthly shared using big data warehouse view authorization and open data platform interface,and further data security was enhanced through the improvement of management system and technical means,and finally a data closed-loop governance system was formed through supporting various applications with rich data services.Based on the big data warehouse to carry out university data governance can achieve comprehensive data circulation,promote deep participation of teachers,students,and various departments in the data governance process,and continuously improve the data quality.