NSTL大数据管理与计算平台的设计与应用实践

Design and Practice of NSTL Big Data Management and Computing Platform

本文针对国家科技图书文献中心(National Science and Technology Library,NSTL)业务流程再造目标,设计了满足NSTL需求的大数据管理和计算平台,提出了平台的业务架构、技术架构和平台构建的方案,并在大数据治理流程、分布式计算和微服务等方面开展了应用实践。大数据管理和计算平台建设解决了多源异构数据的存储问题和计算瓶颈,提高了数据管理和计算能力,为NSTL从文献服务向知识服务转变打下了坚实的数据平台基础。

Aiming at the business process reengineering objectives of National Science and Technology Library,this paper designs one big data management and computing platform to meet the needs of NSTL,and puts forward the business architecture,technical architecture and platform construction scheme of the platform.It also carried out practice in process of big data governance,distributed computing and Micro-Services.The construction of big data management and computing platform solves the storage and calculation bottleneck of multi-source heterogeneous data,improves the ability of data management and calculation,and lays a solid data platform foundation for NSTL to transform from literature service to knowledge service.