摘要
本文针对"天擎"归档系统的建设需求、总体架构,提出系统实现的若干关键技术问题并进行深入分析,气象大数据云平台(以下简称"天擎")归档系统设计为面向海量数据归档存储的支撑系统,保障数据的安全完整。系统基于在线存储、离线存储以及磁带库管理软件,通过层次性结构体系、消息队列和微服务技术框架,实现多协议数据归档、敏感数据归档及转储数据归档等功能,满足各种新增数据归档业务场景,同时具备丰富的数据回取服务、数据全流程的追溯和规范化的磁带管理保障等功能。2020年8月"天擎"归档系统投入业务运行,每日归档的实时数据量约为10TB,后续最高可承载约240TB日数据量的归档业务。
This article focuses on a detailed introduction of the construction requirements and overall architecture of the Meteorological Big Data Cloud Platform("Tianqing")archive storage system,and an in-depth analysis of several key technical issues of the platform implementation."Tianqing"archive storage system is based on online storage,offline storage and tape drive management software.Through the hierarchical structure system,it establishes a dynamic and scalable archive cluster.The system implements multi-protocol data archiving and sensitive data archiving to meet various data archive scenarios.The system has data restoration,entire data process traceability,standardized tape management and other functions.In August 2020,the"Tianqing"archive storage system began to run operationally.
作者
刘媛媛
何文春
王妍
李江涛
白金婷
LIU Yuanyuan;HE Wenchun;WANG Yan;LI Jiangtao;BAI Jinting(National Meteorological Information Center,Beijing 100081)
出处
《气象科技》
2021年第5期697-706,共10页
Meteorological Science and Technology
基金
国家发展改革委员会项目“海洋气象综合保障一期工程”资助。
