海洋数据备份平台的设计和实现

Design and Implementation of Marine Data Backup Platform

随着海洋数据的日益增加(现数据总量已达PB级),长期积累的海洋数据类型越来越多,海洋数据的存储环境也越来越复杂。艰苦的海上作业条件以及昂贵的数据采集和分析设备,使得海洋数据的获取成本越来越高。为了有效地保存海洋数据,需要一套安全可靠的数据备份平台来加强对海洋数据的管理。本文根据海洋数据的多种数据类型和复杂存储环境,设计出了一套能涵盖所有海洋数据类型的备份平台,并针对海量小文件(字节级)和基于OpenStack架构云平台中虚拟机整机的备份流程进行了优化,有效地保障了海洋数据的存储安全。

Marine data is increasing day by day(the total amount of marine data has reached PB level).There are increasing types of marine data accumulated,and the storage environment of marine data is becoming more complex.The arduous marine operation conditions,and expensive observation and analysis equipment make the acquisition cost of marine data very high.To effectively preserve the valuable marine data,a safe and reliable data backup platform is needed.According to the various data types and complex storage environment of marine data,this paper designs a backup platform that can cover all types of marine data,and optimizes the backup process of massive small files(byte level)and virtual machine in cloud platform based on OpenStack architecture,which effectively ensures the storage security of marine data.