气象数据归档与查询系统超立方体结构并行算法设计

Design of a parallel algorithm for data cube of MARS

气象归档与查询系统(MARS)是欧洲中期天气预报中心(ECMWF)开发的用于多种类海量气象数据管理的框架,其核心是利用多维数据模型和数据立方体来组织和管理气象数据。重点研究了MARS系统的主要架构及其超立方体结构的数据索引方法,在此基础上提出了一种大数据背景下数据立方体的元数据查询优化和并行计算方法。实验表明,该方法能够有效缩短大数据量查询及归档情况下的系统响应时间。

Meteorological Archival and Retrieval System （MARS） is developed by Europe Center for Medium-range Weather Forecasts （ECMWF） for managing massive meteorological data. Its core tech- nique is to use the multidimensional data model and the data cube to organize and manage meteorological data. The architecture of MARS and the data indexing method of the data cube are studied. On this ba- sis,we propose a metadata retrieval optimization and parallel computation method of data cube in the context of big data. Experiments show that the method can reduce the response time for archival and re- trieval of massive meteorological data.