海量遥感数据的高性能地学计算应用与发展分析

Recent Developments in High Performance GeoComputation for Massive Remote Sensing Data

航空及航天遥感器的快速发展,使得多源、多时空分辨率的遥感数据成TB级增长,对海量遥感数据的高性能计算与处理提出了更高的要求。据此,当前的遥感应用已经吸收了新型硬件架构计算、集群计算和分布式计算等高性能计算领域的最新技术。本文针对高性能计算处理海量遥感数据的效率问题,分别从分布式并行遥感文件系统和高性能遥感地学计算模式两个方面来论述该问题的研究进展;在此基础上,列举了当前具有代表性的集群和分布式遥感计算平台/系统,并结合具体实验工作,详细阐述了遥感高性能计算平台gDos-IPM(Geospatial Data Operation System-Image Processing Machine)的设计思路;最后总结了高性能遥感地学计算的发展趋势。

As the amount of remote sensing data is sharply increasing within the continuing development in remote sensors,the exploitation of massive amount of remote sensing data is booming in recent years.Therefore,the computational problems in the applications that involve the large collection of remotely sensed imagery processing,such as global climate change and hazard assessment,arise inevitably.On this point,high performance computing（HPC）-based patterns,including cluster computing,grid computing,cloud computing and computing with hardware such as field-programmable gate arrays（FPGA） and graphic processing units（GPU）,are introduced to the applications that concern a huge amount of remote sensing data processing.This paper focuses on the state of the art coping with the challenges that emerge when the massive remote sensing data are processed by the HPC-based platforms.In particular,we review recent developments in the parallel file systems for storing the remote sensing data and high performance geocomputation.Specifically,the HPC-based paradigms delivered in this paper involve cluster-based platform,grid and cloud based environments.Further,the typical examples of the HPC-based platforms that process the massive remote sensing data,comprising the Pixel Factory,the Grid Processing on Demand（G-POD） and the Geospatial Data Operation System-Image Processing Machine（gDos-IPM）,are discussed.And the gDos-IPM,a solution for the platform of high performance computing for remote sensing,is described in detail.The gDos-IPM,which integrates the computation and storage resources and involves GPUs,multicore processors and clusters,provides the remote sensing tools about preprocessing and information extraction for massive remote sensing data in the heterogeneous computing environment.Also,it supports a dynamic model for spatio-temporal data and multi-level parallel computing.At the end of this paper,we present a thoughtful view on the challenges of HPC for further remote sensing applications.