基于感知损失的遥感图像全色锐化反馈网络

Remote Sensing Image Pansharpening Feedback Network Based on Perceptual Loss

全色锐化旨在通过一个高分辨率的单通道全色图像(Panchromatic,PAN)锐化一个低分辨率的多通道多光谱图像(Multispectral,MS),得到一个高分辨率的多通道多光谱图像(High Resolution Multispectral,HRMS),这是遥感图像处理中的重要任务。文中提出了一个基于感知损失的反馈网络,首先对PAN图像和MS图像分别提取细节信息和光谱信息,然后将其合并后利用堆叠的上下采样层和密集连接进行信息融合,利用反馈连接使高层次的信息丰富低层次的信息,最后重建HRMS图像。与传统全色锐化算法相比,所提算法将PAN图像和HRMS图像一起作为网络输出的监督,通过求取PAN图像和网络重建HRMS图像的感知损失使输出图像含有更丰富的空间细节信息。无论是在客观指标还是视觉感受方面,与现有广泛使用的算法相比,所提算法都有更好的效果。

Pansharpening aims to sharpen a low-resolution multi-channel multispectral(MS)image from a high-resolution single-channel panchromatic(PAN)image to obtain a high resolution multispectral(HRMS)image,which is an important task in remote sensing image processing.A feedback network based on perceptual loss is proposed.First,the detail information and the spectral information are extracted from the PAN image and the MS image respectively,and then they are combined to use the stacked up-and down-sampling layers and dense connections for information fusion.The feedback connection is used to enrich the low-level information with high-level information.Finally,the HRMS image is reconstructed.Compared with the traditional pansharpening algorithms,the proposed algorithm uses the PAN image and the HRMS image as the supervision of the network,and the output image contains richer spatial detail information by obtaining the perceptual loss of the PAN image and the network reconstructed HRMS image.The experimental results show that the proposed algorithm has better results than the widely used algorithms both in objective evaluation and visual perception.