摘要
高分辨率遥感图像的缺失区域中地物种类复杂多样、空间异质性高,导致图像修复结果中存在纹理模糊和结构扭曲的问题,且在边界和复杂纹理区域尤为突出。因此提出一种结合空间语义注意力的二段式遥感图像修复网络。该网络由粗修复网络和精修复网络串联而成,旨在使用粗略修复网络提供的先验信息,引导精修复网络对缺失区域的复原。在粗修复网络中,构建多级损失结构以强化网络训练的稳定性;在精修复网络中,提出一种新的空间语义注意力机制,并依据网络特征的分布特点,区别性将空间语义注意力嵌入在编码器和解码器中,以确保局部特征的连续性和全局语义信息的相关性。实验结果表明,所提方法相比于现有其他算法可以进一步提升图像修复效果。
In high-resolution remote sensing images,missing areas feature intricate surface features and pronounced spatial heterogeneity,causing the image inpainting results to suffer texture blurring and structural distortion,particularly for boundaries and areas with complex textures.This study proposed a two-stage remote sensing image inpainting network combined with spatial semantic attention(SSA).The network comprised two networks in series:one for coarse image inpainting and one for fine-scale image inpainting(also referred to as the coarse and fine-scale networks,respectively).This network was designed to guide the fine-scale network to restore the missing areas using the priori information provided by the coarse network.In the coarse network,a multi-level loss structure was constructed to enhance the stability of network training.In the fine-scale network,a novel SSA mechanism was proposed,with SSA being embedded differentially in the encoder and decoder based on the distribution of network features.This ensured the continuity of local features and the correlation of global semantic information.The experimental results show that the network proposed in this study can further improve the image inpainting effects compared to other existing algorithms.
作者
刘宇佳
谢诗哲
杜阳
严瑾
南燕云
温中凯
LIU Yujia;XIE Shizhe;DU Yang;YAN Jin;NAN Yanyun;WEN Zhongkai(School of Geomatics,Liaoning Technical University,Fuxin 123000,China;School of Information Engineering,China University of Geosciemces(Beijing),Beijing 100083,China;College of Astronautics,Nanjing University of Aeronautics and Astronautics,Nanjing 210016,China;National Earthquake Response Support Service,Beijing 100049,China;College of Resource Environment and Toursim,Capital Normal University,Beijing 100048,China;Institute of Remote Sensing Satellite,CAST,Beijing 100094,China)
出处
《自然资源遥感》
CSCD
北大核心
2024年第1期58-66,共9页
Remote Sensing for Natural Resources
基金
国家自然科学基金项目“基于无人机遥感和移动定位数据潮汐特征的地震人员精细化评估伤亡方法研究”(编号:42061073)
中国地震应急搜救中心青年科技基金项目“灾后建筑物震害提取与灾情研究——以川滇某县为例”(编号:SJ2101)共同资助。
关键词
二段式网络
遥感图像修复
空间语义注意力
局部特征连续性
全局语义信息相关性
two-stage network
remote sensing image inpainting
spatial semantic attention
continuity of local features
correlation of global semantic information