融合Transformer结构的高分辨率遥感影像变化检测网络

High-resolution remote sensing image change detection network with Transformer structure

为解决遥感影像变化检测全局上下文信息捕获的问题,本文提出了基于孪生结构、跳跃连接结构及Transformer结构的TSU-Net。该模型编码器采用混合CNN-Transformers结构,借助自注意力机制捕获遥感影像的全局上下文信息,增强了模型对于像素级遥感影像变化检测任务的长距离上下文建模能力。该模型在LEVIR-CD数据集和CDD数据集进行测试,F1得分分别为90.73和93.14,优于各对比模型。

In order to solve the problem of global context information capture in remote sensing image change detection, this paper proposes TSU-Net based on twin structure, jump link structure and Transformer structure. The model encoder adopts a hybrid CNN-Transformers structure to capture the global context information of remote sensing images with the help of self-attention mechanism, which enhances the model’s ability of long distance context modeling for pixel-level remote sensing image change detection task. The model is tested in the LEVIR-CD dataset and the CDD dataset, and the F1 scores are 0.907 3 and 0.931 4, respectively, which are superior to the comparison models.