基于MAEU-CNN的高分辨率遥感影像建筑物提取

Building Extraction from High Spatial Resolution Imagery based on MAEU-CNN

从高空间分辨率图像(HSRI)中提取建筑物信息在遥感应用领域具有重要意义。然而,由于遥感影像中的建筑物尺度变化大、背景复杂和外观变化大等因素,从HSRI中自动提取建筑物仍然是一项具有挑战性的任务。特别是从影像中同时提取小型建筑物群和具有精确边界的大型建筑物时,难度更大。为解决这些问题,本文提出了一种端到端的编码器-解码器神经网络模型,用于从HSRI中自动提取建筑物。所设计的网络称为MAEU-CNN(Multiscale Feature Enhanced U-shaped CNN with Attention Block and Edge Constraint)。首先,在设计的网络编码部分加入多尺度特征融合(MFF)模块,使网络能够更好地聚集多个尺度特征。然后,在编码器和解码器部分之间添加了多尺度特征增强模块(MFEF),以获得不同尺寸的感受野,用于获取更多的多尺度上下文信息。在跳跃连接部分引入双重注意机制,自适应地选择具有代表性的特征图用于提取建筑物。最后,为了进一步解决MAEU-CNN中由于池化及卷积操作导致的分割结果边界模糊的问题,引入多任务学习机制,将建筑物的边界几何信息融入网络中以优化提取的建筑物边界,最终获得精确边界的建筑物信息。MAEU-CNN在ISPRS Vaihingen语义标记数据集和WHU航空影像数据集2种不同尺度建筑物数据集上进行了试验分析,在ISPRS Vaihingen语义标记数据集上,MAEU-CNN在精度、F1分数和IoU指标中获得了最高精度,分别达到了93.4%、93.62%和88.01%;在WHU航空影像数据集上,召回率、F1分数和IoU指标中也获得了最高精度,分别达到了95.45%、95.58%和91.54%。结果表明,本文所提出的MAEU-CNN从遥感图像中提取建筑物信息精度较高,并且对于不同尺度具有较强的鲁棒性。

Extraction of buildings from High Spatial Resolution Imagery(HSRI)plays an important role in remotely sensed imagery application.However,automatically extracting buildings from HSRI is still a challenging task due to factors such as large-scale variation of buildings,background complexity,and variation in appearance,etc.Especially,it is difficult in extracting both crowded small buildings and large buildings with accurate boundaries.To address these challenges,this paper presents an end-to-end encoder-decoder model to automatically extract buildings from HSRI.The designed network is called multiscale feature enhanced UShaped CNN with attention block and edge constraint(MAEU-CNN).Firstly,a Multiscale Feature Fusion(MFF)module is adopted in the encoder part of the network,which enables the network to aggregate features from multiple scales.Then,a Multi-scale Feature Enhancement module(MFEF)is added between the encoder and decoder parts to obtain multiscale receptive fields for obtaining multiscale context information.Thirdly,a dual attention mechanism is introduced to adaptively select representative feature maps for extraction of buildings instead of direct skipping connections.Lastly,in order to further solve the problem of segmentation result with poor boundaries aroused by the pooling operations in the MAEU-CNN,the geometric information of building boundary is introduced into the proposed MAEU-CNN by multi-task learning using the distance class map to produce fine-grained segmentations with precise boundaries.The performance of MAEU-CNN is examined through two different data sets at different building scales.The results show that MAEU-CNN obtains the greatest accuracy in each data set.The Precision,F1,and IoU is 93.4%,93.62%,and 88.01%,respectively using the ISPRS Vaihingen semantic labeling contest data set.The Recall,F1,and IoU reach 95.45%,95.58%,and 91.54%,respectively,using the WHU aerial image data set.Experimental results demonstrate that our proposed MAEU-CNN can achieve high accuracy for the extraction of building from remotely sensed imagery and show great robustness at different scales.