Semantic segmentation of remote sensing images is an important but unsolved problem in the remote sensing society.Advanced image semantic segmentation models,such as DeepLabv3+,have achieved astonishing performance fo...Semantic segmentation of remote sensing images is an important but unsolved problem in the remote sensing society.Advanced image semantic segmentation models,such as DeepLabv3+,have achieved astonishing performance for semantically labeling very high resolution(VHR)remote sensing images.However,it is difficult for these models to capture the precise outlines of ground objects and explore the context information that revealing relationships among image objects for optimizing segmentation results.Consequently,this study proposes a semantic segmentation method for VHR images by incorporating deep learning semantic segmentation model(DeepLabv3+)and objectbased image analysis(OBIA),wherein DSM is employed to provide geometric information to enhance the interpretation of VHR images.The proposed method first obtains two initial probabilistic labeling predictions using a DeepLabv3+network on spectral image and a random forest(RF)classifier on hand-crafted features,respectively.These two predictions are then integrated by Dempster-Shafer(D-S)evidence theory to be fed into an object-constrained higher-order conditional random field(CRF)framework to estimate the final semantic labeling results with the consideration of the spatial contextual information.The proposed method is applied to the ISPRS 2D semantic labeling benchmark,and competitive overall accuracies of 90.6%and 85.0%are achieved for Vaihingen and Potsdam datasets,respectively.展开更多
基金was funded by the Key Laboratory of Surveying and Mapping Science and Geospatial Information Technology of Ministry of Natural Resources[grant number 2020-2-1]the National Natural Science Foundation of China[grant number 41871372].
文摘Semantic segmentation of remote sensing images is an important but unsolved problem in the remote sensing society.Advanced image semantic segmentation models,such as DeepLabv3+,have achieved astonishing performance for semantically labeling very high resolution(VHR)remote sensing images.However,it is difficult for these models to capture the precise outlines of ground objects and explore the context information that revealing relationships among image objects for optimizing segmentation results.Consequently,this study proposes a semantic segmentation method for VHR images by incorporating deep learning semantic segmentation model(DeepLabv3+)and objectbased image analysis(OBIA),wherein DSM is employed to provide geometric information to enhance the interpretation of VHR images.The proposed method first obtains two initial probabilistic labeling predictions using a DeepLabv3+network on spectral image and a random forest(RF)classifier on hand-crafted features,respectively.These two predictions are then integrated by Dempster-Shafer(D-S)evidence theory to be fed into an object-constrained higher-order conditional random field(CRF)framework to estimate the final semantic labeling results with the consideration of the spatial contextual information.The proposed method is applied to the ISPRS 2D semantic labeling benchmark,and competitive overall accuracies of 90.6%and 85.0%are achieved for Vaihingen and Potsdam datasets,respectively.
