融合邻域色差的PSPNet对遥感影像的分割

Remote sensing image segmentation based on PSPNet with neighborhood color difference

传统的遥感影像语义分割利用影像的光谱特性,将具有相似值的像素进行归类,但无法区分具有不同光谱的同一类对象。针对这一问题,提出将邻域的色差信息和原始图像一起输入PSPNet网络中的方法。先将RGB变换到LAB空间,然后采用CIELAB公式计算出每一个像素与周围8个邻域像素的色差值,取平均值作为该像素的邻域色差值。在WHU building dataset和Massachusetts building dataset上使用PSPNet进行对比试验。结果显示,在两个数据集中平均交并比MIoU、准确度ACC和F1-score都有不同程度的提高。因此,融合邻域色差的方法能有效提高PSPNet分割精度。

Traditional semantic segmentation of remote sensing image is to classify the pixels with similar values by using the spectral characteristics of images,but it is unable to distinguish the same kind of objects with different spectra.Aiming at this problem,a method was proposed in which the color difference information of neighborhood is integrated into the original image as input to PSPNet.Firstly,RGB was transformed into LAB.Then CIELAB formula was used to calculate the color difference value between each pixel and eight neighboring pixels,and the average value was taken as the neighborhood color difference value of the pixel.Experiment was done by using PSPNet on WHU building dataset and Massachusetts building dataset.The results show that the MIoU,ACC and F1-score with neighborhood color difference are better than without.Therefore,the proposed method of merging neighborhood color difference is an effective way to improve the segmentation accuracy of PSPNet.