A significant performance boost has been achieved in point cloud semantic segmentation by utilization of the encoder-decoder architecture and novel convolution operations for point clouds.However,co-occurrence relatio...A significant performance boost has been achieved in point cloud semantic segmentation by utilization of the encoder-decoder architecture and novel convolution operations for point clouds.However,co-occurrence relationships within a local region which can directly influence segmentation results are usually ignored by current works.In this paper,we propose a neighborhood co-occurrence matrix(NCM)to model local co-occurrence relationships in a point cloud.We generate target NCM and prediction NCM from semantic labels and a prediction map respectively.Then,Kullback-Leibler(KL)divergence is used to maximize the similarity between the target and prediction NCMs to learn the co-occurrence relationship.Moreover,for large scenes where the NCMs for a sampled point cloud and the whole scene differ greatly,we introduce a reverse form of KL divergence which can better handle the difference to supervise the prediction NCMs.We integrate our method into an existing backbone and conduct comprehensive experiments on three datasets:Semantic3D for outdoor space segmentation,and S3DIS and ScanNet v2 for indoor scene segmentation.Results indicate that our method can significantly improve upon the backbone and outperform many leading competitors.展开更多
基金support of the National Natural Science Foundation of China(61972157)the Natural Science Foundation of Shanghai(20ZR1417700)+2 种基金the National Key R&D Program of China(2019YFC1521104,2020AAA0108301)Shanghai Municipal Commission of Economy and Information(XX-RGZN-01-19-6348)the Art Major Project of National Social Science Fund(I8ZD22).
文摘A significant performance boost has been achieved in point cloud semantic segmentation by utilization of the encoder-decoder architecture and novel convolution operations for point clouds.However,co-occurrence relationships within a local region which can directly influence segmentation results are usually ignored by current works.In this paper,we propose a neighborhood co-occurrence matrix(NCM)to model local co-occurrence relationships in a point cloud.We generate target NCM and prediction NCM from semantic labels and a prediction map respectively.Then,Kullback-Leibler(KL)divergence is used to maximize the similarity between the target and prediction NCMs to learn the co-occurrence relationship.Moreover,for large scenes where the NCMs for a sampled point cloud and the whole scene differ greatly,we introduce a reverse form of KL divergence which can better handle the difference to supervise the prediction NCMs.We integrate our method into an existing backbone and conduct comprehensive experiments on three datasets:Semantic3D for outdoor space segmentation,and S3DIS and ScanNet v2 for indoor scene segmentation.Results indicate that our method can significantly improve upon the backbone and outperform many leading competitors.
