Segmenting the semantic regions of point clouds is a crucial step for intelligent agents to understand 3D scenes.Weakly supervised point cloud segmentation is highly desirable because entirely labelling point clouds i...Segmenting the semantic regions of point clouds is a crucial step for intelligent agents to understand 3D scenes.Weakly supervised point cloud segmentation is highly desirable because entirely labelling point clouds is highly time-consuming and costly.For the low-costing labelling of 3D point clouds,the scene-level label is one of the most effortless label strategies.However,due to the limitation of classifier discriminative capability and the orderless and structurless nature of the point cloud data,existing scene-level method is hard to transfer the semantic information,which usually leads to the under-activated or over-activated issues.To this end,a local semantic embedding network is introduced to learn local structural patterns and semantic propagation.Specifically,the proposed network contains graph convolution-based dilation and erosion embedding modules to implement‘inside-out’and‘outside-in’semantic information dissemination pathways.Therefore,the proposed weakly supervised learning framework could achieve the mutual propagation of semantic information in the foreground and background.Comprehensive experiments on the widely used ScanNet benchmark demonstrate the superior capacity of the proposed approach when compared to the current alternatives and baseline models.展开更多
基金Key-Area Research and Development Program of Guangdong Province,Grant/Award Number:2021B0101200001National Natural Science Foundation of China,Grant/Award Numbers:61876140,U20B2065,U21B2048Open Research Projects of Zhejiang Lab,Grant/Award Number:2019KD0AD01/010。
文摘Segmenting the semantic regions of point clouds is a crucial step for intelligent agents to understand 3D scenes.Weakly supervised point cloud segmentation is highly desirable because entirely labelling point clouds is highly time-consuming and costly.For the low-costing labelling of 3D point clouds,the scene-level label is one of the most effortless label strategies.However,due to the limitation of classifier discriminative capability and the orderless and structurless nature of the point cloud data,existing scene-level method is hard to transfer the semantic information,which usually leads to the under-activated or over-activated issues.To this end,a local semantic embedding network is introduced to learn local structural patterns and semantic propagation.Specifically,the proposed network contains graph convolution-based dilation and erosion embedding modules to implement‘inside-out’and‘outside-in’semantic information dissemination pathways.Therefore,the proposed weakly supervised learning framework could achieve the mutual propagation of semantic information in the foreground and background.Comprehensive experiments on the widely used ScanNet benchmark demonstrate the superior capacity of the proposed approach when compared to the current alternatives and baseline models.
