Recognizing 3D part instances from a 3D point cloud is crucial for 3D structure and scene understanding.Several learning-based approaches use semantic segmentation and instance center prediction as training tasks and ...Recognizing 3D part instances from a 3D point cloud is crucial for 3D structure and scene understanding.Several learning-based approaches use semantic segmentation and instance center prediction as training tasks and fail to further exploit the inherent relationship between shape semantics and part instances.In this paper,we present a new method for 3D part instance segmentation.Our method exploits semantic segmentation to fuse nonlocal instance features,such as center prediction,and further enhances the fusion scheme in a multi-and cross-level way.We also propose a semantic region center prediction task to train and leverage the prediction results to improve the clustering of instance points.Our method outperforms existing methods with a large-margin improvement in the PartNet benchmark.We also demonstrate that our feature fusion scheme can be applied to other existing methods to improve their performance in indoor scene instance segmentation tasks.展开更多
The lack of fine-grained 3D shape segmentation data is the main obstacle to developing learning-based 3D segmentation techniques.We propose an effective semi-supervised method for learning 3D segmentations from a few ...The lack of fine-grained 3D shape segmentation data is the main obstacle to developing learning-based 3D segmentation techniques.We propose an effective semi-supervised method for learning 3D segmentations from a few labeled 3D shapes and a large amount of unlabeled 3D data.For the unlabeled data,we present a novel multilevel consistency loss to enforce consistency of network predictions between perturbed copies of a 3D shape at multiple levels:point level,part level,and hierarchical level.For the labeled data,we develop a simple yet effective part substitution scheme to augment the labeled 3D shapes with more structural variations to enhance training.Our method has been extensively validated on the task of 3D object semantic segmentation on PartNet and ShapeNetPart,and indoor scene semantic segmentation on ScanNet.It exhibits superior performance to existing semi-supervised and unsupervised pre-training 3D approaches.展开更多
文摘Recognizing 3D part instances from a 3D point cloud is crucial for 3D structure and scene understanding.Several learning-based approaches use semantic segmentation and instance center prediction as training tasks and fail to further exploit the inherent relationship between shape semantics and part instances.In this paper,we present a new method for 3D part instance segmentation.Our method exploits semantic segmentation to fuse nonlocal instance features,such as center prediction,and further enhances the fusion scheme in a multi-and cross-level way.We also propose a semantic region center prediction task to train and leverage the prediction results to improve the clustering of instance points.Our method outperforms existing methods with a large-margin improvement in the PartNet benchmark.We also demonstrate that our feature fusion scheme can be applied to other existing methods to improve their performance in indoor scene instance segmentation tasks.
文摘The lack of fine-grained 3D shape segmentation data is the main obstacle to developing learning-based 3D segmentation techniques.We propose an effective semi-supervised method for learning 3D segmentations from a few labeled 3D shapes and a large amount of unlabeled 3D data.For the unlabeled data,we present a novel multilevel consistency loss to enforce consistency of network predictions between perturbed copies of a 3D shape at multiple levels:point level,part level,and hierarchical level.For the labeled data,we develop a simple yet effective part substitution scheme to augment the labeled 3D shapes with more structural variations to enhance training.Our method has been extensively validated on the task of 3D object semantic segmentation on PartNet and ShapeNetPart,and indoor scene semantic segmentation on ScanNet.It exhibits superior performance to existing semi-supervised and unsupervised pre-training 3D approaches.
