结合空间结构卷积和注意力机制的三维点云分类网络

Classification network for 3D point cloud based on spatialstructure convolution and attention mechanism

目的 三维点云分类作为一项关键任务,在计算机视觉、机器人和自动驾驶等领域有着广泛的应用场景。现有的三维点云分类网络在使用边卷积进行局部特征提取时通常存在输入特征差异性小,空间结构信息提取、融合不充分等问题。针对上述问题,设计了一种结合空间结构卷积和注意力机制的点云分类网络。方法 首先,提出一种空间结构卷积,在边卷积的基础上引入邻接点之间的相对位置信息来降低输入特征相似性,而后从结构和位置两个角度分别进行特征编码,实现更具多样性的局部几何结构捕获。其次,设计了全局特征编码模块,从坐标信息中提炼全局特征信息,同时在网络中融合了注意力机制,用于关联局部和全局特征表示,有效保留了全局特征信息,实现全局特征的适应性调整。最后,将局部几何结构信息和全局位置信息进行有效的融合,获得更具代表性和差异性的特征表征。结果 设计实验在公开数据集ModelNet40上对提出的网络模型的性能进行评估,点云分类总体准确率和平均准确率分别达到93.0%和89.7%,具备良好的分类性能和预测效率。实验结果表明,空间结构卷积的使用有效增加了输入特征的多样性,位置和结构的单独编码有效提高了局部特征的表达能力。同时,提出的注意力加权方式在保留全局特征前提下实现了局部特征和全局特征的关联。结论 提出的网络有较强的细粒度特征提取能力,具有良好的分类性能。

Objective 3D point cloud classification is a crucial task with diverse applications in computer vision,robotics,and autonomous driving.The advancement of computing device performance in recent years has enabled researchers toapply deep learning methods to the field of 3D point cloud recognition.Deep learning-based methods that are currently inuse for 3D point cloud classification typically divide the feature information captured by a network into two distinct parts:global and local features.Global features refer to the overall shape and structure of the point cloud,while local featurescapture more detailed information about individual points.By leveraging global and local features,these methods can achieve high accuracy in point cloud classification tasks.Edge convolution(EdgeConv)is currently the most widely usedmethod for local feature extraction in 3D point cloud classification.This method incorporates relative position vectors intofeature encoding to capture the characteristics of local structures effectively.However,when local structures in 3D pointclouds are similar,the use of relative positions in feature encoding may result in similar features,leading to poor classifica⁃tion results.Furthermore,encoding only local features may be insufficient for achieving optimal classification results,because considering the correlation between local and global features is also crucial.Current methods frequently employattention mechanisms to learn attention scores from global features and weigh local features accordingly,effectively estab⁃lishing the correlation between local and global features.However,these methods may not fully consider the importance ofglobal feature information and may suffer from suboptimal classification results.Method To address the aforementionedchallenges,this study proposes a novel 3D point cloud classification network that leverages spatial structure convolution(SSConv)and attention mechanisms.The proposed network architecture consists of two parts:a local feature encoding(LFE)module and a global feature encoding(GFE)module.The former uses SSConv to encode local features from loca⁃tion and structure,while the latter learns global feature representation from raw coordinate data.Furthermore,to enableeffective correlation and complementarity between feature information,we introduce an attention mechanism that facilitatesadaptive adjustment of global features through weighted operations.The LFE module is composed of two operations:graphconstruction and feature extraction.The LFE module performs the K-nearest neighbor(KNN)algorithm to identify adja⁃cent points and construct a graph structure.SSConv is a crucial feature extraction operation that involves a multilayer per⁃ceptron.Compared with EdgeConv,SSConv introduces a relative position vector between adjacent points.This operationeffectively increases the correlation distance between raw input data,enriches local region structure information,andenhances the spatial expression ability of the extracted high-level semantic information.To capture more effective localstructure features,feature extraction is encoded separately on the basis of structure and location.In particular,the locationencoding branch encodes the coordinate information separately to obtain richer location feature information for describingthe spatial location of each point.Meanwhile,the structure encoding branch encodes the relative location vector separatelyto learn the structure information in the local region for describing the overall geometric structure of the local neighborhood.The global feature encoding module maps raw coordinate data to high-dimensional features,which are used as the globalfeature representation of the point cloud.In addition,the module includes an attention mechanism to enhance the correla⁃tion between local and global features.In particular,an attention weighting method is used to guide the learning of globalfeature information by using local feature information.This operation enables correlation and fusion between local andglobal feature representations while preserving raw feature information.Result To evaluate the performance of the proposednetwork model,experimental validation is conducted on the publicly available ModelNet40 dataset,which consists of 9843training models and 2468 testing models in 40 classes.Classification performance was evaluated using metrics,such asoverall accuracy(OA)and mean accuracy(mAcc),in the experiments.To evaluate classification performance,the pro⁃posed model was evaluated against four pointwise methods,two convolution-based methods,two graph convolution-basedmethods,and four attention mechanism-based methods.The experimental results demonstrate that the proposed networkexhibits good performance in the point cloud classification task and is capable of effectively representing local and globalfeatures.The proposed method achieves an OA of 93.0%,outperforming dynamic graph convolutional neural network(DGCNN)by 0.1%,PointWeb by 0.7%,and PointCNN by 0.8%.In addition,the mAcc of the proposed method reaches89.7%.Furthermore,an experiment was designed to validate the efficacy of SSConv.By replacing SSConv with EdgeConvin the network architecture,the experimental results indicate a reduction in OA of 0.5%on the ModelNet40 dataset,demon⁃strating that SSConv is better suited for local representation than EdgeConv.Meanwhile,an experiment was designed toverify the diversity of input features of SSConv.The correlation of features was evaluated using Euclidean,cosine,and corre⁃lation distances.The results indicate that SSConv enhances diversity among input features more effectively than EdgeConv.Furthermore,the visualization results of the intermediate layer features in the model demonstrate that SSConv can learn moredistinctive features.Conclusion The proposed network model achieves better classification results,with an OA of 93.0%and an mAcc of 89.7%,surpassing those of existing methods.The proposed spatially structured convolution effectivelyenhances the variability of input features,allowing the model to learn more diverse local feature representations of objects.The proposed global feature coding method based on the attention mechanism effectively adjusts features and fully extractsthe relationship between local and global feature information while preserving global features.To summarize,the proposednetwork model exhibits good capability for fine-grained feature extraction and achieves good classification performance.