基于TD-Mask R-CNN的机械装配体图像实例分割

Instance Segmentation of Mechanical Assembly Image Based on TD-Mask R-CNN

在机械产品装配过程中,为了准确识别机械装配体零件信息以减少零件漏装、错装等现象,提出一种改进的机械装配体图像实例分割方法TD-Mask R-CNN。首先,在主干网络ResNet101中引入可变形卷积(deformable convolutional networks, DCN)以增加网络模型的泛化能力;其次,使用Transfiner结构作为掩码分支以提高机械零件边缘的分割精度;最后,在Transfiner结构中引入离散余弦变换(discrete cosine transform, DCT)模块以提升模型对机械装配体图像整体的分割能力。实验结果表明,提出的实例分割方法在合成深度图像数据集和真实彩色图像数据集上得到的掩码平均精度(average precision, AP)分别为87.7%和92.0%,与其他主流实例分割算法相比均有所提升。

In the assembly process of mechanical products,in order to accurately identify the mechanical parts information to reduce the phenomenon of parts leakage and misassembly,this paper proposes an improved instance segmentation method TD-Mask R-CNN for mechanical assemblies images.First,deformable convolutional networks(DCN)is introduced into the backbone network ResNet101 to increase the generalization ability of the network model.Then,the Transfiner structure is used as a mask branch to improve the segmentation accuracy of the mechanical part edges.Finally,the discrete cosine transform(DCT)module is introduced in the Transfiner structure to improve the model's ability to segment the whole image of the mechanical assembly.The experimental results show that the average precision(AP)of the mask obtained by this method on the synthetic depth image dataset and the real color image dataset are 87.7%and 92.0%,respectively,which is improved compared with other mainstream instance segmentation algorithms.