基于多视图和显著性分割的古生物三维模型检索

Paleontological 3D model retrieval based on multi-view and saliency segmentation

使用古生物化石图像检索古生物三维模型是一种建立和管理古生物三维数据库的有效方式,而直接以化石图像或复原图像检索古生物三维模型精确度较低。针对此问题,该文提出一种基于多视图和显著性图分割模型相结合的古生物三维模型检索方法。首先,在三维模型投影的基础上,对投影图像和检索图像使用显著性分割网络进行主体分割得到主体特征,然后,利用主体特征进行匹配得到相似投影图像对应的三维模型。在自建的古生物数据集上进行验证,该文所提方法最近邻准确度为0.845,F值为0.782,折损累计增益为0.856,各类别平均准确率为0.754。该方法可以有效地适应古生物数据集,并且准确率相对较好,能够辅助古生物三维模型的检索。

Using paleontological fossil images to retrieve paleontological 3D models is an effective way to establish and manage paleontological 3D databases,while retrieving paleontological 3D models directly from fossil images or restored images is less accurate.Aiming at this problem,a 3D model retrieval method of paleontology based on the combination of multi-view and saliency map segmentation model is proposed in this paper.That is,on the basis of the projection of the 3D model,the saliency segmentation network is used to segment the projected image and the retrieved image to obtain the subject features,and then the 3D model corresponding to the similar projection images is obtained by matching the subject features.Validated on the paleontological dataset established in this paper,the nearest neighbor accuracy of the method proposed in this paper is 0.845,the F value is 0.782,the cumulative gain of impairment is 0.856,and the average accuracy of each category is 0.754.The method in this paper can be effectively adapted to the paleontological dataset,and the accuracy rate is relatively good,which can assist in the retrieval of paleontological 3D models.