基于TripletLoss损失函数的舌象分类方法研究

Tongue image classification based on TripletLoss metric

目的舌象体质分类对后续肿瘤患者舌象的客观化辨证具有重要意义,但对于中医舌图像而言,部分类型的舌图像样本较难采集,达不到目前流行的深度学习方法需要的样本数量,且基于传统分类的深度学习只注重寻找具有相似特征,导致模型在中医舌图像这种类间样本特征差异较小的问题上,分类性能不佳。因此,本文提出一种基于TripletLoss的度量分类方法,在最大化非同类样本的特征距离同时缩小类间样本特征的间距。方法首先通过建立卷积神经网络Inception-ResNet-V1提取对应的高维抽象特征。然后使用L2范数进一步约束高维特征的分布,同时引入降维压缩后的高维特征,最后使用TripletLoss得到有效的映射空间。因此可以根据舌象间的特征向量距离计算相似度以实现分类。结果经过本文方法得到的特征空间,不同类型舌象之间的距离较大,同一类型的舌象距离较小,可以更好地对类间差异较小的舌图像进行分类,且分类速度更快。与现有方法比较,本论文方法在分类精确度上提升了18.34%,并且所需时间最短。结论该方法可以很好地实现舌象体质分类,具有一定的应用价值。

Objective Constitution classification based on tongue image is of great significance to the objective differentiation of tongue image of subsequent tumor patients. However,for tongue images of traditional Chinese medicine,certain types of tongue image samples are difficult to collect,which can not meet the number of samples required by the current popular deep learning methods. Moreover,deep learning based on traditional classification only focuses on finding similar features,resulting in poor classification performance of the model on the problem of small differences in sample features between classes,such as tongue images of traditional Chinese medicine. Therefore,this paper proposes a metric classification method based on TripletLoss,which maximizes the feature distance of different classes of samples while reducing the distance between classes of samples.Methods Firstly,the corresponding high-dimensional abstract features are extracted by establishing convolution neural network Inception-ResNet-V1. Then L2 norm is used to further constrain the distribution of highdimensional features. Meanwhile, the high-dimensional features after data dimensionality reduction and compression are introduced. Finally, a valid mapping space is obtained by using TripletLoss. Therefore, the similarity can be calculated according to the feature vector distance between tongue images to realize classification.Results According to the feature space obtained by the method in this paper,the distance between different types of tongue images is larger,and the distance between the same type of tongue images is smaller,which can better classify tongue images with smaller differences between classes,and the classification speed is faster. Compared with the existing methods,the classification accuracy of the method in this paper is improved by 18.34%,and the required time is the shortest.Conclusions This method can well realize the constitution classification based on tongue image and has certain application value.