基于VGG-NET的特征融合面部表情识别

Facial expression recognition using feature fusion based on VGG-NET

为了解决在面部表情特征提取过程中卷积神经网络CNN和局部二值模式LBP只能提取面部表情图像的单一特征,难以提取与面部变化高度相关的精确特征的问题,提出了一种基于深度学习的特征融合的表情识别方法。该方法将LBP特征和CNN卷积层提取的特征通过加权的方式结合在改进的VGG-16网络连接层中,最后将融合特征送入Softmax分类器获取各类特征的概率,完成基本的6种表情分类。实验结果表明,所提方法在CK+和JAFFE数据集上的平均识别准确率分别达到了97.5%和97.62%,利用融合特征得到的识别结果明显优于利用单一特征识别的效果。与其他方法相比较,该方法能有效提高表情识别准确率,对光照变化更加鲁棒。

Convolutional Neural Networks(CNN)and Local Binary Patterns(LBP)can only extract single features of facial expression images during facial expression feature extraction,so it is difficult to extract the precise features related to facial changes.In order to solve this problem,this paper proposes a facial expression recognition method using feature fusion based on deep learning.The method combines the LBP feature and the features extracted by the CNN convolutional layer into the improved VGG-16 network connection layer by weighting.Finally,the fusion features are sent to the Softmax classifier to obtain the probability of various features,and complete the basic six expression classifications.The experimental results show that the average recognition accuracy of the proposed method on the CK+ and JAFFE datasets is 97.5% and 97.62%,respectively.The recognition results obtained by the fusion features are significantly superior to that of single feature recognition.Compared with other methods,this method can effectively improve the accuracy of expression recognition and is more robust to illumination changes.