基于区域与分类回归融合的AU强度估计算法

AU Strength Estimation Algorithm Based on Region and Classification Regression Fusion

脸部动作编码系统为人脸表情信息定义了脸部动作单元(AU)的概念,但在AU强度的检测上由于各级别之间的区分度较低且个体间人脸表情差异较大,导致检测效果较差。为此,挖掘AU激活和区域之间较强的相关特性,提出一种新的基于区域和特征融合的特征提取算法,并同时给出一种AU强度计算方法,即在对高AU强度和低AU强度二分类后根据有序回归判断AU最终的强度。该算法利用强AU和弱AU较强的可分性,考虑不同AU强度间的相关性,发挥分类和回归方法在AU强度检测方面的优势。在DISFA、FERA2015数据集上的实验结果表明,该算法具有较高的鲁棒性,AU强度的计算效果优于CNN、VGG16等方法。

The facial action coding system defines the concept of facial Action Unit(AU)for facial expression information,but the detection effect of AU strength is poor due to the low degree of discrimination between the levels and the large difference in facial expression between individuals.To this end,mining the strong correlation between AU activation and region,a new feature extraction algorithm based on region and feature fusion is proposed,and an AU strength calculation method is given,high AU strength and low AD strength are classified,the final strength of the AU is judged based on the ordered regression.The algorithm utilizes the strong separability of strong AU and weak AU,considers the correlation between different AU strengtis,and exerts the advantages of classification and regression methods in AU strength detection.Experimental results on the DISFA and FERA2015 datasets show that the proposed algorithm is robust and the AU strengh is better than CNN and VGG16.