自适应权重的双模态情感识别

Bimodal emotion recognition based on adaptive weights

情感识别是人机交互领域的重要问题之一。语音和脸部肌肉动作信息是用于情感识别的2个最重要的模态。该文认为,在双模态情感识别中,给不同的特征赋予不同的权值有利于充分利用双模态信息,提出了一种基于Boosting算法的双模态信息融合方法,它能够自适应地调整语音和人脸动作特征参数的权重,从而达到更好的识别效果。实验表明,该方法能够更好地区分易混淆的情感状态,情感识别率达84%以上。

Emotion recognition is one of the most important issues in human-computer interactions(HCI).This paper describes a bimodal emotion recognition approach using a boosting-based framework to automatically determine the adaptive weights for audio and visual features.The system dynamically balances the importance of the audio and visual features at the feature level to obtain better performance.The tracking accuracy of the facial feature points is based on the traditional KLT algorithm integrated with the point ...