多模态情感识别综述

Survey on Multimodal Emotion Recognition

情感是一种多元的讯息表述,而情感识别又是人机交互,感情交互中中十分极其重要的问题[1]。根据情感的差异来源,本文从脑电和表情两种模态入手,概述了脑电和表情的特征提取方法,着重说明了多模态融合技术和方法,并且列举了现阶段常见的公开多模态数据库。最后总结了仍然存在的问题和今后的研究方向。

Emotion is a kind of multiple information expression, and emotion recognition is human-computer interaction. It is a very important problem in emotion interaction. Based on the two modes of EEG and expression, we introduce the related feature extraction technology, focus on the multimodal emotion fusion recognition technology, and list the commonly used open multi-modal database. Finally,the existing problems in the research of multimodal emotion recognition are briefly explained, and the future research directions are prospected.