视频情感语义分析——类型-强度分解法

Affective semantic analysis in video:type-intensity decomposition method

提出一种视频情感语义分析方法,利用强度和类型两个独立分量构造的二维空间来建立人类情感模型,通过多模态的听觉、视觉特征,分别构造连续型的情感强度时序曲线和离散型的情感类型时序曲线,从而建立低层特征空间与情感空间之间的映射关系,实现对视频内容的情感注释和分析。类型-强度分解曲线可客观、真实地描述视频情感内容随时间的变化情况。实验结果验证了该方法的有效性。

This paper looked into a new direction in video content,affective semantic analysis,which can be defined as the understanding of feelings or emotions expected to arise in viewers while watching video clip.According to the approach proposed in this paper,the affective semantic space can be decomposed by two independence elements,affective intensity and affective type.Thus the affective video content was mapped onto the 2-D emotion space by the model that bridges the gap between low-level features and high-level affective semantic meaning.A number of effective audiovisual cues were formulated to help establish the two element curves.The simulations verify the method＇s reliability and consistency between the emotions reflected by the video and the feelings observed on the viewers.