A personalized emotion space is proposed to bridge the ＂affective gap＂ in video affective content understanding. In order to unify the discrete and dimensional emotion model, fuzzy C-mean （FCM） clustering algorith...A personalized emotion space is proposed to bridge the ＂affective gap＂ in video affective content understanding. In order to unify the discrete and dimensional emotion model, fuzzy C-mean （FCM） clustering algorithm is adopted to divide the emotion space. Gaussian mixture model （GMM） is used to determine the membership functions of typical affective subspaces. At every step of modeling the space, the inputs rely completely on the affective experiences recorded by the audiences. The advantages of the improved V-A （Velance-Arousal） emotion model are the per- sonalization, the ability to define typical affective state areas in the V-A emotion space, and the convenience to explicitly express the intensity of each affective state. The experimental results validate the model and show it can be used as a personalized emotion space for video affective content representation.展开更多
Various wearable equipment enables us to measure people behavior by physiological signals.In our research,we present one galvanic skin reaction(GSR)wearable sensor which can analyze human emotions based on cognition r...Various wearable equipment enables us to measure people behavior by physiological signals.In our research,we present one galvanic skin reaction(GSR)wearable sensor which can analyze human emotions based on cognition reappraisal.First,We research the factors of emotional state transition in Arousal-Valence-Stance(AVS)emotional space.Second,the influence of the cognition on emotional state transition is considered,and the reappraisal factor based on Gross regulation theory is established to correct the effectiveness from cognitive reappraisal ability to emotional state transition.Third,based on the previous work,we establish a GSR emotion sensing system for predicting emotional state transition and considering the correlation between GSR signals and emotions.Finally,an overall wearable sensor layout is built.In the experiment part,we invited 30 college students to wear our GSR sensors and watch 14 kinds of affective videos.We recorded their GSR signals while asking them to record their emotional states synchronously.The experiment results show different reappraisal factors can predict subjects’emotional state transition well and indirectly confirm the feasibility of the Gross regulation theory.展开更多
Emotional space refers to a multi-dimensional emotional model that describes a group of subjective feelings or emotions. Since the existing discrete emotional space is mainly aimed at human’s primary emotions, it can...Emotional space refers to a multi-dimensional emotional model that describes a group of subjective feelings or emotions. Since the existing discrete emotional space is mainly aimed at human’s primary emotions, it cannot describe the complex emotions evoked when watching movies. In order to solve this problem, an emotional fusion space for videos was constructed by selecting movies and TV dramas with rich emotional semantics as the research objects. Firstly, emotional words based on movie and TV drama videos are acquired and analyzed by using subjective evaluation and semantic analysis methods. Then, the emotional word vectors obtained from the above analysis are fused, reduced dimension by t-distributed stochastic neighbor embedding(t-SNE) algorithm, and clustered by bisecting K-means clustering algorithm to get a discrete emotional space for movie and TV drama videos. This emotional fusion space can obtain different categories by changing the value of the emotion classification number without re-labeling and calculation.展开更多
IN our family album, there is a picture of my grandfather, Fang Xiaoyue, and grandmother, Ma Junwan. The picture was taken in the 1920s when my grandparents were a newly married couple. It seemed to be in the afternoo...IN our family album, there is a picture of my grandfather, Fang Xiaoyue, and grandmother, Ma Junwan. The picture was taken in the 1920s when my grandparents were a newly married couple. It seemed to be in the afternoon in the photo, and in the background was an elegant garden, pale clouds in the sky, a rockery close by and a pavilion展开更多
基金Supported by the National Natural Science Foundation of China (60703049)the "Chenguang" Foundation for Young Scientists (200850731353)the National Postdoctoral Foundation of China (20060400847)
文摘A personalized emotion space is proposed to bridge the ＂affective gap＂ in video affective content understanding. In order to unify the discrete and dimensional emotion model, fuzzy C-mean （FCM） clustering algorithm is adopted to divide the emotion space. Gaussian mixture model （GMM） is used to determine the membership functions of typical affective subspaces. At every step of modeling the space, the inputs rely completely on the affective experiences recorded by the audiences. The advantages of the improved V-A （Velance-Arousal） emotion model are the per- sonalization, the ability to define typical affective state areas in the V-A emotion space, and the convenience to explicitly express the intensity of each affective state. The experimental results validate the model and show it can be used as a personalized emotion space for video affective content representation.
基金supported in part by the National Key Research&Development Plan of China under Grant No.2016YFB1001404in part by the National Natural Science Foundation of China(No.61432004,61672093).
文摘Various wearable equipment enables us to measure people behavior by physiological signals.In our research,we present one galvanic skin reaction(GSR)wearable sensor which can analyze human emotions based on cognition reappraisal.First,We research the factors of emotional state transition in Arousal-Valence-Stance(AVS)emotional space.Second,the influence of the cognition on emotional state transition is considered,and the reappraisal factor based on Gross regulation theory is established to correct the effectiveness from cognitive reappraisal ability to emotional state transition.Third,based on the previous work,we establish a GSR emotion sensing system for predicting emotional state transition and considering the correlation between GSR signals and emotions.Finally,an overall wearable sensor layout is built.In the experiment part,we invited 30 college students to wear our GSR sensors and watch 14 kinds of affective videos.We recorded their GSR signals while asking them to record their emotional states synchronously.The experiment results show different reappraisal factors can predict subjects’emotional state transition well and indirectly confirm the feasibility of the Gross regulation theory.
基金supported by the Key Laboratory of the Ministry of Culture and Tourism (WLBSYS2005)the Fundamental Research Funds for the Central Universities (CUC19ZD005)。
文摘Emotional space refers to a multi-dimensional emotional model that describes a group of subjective feelings or emotions. Since the existing discrete emotional space is mainly aimed at human’s primary emotions, it cannot describe the complex emotions evoked when watching movies. In order to solve this problem, an emotional fusion space for videos was constructed by selecting movies and TV dramas with rich emotional semantics as the research objects. Firstly, emotional words based on movie and TV drama videos are acquired and analyzed by using subjective evaluation and semantic analysis methods. Then, the emotional word vectors obtained from the above analysis are fused, reduced dimension by t-distributed stochastic neighbor embedding(t-SNE) algorithm, and clustered by bisecting K-means clustering algorithm to get a discrete emotional space for movie and TV drama videos. This emotional fusion space can obtain different categories by changing the value of the emotion classification number without re-labeling and calculation.
文摘IN our family album, there is a picture of my grandfather, Fang Xiaoyue, and grandmother, Ma Junwan. The picture was taken in the 1920s when my grandparents were a newly married couple. It seemed to be in the afternoon in the photo, and in the background was an elegant garden, pale clouds in the sky, a rockery close by and a pavilion
