A facial expression emotion recognition based human-robot interaction(FEER-HRI) system is proposed, for which a four-layer system framework is designed. The FEERHRI system enables the robots not only to recognize huma...A facial expression emotion recognition based human-robot interaction(FEER-HRI) system is proposed, for which a four-layer system framework is designed. The FEERHRI system enables the robots not only to recognize human emotions, but also to generate facial expression for adapting to human emotions. A facial emotion recognition method based on2D-Gabor, uniform local binary pattern(LBP) operator, and multiclass extreme learning machine(ELM) classifier is presented,which is applied to real-time facial expression recognition for robots. Facial expressions of robots are represented by simple cartoon symbols and displayed by a LED screen equipped in the robots, which can be easily understood by human. Four scenarios,i.e., guiding, entertainment, home service and scene simulation are performed in the human-robot interaction experiment, in which smooth communication is realized by facial expression recognition of humans and facial expression generation of robots within 2 seconds. As a few prospective applications, the FEERHRI system can be applied in home service, smart home, safe driving, and so on.展开更多
Robot companions will soon be part of our everyday life and students in the engineering faculty must be trained to design,build,and interact with them.The two affordable robots presented in this paper have been design...Robot companions will soon be part of our everyday life and students in the engineering faculty must be trained to design,build,and interact with them.The two affordable robots presented in this paper have been designed and constructed by two undergraduate students;one artifi-cial agent is based on the Nvidia Jetson Nano development board and the other one on a remote computer system.Moreover,the robots have been refined with an empathetic system,to make them more user-friendly.Since automatic facial expression recognition skills is a necessary pre-processing step for acknowledging emotions,this paper tested different variations of Convolutional Neural Networks(CNN)to detect the six facial expressions plus the neutral face.The state-of-the-art performance of 75.1%on the Facial Expression Recognition(FER)2013 database has been reached by the ensemble voting method.The runner-up model is the Visual Geometry Group(VGG)16 which has been adopted by the two robots to recognize the expressions of the human partner and behave accordingly.An empirical study run among 55 university students confirmed the hypothesis that contact with empathetic artificial agents contributes to increasing the acceptance rate of robots.展开更多
基金supported by the National Natural Science Foundation of China(61403422,61273102)the Hubei Provincial Natural Science Foundation of China(2015CFA010)+1 种基金the Ⅲ Project(B17040)the Fundamental Research Funds for National University,China University of Geosciences(Wuhan)
文摘A facial expression emotion recognition based human-robot interaction(FEER-HRI) system is proposed, for which a four-layer system framework is designed. The FEERHRI system enables the robots not only to recognize human emotions, but also to generate facial expression for adapting to human emotions. A facial emotion recognition method based on2D-Gabor, uniform local binary pattern(LBP) operator, and multiclass extreme learning machine(ELM) classifier is presented,which is applied to real-time facial expression recognition for robots. Facial expressions of robots are represented by simple cartoon symbols and displayed by a LED screen equipped in the robots, which can be easily understood by human. Four scenarios,i.e., guiding, entertainment, home service and scene simulation are performed in the human-robot interaction experiment, in which smooth communication is realized by facial expression recognition of humans and facial expression generation of robots within 2 seconds. As a few prospective applications, the FEERHRI system can be applied in home service, smart home, safe driving, and so on.
文摘Robot companions will soon be part of our everyday life and students in the engineering faculty must be trained to design,build,and interact with them.The two affordable robots presented in this paper have been designed and constructed by two undergraduate students;one artifi-cial agent is based on the Nvidia Jetson Nano development board and the other one on a remote computer system.Moreover,the robots have been refined with an empathetic system,to make them more user-friendly.Since automatic facial expression recognition skills is a necessary pre-processing step for acknowledging emotions,this paper tested different variations of Convolutional Neural Networks(CNN)to detect the six facial expressions plus the neutral face.The state-of-the-art performance of 75.1%on the Facial Expression Recognition(FER)2013 database has been reached by the ensemble voting method.The runner-up model is the Visual Geometry Group(VGG)16 which has been adopted by the two robots to recognize the expressions of the human partner and behave accordingly.An empirical study run among 55 university students confirmed the hypothesis that contact with empathetic artificial agents contributes to increasing the acceptance rate of robots.
