基于深度相机的自主虚拟化身情感交互技术

Autonomous Virtual Avatar Emotional Interaction Technology Based on Depth Camera

人机情感交互是虚拟现实的研究热点之一,深度相机的普及使基于深度相机的人机交互技术得到广泛应用。将微软Kinect2.0作为交互设备,定义不同情感语义的姿态和手势,设计基于模板匹配的手势识别方法。以建立人机情感和谐为设计目标,提出虚拟角色情感交互方法,构造虚拟化身的认知结构和情绪交互规则,并在计算机上实现原型系统。实验结果显示,虚拟化身可以通过表情动画和头部运动响应用户的身体动作,表明该技术方案具有可行性。

Human-computer emotion interaction is one of the research highlights in the virtual reality.The research of human-computer interaction based on depth camera is valuable with the popularity of depth camera.Using Microsoft Kinect2.0 as the interactive device,this paper defines different emotional semantic postures and gestures,and designs the gesture recognition method based on template matching.In order to realize the harmonious human-computer emotion,it proposes the method to realize emotional interaction of virtual characters and constructs cognitive structure and emotional interaction rules for the virtual avatar.The prototype system is realized in computer.Experimental result shows that the virtual avatar can respond to user’s body movement through facial animation and head motion.It proves that the proposed technical solution is feasible.