面向虚拟化身的人脸表情模拟技术

Facial Expression Simulation Technology for Virtual Avatar

为了实现基于增强现实的电子沙盘环境中的异地可视化交互功能,提出了一种面向虚拟化身的三维表情模拟技术。首先,使用RGB摄像头跟踪异地作业人员的表情,基于约束局部模型(CLM)提取人脸特征点数据后传输到本地;然后,采用基于径向基函数的插值算法计算虚拟化身面部网格点的坐标,驱动模型模拟出与异地作业人员相同的表情;最后,为了提高变形算法的精度和效率,提出一种基于贪心算法与人脸肌群分布的插值控制点选取和分区域插值方法。实验结果表明,该算法能够满足实际应用对实时性和真实感的需求。

In order to realize the offsite visualization interaction function in the electronic sand table environment based on Augmented Reality,a 3 D expression simulation technology for virtual avatar is proposed.First,the expressions of remote worker is tracked using a RGB camera,the face feature point data is extracted based on constrained local models(CLM)and the data is sent to local.The interpolation algorithm based on Radial Basis Function is used to calculate the coordinates of vertices of the virtual avatar face mesh,the model is driven to simulate the same facial expression with the other offsite worker;Finally,in order to improve the accuracy and efficiency of the deformation algorithm,a selection method of interpolation control points and a sub-region interpolation method based on the distribution of the human muscle group and the greedy algorithm are proposed,The experimental results show that the algorithm can meet the real-time and realistic requirements of applications.