面向普通用户的3D虚拟人脸动画

3D Virtual Facial Animation for General Users

为合成真实感人脸动画,提出一种实时的基于单摄像头的3D虚拟人脸动画方法.首先根据用户的单张正面人脸图像重建用户的3D人脸模型,并基于该人脸模型合成姿态、光照和表情变化的人脸图像,利用这些图像训练特定用户的局部纹理模型;然后使用摄像头拍摄人脸视频,利用特定用户的局部纹理模型跟踪人脸特征点;最后由跟踪结果和3D关键形状估计Blendshape系数,通过Blendshape模型合成的人脸动画.实验结果表明,该方法能实时合成真实感3D人脸动画,且只需要一个普通的摄像头,非常适合普通用户使用.

To realistically animate a 3D virtual face, we propose a real-time video-driven facial animation method. Firstly, we reconstruct the user＇s 3D face model from a single frontal face image, and synthesize a set of facial images with different pose, illumination and expression based on this face model. The synthetic images are used to train a user-specific local texture model. Then, a video camera is used to record the facial performance of the user. Facial feature points are tracked using a constrained local model based method. Finally, facial tracking results are transformed to Blendshape coefficients based on 3D key shapes, and facial animation is generated by using Blendshape interpolation. Experiments show that our method is effective for realistic facial animation synthesis. Moreover, the method only requires a web camera and can be easily used by an ordinary user.