基于投影与深度学习网络的三维人脸特征点定位方法

Calibration Method of the Three-dimensional Face Model Feature Points Based on the Projection and Deep Learning Network

标定三维人脸模型特征点对人脸识别、人脸建模等都具有重要作用。针对人脸特征点标定需要手工干预、标定特征点个数少或不准确、标定时间长等问题,提出了一种基于投影与深度学习网络的人脸三维模型特征点标定法。基于正交投影,生成人脸三维模型二维深度图与二维特征点位置,采用以卷积神经网络为主的深度学习网络模型训练测试,将深度图上特征点映射到三维人脸模型,实现眉毛、眼睛、鼻尖、嘴巴等重要区域的特征点定位。实验表明,该方法可自动标定三维人脸模型特征点,快速、准确预测足够数量特征点位置。

Calibration of the three-dimensional face model feature points has an important role on face recognition,face modeling,and so.Some problems still exist,like that Face feature points need to be manually calibrated,the number of calibration points is small or inaccurate,the calibration time is long,and so on.A feature point calibration method of face 3 Dmodel based on projection and depth learning network is proposed.Firstly,based on the orthogonal projection,the two-dimensional depth map and two-dimensional feature point position of the human face 3 Dmodel are generated.Then we use the depth learning network model,mainly based on the convolution neural network,to train and test,and map the feature points on the depth map to the 3 D human model.Finally,we achieve facial key points on eyebrows,eyes,the nose tip and the mouth.Experiments show that this method can automatically calibrate enough 3 Dface model feature points,fastly and accurately.