基于人脸姿态估计的多角度虚拟眼镜试戴技术

Multi-Angle Virtual Glasses Trial Technology Based on Face Attitude Estimation

虚拟眼镜试戴手动操作占比高、试戴角度单一、试戴效果失真,所以试戴技术商用率较低。针对这些问题,文中提出了一种基于人脸特征检测与头部空间姿态估计相结合的虚拟试戴技术,并实现了一套虚拟眼镜试戴系统。通过摄像头采集头部实时视频,并按帧分析,采用ERT级联回归定位面部特征点。根据面部特征点位置信息和头部旋转信息将透视变换后的眼镜图像准确融合到对应角度的人脸图像中。在AFLW人脸数据库上对三维实时姿态估计进行了量化评估,±60°内角度误差约为8.8°。结果表明,该算法精度高且速度快,在角度变化频繁、外界光线强弱变化大、背景干扰物较多的复杂情况下仍能快速准确地实现三维多角度虚拟试戴,效果逼真自然,基本满足虚拟试戴技术的要求。

In view of the problems that current high proportion of manual operations for virtual glasses try-on,single try-on angle,distorted try-on effect,and low commercial rate of try-on technology,a virtual try based on the combination of facial feature detection and head space pose estimation is proposed,and a virtual glasses try-on system is implemented.The real-time videos of the head are collected through the camera and analyzed by frame,and ERT cascade regression is used to locate facial feature points.According to the position information of the facial feature points and the head rotation information,the perspective-transformed eyeglass image is accurately integrated into the face image at the corresponding angle.The 3D real-time pose estimation is quantitatively evaluated on the AFLW face database,and the angle error within±60°is about 8.8°.The results show that the algorithm has high precision and fast speed,and can quickly and accurately realize 3D multi-angle virtual try-on in complex situations with frequent angle changes,large changes in external light intensity,and many background interferences.The effect obtained by the algorithm is realistic and natural,and basically meets the requirements of virtual try-on technology.