基于面部特征图对称的人脸正面化生成对抗网络算法

Face frontalization generative adversarial network algorithm based on face feature map symmetry

目前人脸正面化研究主要解决人脸偏转问题,而对监控视频等现实场景中同时受偏转和俯仰变化影响的侧脸的正面化生成关注较少,针对这个问题和多角度侧脸生成的正面人脸图存在身份信息保留不全的问题,提出了一种基于特征图对称模块和眼周特征保留损失的生成对抗网络(GAN)。首先,根据人脸对称性先验,提出特征图对称模块,先使用人脸关键点检测器检测出侧脸鼻尖点位置,再将编码器提取到的特征图依照鼻尖位置进行镜像对称,从而在特征层面上缓解面部信息缺失的问题。其次,借鉴眼周识别思想,在现有的生成图身份保留方法中加入了眼周特征保留损失以训练生成器生成逼真的且保留身份信息的人脸正面图像。实验结果表明,所提算法得到的生成图面部细节保留较好,且在CAS-PEAL-R1数据集的所有俯角下人脸的平均Rank-1识别率为99.03%,可见该算法能够有效解决多角度侧脸的正面化问题。

At present,the research of face frontalization mainly solves the face yaw problem,and pays less attention to the face frontalization of the side face affected by yaw and pitch at the same time in real scenes such as surveillance video.Aiming at this problem and the problem of incomplete identity information retained in front face image generated by multiangle side faces,a Generative Adversarial Network(GAN)based on feature map symmetry and periocular feature preserving loss was proposed.Firstly,according to the prior of face symmetry,a symmetry module of the feature map was proposed.The face key point detector was used to detect the position of nasal tip point,and mirror symmetry was performed to the feature map extracted by the encoder according to the nasal tip,so as to alleviate the lack of facial information at the feature level.Finally,benefiting from the idea of periocular recognition,the periocular feature preserving loss was added in the existing identity preserving method of generated image to train the generator to generate realistic and identity-preserving front face image.Experimental results show that the facial details of the images generated by the proposed algorithm were well preserved,and the average Rank-1 recognition rate of faces with all angles under the pitch of CAS-PEAL-R1 dataset is 99.03%,which can effectively solve the frontalization problem of multi-angle side faces.