基于人脸画像的伪照片合成及修正

Pseudophoto synthesis based on face sketch and its amendment

提出一种基于人脸画像的伪照片合成及修正方法,该方法包括人脸伪照片的合成、增强以及局部修正3个部分。首先,应用局部本征变换(LET)方法合成人脸伪照片的初始估计。然后,提取人脸画像的边缘和纹理信息对人脸伪照片进行增强以改善合成结果的视觉效果。最后,通过移动最小二乘法对伪照片局部合成错误进行修正。在CUHK student人脸画像库上进行了实验,对转换结果与真实人脸照片进行了比较。结果表明:提出的方法可以有效地合成人脸伪照片,对人脸伪照片能够进行有效增强和修正,且在修正局部合成错误的同时能够保证整体相似度不会下降。由于本文的方法只涉及到局部区域的变形,所以不需要依靠神经网络来预测输出结果中控制点的目标位置,从而降低了计算的复杂度。

A method was proposed to transform a face sketch into a pseudophoto and to amend the synthesized pseudophoto.It consists of three procedures for the face pseudophoto：synthesizing,enhancement and local amendment.Firstly,the initial face pseudophoto was synthesized by Local Eigentransformation Technique（LET）.Then,the edge features and textures of the face sketch were enhanced to improve the visual effect of synthesized pseudophoto.Finally,the local synthesis error of the face pseudophoto was amended by moving least squares algorithm.The experiment was performed on the CUHK face sketch database and the transformation was compared with real photos.Result shows that the method can effectively synthesize and amend the pseudophoto and can guarantee the similarity with sufficient amendment.As the proposed method only involves the deformation of a local region,it is independent on the neural network to predict the target location in control points.So,it has lowered the computing complexity.