基于多任务对抗和抗噪对抗学习的人脸超分辨率算法

Face Super-Resolution Algorithm Based on Multi-task Adversarial and Antinoise Adversarial Learning

高倍率单幅人脸图像超分辨率重建是一项具有实用价值但困难的任务。在人脸超分辨率任务中,端到端网络超分辨率图像较模糊,图像真实性和人眼视觉效果较差。针对上述问题,文中提出基于多任务对抗和抗噪对抗学习的人脸超分辨率算法。算法分为端到端网络学习阶段和网络参数微调阶段。为了提高端到端学习效果,设计深度多任务拉普拉斯金字塔网络,并结合多任务对抗学习。主任务为端到端学习,子任务为优化对抗学习惩罚项函数。为了改进通过对抗学习并微调主任务网络参数后的效果,在对抗学习的判别器优化过程中,融入抗噪对抗学习。实验表明,文中算法能使人脸超分辨率图像更具有图像真实性,更符合人眼视觉习惯。

The super-resolution(SR)of high magnification single face image is a hard but valuable task.In the face super-resolution(FSR)task,the end-to-end network SR image is fuzzy,and the photoreality and human visual effect are poor.Aiming at the problems,a FSR algorithm based on multi-task adversarial learning(MTAL)and antinoise adversarial learning(ANAL)is proposed.The algorithm is divided into end-to-end network learning and network parameters fine-tuning.To improve the end-to-end learning result,a deep multi-task Laplacian pyramid network(MTLapNet)is designed and integrated with MTAL.The main task is end-to-end learning,while the subtask is the optimization of adversarial learning penalty function.To improve the result of adversarial learning and parameters fine-tuning of the main task network,ANAL is integrated into the optimization process of discriminator of adversarial learning.The experiments show that the proposed algorithm can make the FSR image more photo-realistic and more consistent with human visual habits.