面向医疗整容的三维人脸重建与编辑系统

3D Face Reconstruction and Editing System for Medical Plastic Surgery

针对医疗整容领域中客户在术前无法直观感受术后整容效果的问题,提出了面向医疗整容领域的三维人脸重建与编辑系统.该系统首先对用户上传的图片进行特征点标记,然后结合三维形变模型(3D morphable model,3DMM)对输入图像进行对齐,接着将处理后的图像输入预先训练好的三维人脸重建网络中,便可得到输入图像所对应的三维人脸模型.系统对此模型进行加载渲染后,用户可以对模型的脸颊、鼻梁和下巴进行编辑以达到模拟整容的效果,之后可对模型进行保存并查看诊断结果.最后,对重建效果、整形效果和诊断结果可靠性进行测试.实验结果表明,该系统对中青年人脸的重建效果好,重建模型与输入图片相似度高;对模型整形后的部位依然保持平滑自然,达到了模拟整容的效果;在给定正确的人脸尺寸后,诊断结果给出的整形建议在毫米级范围内,说明了整形结果具有较高的可靠性.

Given the problem that in the field of medical plastic surgery,customers can not directly grasp the postoperative effect of plastic surgery before the surgery,this study proposes a three-dimensional(3D)face reconstruction and editing system for medical plastic surgery.Specifically,the system marks the feature points of the pictures uploaded by the user,aligns the input images with the 3D morphable model(3DMM),and then inputs the processed images into the pre-trained 3D face reconstruction network to obtain the 3D face model corresponding to the input images.After the system loads and renders this model,the user can edit the cheeks,bridge of the nose,and chin of the model to simulate the plastic surgery,and he/she can also save the model to view the diagnosis results.Finally,the reliability of the reconstruction effect,plastic surgery effect,and diagnosis results are tested.The experimental results show that the system is effective in reconstructing young and middle-aged faces,offering reconstructed models highly similar to the input images.The parts of the model remain smooth and natural after the plastic surgery,which means the effect of simulating the plastic surgery is achieved.After the correct face size is determined,the plastic surgery recommendations suggested by the diagnosis results are at the mm level,indicating that the plastic surgery results are highly reliable.