融合感知损失的深度学习在常规MR图像转换的研究

Application of deep learning with perceptual loss in conventional MR image translation

目的:研究在完全无监督的条件下深度神经网络实现常规磁共振图像间相互转换的可行性。方法:在循环生成式对抗网络(CycleGAN)中引入感知损失,使网络利用对抗损失学习图像结构信息的同时,结合循环一致性损失和感知损失生成高质量的磁共振图像,并将生成图像与CycleGAN模型以及有监督的CycleGAN模型(S_CycleGAN)生成的图像进行定量比较。结果:引入感知损失后的网络生成的图像定量评估值均高于CycleGAN模型生成的图像,生成的T1加权图像(T1WI)的定量评估值也均高于S_CycleGAN模型生成的T1WI,生成的T2加权图像(T2WI)与S_CycleGAN模型生成的T2WI的定量评估值相似。结论:在CycleGAN中引入感知损失,可以在完全无监督的条件下生成高质量的磁共振图像,进而实现高质量的常规磁共振图像的相互转换。

Objective To research the feasibility of using deep neural networks to achieve image-to-image translation on conventional magnetic resonance(MR)images in a completely unsupervised way.Methods Perception loss was introduced into cycle generative adversarial network(CycleGAN),so that the proposed network could use the adversarial loss to learn image structure information,and combine cycle consistency loss with perceptual loss to generate high-quality MR image.The generated image was compared quantitatively with those generated by CycleGAN model and supervised CycleGAN model(S_CycleGAN).Results The quantitative evaluation showed that the proposed network with the introduction of perceptual loss was superior to CycleGAN model on imaging,and that the evaluation result of the T1-weighted image generated by the proposed network was also better than that of the image generated by S_CycleGAN model.However,the evaluation results of the T2-weighted images generated by the proposed network and S_CycleGAN model were similar.Conclusion The introduction of perceptual loss to CycleGAN can generate high-quality MR images in a completely unsupervised way,and then realize image-to-image translation on high-quality conventional MR images.