基于循环一致性生成对抗网络的盆腔伪CT生成方法

The method of pelvic synthetic CT generation based on the cycle-consistent generative adversarial networks

目的:基于循环一致性生成对抗网络(CycleGAN),利用非配对患者盆腔部位数据,实现MRI和CT图像之间的相互转换,并对基于该模型生成的盆腔伪CT(sCT)进行精度和剂量性能的评估。方法:该CycleGAN网络包含两个生成器和两个判别器。先基于全卷积网络(FCNs)构建两个生成器,一个将2D盆腔MRI转换为2D盆腔sCT图像,另一个将CT图像转换为伪MRI(sMRI)图像。再基于FCNs构建两个判别器,用于对真实图像和生成的伪图像进行判别,提升生成图像的质量。为保证sCT图像与MRI图像的一致性,引入归一化互信息作为相似性约束损失项,对模型进行改进。训练集包括35例患者盆腔部位的T1-MRI图像和另外36例患者盆腔部位的CT图像,测试集包括10例盆腔部位患者的MRI和CT图像,评估方法包括sCT与CT图像的误差和放疗剂量伽马通过率。结果:对于测试集中所有病例,生成的sCT与真实CT图像之间的平均绝对误差(MAE)为35.537(±4.537)HU;基于体素的平均剂量差异最大为0.49%;以3%/3 mm、2%/2 mm和1%/1 mm为标准的平均伽马通过率分别高于99%、98%和95%。结论:使用CycleGAN网络和非配对患者训练数据可以生成准确且符合临床剂量精度要求的盆腔部位sCT图像。

Objective Based on the Cycle-Consistent Generative Adversarial Networks(CycleGAN),pelvic data from unpaired patients are applied to achieve interconversion between MRI images and CT images,and the accuracy and dose performance of synthetic CT(s CT)images generated based on this model are assessed.Methods This Cycle GAN network includes two generators and two discriminators.Based on fully convolutional networks(FCNs),two generators were constructed first.One converted 2D pelvic MRI images to 2D pelvic s CT images,and the other converted CT images to synthetic MRI(s MRI)images.Based on FCNs,two discriminators were then constructed for discriminating real images and generated synthetic images to facilitate the s CT/s MRI quality improvement.To ensure the consistency between s CT images and MRI images,normalized mutual information was applied as a similarity-constraint loss term to improve the model.The training set consists of T1-weighted pelvic MRI images from 35 patients and pelvic CT images from an additional 36 patients,and the test set consists of pelvic MRI images and CT images from10 patients.Assessment methods included errors between sCT images and CT images and the radiation dose gamma pass rates.Results For all the cases in the test set,the mean absolute error(MAE)between the generated s CT images and the true CT images was 35.537(±4.537)HU.The maximum voxel-based mean dose difference was 0.49%.The mean gamma pass rates were above99%,98%and 95%with 3%/3 mm,2%/2 mm,and 1%/1 mm criteria,respectively.Conclusion Accurate pelvic s CT images can be generated by using CycleGAN network and unpaired training data from different patients,and the dose accuracy calculated based on the sCT images meets the clinical requirements.