基于动态卷积的多模态脑MR图像生成

Multi-modality Brain MR Images Synthesis Based on Dynamic Convolution

近年来,通过自动生成方法获取多模态MR图像得到了广泛研究,但仍难以通过一种模态直接生成其他各类模态的图像.针对该问题,本文提出了动态生成对抗网络.新模型通过将生成对抗网络与动态卷积相结合,同时加入任务标签这一条件,实现从一种MR模态同时生成其他3种MR模态.同时为了提高图像生成质量,进一步提出了多尺度判别策略,通过融合多个尺度来提升判别效果.基于BRATS19数据集进行生成验证,实验结果表明,新方法不但可以同时生成多种模态的数据,而且提高了生成图像的质量.

In recent years,obtaining multi-modality magnetic resonance(MR)images with automatic generation methods has been widely studied.However,it is still difficult to generate images of all the other modalities by one given modality.To solve this problem,this study proposes a dynamic generative adversarial network(DyGAN)model.By combining the generative adversarial network and dynamic convolution and introducing a task label,the new model can simultaneously generate other three MR modalities from one modality.In addition,a multi-scale discrimination strategy is further proposed to improve the quality of image generation by fusing multiple scales.Image generation is verified on the BRATS19 dataset.The experimental results show that the new method can not only simultaneously generate multimodality images but also improve the quality of the generated images.