四通道无监督学习图像去雾网络

Four-path unsupervised learning-based image defogging network

为了解决单幅图像去雾领域有监督网络和无监督网络分别存在的问题,基于循环生成对抗网络(CycleGAN),提出了一种四通道无监督学习图像去雾网络。所提模型主要包括3个子网络,即去雾网络、合成雾网络和注意力特征融合网络;并由此3个子网络顺序组合构建了4条学习通道,即去雾通道、去雾结果颜色-纹理恢复通道、合成雾通道以及合成雾结果颜色-纹理恢复通道。特别地,在合成雾网络中,为了更好地约束去雾网络生成更高质量的无雾图像,引入了大气散射模型(ASM)以加强网络从有雾图像域到无雾图像域的映射转换;同时,为了进一步提高去雾网络和合成雾网络的图像生成质量,提出了一种注意力特征融合网络,该网络基于雾相关派生图,采用多路映射结构和注意力机制,加强对生成图像颜色、纹理细节等信息的恢复。在合成雾和真实雾图数据集上的大量实验结果表明,所提方法能更好地恢复各类场景中雾图的颜色和纹理细节等信息。

To solve the problems of supervised network and unsupervised network in the field of single image defogging,a four-path unsupervised learning-based image defogging network based on cycle generative adversarial network(CycleGAN)was proposed,which mainly included three sub-networks:defogging network,synthetic fog network and attention feature fusion network.The three sub-networks were sequentially combined to construct four learning paths,which were the defogging path,the color-texture recovery path for defogged result,the synthetic fog path,and the color-texture recovery path for synthetic fog result.Specifically,in the synthetic fog network,to better constrain the defogging network to generate higher quality fogfree images,the atmospheric scattering model(ASM)was introduced to enhance the mapping transformation of the network from the foggy image domain to the fogfree image domain.Furthermore,to further improve the image generation quality of the defogging network and the synthetic fog network,an attention feature fusion network was proposed.The proposed network was based on several fog-derived images,which adopts a multi-channel mapping structure and an attention mechanism to enhance the recovery of color and texture details.Extensive experiments on both synthetic and real-world datasets show that the proposed method can better restore the color and texture details information of foggy images in various scenes.