联合图像通道与像素双注意力机制精细化单幅图像去雪

Dual attention refinement single image desnowing

针对雪天退化图像中不规则和多变的雪花形态,提出一种双注意力机制的精细化图像去雪网络(Dual Attention Refinement Desnowing Network,DARDNet)。网络引入维度拆分处理策略,并行处理通道和像素双维度特征,旨在有效配置两种注意力机制,兼顾提取复杂特征和保护纹理细节。其中,通道注意力机制针对雪花形态构建基础模块,形成U型金字塔结构分层提取深层次特征;像素注意力机制结合卷积形成自校准模块,串联高效Transformer关注图像纹理细节;两种注意力机制并行化处理后进行特征融合,提升信息融合度。在CSD,SRRS和Snow100K三个数据集上进行验证测试,其中在CSD数据集上PSNR达到32.16 dB,SSIM达到0.96。本文方法在处理多种雪花形态方面具有一定优势,能很好地重建纹理细节,获得高质量的去雪图像。

Snow degradation is complex and variable,including various snowflakes,snow spots and snow streaks.To this end,we proposed a dual attention refinement desnowing network(DARDNet).The network introduced a dimensional splitting strategy to handle two-dimensional features of channel and pixel in parallel,aiming to achieve a good trade-off between complex features and texture details.The channel attention mechanism built a module for the multiple degradation and forms a U-shaped pyramid structure to extract the depth features;the pixel attention mechanism combined the convolution to form the self-calibration module,and connected the efficient Transformer to preserve texture details;The parallel processed information streams were fused to improve the reconstruction quality of the image.Experiments were carried out on CSD,SRRS and Snow100K datasets,where PSNR reached 32.56 dB and SSIM reached 0.96 on CSD dataset.The experimental results show that our proposed method has obvious advantages in dealing with various snow degradations,which can better reconstruct the detail information and achieve satisfactory snow removal results.