一种结合自注意力和门控机制的图像超分辨率重建算法

An Image Super-Resolution Reconstruction Algorithm Combining Self-Attention and Gating Mechanism

图像超分辨率重建旨在将低分辨率图像重建为更加清晰的高分辨率图像。超分辨率重建算法有助于提高图像质量,可以尽可能精确地恢复出原始图像缺失的纹理、细节信息,在图像处理领域具有重要的科学意义和应用价值。为了进一步提高图像重建质量,本文将稀疏表示以及深度学习算法相结合,利用稀疏表示模型得到的重构高分辨率图像作为深度学习模型的输入,在VDSR网络的基础上减少卷积层并引入自注意力机制以及门控机制,模型可以在训练过程中动态学习到不同特征的重要性,从而进一步丰富图像的特征。我们在Set5、set14、B100、Urban100等公开的超分重建数据集上进行了大量的实验,结果表明,本文提出的基于自注意力机制和门控机制残差网络图像超分辨率重建算法相较于现有的重建方法,可以获得更好的重建细节以及更高的PSNR/SSIM值。

Image super resolution reconstruction aims to reconstruct a low resolution image into a clearer high-resolution image. The super resolution reconstruction algorithm is helpful to improve the image quality and can recover the missing texture and detail information as accurately as possible. It has important scientific significance and application value in the field of image processing. In order to further improve the quality of image reconstruction, this paper combines the sparse representation and deep learning algorithm. The reconstruction of the sparse representation model is used to get the high resolution image as input of deep learning model, and on the basis of introducing the VDSR network since attention mechanism and gating mechanism, models can be dynamically in the process of training to learn the importance of different characteristics. Thus, the pixel size and characteristics of granularity further enrich the characteristics of the image. We carried out a large number of experiments on the public super-fractional reconstruction data sets, such as Set5, SET14, B100 and Urban100. The results show that the multi-granularity feature extraction reconstruction algorithm proposed in this paper can obtain better reconstruction details and higher PSNR/SSIM values compared with the existing reconstruction methods.