基于风格注意力的壁画图像色彩还原

Color restoration of mural image based on style attention

针对褪变色壁画图像色彩还原过程中容易出现伪影、色彩混叠、边缘细节保持效果不佳等问题,提出了一种基于风格注意力的壁画图像色彩还原方法.该方法通过构建基于风格注意力的色彩迁移模块建立参考壁画图像与褪化壁画图像特征间的语义映射关系,使用参考壁画图像的色彩信息对褪化壁画图像进行色彩还原;同时,为了更有效地保留褪化壁画图像的结构纹理细节信息,构建基于自注意力的细节保持模块建立褪化图像与还原结果低层特征的全局依赖关系,以减少感受野限制及噪声影响在还原图像中产生的伪影和假色现象.实验分析表明:提出的方法在壁画褪化区域色彩还原和结构纹理细节保持等方面具有较好的表现.

Aiming at the problems of artifacts,color aliasing,and poor edge detail retention that are easy to occur in the process of color restoration of faded mural images,a method of mural image color restoration based on style attention was proposed.The semantic mapping relationship between the features of the reference mural image and the faded mural image was established by constructing a color migration module based on style attention.The faded mural image was then restored using the reference mural's color information.Besides,in order to retain the structural texture details of the faded mural image more effectively,a detail preserving module based on self-attention was built to establish the global dependence of the low level features between the faded image and the restored image,so as to reduce the artifacts and false color phenomena caused by the receptive field limitation and noise influence in the restored image.The experimental results show that the proposed method performs well in the overall color restoration and structural texture detail preservation of the fading areas of mural images.