基于透射率修正和分层优化的夜间图像去雾

Nighttime image dehazing based on transmittance correction and layered optimization

目的大气中颗粒对光线的吸收和散射以及人造光源的影响,导致夜间获取的图像存在雾化、照度低和颜色偏差等问题,但传统的夜间去雾方法常局限于处理特定情况,未能综合考虑夜间图像中的各种影响因素。针对上述问题,提出一种基于透射率补偿与归一化和结构纹理优化的两阶段夜间图像去雾方法。方法首先,提出融合透射率补偿与归一化的修正方法获取透射率图,同时使用二次高斯滤波方法获取大气光图,并根据夜间成像模型实现图像去雾;其次,使用改进的基于Retinex的结构纹理分层模型(structure and texture aware retinex model based on the YUV color space,STAR-YUV)将图像分为结构层和纹理层,对结构层进行照明补偿和颜色校正,对纹理层采用拉普拉斯高斯滤波器以丰富细节信息;最后,采用两阶段融合方法将图像分步融合得到增强后的图像。结果理论分析和实验结果表明,经本文算法处理过的测试集图像,其峰值信噪比(peak signal-to-noise ratio,PSNR)、结构相似性(structural similarity index measure,SSIM)、平均梯度(average gradient,AG)、信息熵(information entropy,IE)和自然图像质量评估器(natural image quality evaluator,NIQE)指标平均值分别达到了17.024 dB、0.765、7.604、7.528和2.693,在对比的传统和深度学习算法中均位于前列,表明本文算法能够很好地实现夜间图像去雾,对细节和图像自然度的恢复也取得了较好结果。结论所提出的方法将透射率修正与结构纹理优化有效结合在一起,对含有整体色偏问题的夜间图像有更好的效果,能够提高场景亮度、校正色偏并丰富细节信息,具有普适性。

Objective Adverse weather conditions,such as the presence of haze,along with the absorption and scattering of light by atmospheric particles,as well as insufficient and colored artificial light sources,pose a series of challenges for nighttime image dehazing.These challenges include hazing,low illumination,and color deviations,resulting in substantial degradation of images obtained by intelligent image capture systems.Consequently,the demand for advanced nighttime image processing technology continues to rise.At present,traditional nighttime dehazing methods are generally tailored for specific situations involving phenomena such as glow or low illuminance without considering various factors found in night‐time images,including low-illumination conditions,color discrepancies,and image blurring.This limitation leads to subpar performance when handling complex nighttime scenes.Meanwhile,most nighttime dehazing methods build upon daytime dehazing techniques as their foundation.However,daytime dehazing methods often overlook the impact of artificial light sources.Consequently,these methods can result in color distortions and insufficient brightness when applied directly to nighttime images.Furthermore,deep learning-based methods for nighttime image dehazing demand a substantial volume of training data and high-performance computing resources to achieve visually pleasing results.However,neglecting the fundamental principles of image formation in hazy conditions results in diminished interpretability of their results.A nighttime image dehazing method based on transmittance correction and layered optimization is presented to address the aforementioned challenge.On the one hand,the atmospheric light function is used to model nighttime scenes,while the nonuniform distribution of nighttime atmospheric light is considered to correct the transmittance.On the other hand,the structure and texture are optimized in layers to solve problems such as color deviation and low illumination.Method First,a novel transmittance correction method is introduced.This method establishes clear initial transmittance maps by setting maximum and minimum boundary values through boundary constraints.Subsequently,compensation and normalization are conducted based on whether the initial transmittance map corresponds to the light source area of the image.This process ensures the relevance and effectiveness of dehazing,resulting in the final transmittance map.Haze is concentrated on the haze line within the RGB color space and can be precisely mapped onto the gray component of the Y channel in the YUV color space.This relationship between the Y channel and haze is leveraged to obtain the final atmospheric light map.This approach is achieved by employing the quadratic Gaussian filtering method,which involves conducting an initial Gaussian filter on the Y channel to extract relevant information and applying a second Gaussian filter to all channels.Afterward,image dehazing is accomplished by utilizing the two resulting maps obtained via the nighttime imaging model.Second,a STAR model based on the YUV color space(STAR-YUV)is introduced.This model decomposes the Y channels,which can reflect the lighting information of each component,into structural and texture layers and enhances the image features accordingly.For structural layers with rich color information,gamma correction is applied for illumination compensation,and MSRCR color correction is used to effectively correct color deviations,obtaining natural color output.For texture layers with rich detail information,Laplacian Gaussian filters are employed to enrich and sharpen complex details while preserving image edges and texture information,resulting in detail enhancement output.Finally,a novel two-stage nighttime image fusion method is introduced to achieve a superior visual result and integrate the previous two steps.In the first stage,a nonlinear fusion approach is employed on the structural and texture layers to preserve structural details and fine features,respectively,based on the principles of the Retinex theory.In the second stage,a linear fusion method is applied to merge the dehazing results with the outcomes of the first stage,thereby leveraging the advantages of dehazing and image enhancement to generate a high-quality and visually appealing final image.Considering the distinctive characteristics of nighttime images and addressing the limitations of existing approaches,this method consolidates the transmittance correction method for transmittance compensation with structural and textural optimization,thereby offering a highly effective solution for enhancing nighttime images.Result Based on theoretical analysis and extensive experiments conducted on two distinct test datasets,the proposed algorithm is shown to achieve dehazing of nighttime images.On the ZS330 test dataset images,the visual quality of the processed images was improved,with the average values of AG,IE,and NIQE indicators reaching 7.836,7.461,and 2.683,respectively.On the HC770 test dataset images,the processed images also exhibited better performance,with PSNR,SSIM,AG,IE,and NIQE indicators reaching 17.024 dB,0.765,7.371,7.595,and 2.702,respectively.Across the entire test dataset,the average PSNR,SSIM,AG,IE,and NIQE indicators reached 17.024 dB,0.765,7.604,7.528,and 2.693,respectively.Compared to traditional and deep learning-based algorithms used in the paper,this approach consistently ranks among the top performers across various indicators.The proposed algorithm displays strong performance in restoring image details,preserving naturalness,and effectively addressing severe color deviations commonly observed in nighttime images.Additionally,the algorithm demonstrates robustness by effectively enhancing images in scenarios with or without artificial light sources.Conclusion This approach combines a novel transmittance correction method with structural and texture layer optimization.Leveraging the strengths of the two methods has resulted in advancements in restoring the clarity of nighttime images,improving lighting conditions,correcting color deviations,and preserving intricate details.