The rotary motion deblurring is an inevitable procedure when the imaging seeker is mounted in the rotating missiles.Traditional rotary motion deblurring methods suffer from ringing artifacts and noise,especially for l...The rotary motion deblurring is an inevitable procedure when the imaging seeker is mounted in the rotating missiles.Traditional rotary motion deblurring methods suffer from ringing artifacts and noise,especially for large blur extents.To solve the above problems,we propose a progressive rotary motion deblurring framework consisting of a coarse deblurring stage and a refinement stage.In the first stage,we design an adaptive blur extents factor(BE factor)to balance noise suppression and details reconstruction.And a novel deconvolution model is proposed based on BE factor.In the second stage,a triplescale deformable module CNN(TDM-CNN)is designed to reduce the ringing artifacts,which can exploit the 2D information of an image and adaptively adjust spatial sampling locations.To establish a standard evaluation benchmark,a real-world rotary motion blur dataset is proposed and released,which includes rotary blurred images and corresponding ground truth images with different blur angles.Experimental results demonstrate that the proposed method outperforms the state-of-the-art models on synthetic and real-world rotary motion blur datasets.The code and dataset are available at https://github.com/JinhuiQin/RotaryDeblurring.展开更多
Background For static scenes with multiple depth layers,existing defocused image deblurring methods have the problems of edge-ringing artifacts or insufficient deblurring owing to inaccurate estimation of the blur amo...Background For static scenes with multiple depth layers,existing defocused image deblurring methods have the problems of edge-ringing artifacts or insufficient deblurring owing to inaccurate estimation of the blur amount,and prior knowledge in nonblind deconvolution is not strong,which leads to image detail recovery challenges.Methods To this end,this study proposes a blur map estimation method for defocused images based on the gradient difference of the boundary neighborhood,which uses the gradient difference of the boundary neighborhood to accurately obtain the amount of blurring,thereby preventing boundary ringing artifacts.The obtained blur map is then used for blur detection to determine whether the image needs to be deblurred,thereby improving the efficiency of deblurring without manual intervention and judgment.Finally,a nonblind deconvolution algorithm was designed to achieve image deblurring based on the blur amount selection strategy and sparse prior.Results Experimental results showed that our method improves PSNR(Peak Signal-to-Noise Ratio)and SSIM(Structural Similarity Index)by an average of 4.6%and 7.3%,respectively,compared to existing methods.Conclusions Experimental results showed that the proposed method outperforms existing methods.Compared to existing methods,our method can better solve the problems of boundary ringing artifacts and detail information preservation in defocused image deblurring.展开更多
Reducing the defocus blur that arises from the finite aperture size and short exposure time is an essential problem in computational photography.It is very challenging because the blur kernel is spatially varying and ...Reducing the defocus blur that arises from the finite aperture size and short exposure time is an essential problem in computational photography.It is very challenging because the blur kernel is spatially varying and difficult to estimate by traditional methods.Due to its great breakthrough in low-level tasks,convolutional neural networks(CNNs)have been introdu-ced to the defocus deblurring problem and achieved significant progress.However,previous methods apply the same learned kernel for different regions of the defocus blurred images,thus it is difficult to handle nonuniform blurred images.To this end,this study designs a novel blur-aware multi-branch network(Ba-MBNet),in which different regions are treated differentially.In particular,we estimate the blur amounts of different regions by the internal geometric constraint of the dual-pixel(DP)data,which measures the defocus disparity between the left and right views.Based on the assumption that different image regions with different blur amounts have different deblurring difficulties,we leverage different networks with different capacities to treat different image regions.Moreover,we introduce a meta-learning defocus mask generation algorithm to assign each pixel to a proper branch.In this way,we can expect to maintain the information of the clear regions well while recovering the missing details of the blurred regions.Both quantitative and qualitative experiments demonstrate that our BaMBNet outperforms the state-of-the-art(SOTA)methods.For the dual-pixel defocus deblurring(DPD)-blur dataset,the proposed BaMBNet achieves 1.20 dB gain over the previous SOTA method in term of peak signal-to-noise ratio(PSNR)and reduces learnable parameters by 85%.The details of the code and dataset are available at https://github.com/junjun-jiang/BaMBNet.展开更多
Online defect visual inspection (ODVI) works while the object has to be static, otherwise the relative motion between camera and object will create motion blur in images. In order to implement ODVI in dynamic scene, i...Online defect visual inspection (ODVI) works while the object has to be static, otherwise the relative motion between camera and object will create motion blur in images. In order to implement ODVI in dynamic scene, it developes one blind motion deblurring method whose objective is to estimate blur kernel parameters precisely. In the proposed method, Radon transform on superpixels determinated the blur angle, and the autocorrelation function based on magnitude (AFM) of the preprocessed blurred image was utilized to identify the blur length. With the projection relationship discussed in this study, it will be unnecessary to rotate the blurred image or the axis. The proposed method is of high accuracy and robustness to noise, and it can somehow handle saturated pixels. To validate the proposed method, experiments have been carried out on synthetic images both in noise free and noisy situations. The results show that the method outperforms existing approaches. With the modified Richardson– Lucy deconvolution, it demonstrates that the proposed method is effective for ODVI in terms of subjective visual quality.展开更多
基金the National Natural Science Foundation of China under Grant 62075169,Grant 62003247,and Grant 62061160370the Hubei Province Key Research and Development Program under Grant 2021BBA235the Zhuhai Basic and Applied Basic Research Foundation under Grant ZH22017003200010PWC.
文摘The rotary motion deblurring is an inevitable procedure when the imaging seeker is mounted in the rotating missiles.Traditional rotary motion deblurring methods suffer from ringing artifacts and noise,especially for large blur extents.To solve the above problems,we propose a progressive rotary motion deblurring framework consisting of a coarse deblurring stage and a refinement stage.In the first stage,we design an adaptive blur extents factor(BE factor)to balance noise suppression and details reconstruction.And a novel deconvolution model is proposed based on BE factor.In the second stage,a triplescale deformable module CNN(TDM-CNN)is designed to reduce the ringing artifacts,which can exploit the 2D information of an image and adaptively adjust spatial sampling locations.To establish a standard evaluation benchmark,a real-world rotary motion blur dataset is proposed and released,which includes rotary blurred images and corresponding ground truth images with different blur angles.Experimental results demonstrate that the proposed method outperforms the state-of-the-art models on synthetic and real-world rotary motion blur datasets.The code and dataset are available at https://github.com/JinhuiQin/RotaryDeblurring.
基金Supported by the National Natural Science Foundation of China (62172190)the“Double Creation”Plan of Jiangsu Province (JSSCRC2021532)the“Taihu Talent-Innovative Leading Talent”Plan of Wuxi City (Certificate Date:202110)。
文摘Background For static scenes with multiple depth layers,existing defocused image deblurring methods have the problems of edge-ringing artifacts or insufficient deblurring owing to inaccurate estimation of the blur amount,and prior knowledge in nonblind deconvolution is not strong,which leads to image detail recovery challenges.Methods To this end,this study proposes a blur map estimation method for defocused images based on the gradient difference of the boundary neighborhood,which uses the gradient difference of the boundary neighborhood to accurately obtain the amount of blurring,thereby preventing boundary ringing artifacts.The obtained blur map is then used for blur detection to determine whether the image needs to be deblurred,thereby improving the efficiency of deblurring without manual intervention and judgment.Finally,a nonblind deconvolution algorithm was designed to achieve image deblurring based on the blur amount selection strategy and sparse prior.Results Experimental results showed that our method improves PSNR(Peak Signal-to-Noise Ratio)and SSIM(Structural Similarity Index)by an average of 4.6%and 7.3%,respectively,compared to existing methods.Conclusions Experimental results showed that the proposed method outperforms existing methods.Compared to existing methods,our method can better solve the problems of boundary ringing artifacts and detail information preservation in defocused image deblurring.
基金supported by the National Natural Science Foundation of China (61971165, 61922027, 61773295)in part by the Fundamental Research Funds for the Central Universities (FRFCU5710050119)+1 种基金the Natural Science Foundation of Heilongjiang Province(YQ2020F004)the Chinese Association for Artificial Intelligence(CAAI)-Huawei Mind Spore Open Fund
文摘Reducing the defocus blur that arises from the finite aperture size and short exposure time is an essential problem in computational photography.It is very challenging because the blur kernel is spatially varying and difficult to estimate by traditional methods.Due to its great breakthrough in low-level tasks,convolutional neural networks(CNNs)have been introdu-ced to the defocus deblurring problem and achieved significant progress.However,previous methods apply the same learned kernel for different regions of the defocus blurred images,thus it is difficult to handle nonuniform blurred images.To this end,this study designs a novel blur-aware multi-branch network(Ba-MBNet),in which different regions are treated differentially.In particular,we estimate the blur amounts of different regions by the internal geometric constraint of the dual-pixel(DP)data,which measures the defocus disparity between the left and right views.Based on the assumption that different image regions with different blur amounts have different deblurring difficulties,we leverage different networks with different capacities to treat different image regions.Moreover,we introduce a meta-learning defocus mask generation algorithm to assign each pixel to a proper branch.In this way,we can expect to maintain the information of the clear regions well while recovering the missing details of the blurred regions.Both quantitative and qualitative experiments demonstrate that our BaMBNet outperforms the state-of-the-art(SOTA)methods.For the dual-pixel defocus deblurring(DPD)-blur dataset,the proposed BaMBNet achieves 1.20 dB gain over the previous SOTA method in term of peak signal-to-noise ratio(PSNR)and reduces learnable parameters by 85%.The details of the code and dataset are available at https://github.com/junjun-jiang/BaMBNet.
文摘Online defect visual inspection (ODVI) works while the object has to be static, otherwise the relative motion between camera and object will create motion blur in images. In order to implement ODVI in dynamic scene, it developes one blind motion deblurring method whose objective is to estimate blur kernel parameters precisely. In the proposed method, Radon transform on superpixels determinated the blur angle, and the autocorrelation function based on magnitude (AFM) of the preprocessed blurred image was utilized to identify the blur length. With the projection relationship discussed in this study, it will be unnecessary to rotate the blurred image or the axis. The proposed method is of high accuracy and robustness to noise, and it can somehow handle saturated pixels. To validate the proposed method, experiments have been carried out on synthetic images both in noise free and noisy situations. The results show that the method outperforms existing approaches. With the modified Richardson– Lucy deconvolution, it demonstrates that the proposed method is effective for ODVI in terms of subjective visual quality.
文摘工业精密制造中,视觉检测设备的成像系统往往景深较小,易产生离焦模糊,严重影响检测效果。针对这一问题,提出了一种针对于均匀离焦图像的盲去模糊网络(Uniform Defocus Blind Deblur Net,UDBD-Net)。首先,提出一种模糊核估计网络,提取离焦模糊的特征,并准确地估计出模糊核;其次,提出一种反卷积网络,通过神经网络学习并估计基于特征维纳反卷积(Feature-based Wiener Deconvolution,FWD)公式中的未知量,更准确地生成去模糊图像的潜在特征;最后,使用一个编解码网络(Encoder-Decoder Net)增强图像的细节,并去除伪影。实验结果表明,该方法在DIV2K和GOPRO图片上的峰值信噪比(Peak Signal to Noise Ratio,PSNR)分别达到31.16 dB和36.16 dB;与目前主流的方法相比,该方法在不显著增加模型推理时间的同时能够复原出更高质量、更自然地去模糊图像。此外,该方法对真实的均匀离焦模糊图像也有较好的去模糊效果,且能够显著提升工业视觉检测算法对于离焦模糊图像的检测效果。
