A progressive framework for rotary motion deblurring

The rotary motion deblurring is an inevitable procedure when the imaging seeker is mounted in the rotating missiles.Traditional rotary motion deblurring methods suffer from ringing artifacts and noise,especially for large blur extents.To solve the above problems,we propose a progressive rotary motion deblurring framework consisting of a coarse deblurring stage and a refinement stage.In the first stage,we design an adaptive blur extents factor(BE factor)to balance noise suppression and details reconstruction.And a novel deconvolution model is proposed based on BE factor.In the second stage,a triplescale deformable module CNN(TDM-CNN)is designed to reduce the ringing artifacts,which can exploit the 2D information of an image and adaptively adjust spatial sampling locations.To establish a standard evaluation benchmark,a real-world rotary motion blur dataset is proposed and released,which includes rotary blurred images and corresponding ground truth images with different blur angles.Experimental results demonstrate that the proposed method outperforms the state-of-the-art models on synthetic and real-world rotary motion blur datasets.The code and dataset are available at https://github.com/JinhuiQin/RotaryDeblurring.

MIDNet:Deblurring Network for Material Microstructure Images

Scanning electron microscopy(SEM)is a crucial tool in the field of materials science,providing valuable insightsinto the microstructural characteristics of materials.Unfortunately,SEM images often suffer from blurrinesscaused by improper hardware calibration or imaging automation errors,which present challenges in analyzingand interpretingmaterial characteristics.Consequently,rectifying the blurring of these images assumes paramountsignificance to enable subsequent analysis.To address this issue,we introduce a Material Images DeblurringNetwork(MIDNet)built upon the foundation of the Nonlinear Activation Free Network(NAFNet).MIDNetis meticulously tailored to address the blurring in images capturing the microstructure of materials.The keycontributions include enhancing the NAFNet architecture for better feature extraction and representation,integratinga novel soft attention mechanism to uncover important correlations between encoder and decoder,andintroducing newmulti-loss functions to improve training effectiveness and overallmodel performance.We conducta comprehensive set of experiments utilizing the material blurry dataset and compare them to several state-of-theartdeblurring methods.The experimental results demonstrate the applicability and effectiveness of MIDNet in thedomain of deblurring material microstructure images,with a PSNR(Peak Signal-to-Noise Ratio)reaching 35.26 dBand an SSIM(Structural Similarity)of 0.946.Our dataset is available at:https://github.com/woshigui/MIDNet.

Deblurring,artifact-free optical coherence tomography with deconvolution-random phase modulation

Deconvolution is a commonly employed technique for enhancing image quality in optical imaging methods.Unfortu-nately,its application in optical coherence tomography(OCT)is often hindered by sensitivity to noise,which leads to ad-ditive ringing artifacts.These artifacts considerably degrade the quality of deconvolved images,thereby limiting its effect-iveness in OCT imaging.In this study,we propose a framework that integrates numerical random phase masks into the deconvolution process,effectively eliminating these artifacts and enhancing image clarity.The optimized joint operation of an iterative Richardson-Lucy deconvolution and numerical synthesis of random phase masks(RPM),termed as De-conv-RPM,enables a 2.5-fold reduction in full width at half-maximum(FWHM).We demonstrate that the Deconv-RPM method significantly enhances image clarity,allowing for the discernment of previously unresolved cellular-level details in nonkeratinized epithelial cells ex vivo and moving blood cells in vivo.

Image defocus deblurring method based on gradient difference of boundary neighborhood

Background For static scenes with multiple depth layers,existing defocused image deblurring methods have the problems of edge-ringing artifacts or insufficient deblurring owing to inaccurate estimation of the blur amount,and prior knowledge in nonblind deconvolution is not strong,which leads to image detail recovery challenges.Methods To this end,this study proposes a blur map estimation method for defocused images based on the gradient difference of the boundary neighborhood,which uses the gradient difference of the boundary neighborhood to accurately obtain the amount of blurring,thereby preventing boundary ringing artifacts.The obtained blur map is then used for blur detection to determine whether the image needs to be deblurred,thereby improving the efficiency of deblurring without manual intervention and judgment.Finally,a nonblind deconvolution algorithm was designed to achieve image deblurring based on the blur amount selection strategy and sparse prior.Results Experimental results showed that our method improves PSNR(Peak Signal-to-Noise Ratio)and SSIM(Structural Similarity Index)by an average of 4.6%and 7.3%,respectively,compared to existing methods.Conclusions Experimental results showed that the proposed method outperforms existing methods.Compared to existing methods,our method can better solve the problems of boundary ringing artifacts and detail information preservation in defocused image deblurring.

基于DeblurGAN的运动图像去模糊方法分析

阐述DeblurGAN盲运动模糊移动方法,对运动图像进行去模糊化处理。试验结果表明,与bur影像相比,通过运用DeblurGAN,可以确保运动图像清晰度得以显著提升,同时,还能实现对图像细节纹理的清晰显示。

基于DeblurGAN对运动图像的去模糊化研究

在实际生产与生活中,拍摄设备与成像物体之间经常会出现难以保持相对静止的状态,故拍摄出来的图像易出现运动模糊现象。针对该问题,基于DeblurGAN对运动模糊图像进行去模糊化处理。实验结果表明,该模型可以有效去除运动图像中的模糊,同时对比传统算法,该算法不仅能使获得的图像更清晰,同时还能增加图像中的纹理和细节。

BaMBNet:A Blur-Aware Multi-Branch Network for Dual-Pixel Defocus Deblurring

Reducing the defocus blur that arises from the finite aperture size and short exposure time is an essential problem in computational photography.It is very challenging because the blur kernel is spatially varying and difficult to estimate by traditional methods.Due to its great breakthrough in low-level tasks,convolutional neural networks(CNNs)have been introdu-ced to the defocus deblurring problem and achieved significant progress.However,previous methods apply the same learned kernel for different regions of the defocus blurred images,thus it is difficult to handle nonuniform blurred images.To this end,this study designs a novel blur-aware multi-branch network(Ba-MBNet),in which different regions are treated differentially.In particular,we estimate the blur amounts of different regions by the internal geometric constraint of the dual-pixel(DP)data,which measures the defocus disparity between the left and right views.Based on the assumption that different image regions with different blur amounts have different deblurring difficulties,we leverage different networks with different capacities to treat different image regions.Moreover,we introduce a meta-learning defocus mask generation algorithm to assign each pixel to a proper branch.In this way,we can expect to maintain the information of the clear regions well while recovering the missing details of the blurred regions.Both quantitative and qualitative experiments demonstrate that our BaMBNet outperforms the state-of-the-art(SOTA)methods.For the dual-pixel defocus deblurring(DPD)-blur dataset,the proposed BaMBNet achieves 1.20 dB gain over the previous SOTA method in term of peak signal-to-noise ratio(PSNR)and reduces learnable parameters by 85%.The details of the code and dataset are available at https://github.com/junjun-jiang/BaMBNet.

基于DeblurGAN和低秩分解的去运动模糊

为研究出一种快速且有效的图像去模糊方法,基于DeblurGAN提出一种利用条件生成对抗网络实现的端到端图像去运动模糊方法。该方法将DeblurGAN的标准卷积层改成瓶颈结构,并对瓶颈结构中的卷积进行低秩分解,且添加两个残差对称跳跃连接,以加速网络收敛。为解决DeblurGAN复原图像不够清晰这个问题,向网络损失函数添加互信息损失和梯度图像L1损失,通过最大化输入图像和其隐含特征间的互信息,使所提取的隐含特征能很好地表征输入信息,从而利用隐含特征还原出清晰图像,而L1损失有利于使复原图像的边缘更明显。同时,通过实验对该方法的有效性进行了验证,并与其他已有的同类算法进行了比较。结果表明:相比DeblurGAN,文中方法峰值信噪比更高,两者的结构相似性指标相当,且文中模型参数量压缩至DeblurGAN的3.25%,去模糊速度提高3倍,模型性能优于已有的其他同类算法。

基于DeblurGAN的文本图像去模糊算法

为了去除文本图像的模糊,对比了几种常用的去模糊算法后,使用效果更加优秀的DeblurGAN生成对抗网络算法对模糊文本图像去模糊,并对原算法进行了多处改进以满足文本图像去模糊的要求.实验表明改进后的DeblurGAN的去模糊效果有明显提升.

On weak solutions for an image denoising-deblurring model

A new denoising-deblurring model in image restoration is proposed,in which the regularization term carries out anisotropic diffusion on the edges and isotropic diffusion on the regular regions.The existence and uniqueness of weak solutions for this model are proved,and the numerical model is also testified.Compared with the TV diffusion,this model preferably reduces the staircase appearing in the restored images.

Remote Sensing Image Deblurring Based on Grid Computation

In general, there is a demand for real-time processing of mass quantity remote sensing images. However, the task is not only data-intensive but also computating-intensive. Distributed processing is a hot topic in remote sensing processing and image deblurring is also one of the most important needs. In order to satisfy the demand for quick proc- essing and deblurring of mass quantity satellite images, we developed a distributed, grid computation-based platform as well as a corresponding middleware for grid computation. Both a constrained power spectrum equalization algorithm and effective block processing measures, which can avoid boundary effect, were applied during the processing. The re- sult is satisfactory since computation efficiency and visual effect were greatly improved. It can be concluded that the technology of spatial information grids is effective for mass quantity remote sensing image processing.

Image Motion Deblurring Based on Salient Structure Selection and L0-2 Norm Kernel Estimation

Single image motion deblurring has been a very challenging problem in the field of image processing. Although there are many researches had been proposed to solve this problem, it still has problems on kernel accuracy. In order to improve the kernel accuracy, an effective structure selection method was used to select the salient structure of the blur image. Then a novel kernel estimation method based on L0-2 norm was proposed. To guarantee the sparse kernel and eliminate the negative influence of details L0-norm was used. And L2-norm was used to ensure the continuity of kernel. Many experiments were done to compare proposed method and state-of-the-art methods. The results show that our method can estimate a better kernel and use less time than previous work, especially when the size of blur kernel is large.

Deblurring Texture Extraction from Digital Aerial Image by Reforming “Steep Edge” Curve

Texture extract from digital aerial image is widely used in three-dimensional city modeling to generate “photo-realistic” views. In this paper, a method based on reforming “Steep edge” curve, which clearly explains how the diffraction of the sunlight makes digital aerial image blurring, is proposed to deblur the texture extraction from digital aerial image, and the experiment shows a good result in visualization and automation.

基于改进的DeblurGAN的指针式仪表图像去模糊方法研究

针对指针式仪表图像的聚焦模糊问题,提出使用基于改进的DeblurGAN网络的图像去模糊处理方法。由于原始网络输入输出大小均为256×256,修复的图像分辨率相对较低,本文将网络作出相应调整,使其输入输出大小更改为512×512,并采集制作了模糊数据集,实验结果表明修复的图像质量得到了很大的提升。

基于零次学习SelfDeblur机器视觉动态检测图像去模糊方法

机器视觉动态检测容易生成模糊图像,研究图像去模糊方法是提高机器视觉检测性能重要手段。端到端图像去模糊方法受庞大数据集以及成对输入要求的制约,SelfDeblur则通过零次学习降低数据集要求,可用于机器视觉动态检测。根据机器视觉动态检测特定应用场景,将SeDeblur应用于非盲去模糊,并改进其损失函数、网络结构以及训练优化方法,实现数据集低要求的端到端图像去模糊。试验表明所述方法图像去模糊质量优于现有方法,无参考指标平均提高34.45%。

Blind Deblurring Based on L_0 Norm from Salient Edges

Motion deblurring is a basic problem in the field of image processing and analysis. This paper proposes a new method of single image blind deblurring which can be significant to kernel estimation and non-blind deconvolution. Experiments show that the details of the image destroy the structure of the kernel, especially when the blur kernel is large. So we extract the image structure with salient edges by the method based on RTV. In addition, the traditional method for motion blur kernel estimation based on sparse priors is conducive to gain a sparse blur kernel. But these priors do not ensure the continuity of blur kernel and sometimes induce noisy estimated results. Therefore we propose the kernel refinement method based on L0 to overcome the above shortcomings. In terms of non-blind deconvolution we adopt the L1/L2 regularization term. Compared with the traditional method, the method based on L1/L2 norm has better adaptability to image structure, and the constructed energy functional can better describe the sharp image. For this model, an effective algorithm is presented based on alternating minimization algorithm.

Blind Motion Deblurring for Online Defect Visual Inspection

Online defect visual inspection (ODVI) works while the object has to be static, otherwise the relative motion between camera and object will create motion blur in images. In order to implement ODVI in dynamic scene, it developes one blind motion deblurring method whose objective is to estimate blur kernel parameters precisely. In the proposed method, Radon transform on superpixels determinated the blur angle, and the autocorrelation function based on magnitude (AFM) of the preprocessed blurred image was utilized to identify the blur length. With the projection relationship discussed in this study, it will be unnecessary to rotate the blurred image or the axis. The proposed method is of high accuracy and robustness to noise, and it can somehow handle saturated pixels. To validate the proposed method, experiments have been carried out on synthetic images both in noise free and noisy situations. The results show that the method outperforms existing approaches. With the modified Richardson– Lucy deconvolution, it demonstrates that the proposed method is effective for ODVI in terms of subjective visual quality.

基于Ghost-SK-DeblurGAN的钢筋套丝头图像去模糊算法

针对视觉测量钢筋套丝头尺寸方法中,由于振动导致采集到的图片存在运动模糊而影响测量结果的问题,提出了一种轻量化的带有注意力机制的基于DeblurGAN-v2的去模糊算法Ghost-SK-DeblurGAN,算法采用GhostNet轻量化模块作为特征提取网络,引入注意力模块SKNet,对生成器损失函数进行修改。采集了不同规格的清晰钢筋套丝头图像,对采集到的清晰图像施加运动模糊处理,得到模糊图像,构建模糊数据集BRT。实验结果表明,与其他基于DeblurGAN-v2的去模糊算法相比,该算法能够兼顾去模糊效果和实时性。

A survey on facial image deblurring

When a facial image is blurred,it significantly affects high-level vision tasks such as face recognition.The purpose of facial image deblurring is to recover a clear image from a blurry input image,which can improve the recognition accuracy,etc.However,general deblurring methods do not perform well on facial images.Therefore,some face deblurring methods have been proposed to improve performance by adding semantic or structural information as specific priors according to the characteristics of the facial images.In this paper,we survey and summarize recently published methods for facial image deblurring,most of which are based on deep learning.First,we provide a brief introduction to the modeling of image blurring.Next,we summarize face deblurring methods into two categories:model-based methods and deep learning-based methods.Furthermore,we summarize the datasets,loss functions,and performance evaluation metrics commonly used in the neural network training process.We show the performance of classical methods on these datasets and metrics and provide a brief discussion on the differences between model-based and learning-based methods.Finally,we discuss the current challenges and possible future research directions.

Non-Blind Image Deblurring via Shear Total Variation Norm

In this paper, we propose a novel shear gradient operator by combining the shear and gradient operators. The shear gradient operator performs well to capture diverse directional information in the image gradient domain. Based on the shear gradient operator, we extend the total variation(TV) norm to the shear total variation(STV) norm by adding two shear gradient terms. Subsequently, we introduce a shear total variation deblurring model. Experimental results are provided to validate the ability of the STV norm to capture the detailed information. Leveraging the Block Circulant with Circulant Blocks(BCCB) structure of the shear gradient matrices, the alternating direction method of multipliers(ADMM) algorithm can be used to solve the proposed model efficiently. Numerous experiments are presented to verify the performance of our algorithm for non-blind image deblurring.