The rotary motion deblurring is an inevitable procedure when the imaging seeker is mounted in the rotating missiles.Traditional rotary motion deblurring methods suffer from ringing artifacts and noise,especially for l...The rotary motion deblurring is an inevitable procedure when the imaging seeker is mounted in the rotating missiles.Traditional rotary motion deblurring methods suffer from ringing artifacts and noise,especially for large blur extents.To solve the above problems,we propose a progressive rotary motion deblurring framework consisting of a coarse deblurring stage and a refinement stage.In the first stage,we design an adaptive blur extents factor(BE factor)to balance noise suppression and details reconstruction.And a novel deconvolution model is proposed based on BE factor.In the second stage,a triplescale deformable module CNN(TDM-CNN)is designed to reduce the ringing artifacts,which can exploit the 2D information of an image and adaptively adjust spatial sampling locations.To establish a standard evaluation benchmark,a real-world rotary motion blur dataset is proposed and released,which includes rotary blurred images and corresponding ground truth images with different blur angles.Experimental results demonstrate that the proposed method outperforms the state-of-the-art models on synthetic and real-world rotary motion blur datasets.The code and dataset are available at https://github.com/JinhuiQin/RotaryDeblurring.展开更多
In imaging on moving target, it is easy to get space- variant blurred image. In order to recover the image and gain recognizable target, an approach to recover the space-variant blurred image is presented based on ima...In imaging on moving target, it is easy to get space- variant blurred image. In order to recover the image and gain recognizable target, an approach to recover the space-variant blurred image is presented based on image segmentation. Be- cause of motion blur's convolution process, the pixels of observed image's target and background will be displaced and piled up to produce two superposition regions. As a result, the neighbor- ing pixels in the superposition regions will have similar grey level change. According to the pixel's motion-blur character, the target's blurred edge of superposition region could be detected. Canny operator can be recurred to detect the target edge which parallels the motion blur direction. Then in the segmentation process, the whole target image which has the character of integral convolution between motion blur and real target image can be obtained. At last, the target image is restored by deconvolution algorithms with adding zeros. The restoration result indicates that the approach can effectively solve the kind of problem of space-variant motion blurred image restoration.展开更多
A novel single-channel blind separation algorithm for permuted motion blurred images is proposed by using blind restoration in this paper. Both the motion direction and the length of the point spread function (PSF) ...A novel single-channel blind separation algorithm for permuted motion blurred images is proposed by using blind restoration in this paper. Both the motion direction and the length of the point spread function (PSF) are estimated by Radon transformation and extrema a detection. Using the estimated blur parameters, the permuted image is restored by performing the L-R blind restoration method. The permutation mixing matrices can be accurately estimated by classifying the ringing effect in the restored image, thereby the source images can be separated. Simulation results show a better separation efficiency for the permuted motion blurred image with various permutation operations. The proposed algorithm indicates a better performance on the robustness against Gaussian noise and lossy JPEG compression.展开更多
In this paper image with horizontal motion blur, vertical motion blur and angled motion blur are considered. We construct several difference schemes to the highly nonlinear term △↓.(△↓u/√|△↓|^2+β) of the ...In this paper image with horizontal motion blur, vertical motion blur and angled motion blur are considered. We construct several difference schemes to the highly nonlinear term △↓.(△↓u/√|△↓|^2+β) of the total variation-based image motion deblurring problem. The large nonlinear system is linearized by fixed point iteration method. An algebraic multigrid method with Krylov subspace acceleration is used to solve the corresponding linear equations as in [7]. The algorithms can restore the image very well. We give some numerical experiments to demonstrate that our difference schemes are efficient and robust.展开更多
The 3D reconstruction using deep learning-based intelligent systems can provide great help for measuring an individual’s height and shape quickly and accurately through 2D motion-blurred images.Generally,during the a...The 3D reconstruction using deep learning-based intelligent systems can provide great help for measuring an individual’s height and shape quickly and accurately through 2D motion-blurred images.Generally,during the acquisition of images in real-time,motion blur,caused by camera shaking or human motion,appears.Deep learning-based intelligent control applied in vision can help us solve the problem.To this end,we propose a 3D reconstruction method for motion-blurred images using deep learning.First,we develop a BF-WGAN algorithm that combines the bilateral filtering(BF)denoising theory with a Wasserstein generative adversarial network(WGAN)to remove motion blur.The bilateral filter denoising algorithm is used to remove the noise and to retain the details of the blurred image.Then,the blurred image and the corresponding sharp image are input into the WGAN.This algorithm distinguishes the motion-blurred image from the corresponding sharp image according to the WGAN loss and perceptual loss functions.Next,we use the deblurred images generated by the BFWGAN algorithm for 3D reconstruction.We propose a threshold optimization random sample consensus(TO-RANSAC)algorithm that can remove the wrong relationship between two views in the 3D reconstructed model relatively accurately.Compared with the traditional RANSAC algorithm,the TO-RANSAC algorithm can adjust the threshold adaptively,which improves the accuracy of the 3D reconstruction results.The experimental results show that our BF-WGAN algorithm has a better deblurring effect and higher efficiency than do other representative algorithms.In addition,the TO-RANSAC algorithm yields a calculation accuracy considerably higher than that of the traditional RANSAC algorithm.展开更多
A novel motion-blur-based method for measuring the angular amplitude of a high-frequency rotational vibration is schemed. The proposed approach combines the active vision concept and the mechanism of motion-from-blur,...A novel motion-blur-based method for measuring the angular amplitude of a high-frequency rotational vibration is schemed. The proposed approach combines the active vision concept and the mechanism of motion-from-blur, generates motion blur on the image plane actively by extending exposure time, and utilizes the motion blur information in polar images to estimate the angular amplitude of a high-frequency rotational vibration. This method obtains the analytical results of the angular vibration amplitude from the geometric moments of a motion blurred polar image and an unblurred image for reference. Experimental results are provided to validate the presented scheme.展开更多
We investigate the influence of blurred ways on pattern recognition of a Barabasi-Albert scale-free Hopfield neural network (SFHN) with a small amount of errors. Pattern recognition is an important function of infor...We investigate the influence of blurred ways on pattern recognition of a Barabasi-Albert scale-free Hopfield neural network (SFHN) with a small amount of errors. Pattern recognition is an important function of information processing in brain. Due to heterogeneous degree of scale-free network, different blurred ways have different influences on pattern recognition with same errors. Simulation shows that among partial recognition, the larger loading ratio (the number of patterns to average degree P/ (k) ) is, the smaller the overlap of SFHN is. The influence of directed (large) way is largest and the directed (small) way is smallest while random way is intermediate between them. Under the ratio of the numbers of stored patterns to the size of the network PIN is less than O. 1 conditions, there are three families curves of the overlap corresponding to directed (small), random and directed (large) blurred ways of patterns and these curves are not associated with the size of network and the number of patterns. This phenomenon only occurs in the SFHN. These conclusions are benefit for understanding the relation between neural network structure and brain function.展开更多
Blur is produced in a digital image due to low passfiltering,moving objects or defocus of the camera lens during capture.Image viewers are annoyed by blur artefact and the image's perceived quality suffers as a re...Blur is produced in a digital image due to low passfiltering,moving objects or defocus of the camera lens during capture.Image viewers are annoyed by blur artefact and the image's perceived quality suffers as a result.The high-quality input is relevant to communication service providers and imaging product makers because it may help them improve their processes.Human-based blur assessment is time-consuming,expensive and must adhere to subjective evaluation standards.This paper presents a revolutionary no-reference blur assessment algorithm based on reblurring blurred images using a special mask developed with a Markov basis and Laplacefilter.Thefinal blur score of blurred images has been calculated from the local variation in horizontal and vertical pixel intensity of blurred and re-blurred images.The objective scores are generated by applying proposed algorithm on the two image databases i.e.,Laboratory for image and video engineering(LIVE)database and Tampere image database(TID 2013).Finally,on the basis of objective and subjective scores performance analysis is done in terms of Pearson linear correlation coefficient(PLCC),Spearman rank-order correlation coefficient(SROCC),Mean absolute error(MAE),Root mean square error(RMSE)and Outliers ratio(OR).The existing no-reference blur assessment algorithms have been used various methods for the evaluation of blur from no-reference image such as Just noticeable blur(JNB),Cumulative Probability Distribution of Blur Detection(CPBD)and Edge Model based Blur Metric(EMBM).The results illustrate that the proposed method was successful in predicting high blur scores with high accuracy as compared to existing no-reference blur assessment algorithms such as JNB,CPBD and EMBM algorithms.展开更多
Background For static scenes with multiple depth layers,existing defocused image deblurring methods have the problems of edge-ringing artifacts or insufficient deblurring owing to inaccurate estimation of the blur amo...Background For static scenes with multiple depth layers,existing defocused image deblurring methods have the problems of edge-ringing artifacts or insufficient deblurring owing to inaccurate estimation of the blur amount,and prior knowledge in nonblind deconvolution is not strong,which leads to image detail recovery challenges.Methods To this end,this study proposes a blur map estimation method for defocused images based on the gradient difference of the boundary neighborhood,which uses the gradient difference of the boundary neighborhood to accurately obtain the amount of blurring,thereby preventing boundary ringing artifacts.The obtained blur map is then used for blur detection to determine whether the image needs to be deblurred,thereby improving the efficiency of deblurring without manual intervention and judgment.Finally,a nonblind deconvolution algorithm was designed to achieve image deblurring based on the blur amount selection strategy and sparse prior.Results Experimental results showed that our method improves PSNR(Peak Signal-to-Noise Ratio)and SSIM(Structural Similarity Index)by an average of 4.6%and 7.3%,respectively,compared to existing methods.Conclusions Experimental results showed that the proposed method outperforms existing methods.Compared to existing methods,our method can better solve the problems of boundary ringing artifacts and detail information preservation in defocused image deblurring.展开更多
In this paper, we will be looking at our efforts to find a novel solution for motion deblurring in videos. In addition, our solution has the requirement of being camera-independent. This means that the solution is ful...In this paper, we will be looking at our efforts to find a novel solution for motion deblurring in videos. In addition, our solution has the requirement of being camera-independent. This means that the solution is fully implemented in software and is not aware of any of the characteristics of the camera. We found a solution by implementing a Convolutional Neural Network-Long Short Term Memory (CNN-LSTM) hybrid model. Our CNN-LSTM is able to deblur video without any knowledge of the camera hardware. This allows it to be implemented on any system that allows the camera to be swapped out with any camera model with any physical characteristics.展开更多
基金the National Natural Science Foundation of China under Grant 62075169,Grant 62003247,and Grant 62061160370the Hubei Province Key Research and Development Program under Grant 2021BBA235the Zhuhai Basic and Applied Basic Research Foundation under Grant ZH22017003200010PWC.
文摘The rotary motion deblurring is an inevitable procedure when the imaging seeker is mounted in the rotating missiles.Traditional rotary motion deblurring methods suffer from ringing artifacts and noise,especially for large blur extents.To solve the above problems,we propose a progressive rotary motion deblurring framework consisting of a coarse deblurring stage and a refinement stage.In the first stage,we design an adaptive blur extents factor(BE factor)to balance noise suppression and details reconstruction.And a novel deconvolution model is proposed based on BE factor.In the second stage,a triplescale deformable module CNN(TDM-CNN)is designed to reduce the ringing artifacts,which can exploit the 2D information of an image and adaptively adjust spatial sampling locations.To establish a standard evaluation benchmark,a real-world rotary motion blur dataset is proposed and released,which includes rotary blurred images and corresponding ground truth images with different blur angles.Experimental results demonstrate that the proposed method outperforms the state-of-the-art models on synthetic and real-world rotary motion blur datasets.The code and dataset are available at https://github.com/JinhuiQin/RotaryDeblurring.
文摘In imaging on moving target, it is easy to get space- variant blurred image. In order to recover the image and gain recognizable target, an approach to recover the space-variant blurred image is presented based on image segmentation. Be- cause of motion blur's convolution process, the pixels of observed image's target and background will be displaced and piled up to produce two superposition regions. As a result, the neighbor- ing pixels in the superposition regions will have similar grey level change. According to the pixel's motion-blur character, the target's blurred edge of superposition region could be detected. Canny operator can be recurred to detect the target edge which parallels the motion blur direction. Then in the segmentation process, the whole target image which has the character of integral convolution between motion blur and real target image can be obtained. At last, the target image is restored by deconvolution algorithms with adding zeros. The restoration result indicates that the approach can effectively solve the kind of problem of space-variant motion blurred image restoration.
基金Project supported by the National Natural Science Foundation of China (Grant No.60872114)the Shanghai Leading Academic Discipline Project (Grant No.S30108)the Graduate Student Innovation Foundation of Shanghai University (Grant No.SHUCX101086)
文摘A novel single-channel blind separation algorithm for permuted motion blurred images is proposed by using blind restoration in this paper. Both the motion direction and the length of the point spread function (PSF) are estimated by Radon transformation and extrema a detection. Using the estimated blur parameters, the permuted image is restored by performing the L-R blind restoration method. The permutation mixing matrices can be accurately estimated by classifying the ringing effect in the restored image, thereby the source images can be separated. Simulation results show a better separation efficiency for the permuted motion blurred image with various permutation operations. The proposed algorithm indicates a better performance on the robustness against Gaussian noise and lossy JPEG compression.
文摘In this paper image with horizontal motion blur, vertical motion blur and angled motion blur are considered. We construct several difference schemes to the highly nonlinear term △↓.(△↓u/√|△↓|^2+β) of the total variation-based image motion deblurring problem. The large nonlinear system is linearized by fixed point iteration method. An algebraic multigrid method with Krylov subspace acceleration is used to solve the corresponding linear equations as in [7]. The algorithms can restore the image very well. We give some numerical experiments to demonstrate that our difference schemes are efficient and robust.
基金the National Natural Science Foundation of China under Grant 61902311in part by the Japan Society for the Promotion of Science(JSPS)Grants-in-Aid for Scientific Research(KAKENHI)under Grant JP18K18044.
文摘The 3D reconstruction using deep learning-based intelligent systems can provide great help for measuring an individual’s height and shape quickly and accurately through 2D motion-blurred images.Generally,during the acquisition of images in real-time,motion blur,caused by camera shaking or human motion,appears.Deep learning-based intelligent control applied in vision can help us solve the problem.To this end,we propose a 3D reconstruction method for motion-blurred images using deep learning.First,we develop a BF-WGAN algorithm that combines the bilateral filtering(BF)denoising theory with a Wasserstein generative adversarial network(WGAN)to remove motion blur.The bilateral filter denoising algorithm is used to remove the noise and to retain the details of the blurred image.Then,the blurred image and the corresponding sharp image are input into the WGAN.This algorithm distinguishes the motion-blurred image from the corresponding sharp image according to the WGAN loss and perceptual loss functions.Next,we use the deblurred images generated by the BFWGAN algorithm for 3D reconstruction.We propose a threshold optimization random sample consensus(TO-RANSAC)algorithm that can remove the wrong relationship between two views in the 3D reconstructed model relatively accurately.Compared with the traditional RANSAC algorithm,the TO-RANSAC algorithm can adjust the threshold adaptively,which improves the accuracy of the 3D reconstruction results.The experimental results show that our BF-WGAN algorithm has a better deblurring effect and higher efficiency than do other representative algorithms.In addition,the TO-RANSAC algorithm yields a calculation accuracy considerably higher than that of the traditional RANSAC algorithm.
基金This project is supported by National Natural Science Foundation of China (No. 50375099, No. 50390064)
文摘A novel motion-blur-based method for measuring the angular amplitude of a high-frequency rotational vibration is schemed. The proposed approach combines the active vision concept and the mechanism of motion-from-blur, generates motion blur on the image plane actively by extending exposure time, and utilizes the motion blur information in polar images to estimate the angular amplitude of a high-frequency rotational vibration. This method obtains the analytical results of the angular vibration amplitude from the geometric moments of a motion blurred polar image and an unblurred image for reference. Experimental results are provided to validate the presented scheme.
基金Supported by "Qing Lan" Talent Engineering Funds by Lanzhou Jiaotong University under Grant No. QL-08-18A
文摘We investigate the influence of blurred ways on pattern recognition of a Barabasi-Albert scale-free Hopfield neural network (SFHN) with a small amount of errors. Pattern recognition is an important function of information processing in brain. Due to heterogeneous degree of scale-free network, different blurred ways have different influences on pattern recognition with same errors. Simulation shows that among partial recognition, the larger loading ratio (the number of patterns to average degree P/ (k) ) is, the smaller the overlap of SFHN is. The influence of directed (large) way is largest and the directed (small) way is smallest while random way is intermediate between them. Under the ratio of the numbers of stored patterns to the size of the network PIN is less than O. 1 conditions, there are three families curves of the overlap corresponding to directed (small), random and directed (large) blurred ways of patterns and these curves are not associated with the size of network and the number of patterns. This phenomenon only occurs in the SFHN. These conclusions are benefit for understanding the relation between neural network structure and brain function.
文摘Blur is produced in a digital image due to low passfiltering,moving objects or defocus of the camera lens during capture.Image viewers are annoyed by blur artefact and the image's perceived quality suffers as a result.The high-quality input is relevant to communication service providers and imaging product makers because it may help them improve their processes.Human-based blur assessment is time-consuming,expensive and must adhere to subjective evaluation standards.This paper presents a revolutionary no-reference blur assessment algorithm based on reblurring blurred images using a special mask developed with a Markov basis and Laplacefilter.Thefinal blur score of blurred images has been calculated from the local variation in horizontal and vertical pixel intensity of blurred and re-blurred images.The objective scores are generated by applying proposed algorithm on the two image databases i.e.,Laboratory for image and video engineering(LIVE)database and Tampere image database(TID 2013).Finally,on the basis of objective and subjective scores performance analysis is done in terms of Pearson linear correlation coefficient(PLCC),Spearman rank-order correlation coefficient(SROCC),Mean absolute error(MAE),Root mean square error(RMSE)and Outliers ratio(OR).The existing no-reference blur assessment algorithms have been used various methods for the evaluation of blur from no-reference image such as Just noticeable blur(JNB),Cumulative Probability Distribution of Blur Detection(CPBD)and Edge Model based Blur Metric(EMBM).The results illustrate that the proposed method was successful in predicting high blur scores with high accuracy as compared to existing no-reference blur assessment algorithms such as JNB,CPBD and EMBM algorithms.
基金Supported by the National Natural Science Foundation of China (62172190)the“Double Creation”Plan of Jiangsu Province (JSSCRC2021532)the“Taihu Talent-Innovative Leading Talent”Plan of Wuxi City (Certificate Date:202110)。
文摘Background For static scenes with multiple depth layers,existing defocused image deblurring methods have the problems of edge-ringing artifacts or insufficient deblurring owing to inaccurate estimation of the blur amount,and prior knowledge in nonblind deconvolution is not strong,which leads to image detail recovery challenges.Methods To this end,this study proposes a blur map estimation method for defocused images based on the gradient difference of the boundary neighborhood,which uses the gradient difference of the boundary neighborhood to accurately obtain the amount of blurring,thereby preventing boundary ringing artifacts.The obtained blur map is then used for blur detection to determine whether the image needs to be deblurred,thereby improving the efficiency of deblurring without manual intervention and judgment.Finally,a nonblind deconvolution algorithm was designed to achieve image deblurring based on the blur amount selection strategy and sparse prior.Results Experimental results showed that our method improves PSNR(Peak Signal-to-Noise Ratio)and SSIM(Structural Similarity Index)by an average of 4.6%and 7.3%,respectively,compared to existing methods.Conclusions Experimental results showed that the proposed method outperforms existing methods.Compared to existing methods,our method can better solve the problems of boundary ringing artifacts and detail information preservation in defocused image deblurring.
文摘In this paper, we will be looking at our efforts to find a novel solution for motion deblurring in videos. In addition, our solution has the requirement of being camera-independent. This means that the solution is fully implemented in software and is not aware of any of the characteristics of the camera. We found a solution by implementing a Convolutional Neural Network-Long Short Term Memory (CNN-LSTM) hybrid model. Our CNN-LSTM is able to deblur video without any knowledge of the camera hardware. This allows it to be implemented on any system that allows the camera to be swapped out with any camera model with any physical characteristics.