The rotary motion deblurring is an inevitable procedure when the imaging seeker is mounted in the rotating missiles.Traditional rotary motion deblurring methods suffer from ringing artifacts and noise,especially for l...The rotary motion deblurring is an inevitable procedure when the imaging seeker is mounted in the rotating missiles.Traditional rotary motion deblurring methods suffer from ringing artifacts and noise,especially for large blur extents.To solve the above problems,we propose a progressive rotary motion deblurring framework consisting of a coarse deblurring stage and a refinement stage.In the first stage,we design an adaptive blur extents factor(BE factor)to balance noise suppression and details reconstruction.And a novel deconvolution model is proposed based on BE factor.In the second stage,a triplescale deformable module CNN(TDM-CNN)is designed to reduce the ringing artifacts,which can exploit the 2D information of an image and adaptively adjust spatial sampling locations.To establish a standard evaluation benchmark,a real-world rotary motion blur dataset is proposed and released,which includes rotary blurred images and corresponding ground truth images with different blur angles.Experimental results demonstrate that the proposed method outperforms the state-of-the-art models on synthetic and real-world rotary motion blur datasets.The code and dataset are available at https://github.com/JinhuiQin/RotaryDeblurring.展开更多
In this paper, we will be looking at our efforts to find a novel solution for motion deblurring in videos. In addition, our solution has the requirement of being camera-independent. This means that the solution is ful...In this paper, we will be looking at our efforts to find a novel solution for motion deblurring in videos. In addition, our solution has the requirement of being camera-independent. This means that the solution is fully implemented in software and is not aware of any of the characteristics of the camera. We found a solution by implementing a Convolutional Neural Network-Long Short Term Memory (CNN-LSTM) hybrid model. Our CNN-LSTM is able to deblur video without any knowledge of the camera hardware. This allows it to be implemented on any system that allows the camera to be swapped out with any camera model with any physical characteristics.展开更多
The degraded parameters recognition is very important for the restoration of blurred images. There are two common types of blurs for most camera systems. One is the defocus blur due to the optical system's defocus...The degraded parameters recognition is very important for the restoration of blurred images. There are two common types of blurs for most camera systems. One is the defocus blur due to the optical system's defocus phenomenon and the other is the motion blur due to the relative movement between the objectives and the camera. Compared with the recognition for the blurred image with only one blur model, the parameter estimation for the picture combining defocus and motion blur models is a more complicated mission. A method was proposed for computer to estimate the parameters of defocus blur and motion blur in cepstrum area simultaneously. According to characters of both blur models in the frequency domain, an adjustment approach was suggested in the frequency area and then convert to the cepstrum field to increase the accuracy of measurement.展开更多
A novel single-channel blind separation algorithm for permuted motion blurred images is proposed by using blind restoration in this paper. Both the motion direction and the length of the point spread function (PSF) ...A novel single-channel blind separation algorithm for permuted motion blurred images is proposed by using blind restoration in this paper. Both the motion direction and the length of the point spread function (PSF) are estimated by Radon transformation and extrema a detection. Using the estimated blur parameters, the permuted image is restored by performing the L-R blind restoration method. The permutation mixing matrices can be accurately estimated by classifying the ringing effect in the restored image, thereby the source images can be separated. Simulation results show a better separation efficiency for the permuted motion blurred image with various permutation operations. The proposed algorithm indicates a better performance on the robustness against Gaussian noise and lossy JPEG compression.展开更多
The 3D reconstruction using deep learning-based intelligent systems can provide great help for measuring an individual’s height and shape quickly and accurately through 2D motion-blurred images.Generally,during the a...The 3D reconstruction using deep learning-based intelligent systems can provide great help for measuring an individual’s height and shape quickly and accurately through 2D motion-blurred images.Generally,during the acquisition of images in real-time,motion blur,caused by camera shaking or human motion,appears.Deep learning-based intelligent control applied in vision can help us solve the problem.To this end,we propose a 3D reconstruction method for motion-blurred images using deep learning.First,we develop a BF-WGAN algorithm that combines the bilateral filtering(BF)denoising theory with a Wasserstein generative adversarial network(WGAN)to remove motion blur.The bilateral filter denoising algorithm is used to remove the noise and to retain the details of the blurred image.Then,the blurred image and the corresponding sharp image are input into the WGAN.This algorithm distinguishes the motion-blurred image from the corresponding sharp image according to the WGAN loss and perceptual loss functions.Next,we use the deblurred images generated by the BFWGAN algorithm for 3D reconstruction.We propose a threshold optimization random sample consensus(TO-RANSAC)algorithm that can remove the wrong relationship between two views in the 3D reconstructed model relatively accurately.Compared with the traditional RANSAC algorithm,the TO-RANSAC algorithm can adjust the threshold adaptively,which improves the accuracy of the 3D reconstruction results.The experimental results show that our BF-WGAN algorithm has a better deblurring effect and higher efficiency than do other representative algorithms.In addition,the TO-RANSAC algorithm yields a calculation accuracy considerably higher than that of the traditional RANSAC algorithm.展开更多
In this paper image with horizontal motion blur, vertical motion blur and angled motion blur are considered. We construct several difference schemes to the highly nonlinear term △↓.(△↓u/√|△↓|^2+β) of the ...In this paper image with horizontal motion blur, vertical motion blur and angled motion blur are considered. We construct several difference schemes to the highly nonlinear term △↓.(△↓u/√|△↓|^2+β) of the total variation-based image motion deblurring problem. The large nonlinear system is linearized by fixed point iteration method. An algebraic multigrid method with Krylov subspace acceleration is used to solve the corresponding linear equations as in [7]. The algorithms can restore the image very well. We give some numerical experiments to demonstrate that our difference schemes are efficient and robust.展开更多
In imaging on moving target, it is easy to get space- variant blurred image. In order to recover the image and gain recognizable target, an approach to recover the space-variant blurred image is presented based on ima...In imaging on moving target, it is easy to get space- variant blurred image. In order to recover the image and gain recognizable target, an approach to recover the space-variant blurred image is presented based on image segmentation. Be- cause of motion blur's convolution process, the pixels of observed image's target and background will be displaced and piled up to produce two superposition regions. As a result, the neighbor- ing pixels in the superposition regions will have similar grey level change. According to the pixel's motion-blur character, the target's blurred edge of superposition region could be detected. Canny operator can be recurred to detect the target edge which parallels the motion blur direction. Then in the segmentation process, the whole target image which has the character of integral convolution between motion blur and real target image can be obtained. At last, the target image is restored by deconvolution algorithms with adding zeros. The restoration result indicates that the approach can effectively solve the kind of problem of space-variant motion blurred image restoration.展开更多
Online defect visual inspection (ODVI) works while the object has to be static, otherwise the relative motion between camera and object will create motion blur in images. In order to implement ODVI in dynamic scene, i...Online defect visual inspection (ODVI) works while the object has to be static, otherwise the relative motion between camera and object will create motion blur in images. In order to implement ODVI in dynamic scene, it developes one blind motion deblurring method whose objective is to estimate blur kernel parameters precisely. In the proposed method, Radon transform on superpixels determinated the blur angle, and the autocorrelation function based on magnitude (AFM) of the preprocessed blurred image was utilized to identify the blur length. With the projection relationship discussed in this study, it will be unnecessary to rotate the blurred image or the axis. The proposed method is of high accuracy and robustness to noise, and it can somehow handle saturated pixels. To validate the proposed method, experiments have been carried out on synthetic images both in noise free and noisy situations. The results show that the method outperforms existing approaches. With the modified Richardson– Lucy deconvolution, it demonstrates that the proposed method is effective for ODVI in terms of subjective visual quality.展开更多
针对车载视频图像中同时包含局部运动模糊和全局运动模糊,现有去模糊算法难以适用且效果差等问题,提出一种基于再模糊理论的复杂车载模糊图像复原方法。根据车载视频图像的特点把图像分割为车身和非车身区域,采用改进后的模糊参数估计算...针对车载视频图像中同时包含局部运动模糊和全局运动模糊,现有去模糊算法难以适用且效果差等问题,提出一种基于再模糊理论的复杂车载模糊图像复原方法。根据车载视频图像的特点把图像分割为车身和非车身区域,采用改进后的模糊参数估计算法,在车身区域图像块估算出的全局运动模糊参数,对整幅图像进行全局模糊恢复;对复原前后的非车身图像进行分块处理,利用复原前后图像块结构相似度(Structural Similarity,SSIM)和局部均方差的差异性,检测和提取出局部模糊区域;对提取的模糊区域进行复原后与清晰区域拼接融合,合成清晰的图像。与现有算法对比实验分析,所提算法取得了不错的效果,且复原后图像的峰值信噪比(Peak Signal to Noise Ratio,PSNR)和SSIM表现良好。展开更多
A simulation method is proposed to predict the motion artifacts of plasma display panels (PDPs). The method simulates the behavior of the human vision system when perceiving moving objects. The simulation is based o...A simulation method is proposed to predict the motion artifacts of plasma display panels (PDPs). The method simulates the behavior of the human vision system when perceiving moving objects. The simulation is based on the measured temporal light properties of the display for each gray level and each phosphor. Both the effect of subfield arrangement and phosphor decay are involved. A novel algorithm is proposed to improve the calculation speed. The simulation model manages to predict the appearance of the motion image perceived by a human with a still image. The results are validated by a set of perceptual evaluation experiments. This rapid and accurate prediction of motion artifacts enables objective characterization of the PDP performance in this aspect.展开更多
基金the National Natural Science Foundation of China under Grant 62075169,Grant 62003247,and Grant 62061160370the Hubei Province Key Research and Development Program under Grant 2021BBA235the Zhuhai Basic and Applied Basic Research Foundation under Grant ZH22017003200010PWC.
文摘The rotary motion deblurring is an inevitable procedure when the imaging seeker is mounted in the rotating missiles.Traditional rotary motion deblurring methods suffer from ringing artifacts and noise,especially for large blur extents.To solve the above problems,we propose a progressive rotary motion deblurring framework consisting of a coarse deblurring stage and a refinement stage.In the first stage,we design an adaptive blur extents factor(BE factor)to balance noise suppression and details reconstruction.And a novel deconvolution model is proposed based on BE factor.In the second stage,a triplescale deformable module CNN(TDM-CNN)is designed to reduce the ringing artifacts,which can exploit the 2D information of an image and adaptively adjust spatial sampling locations.To establish a standard evaluation benchmark,a real-world rotary motion blur dataset is proposed and released,which includes rotary blurred images and corresponding ground truth images with different blur angles.Experimental results demonstrate that the proposed method outperforms the state-of-the-art models on synthetic and real-world rotary motion blur datasets.The code and dataset are available at https://github.com/JinhuiQin/RotaryDeblurring.
文摘In this paper, we will be looking at our efforts to find a novel solution for motion deblurring in videos. In addition, our solution has the requirement of being camera-independent. This means that the solution is fully implemented in software and is not aware of any of the characteristics of the camera. We found a solution by implementing a Convolutional Neural Network-Long Short Term Memory (CNN-LSTM) hybrid model. Our CNN-LSTM is able to deblur video without any knowledge of the camera hardware. This allows it to be implemented on any system that allows the camera to be swapped out with any camera model with any physical characteristics.
基金The National Natural Science Foundation of China (No 30570485)
文摘The degraded parameters recognition is very important for the restoration of blurred images. There are two common types of blurs for most camera systems. One is the defocus blur due to the optical system's defocus phenomenon and the other is the motion blur due to the relative movement between the objectives and the camera. Compared with the recognition for the blurred image with only one blur model, the parameter estimation for the picture combining defocus and motion blur models is a more complicated mission. A method was proposed for computer to estimate the parameters of defocus blur and motion blur in cepstrum area simultaneously. According to characters of both blur models in the frequency domain, an adjustment approach was suggested in the frequency area and then convert to the cepstrum field to increase the accuracy of measurement.
基金Project supported by the National Natural Science Foundation of China (Grant No.60872114)the Shanghai Leading Academic Discipline Project (Grant No.S30108)the Graduate Student Innovation Foundation of Shanghai University (Grant No.SHUCX101086)
文摘A novel single-channel blind separation algorithm for permuted motion blurred images is proposed by using blind restoration in this paper. Both the motion direction and the length of the point spread function (PSF) are estimated by Radon transformation and extrema a detection. Using the estimated blur parameters, the permuted image is restored by performing the L-R blind restoration method. The permutation mixing matrices can be accurately estimated by classifying the ringing effect in the restored image, thereby the source images can be separated. Simulation results show a better separation efficiency for the permuted motion blurred image with various permutation operations. The proposed algorithm indicates a better performance on the robustness against Gaussian noise and lossy JPEG compression.
基金the National Natural Science Foundation of China under Grant 61902311in part by the Japan Society for the Promotion of Science(JSPS)Grants-in-Aid for Scientific Research(KAKENHI)under Grant JP18K18044.
文摘The 3D reconstruction using deep learning-based intelligent systems can provide great help for measuring an individual’s height and shape quickly and accurately through 2D motion-blurred images.Generally,during the acquisition of images in real-time,motion blur,caused by camera shaking or human motion,appears.Deep learning-based intelligent control applied in vision can help us solve the problem.To this end,we propose a 3D reconstruction method for motion-blurred images using deep learning.First,we develop a BF-WGAN algorithm that combines the bilateral filtering(BF)denoising theory with a Wasserstein generative adversarial network(WGAN)to remove motion blur.The bilateral filter denoising algorithm is used to remove the noise and to retain the details of the blurred image.Then,the blurred image and the corresponding sharp image are input into the WGAN.This algorithm distinguishes the motion-blurred image from the corresponding sharp image according to the WGAN loss and perceptual loss functions.Next,we use the deblurred images generated by the BFWGAN algorithm for 3D reconstruction.We propose a threshold optimization random sample consensus(TO-RANSAC)algorithm that can remove the wrong relationship between two views in the 3D reconstructed model relatively accurately.Compared with the traditional RANSAC algorithm,the TO-RANSAC algorithm can adjust the threshold adaptively,which improves the accuracy of the 3D reconstruction results.The experimental results show that our BF-WGAN algorithm has a better deblurring effect and higher efficiency than do other representative algorithms.In addition,the TO-RANSAC algorithm yields a calculation accuracy considerably higher than that of the traditional RANSAC algorithm.
文摘In this paper image with horizontal motion blur, vertical motion blur and angled motion blur are considered. We construct several difference schemes to the highly nonlinear term △↓.(△↓u/√|△↓|^2+β) of the total variation-based image motion deblurring problem. The large nonlinear system is linearized by fixed point iteration method. An algebraic multigrid method with Krylov subspace acceleration is used to solve the corresponding linear equations as in [7]. The algorithms can restore the image very well. We give some numerical experiments to demonstrate that our difference schemes are efficient and robust.
文摘In imaging on moving target, it is easy to get space- variant blurred image. In order to recover the image and gain recognizable target, an approach to recover the space-variant blurred image is presented based on image segmentation. Be- cause of motion blur's convolution process, the pixels of observed image's target and background will be displaced and piled up to produce two superposition regions. As a result, the neighbor- ing pixels in the superposition regions will have similar grey level change. According to the pixel's motion-blur character, the target's blurred edge of superposition region could be detected. Canny operator can be recurred to detect the target edge which parallels the motion blur direction. Then in the segmentation process, the whole target image which has the character of integral convolution between motion blur and real target image can be obtained. At last, the target image is restored by deconvolution algorithms with adding zeros. The restoration result indicates that the approach can effectively solve the kind of problem of space-variant motion blurred image restoration.
文摘Online defect visual inspection (ODVI) works while the object has to be static, otherwise the relative motion between camera and object will create motion blur in images. In order to implement ODVI in dynamic scene, it developes one blind motion deblurring method whose objective is to estimate blur kernel parameters precisely. In the proposed method, Radon transform on superpixels determinated the blur angle, and the autocorrelation function based on magnitude (AFM) of the preprocessed blurred image was utilized to identify the blur length. With the projection relationship discussed in this study, it will be unnecessary to rotate the blurred image or the axis. The proposed method is of high accuracy and robustness to noise, and it can somehow handle saturated pixels. To validate the proposed method, experiments have been carried out on synthetic images both in noise free and noisy situations. The results show that the method outperforms existing approaches. With the modified Richardson– Lucy deconvolution, it demonstrates that the proposed method is effective for ODVI in terms of subjective visual quality.
文摘针对车载视频图像中同时包含局部运动模糊和全局运动模糊,现有去模糊算法难以适用且效果差等问题,提出一种基于再模糊理论的复杂车载模糊图像复原方法。根据车载视频图像的特点把图像分割为车身和非车身区域,采用改进后的模糊参数估计算法,在车身区域图像块估算出的全局运动模糊参数,对整幅图像进行全局模糊恢复;对复原前后的非车身图像进行分块处理,利用复原前后图像块结构相似度(Structural Similarity,SSIM)和局部均方差的差异性,检测和提取出局部模糊区域;对提取的模糊区域进行复原后与清晰区域拼接融合,合成清晰的图像。与现有算法对比实验分析,所提算法取得了不错的效果,且复原后图像的峰值信噪比(Peak Signal to Noise Ratio,PSNR)和SSIM表现良好。
文摘A simulation method is proposed to predict the motion artifacts of plasma display panels (PDPs). The method simulates the behavior of the human vision system when perceiving moving objects. The simulation is based on the measured temporal light properties of the display for each gray level and each phosphor. Both the effect of subfield arrangement and phosphor decay are involved. A novel algorithm is proposed to improve the calculation speed. The simulation model manages to predict the appearance of the motion image perceived by a human with a still image. The results are validated by a set of perceptual evaluation experiments. This rapid and accurate prediction of motion artifacts enables objective characterization of the PDP performance in this aspect.