As the representative of flexibility in optical imaging media,in recent years,fiber bundles have emerged as a promising architecture in the development of compact visual systems.Dedicated to tackling the problems of u...As the representative of flexibility in optical imaging media,in recent years,fiber bundles have emerged as a promising architecture in the development of compact visual systems.Dedicated to tackling the problems of universal honeycomb artifacts and low signal-to-noise ratio(SNR)imaging in fiber bundles,the iterative super-resolution reconstruction network based on a physical model is proposed.Under the constraint of solving the two subproblems of data fidelity and prior regularization term alternately,the network can efficiently“regenerate”the lost spatial resolution with deep learning.By building and calibrating a dual-path imaging system,the real-world dataset where paired low-resolution(LR)-high-resolution(HR)images on the same scene can be generated simultaneously.Numerical results on both the United States Air Force(USAF)resolution target and complex target objects demonstrate that the algorithm can restore high-contrast images without pixilated noise.On the basis of super-resolution reconstruction,compound eye image composition based on fiber bundle is also embedded in this paper for the actual imaging requirements.The proposed work is the first to apply a physical model-based deep learning network to fiber bundle imaging in the infrared band,effectively promoting the engineering application of thermal radiation detection.展开更多
Deep learning techniques have significantly improved image restoration tasks in recent years.As a crucial compo-nent of deep learning,the loss function plays a key role in network optimization and performance enhancem...Deep learning techniques have significantly improved image restoration tasks in recent years.As a crucial compo-nent of deep learning,the loss function plays a key role in network optimization and performance enhancement.However,the currently prevalent loss functions assign equal weight to each pixel point during loss calculation,which hampers the ability to reflect the roles of different pixel points and fails to exploit the image’s characteristics fully.To address this issue,this study proposes an asymmetric loss function based on the image and data characteristics of the image recovery task.This novel loss function can adjust the weight of the reconstruction loss based on the grey value of different pixel points,thereby effectively optimizing the network training by differentially utilizing the grey information from the original image.Specifically,we calculate a weight factor for each pixel point based on its grey value and combine it with the reconstruction loss to create a new loss function.This ensures that pixel points with smaller grey values receive greater attention,improving network recovery.In order to verify the effectiveness of the proposed asymmetric loss function,we conducted experimental tests in the image super-resolution task.The experimental results show that the model with the introduction of asymmetric loss weights improves all the indexes of the processing results without increasing the training time.In the typical super-resolution network SRCNN,by introducing asymmetric weights,it is possible to improve the peak signal-to-noise ratio(PSNR)by up to about 0.5%,the structural similarity index(SSIM)by up to about 0.3%,and reduce the root-mean-square error(RMSE)by up to about 1.7%with essentially no increase in training time.In addition,we also further tested the performance of the proposed method in the denoising task to verify the potential applicability of the method in the image restoration task.展开更多
The purpose of this paper is to show the preconditioned BMinPert algorithm and analyse the practical implementation. Then a posteriori backward error for BGMRES is given. Furthermore, we discuss their applications in ...The purpose of this paper is to show the preconditioned BMinPert algorithm and analyse the practical implementation. Then a posteriori backward error for BGMRES is given. Furthermore, we discuss their applications in color image restoration. The key differences between BMinPert and other methods such as BFGMRES-S(m, p<sub>f</sub>), GsGMRES and BGMRES are illustrated with numerical experiments which expound the advantages of BMinPert in the presence of sensitive data with ill-condition problems.展开更多
This paper proposes a new image restoration technique, in which the resulting regularized image approximates the optimal solution steadily. The affect of the regular-ization operator and parameter on the lower band an...This paper proposes a new image restoration technique, in which the resulting regularized image approximates the optimal solution steadily. The affect of the regular-ization operator and parameter on the lower band and upper band energy of the residue of the regularized image is theoretically analyzed by employing wavelet transform. This paper shows that regularization operator should generally be lowstop and highpass. So this paper chooses a lowstop and highpass operator as regularization operator, and construct an optimization model which minimizes the mean squares residue of regularized solution to determine regularization parameter. Although the model is random, on the condition of this paper, it can be solved and yields regularization parameter and regularized solution. Otherwise, the technique has a mechanism to predict noise energy. So, without noise information, it can also work and yield good restoration results.展开更多
In this paper, we present a method of ROV based image processing to restore underwater blurry images from the theory of light and image transmission in the sea. Computer is used to simulate the maximum detection range...In this paper, we present a method of ROV based image processing to restore underwater blurry images from the theory of light and image transmission in the sea. Computer is used to simulate the maximum detection range of the ROV under different water body conditions. The receiving irradiance of the video camera at different detection ranges is also calculated. The ROV’s detection performance under different water body conditions is given by simulation. We restore the underwater blurry images using the Wiener filter based on the simulation. The Wiener filter is shown to be a simple useful method for underwater image restoration in the ROV underwater experiments. We also present examples of restored images of an underwater standard target taken by the video camera in these experiments.展开更多
This paper proposes a model for image restoration by combining the wavelet shrinkage and inverse scale space (ISS) method. The ISS is applied to the wavelet representation to modify the retained wavelet coefficients...This paper proposes a model for image restoration by combining the wavelet shrinkage and inverse scale space (ISS) method. The ISS is applied to the wavelet representation to modify the retained wavelet coefficients, and the coefficients smaller than the threshold are set to zero. The curvature term of the ISS can remove the edge artifacts and preserve sharp edges. For the multiscale interpretation of the ISS and the multiscale property of the wavelet representation, small details are preserved. This paper illustrates that the wavelet ISS model can be deduced from the wavelet based on a total variation minimization problem. A stopping criterion is obtained from this minimization in the sense of the Bregman distance in the wavelet domain. Numerical examples show the improvement for the image denoising with the proposed method in the sense of the signal to noise ratio and with fewer details remained in the residue.展开更多
The blurred image restoration method can dramatically highlight the image details and enhance the global contrast, which is of benefit to improvement of the visual effect during practical ap- plications. This paper is...The blurred image restoration method can dramatically highlight the image details and enhance the global contrast, which is of benefit to improvement of the visual effect during practical ap- plications. This paper is based on the dark channel prior principle and aims at the prior information absent blurred image degradation situation. A lot of improvements have been made to estimate the transmission map of blurred images. Since the dark channel prior principle can effectively restore the blurred image at the cost of a large amount of computation, the total variation (TV) and image morphology transform (specifically top-hat transform and bottom- hat transform) have been introduced into the improved method. Compared with original transmission map estimation methods, the proposed method features both simplicity and accuracy. The es- timated transmission map together with the element can restore the image. Simulation results show that this method could inhibit the ill-posed problem during image restoration, meanwhile it can greatly improve the image quality and definition.展开更多
A novel image restoration model coupling with a gradient fidelity term based on adaptive total variation is proposed in this paper. In order to choose proper parameters, the selection criteria were analyzed theoretica...A novel image restoration model coupling with a gradient fidelity term based on adaptive total variation is proposed in this paper. In order to choose proper parameters, the selection criteria were analyzed theoretically, and a simple scheme to demonstrate its validity was adopted experimentally. To make fair comparisons of performances of three models, the same numerical algorithm was used to solve partial differential equations. Both the international standard test image on Lena and HR image of CBERS-02B of Dalian city were used to verify the performance of the model. Experimental results illustrate that the new model not only preserved the edge and important details but also alleviated the staircase effect effectively.展开更多
The multispectral remote sensing image(MS-RSI)is degraded existing multi-spectral camera due to various hardware limitations.In this paper,we propose a novel core tensor dictionary learning approach with the robust mo...The multispectral remote sensing image(MS-RSI)is degraded existing multi-spectral camera due to various hardware limitations.In this paper,we propose a novel core tensor dictionary learning approach with the robust modified Gaussian mixture model for MS-RSI restoration.First,the multispectral patch is modeled by three-order tensor and high-order singular value decomposition is applied to the tensor.Then the task of MS-RSI restoration is formulated as a minimum sparse core tensor estimation problem.To improve the accuracy of core tensor coding,the core tensor estimation based on the robust modified Gaussian mixture model is introduced into the proposed model by exploiting the sparse distribution prior in image.When applied to MS-RSI restoration,our experimental results have shown that the proposed algorithm can better reconstruct the sharpness of the image textures and can outperform several existing state-of-the-art multispectral image restoration methods in both subjective image quality and visual perception.展开更多
Filling techniques are often used in the restoration of images.Yet the existing filling technique approaches either have high computational costs or present problems such as filling holes redundantly.This paper propos...Filling techniques are often used in the restoration of images.Yet the existing filling technique approaches either have high computational costs or present problems such as filling holes redundantly.This paper proposes a novel algorithm for filling holes and regions of the images.The proposed algorithm combines the advantages of both the parity-check filling approach and the region-growing inpainting technique.Pairing points of the region’s boundary are used to search and to fill the region.The scanning range of the filling method is within the target regions.The proposed method does not require additional working memory or assistant colors,and it can correctly fill any complex contours.Experimental results show that,compared to other approaches,the proposed algorithm fills regions faster and with lower computational cost.展开更多
Focusing on the degradation of foggy images, a restora- tion approach from a single image based on spatial correlation of dark channel prior is proposed. Firstly, the transmission of each pixel is estimated by the spa...Focusing on the degradation of foggy images, a restora- tion approach from a single image based on spatial correlation of dark channel prior is proposed. Firstly, the transmission of each pixel is estimated by the spatial correlation of dark channel prior. Secondly, a degradation model is utilized to restore the foggy image. Thirdly, the final recovered image, with enhanced contrast, is obtained by performing a post-processing technique based on just-noticeable difference. Experimental results demonstrate that the information of a foggy image can be recovered perfectly by the proposed method, even in the case of the abrupt depth changing scene.展开更多
To implement restoration in a single motion blurred image,the PSF(Point Spread Function)is difficult to estimate and the image deconvolution is ill-posed as a result that a good recovery effect cannot be obtained.Cons...To implement restoration in a single motion blurred image,the PSF(Point Spread Function)is difficult to estimate and the image deconvolution is ill-posed as a result that a good recovery effect cannot be obtained.Considering that several different PSFs can get joint invertibility to make restoration wellposed,we proposed a motion-blurred image restoration method based on joint invertibility of PSFs by means of computational photography.Firstly,we designed a set of observation device which composed by multiple cameras with the same parameters to shoot the moving target in the same field of view continuously to obtain the target images with the same background.The target images have the same brightness,but different exposure time and different motion blur length.It is easy to estimate the blur PSFs of the target images make use of the sequence frames obtained by one camera.According to the motion blur superposition feature of the target and its background,the complete blurred target images can be extracted from the observed images respectively.Finally,for the same target images with different PSFs,the iterative restoration is solved by joint solution of multiple images in spatial domain.The experiments showed that the moving target observation device designed by this method had lower requirements on hardware conditions,and the observed images are more convenient to use joint-PSF solution for image restoration,and the restoration results maintained details well and had lower signal noise ratio(SNR).展开更多
Image restoration is often solved by minimizing an energy function consisting of a data-fidelity term and a regularization term.A regularized convex term can usually preserve the image edges well in the restored image...Image restoration is often solved by minimizing an energy function consisting of a data-fidelity term and a regularization term.A regularized convex term can usually preserve the image edges well in the restored image.In this paper,we consider a class of convex and edge-preserving regularization functions,i.e.,multiplicative half-quadratic regularizations,and we use the Newton method to solve the correspondingly reduced systems of nonlinear equations.At each Newton iterate,the preconditioned conjugate gradient method,incorporated with a constraint preconditioner,is employed to solve the structured Newton equation that has a symmetric positive definite coefficient matrix. The eigenvalue bounds of the preconditioned matrix are deliberately derived,which can be used to estimate the convergence speed of the preconditioned conjugate gradient method.We use experimental results to demonstrate that this new approach is efficient, and the effect of image restoration is reasonably well.展开更多
A new method of artificial intelligence based on a new improved back propagation neural network (BPNN) algorithm is partially applied in the problem of image restoration. In order to over- come the inherited issues ...A new method of artificial intelligence based on a new improved back propagation neural network (BPNN) algorithm is partially applied in the problem of image restoration. In order to over- come the inherited issues in conventional back propagation algorithm i.e. slow convergence rate, longer training time, hard to achieve global minima etc. , different methods have been used including the introduction of dynamic learning rate and dynamic momentum coefficient etc. With the passage of time different techniques has been used to improve the dynamicity of these coefficients. The meth- od applied in this paper improves the effect of learning coefficient η by using a new way to modify the value dynamically during learning process. The experimental results show that this helps in im- proving the efficiency overall both in visual effect and quality analysis.展开更多
The imaging problem of low signal to noise ratio (SNR)echo is very important for ultra-wide band (UWB) through-wall radar. An improved multi-channel blind image restoration algorithm based on sub-space and constra...The imaging problem of low signal to noise ratio (SNR)echo is very important for ultra-wide band (UWB) through-wall radar. An improved multi-channel blind image restoration algorithm based on sub-space and constrained least square (CLS) is presented and applied to UWB radar system to deal with this issue. The high resolution of radar image is equivalent to multi-channel blind image restoration based on the improved model of the through-wall radar echo. And a new cost function is proposed to the multi-channel blind image restoration by considering the concept of sub-space as the limitation of blur identification. The proposed algorithm has all advantages of CLS and sub-space, and converts the image estimation to alternating-minimizing the two cost functions. Experimental results prove that the proposed algorithm is effective at improving the resolution of radar image even at low SNR.展开更多
In order to restore the degraded ultrasonic C-scan image for testing surfacing inteoface, a method based on support vector regression (SVR) network is proposed. By using the image of a simulating defect, the network...In order to restore the degraded ultrasonic C-scan image for testing surfacing inteoface, a method based on support vector regression (SVR) network is proposed. By using the image of a simulating defect, the network is trained and a mapping relationship between the degraded and restored image is founded. The degraded C-scan image of Cu-Steel surfacing inteoface is processed by the trained network and improved image is obtained. The result shows that the method can effectively suppress the noise and deblur the defect edge in the image, and provide technique support for quality and reliability evaluation of the surfacing weld.展开更多
Images are generally corrupted by impulse noise during acquisition and transmission.Noise deteriorates the quality of images.To remove corruption noise,we propose a hybrid approach to restoring a random noisecorrupted...Images are generally corrupted by impulse noise during acquisition and transmission.Noise deteriorates the quality of images.To remove corruption noise,we propose a hybrid approach to restoring a random noisecorrupted image,including a block matching 3D(BM3D)method,an adaptive non-local mean(ANLM)scheme,and the K-singular value decomposition(K-SVD)algorithm.In the proposed method,we employ the morphological component analysis(MCA)to decompose an image into the texture,structure,and edge parts.Then,the BM3D method,ANLM scheme,and K-SVD algorithm are utilized to eliminate noise in the texture,structure,and edge parts of the image,respectively.Experimental results show that the proposed approach can effectively remove interference random noise in different parts;meanwhile,the deteriorated image is able to be reconstructed well.展开更多
A new method of back propagation learning with respect to the problem of image restora- tion which is named as greyscale based learning in back propagation neural networks (BPNN) is in- vestigated. It is observed th...A new method of back propagation learning with respect to the problem of image restora- tion which is named as greyscale based learning in back propagation neural networks (BPNN) is in- vestigated. It is observed that by using this method the value of mean square error (MSE) decreases significantly. In addition, this method also gives good visual results when it is applied in image resto- ration problem. This method is also useful to tackle the inherited drawback of falling into local mini- ma by reducing its effect on overall system by bifurcating the learning locally different for different grey scale values. The performance of this algorithm has been studied in detail with different combi- nations of weights. In short, this algorithm provides much better results especially when compared with the simple back propagation algorithm with any further enhancements and without going for hy- brid solutions.展开更多
With the development of image restoration technology based on deep learning,more complex problems are being solved,especially in image semantic inpainting based on context.Nowadays,image semantic inpainting techniques...With the development of image restoration technology based on deep learning,more complex problems are being solved,especially in image semantic inpainting based on context.Nowadays,image semantic inpainting techniques are becoming more mature.However,due to the limitations of memory,the instability of training,and the lack of sample diversity,the results of image restoration are still encountering difficult problems,such as repairing the content of glitches which cannot be well integrated with the original image.Therefore,we propose an image inpainting network based on Wasserstein generative adversarial network(WGAN)distance.With the corresponding technology having been adjusted and improved,we attempted to use the Adam algorithm to replace the traditional stochastic gradient descent,and another algorithm to optimize the training used in recent years.We evaluated our algorithm on the ImageNet dataset.We obtained high-quality restoration results,indicating that our algorithm improves the clarity and consistency of the image.展开更多
A novel filter for image restoration is proposed in this paper. The filter estimates histogram of original image via input image. It gets a membership function through the histogram, and the membership function contai...A novel filter for image restoration is proposed in this paper. The filter estimates histogram of original image via input image. It gets a membership function through the histogram, and the membership function contains a lot of information of original image. Then a weighted fuzzy mean filter is established based on this membership function; meanwhile, the filter adaptively adopts different filter scale according to the character divergence of image region and intensity of impulsive noise. Experimental result shows that new filter gives superior performance to conventional filters and currently used fuzzy filter.展开更多
基金the National Natural Science Foundation of China(Grant Nos.61905115,62105151,62175109,U21B2033)Leading Technology of Jiangsu Basic Research Plan(Grant No.BK20192003)+2 种基金Youth Foundation of Jiangsu Province(Grant Nos.BK20190445,BK20210338)Fundamental Research Funds for the Central Universities(Grant No.30920032101)Open Research Fund of Jiangsu Key Laboratory of Spectral Imaging&Intelligent Sense(Grant No.JSGP202105)to provide fund for conducting experiments。
文摘As the representative of flexibility in optical imaging media,in recent years,fiber bundles have emerged as a promising architecture in the development of compact visual systems.Dedicated to tackling the problems of universal honeycomb artifacts and low signal-to-noise ratio(SNR)imaging in fiber bundles,the iterative super-resolution reconstruction network based on a physical model is proposed.Under the constraint of solving the two subproblems of data fidelity and prior regularization term alternately,the network can efficiently“regenerate”the lost spatial resolution with deep learning.By building and calibrating a dual-path imaging system,the real-world dataset where paired low-resolution(LR)-high-resolution(HR)images on the same scene can be generated simultaneously.Numerical results on both the United States Air Force(USAF)resolution target and complex target objects demonstrate that the algorithm can restore high-contrast images without pixilated noise.On the basis of super-resolution reconstruction,compound eye image composition based on fiber bundle is also embedded in this paper for the actual imaging requirements.The proposed work is the first to apply a physical model-based deep learning network to fiber bundle imaging in the infrared band,effectively promoting the engineering application of thermal radiation detection.
基金supported by the National Natural Science Foundation of China(62201618).
文摘Deep learning techniques have significantly improved image restoration tasks in recent years.As a crucial compo-nent of deep learning,the loss function plays a key role in network optimization and performance enhancement.However,the currently prevalent loss functions assign equal weight to each pixel point during loss calculation,which hampers the ability to reflect the roles of different pixel points and fails to exploit the image’s characteristics fully.To address this issue,this study proposes an asymmetric loss function based on the image and data characteristics of the image recovery task.This novel loss function can adjust the weight of the reconstruction loss based on the grey value of different pixel points,thereby effectively optimizing the network training by differentially utilizing the grey information from the original image.Specifically,we calculate a weight factor for each pixel point based on its grey value and combine it with the reconstruction loss to create a new loss function.This ensures that pixel points with smaller grey values receive greater attention,improving network recovery.In order to verify the effectiveness of the proposed asymmetric loss function,we conducted experimental tests in the image super-resolution task.The experimental results show that the model with the introduction of asymmetric loss weights improves all the indexes of the processing results without increasing the training time.In the typical super-resolution network SRCNN,by introducing asymmetric weights,it is possible to improve the peak signal-to-noise ratio(PSNR)by up to about 0.5%,the structural similarity index(SSIM)by up to about 0.3%,and reduce the root-mean-square error(RMSE)by up to about 1.7%with essentially no increase in training time.In addition,we also further tested the performance of the proposed method in the denoising task to verify the potential applicability of the method in the image restoration task.
文摘The purpose of this paper is to show the preconditioned BMinPert algorithm and analyse the practical implementation. Then a posteriori backward error for BGMRES is given. Furthermore, we discuss their applications in color image restoration. The key differences between BMinPert and other methods such as BFGMRES-S(m, p<sub>f</sub>), GsGMRES and BGMRES are illustrated with numerical experiments which expound the advantages of BMinPert in the presence of sensitive data with ill-condition problems.
基金This work was supported by the National Natural Science Foundation of China(60204001, 60133010)the Scientific Research Fundation of Hunan Provincial Education Department(02C640)the Youth Chengguang Project of Science and Technology of Wuhan City(
文摘This paper proposes a new image restoration technique, in which the resulting regularized image approximates the optimal solution steadily. The affect of the regular-ization operator and parameter on the lower band and upper band energy of the residue of the regularized image is theoretically analyzed by employing wavelet transform. This paper shows that regularization operator should generally be lowstop and highpass. So this paper chooses a lowstop and highpass operator as regularization operator, and construct an optimization model which minimizes the mean squares residue of regularized solution to determine regularization parameter. Although the model is random, on the condition of this paper, it can be solved and yields regularization parameter and regularized solution. Otherwise, the technique has a mechanism to predict noise energy. So, without noise information, it can also work and yield good restoration results.
基金supported by the National Natural Science Foundation of China(No.60178017)
文摘In this paper, we present a method of ROV based image processing to restore underwater blurry images from the theory of light and image transmission in the sea. Computer is used to simulate the maximum detection range of the ROV under different water body conditions. The receiving irradiance of the video camera at different detection ranges is also calculated. The ROV’s detection performance under different water body conditions is given by simulation. We restore the underwater blurry images using the Wiener filter based on the simulation. The Wiener filter is shown to be a simple useful method for underwater image restoration in the ROV underwater experiments. We also present examples of restored images of an underwater standard target taken by the video camera in these experiments.
基金supported by the National Natural Science Foundation of China (61101208)
文摘This paper proposes a model for image restoration by combining the wavelet shrinkage and inverse scale space (ISS) method. The ISS is applied to the wavelet representation to modify the retained wavelet coefficients, and the coefficients smaller than the threshold are set to zero. The curvature term of the ISS can remove the edge artifacts and preserve sharp edges. For the multiscale interpretation of the ISS and the multiscale property of the wavelet representation, small details are preserved. This paper illustrates that the wavelet ISS model can be deduced from the wavelet based on a total variation minimization problem. A stopping criterion is obtained from this minimization in the sense of the Bregman distance in the wavelet domain. Numerical examples show the improvement for the image denoising with the proposed method in the sense of the signal to noise ratio and with fewer details remained in the residue.
基金supported by the National Natural Science Foundation of China(61301095)the Chinese University Scientific Fund(HEUCF130807)the Chinese Defense Advanced Research Program of Science and Technology(10J3.1.6)
文摘The blurred image restoration method can dramatically highlight the image details and enhance the global contrast, which is of benefit to improvement of the visual effect during practical ap- plications. This paper is based on the dark channel prior principle and aims at the prior information absent blurred image degradation situation. A lot of improvements have been made to estimate the transmission map of blurred images. Since the dark channel prior principle can effectively restore the blurred image at the cost of a large amount of computation, the total variation (TV) and image morphology transform (specifically top-hat transform and bottom- hat transform) have been introduced into the improved method. Compared with original transmission map estimation methods, the proposed method features both simplicity and accuracy. The es- timated transmission map together with the element can restore the image. Simulation results show that this method could inhibit the ill-posed problem during image restoration, meanwhile it can greatly improve the image quality and definition.
基金Supported by the National Basic Research Program of China ("973"Program)(2009CB72400603) the National Natural Science Foundation of China(6102700260972100)
文摘A novel image restoration model coupling with a gradient fidelity term based on adaptive total variation is proposed in this paper. In order to choose proper parameters, the selection criteria were analyzed theoretically, and a simple scheme to demonstrate its validity was adopted experimentally. To make fair comparisons of performances of three models, the same numerical algorithm was used to solve partial differential equations. Both the international standard test image on Lena and HR image of CBERS-02B of Dalian city were used to verify the performance of the model. Experimental results illustrate that the new model not only preserved the edge and important details but also alleviated the staircase effect effectively.
基金This work was supported by the Project of Shandong Province Higher Educational Science and Technology Program[KJ2018BAN047,Geng,L.]National Natural Science Foundation of China[61801222,Fu,P.]+2 种基金Fundamental Research Funds for the Central Universities[30919011230,Fu,P.]Science and Technology Innovation Program for Distributed Young Talents of Shandong Province Higher Education Institutions[2019KJN045,Guo,Q.]Shandong Provincial Key Laboratory of Network Based Intelligent Computing[http://nbic.ujn.edu.cn/].
文摘The multispectral remote sensing image(MS-RSI)is degraded existing multi-spectral camera due to various hardware limitations.In this paper,we propose a novel core tensor dictionary learning approach with the robust modified Gaussian mixture model for MS-RSI restoration.First,the multispectral patch is modeled by three-order tensor and high-order singular value decomposition is applied to the tensor.Then the task of MS-RSI restoration is formulated as a minimum sparse core tensor estimation problem.To improve the accuracy of core tensor coding,the core tensor estimation based on the robust modified Gaussian mixture model is introduced into the proposed model by exploiting the sparse distribution prior in image.When applied to MS-RSI restoration,our experimental results have shown that the proposed algorithm can better reconstruct the sharpness of the image textures and can outperform several existing state-of-the-art multispectral image restoration methods in both subjective image quality and visual perception.
基金The research is jointly supported by the National Natural Science Foundation of China No.61561035by Ukrainian government project No.0117U007177the Slovak Research and Development Agency project number APVV-18-0214.
文摘Filling techniques are often used in the restoration of images.Yet the existing filling technique approaches either have high computational costs or present problems such as filling holes redundantly.This paper proposes a novel algorithm for filling holes and regions of the images.The proposed algorithm combines the advantages of both the parity-check filling approach and the region-growing inpainting technique.Pairing points of the region’s boundary are used to search and to fill the region.The scanning range of the filling method is within the target regions.The proposed method does not require additional working memory or assistant colors,and it can correctly fill any complex contours.Experimental results show that,compared to other approaches,the proposed algorithm fills regions faster and with lower computational cost.
基金supported by "the Twelfth Five-year Civil Aerospace Technologies Pre-Research Program"(D040201)
文摘Focusing on the degradation of foggy images, a restora- tion approach from a single image based on spatial correlation of dark channel prior is proposed. Firstly, the transmission of each pixel is estimated by the spatial correlation of dark channel prior. Secondly, a degradation model is utilized to restore the foggy image. Thirdly, the final recovered image, with enhanced contrast, is obtained by performing a post-processing technique based on just-noticeable difference. Experimental results demonstrate that the information of a foggy image can be recovered perfectly by the proposed method, even in the case of the abrupt depth changing scene.
基金funding of Natural Science Foundation of Shandong Province(ZR2013F0025),www.sdnsf.gov.cn.
文摘To implement restoration in a single motion blurred image,the PSF(Point Spread Function)is difficult to estimate and the image deconvolution is ill-posed as a result that a good recovery effect cannot be obtained.Considering that several different PSFs can get joint invertibility to make restoration wellposed,we proposed a motion-blurred image restoration method based on joint invertibility of PSFs by means of computational photography.Firstly,we designed a set of observation device which composed by multiple cameras with the same parameters to shoot the moving target in the same field of view continuously to obtain the target images with the same background.The target images have the same brightness,but different exposure time and different motion blur length.It is easy to estimate the blur PSFs of the target images make use of the sequence frames obtained by one camera.According to the motion blur superposition feature of the target and its background,the complete blurred target images can be extracted from the observed images respectively.Finally,for the same target images with different PSFs,the iterative restoration is solved by joint solution of multiple images in spatial domain.The experiments showed that the moving target observation device designed by this method had lower requirements on hardware conditions,and the observed images are more convenient to use joint-PSF solution for image restoration,and the restoration results maintained details well and had lower signal noise ratio(SNR).
基金supported by the National Basic Research Program (No.2005CB321702)the National Outstanding Young Scientist Foundation(No. 10525102)the Specialized Research Grant for High Educational Doctoral Program(Nos. 20090211120011 and LZULL200909),Hong Kong RGC grants and HKBU FRGs
文摘Image restoration is often solved by minimizing an energy function consisting of a data-fidelity term and a regularization term.A regularized convex term can usually preserve the image edges well in the restored image.In this paper,we consider a class of convex and edge-preserving regularization functions,i.e.,multiplicative half-quadratic regularizations,and we use the Newton method to solve the correspondingly reduced systems of nonlinear equations.At each Newton iterate,the preconditioned conjugate gradient method,incorporated with a constraint preconditioner,is employed to solve the structured Newton equation that has a symmetric positive definite coefficient matrix. The eigenvalue bounds of the preconditioned matrix are deliberately derived,which can be used to estimate the convergence speed of the preconditioned conjugate gradient method.We use experimental results to demonstrate that this new approach is efficient, and the effect of image restoration is reasonably well.
基金Supported by the National Natural Science Foundation of China (60772066)Higher Education Commission of Pakistan
文摘A new method of artificial intelligence based on a new improved back propagation neural network (BPNN) algorithm is partially applied in the problem of image restoration. In order to over- come the inherited issues in conventional back propagation algorithm i.e. slow convergence rate, longer training time, hard to achieve global minima etc. , different methods have been used including the introduction of dynamic learning rate and dynamic momentum coefficient etc. With the passage of time different techniques has been used to improve the dynamicity of these coefficients. The meth- od applied in this paper improves the effect of learning coefficient η by using a new way to modify the value dynamically during learning process. The experimental results show that this helps in im- proving the efficiency overall both in visual effect and quality analysis.
基金Sponsored by the National Natural Science Foundation of China(60472110)
文摘The imaging problem of low signal to noise ratio (SNR)echo is very important for ultra-wide band (UWB) through-wall radar. An improved multi-channel blind image restoration algorithm based on sub-space and constrained least square (CLS) is presented and applied to UWB radar system to deal with this issue. The high resolution of radar image is equivalent to multi-channel blind image restoration based on the improved model of the through-wall radar echo. And a new cost function is proposed to the multi-channel blind image restoration by considering the concept of sub-space as the limitation of blur identification. The proposed algorithm has all advantages of CLS and sub-space, and converts the image estimation to alternating-minimizing the two cost functions. Experimental results prove that the proposed algorithm is effective at improving the resolution of radar image even at low SNR.
文摘In order to restore the degraded ultrasonic C-scan image for testing surfacing inteoface, a method based on support vector regression (SVR) network is proposed. By using the image of a simulating defect, the network is trained and a mapping relationship between the degraded and restored image is founded. The degraded C-scan image of Cu-Steel surfacing inteoface is processed by the trained network and improved image is obtained. The result shows that the method can effectively suppress the noise and deblur the defect edge in the image, and provide technique support for quality and reliability evaluation of the surfacing weld.
基金supported by MOST under Grant No.104-2221-E-468-007
文摘Images are generally corrupted by impulse noise during acquisition and transmission.Noise deteriorates the quality of images.To remove corruption noise,we propose a hybrid approach to restoring a random noisecorrupted image,including a block matching 3D(BM3D)method,an adaptive non-local mean(ANLM)scheme,and the K-singular value decomposition(K-SVD)algorithm.In the proposed method,we employ the morphological component analysis(MCA)to decompose an image into the texture,structure,and edge parts.Then,the BM3D method,ANLM scheme,and K-SVD algorithm are utilized to eliminate noise in the texture,structure,and edge parts of the image,respectively.Experimental results show that the proposed approach can effectively remove interference random noise in different parts;meanwhile,the deteriorated image is able to be reconstructed well.
基金Supported by the National Natural Science Foundation of China(60772066)Higher Education Commission,Pakistan
文摘A new method of back propagation learning with respect to the problem of image restora- tion which is named as greyscale based learning in back propagation neural networks (BPNN) is in- vestigated. It is observed that by using this method the value of mean square error (MSE) decreases significantly. In addition, this method also gives good visual results when it is applied in image resto- ration problem. This method is also useful to tackle the inherited drawback of falling into local mini- ma by reducing its effect on overall system by bifurcating the learning locally different for different grey scale values. The performance of this algorithm has been studied in detail with different combi- nations of weights. In short, this algorithm provides much better results especially when compared with the simple back propagation algorithm with any further enhancements and without going for hy- brid solutions.
基金supported by the National Natural Science Foundation of China(Grant No.42075007)the Open Project of Provincial Key Laboratory for Computer Information Processing Technology under Grant KJS1935,Soochow University+1 种基金the Priority Academic Program Development of Jiangsu Higher Education InstitutionsGraduate Scientific Research Innovation Program of Jiangsu Province under Grant no.KYCX21_1015.
文摘With the development of image restoration technology based on deep learning,more complex problems are being solved,especially in image semantic inpainting based on context.Nowadays,image semantic inpainting techniques are becoming more mature.However,due to the limitations of memory,the instability of training,and the lack of sample diversity,the results of image restoration are still encountering difficult problems,such as repairing the content of glitches which cannot be well integrated with the original image.Therefore,we propose an image inpainting network based on Wasserstein generative adversarial network(WGAN)distance.With the corresponding technology having been adjusted and improved,we attempted to use the Adam algorithm to replace the traditional stochastic gradient descent,and another algorithm to optimize the training used in recent years.We evaluated our algorithm on the ImageNet dataset.We obtained high-quality restoration results,indicating that our algorithm improves the clarity and consistency of the image.
基金the National Natural Science Foundation of China(No.69972041)
文摘A novel filter for image restoration is proposed in this paper. The filter estimates histogram of original image via input image. It gets a membership function through the histogram, and the membership function contains a lot of information of original image. Then a weighted fuzzy mean filter is established based on this membership function; meanwhile, the filter adaptively adopts different filter scale according to the character divergence of image region and intensity of impulsive noise. Experimental result shows that new filter gives superior performance to conventional filters and currently used fuzzy filter.