Using restored two-dimensional X-ray images to reconstruct the three-dimensional magnetopause

Astronomical imaging technologies are basic tools for the exploration of the universe,providing basic data for the research of astronomy and space physics.The Soft X-ray Imager(SXI)carried by the Solar wind Magnetosphere Ionosphere Link Explorer(SMILE)aims to capture two-dimensional(2-D)images of the Earth’s magnetosheath by using soft X-ray imaging.However,the observed 2-D images are affected by many noise factors,destroying the contained information,which is not conducive to the subsequent reconstruction of the three-dimensional(3-D)structure of the magnetopause.The analysis of SXI-simulated observation images shows that such damage cannot be evaluated with traditional restoration models.This makes it difficult to establish the mapping relationship between SXIsimulated observation images and target images by using mathematical models.We propose an image restoration algorithm for SXIsimulated observation images that can recover large-scale structure information on the magnetosphere.The idea is to train a patch estimator by selecting noise–clean patch pairs with the same distribution through the Classification–Expectation Maximization algorithm to achieve the restoration estimation of the SXI-simulated observation image,whose mapping relationship with the target image is established by the patch estimator.The Classification–Expectation Maximization algorithm is used to select multiple patch clusters with the same distribution and then train different patch estimators so as to improve the accuracy of the estimator.Experimental results showed that our image restoration algorithm is superior to other classical image restoration algorithms in the SXI-simulated observation image restoration task,according to the peak signal-to-noise ratio and structural similarity.The restoration results of SXI-simulated observation images are used in the tangent fitting approach and the computed tomography approach toward magnetospheric reconstruction techniques,significantly improving the reconstruction results.Hence,the proposed technology may be feasible for processing SXI-simulated observation images.

Model-based deep learning for fiber bundle infrared image restoration

As the representative of flexibility in optical imaging media,in recent years,fiber bundles have emerged as a promising architecture in the development of compact visual systems.Dedicated to tackling the problems of universal honeycomb artifacts and low signal-to-noise ratio(SNR)imaging in fiber bundles,the iterative super-resolution reconstruction network based on a physical model is proposed.Under the constraint of solving the two subproblems of data fidelity and prior regularization term alternately,the network can efficiently“regenerate”the lost spatial resolution with deep learning.By building and calibrating a dual-path imaging system,the real-world dataset where paired low-resolution(LR)-high-resolution(HR)images on the same scene can be generated simultaneously.Numerical results on both the United States Air Force(USAF)resolution target and complex target objects demonstrate that the algorithm can restore high-contrast images without pixilated noise.On the basis of super-resolution reconstruction,compound eye image composition based on fiber bundle is also embedded in this paper for the actual imaging requirements.The proposed work is the first to apply a physical model-based deep learning network to fiber bundle imaging in the infrared band,effectively promoting the engineering application of thermal radiation detection.

Asymmetric Loss Based on Image Properties for Deep Learning-Based Image Restoration

Deep learning techniques have significantly improved image restoration tasks in recent years.As a crucial compo-nent of deep learning,the loss function plays a key role in network optimization and performance enhancement.However,the currently prevalent loss functions assign equal weight to each pixel point during loss calculation,which hampers the ability to reflect the roles of different pixel points and fails to exploit the image’s characteristics fully.To address this issue,this study proposes an asymmetric loss function based on the image and data characteristics of the image recovery task.This novel loss function can adjust the weight of the reconstruction loss based on the grey value of different pixel points,thereby effectively optimizing the network training by differentially utilizing the grey information from the original image.Specifically,we calculate a weight factor for each pixel point based on its grey value and combine it with the reconstruction loss to create a new loss function.This ensures that pixel points with smaller grey values receive greater attention,improving network recovery.In order to verify the effectiveness of the proposed asymmetric loss function,we conducted experimental tests in the image super-resolution task.The experimental results show that the model with the introduction of asymmetric loss weights improves all the indexes of the processing results without increasing the training time.In the typical super-resolution network SRCNN,by introducing asymmetric weights,it is possible to improve the peak signal-to-noise ratio(PSNR)by up to about 0.5%,the structural similarity index(SSIM)by up to about 0.3%,and reduce the root-mean-square error(RMSE)by up to about 1.7%with essentially no increase in training time.In addition,we also further tested the performance of the proposed method in the denoising task to verify the potential applicability of the method in the image restoration task.

CLGA Net:Cross Layer Gated Attention Network for Image Dehazing

In this paper,we propose an end-to-end cross-layer gated attention network(CLGA-Net)to directly restore fog-free images.Compared with the previous dehazing network,the dehazing model presented in this paper uses the smooth cavity convolution and local residual module as the feature extractor,combined with the channel attention mechanism,to better extract the restored features.A large amount of experimental data proves that the defogging model proposed in this paper is superior to previous defogging technologies in terms of structure similarity index(SSIM),peak signal to noise ratio(PSNR)and subjective visual quality.In order to improve the efficiency of decoding and encoding,we also describe a fusion residualmodule and conduct ablation experiments,which prove that the fusion residual is suitable for the dehazing problem.Therefore,we use fusion residual as a fixed module for encoding and decoding.In addition,we found that the traditional defogging model based on the U-net network may cause some information losses in space.We have achieved effective maintenance of low-level feature information through the cross-layer gating structure that better takes into account global and subtle features.We also present the application of our CLGA-Net in challenging scenarios where the best results in both quantity and quality can be obtained.Experimental results indicate that the present cross-layer gating module can be widely used in the same type of network.

Preconditioned Bminpert Algorithms for Matrix Equation AX = B and Their Applications in Color Image Restoration

The purpose of this paper is to show the preconditioned BMinPert algorithm and analyse the practical implementation. Then a posteriori backward error for BGMRES is given. Furthermore, we discuss their applications in color image restoration. The key differences between BMinPert and other methods such as BFGMRES-S(m, pf), GsGMRES and BGMRES are illustrated with numerical experiments which expound the advantages of BMinPert in the presence of sensitive data with ill-condition problems.

Restoration of space-variant blurred image based on motion-blurred target segmentation

In imaging on moving target, it is easy to get space- variant blurred image. In order to recover the image and gain recognizable target, an approach to recover the space-variant blurred image is presented based on image segmentation. Be- cause of motion blur＇s convolution process, the pixels of observed image＇s target and background will be displaced and piled up to produce two superposition regions. As a result, the neighbor- ing pixels in the superposition regions will have similar grey level change. According to the pixel＇s motion-blur character, the target＇s blurred edge of superposition region could be detected. Canny operator can be recurred to detect the target edge which parallels the motion blur direction. Then in the segmentation process, the whole target image which has the character of integral convolution between motion blur and real target image can be obtained. At last, the target image is restored by deconvolution algorithms with adding zeros. The restoration result indicates that the approach can effectively solve the kind of problem of space-variant motion blurred image restoration.

On weak solutions for an image denoising-deblurring model

A new denoising-deblurring model in image restoration is proposed,in which the regularization term carries out anisotropic diffusion on the edges and isotropic diffusion on the regular regions.The existence and uniqueness of weak solutions for this model are proved,and the numerical model is also testified.Compared with the TV diffusion,this model preferably reduces the staircase appearing in the restored images.

A METHOD TO APPROACH OPTIMAL RESTORATION IN IMAGE RESTORATION PROBLEMS WITHOUT NOISE ENERGY INFORMATION

This paper proposes a new image restoration technique, in which the resulting regularized image approximates the optimal solution steadily. The affect of the regular-ization operator and parameter on the lower band and upper band energy of the residue of the regularized image is theoretically analyzed by employing wavelet transform. This paper shows that regularization operator should generally be lowstop and highpass. So this paper chooses a lowstop and highpass operator as regularization operator, and construct an optimization model which minimizes the mean squares residue of regularized solution to determine regularization parameter. Although the model is random, on the condition of this paper, it can be solved and yields regularization parameter and regularized solution. Otherwise, the technique has a mechanism to predict noise energy. So, without noise information, it can also work and yield good restoration results.

Anisotropic Total Variation Regularization Based NAS-RIF Blind Restoration Method for OCT Image

Based on anisotropic total variation regularization(ATVR), a nonnegativity and support constraints recursive inverse filtering(NAS-RIF) blind restoration method is proposed to enhance the quality of optical coherence tomography(OCT) image. First, ATVR is introduced into the cost function of NAS-RIF to improve the noise robustness and retain the details in the image.Since the split Bregman iterative is used to optimize the ATVR based cost function, the ATVR based NAS-RIF blind restoration method is then constructed. Furthermore, combined with the geometric nonlinear diffusion filter and the Poisson-distribution-based minimum error thresholding, the ATVR based NAS-RIF blind restoration method is used to realize the blind OCT image restoration. The experimental results demonstrate that the ATVR based NAS-RIF blind restoration method can successfully retain the details in the OCT images. In addition, the signal-to-noise ratio of the blind restored OCT images can be improved, along with the noise robustness.

Radial Basis Function Neural Network Based Super- Resolution Restoration for an Undersampled Image

To achieve restoration of high frequency information for an undersampled and degraded low-resolution image, a nonlinear and real-time processing method-the radial basis function (RBF) neural network based super-resolution method of restoration is proposed. The RBF network configuration and processing method is suitable for a high resolution restoration from an undersampled low-resolution image. The soft-competition learning scheme based on the k-means algorithm is used, and can achieve higher mapping approximation accuracy without increase in the network size. Experiments showed that the proposed algorithm can achieve a super-resolution restored image from an undersampled and degraded low-resolution image, and requires a shorter training time when compared with the multiplayer perception (MLP) network.

Dark channel prior based blurred image restoration method using total variation and morphology

The blurred image restoration method can dramatically highlight the image details and enhance the global contrast, which is of benefit to improvement of the visual effect during practical ap- plications. This paper is based on the dark channel prior principle and aims at the prior information absent blurred image degradation situation. A lot of improvements have been made to estimate the transmission map of blurred images. Since the dark channel prior principle can effectively restore the blurred image at the cost of a large amount of computation, the total variation （TV） and image morphology transform （specifically top-hat transform and bottom- hat transform） have been introduced into the improved method. Compared with original transmission map estimation methods, the proposed method features both simplicity and accuracy. The es- timated transmission map together with the element can restore the image. Simulation results show that this method could inhibit the ill-posed problem during image restoration, meanwhile it can greatly improve the image quality and definition.

Wavelet inverse scale space for image restoration

This paper proposes a model for image restoration by combining the wavelet shrinkage and inverse scale space （ISS） method. The ISS is applied to the wavelet representation to modify the retained wavelet coefficients, and the coefficients smaller than the threshold are set to zero. The curvature term of the ISS can remove the edge artifacts and preserve sharp edges. For the multiscale interpretation of the ISS and the multiscale property of the wavelet representation, small details are preserved. This paper illustrates that the wavelet ISS model can be deduced from the wavelet based on a total variation minimization problem. A stopping criterion is obtained from this minimization in the sense of the Bregman distance in the wavelet domain. Numerical examples show the improvement for the image denoising with the proposed method in the sense of the signal to noise ratio and with fewer details remained in the residue.

Artifacts Reduction Using Multi-Scale Feature Attention Network in Compressed Medical Images

Medical image compression is one of the essential technologies to facilitate real-time medical data transmission in remote healthcare applications.In general,image compression can introduce undesired coding artifacts,such as blocking artifacts and ringing effects.In this paper,we proposed a Multi-Scale Feature Attention Network(MSFAN)with two essential parts,which are multi-scale feature extraction layers and feature attention layers to efficiently remove coding artifacts of compressed medical images.Multiscale feature extraction layers have four Feature Extraction(FE)blocks.Each FE block consists of five convolution layers and one CA block for weighted skip connection.In order to optimize the proposed network architectures,a variety of verification tests were conducted using validation dataset.We used Computer Vision Center-Clinic Database(CVC-ClinicDB)consisting of 612 colonoscopy medical images to evaluate the enhancement of image restoration.The proposedMSFAN can achieve improved PSNR gains as high as 0.25 and 0.24 dB on average compared to DnCNNand DCSC,respectively.

A Fast Filling Algorithm for Image Restoration Based on Contour Parity

Filling techniques are often used in the restoration of images.Yet the existing filling technique approaches either have high computational costs or present problems such as filling holes redundantly.This paper proposes a novel algorithm for filling holes and regions of the images.The proposed algorithm combines the advantages of both the parity-check filling approach and the region-growing inpainting technique.Pairing points of the region’s boundary are used to search and to fill the region.The scanning range of the filling method is within the target regions.The proposed method does not require additional working memory or assistant colors,and it can correctly fill any complex contours.Experimental results show that,compared to other approaches,the proposed algorithm fills regions faster and with lower computational cost.

Novel image restoration model coupling gradient fidelity term based on adaptive total variation

A novel image restoration model coupling with a gradient fidelity term based on adaptive total variation is proposed in this paper. In order to choose proper parameters, the selection criteria were analyzed theoretically, and a simple scheme to demonstrate its validity was adopted experimentally. To make fair comparisons of performances of three models, the same numerical algorithm was used to solve partial differential equations. Both the international standard test image on Lena and HR image of CBERS-02B of Dalian city were used to verify the performance of the model. Experimental results illustrate that the new model not only preserved the edge and important details but also alleviated the staircase effect effectively.

Robust Core Tensor Dictionary Learning with Modified Gaussian Mixture Model for Multispectral Image Restoration

The multispectral remote sensing image(MS-RSI)is degraded existing multi-spectral camera due to various hardware limitations.In this paper,we propose a novel core tensor dictionary learning approach with the robust modified Gaussian mixture model for MS-RSI restoration.First,the multispectral patch is modeled by three-order tensor and high-order singular value decomposition is applied to the tensor.Then the task of MS-RSI restoration is formulated as a minimum sparse core tensor estimation problem.To improve the accuracy of core tensor coding,the core tensor estimation based on the robust modified Gaussian mixture model is introduced into the proposed model by exploiting the sparse distribution prior in image.When applied to MS-RSI restoration,our experimental results have shown that the proposed algorithm can better reconstruct the sharpness of the image textures and can outperform several existing state-of-the-art multispectral image restoration methods in both subjective image quality and visual perception.

Single foggy image restoration based on spatial correlation analysis of dark channel prior

Focusing on the degradation of foggy images, a restora- tion approach from a single image based on spatial correlation of dark channel prior is proposed. Firstly, the transmission of each pixel is estimated by the spatial correlation of dark channel prior. Secondly, a degradation model is utilized to restore the foggy image. Thirdly, the final recovered image, with enhanced contrast, is obtained by performing a post-processing technique based on just-noticeable difference. Experimental results demonstrate that the information of a foggy image can be recovered perfectly by the proposed method, even in the case of the abrupt depth changing scene.

Motion-Blurred Image Restoration Based on Joint Invertibility of PSFs

To implement restoration in a single motion blurred image,the PSF(Point Spread Function)is difficult to estimate and the image deconvolution is ill-posed as a result that a good recovery effect cannot be obtained.Considering that several different PSFs can get joint invertibility to make restoration wellposed,we proposed a motion-blurred image restoration method based on joint invertibility of PSFs by means of computational photography.Firstly,we designed a set of observation device which composed by multiple cameras with the same parameters to shoot the moving target in the same field of view continuously to obtain the target images with the same background.The target images have the same brightness,but different exposure time and different motion blur length.It is easy to estimate the blur PSFs of the target images make use of the sequence frames obtained by one camera.According to the motion blur superposition feature of the target and its background,the complete blurred target images can be extracted from the observed images respectively.Finally,for the same target images with different PSFs,the iterative restoration is solved by joint solution of multiple images in spatial domain.The experiments showed that the moving target observation device designed by this method had lower requirements on hardware conditions,and the observed images are more convenient to use joint-PSF solution for image restoration,and the restoration results maintained details well and had lower signal noise ratio(SNR).

Algorithm for repairing the damaged images of grain structures obtained from the cellular automata and measurement of grain size

Computational models are developed to create grain structures using mathematical algorithms based on the chaos theory such as cellular automaton, geometrical models, fractals, and stochastic methods. Because of the chaotic nature of grain structures, some of the most popular routines are based on the Monte Carlo method, statistical distributions, and random walk methods, which can be easily programmed and included in nested loops. Nevertheless, grain structures are not well defined as the results of computational errors and numerical incon- sistencies on mathematical methods. Due to the finite definition of numbers or the numerical restrictions during the simulation of solidifica- tion, damaged images appear on the screen. These images must be repaired to obtain a good measurement of grain geometrical properties. Some mathematical algorithms were developed to repair, measure, and characterize grain structures obtained from cellular automata in the present work. An appropriate measurement of grain size and the corrected identification of interfaces and length are very important topics in materials science because they are the representation and validation of mathematical models with real samples. As a result, the developed al- gorithms are tested and proved to be appropriate and efficient to eliminate the errors and characterize the grain structures.

Research on a novel restoration algorithm of turbulence-degraded images with alternant iterations

A new restoration algorithm based on double loops and alternant iterations is proposed to restore the object image effectively from a few frames of turbulence-degraded images, Based on the double loops, the iterative relations for estimating the turbulent point spread function PSF and object image alternately are derived. The restoration experiments have been made on computers, showing that the proposed algorithm can obtain the optimal estimations of the object and the point spread function, with the feasibility and practicality of the proposed algorithm being convincing.