Estimation-free spatial-domain image reconstruction of structured illumination microscopy

Structured illumination microscopy(SIM)achieves super-resolution(SR)by modulating the high-frequency information of the sample into the passband of the optical system and subsequent image reconstruction.The traditional Wiener-filtering-based reconstruction algorithm operates in the Fourier domain,it requires prior knowledge of the sinusoidal illumination patterns which makes the time-consuming procedure of parameter estimation to raw datasets necessary,besides,the parameter estimation is sensitive to noise or aberration-induced pattern distortion which leads to reconstruction artifacts.Here,we propose a spatial-domain image reconstruction method that does not require parameter estimation but calculates patterns from raw datasets,and a reconstructed image can be obtained just by calculating the spatial covariance of differential calculated patterns and differential filtered datasets(the notch filtering operation is performed to the raw datasets for attenuating and compensating the optical transfer function(OTF)).Experiments on reconstructing raw datasets including nonbiological,biological,and simulated samples demonstrate that our method has SR capability,high reconstruction speed,and high robustness to aberration and noise.

Triple-path feature transform network for ring-array photoacoustic tomography image reconstruction

Photoacoustic imaging(PAI)is a noninvasive emerging imaging method based on the photoacoustic effect,which provides necessary assistance for medical diagnosis.It has the characteristics of large imaging depth and high contrast.However,limited by the equipment cost and reconstruction time requirements,the existing PAI systems distributed with annular array transducers are difficult to take into account both the image quality and the imaging speed.In this paper,a triple-path feature transform network(TFT-Net)for ring-array photoacoustic tomography is proposed to enhance the imaging quality from limited-view and sparse measurement data.Specifically,the network combines the raw photoacoustic pressure signals and conventional linear reconstruction images as input data,and takes the photoacoustic physical model as a prior information to guide the reconstruction process.In addition,to enhance the ability of extracting signal features,the residual block and squeeze and excitation block are introduced into the TFT-Net.For further efficient reconstruction,the final output of photoacoustic signals uses‘filter-then-upsample’operation with a pixel-shuffle multiplexer and a max out module.Experiment results on simulated and in-vivo data demonstrate that the constructed TFT-Net can restore the target boundary clearly,reduce background noise,and realize fast and high-quality photoacoustic image reconstruction of limited view with sparse sampling.

Image Reconstruction of Ghost Imaging Based on Improved Generative Adversarial Networks

In this paper, we improve traditional generative adversarial networks (GAN) with reference to residual networks and convolutional neural networks to facilitate the reconstruction of complex objects that cannot be reconstructed by traditional associative imaging methods. Unlike traditional ghost imaging to reconstruct objects from bucket signals, our proposed method can use simple objects (such as EMNIST) as a training set for GAN, and then recognize objects (such as faces) of completely different complexity than the training set. We use traditional ghost imaging and neural network to reconstruct target objects respectively. According to the research results in this paper, the method based on neural network can reconstruct complex objects very well, but the method based on traditional ghost imaging cannot reconstruct complex objects. The research scheme in this paper is of great significance for the reconstruction of complex object-related imaging under low sampling conditions.

A new imaging mode based on X-ray CT as prior image and sparsely sampled projections for rapid clinical proton CT

Proton computed tomography(CT)has a distinct practical significance in clinical applications.It eliminates 3–5%errors caused by the transformation of Hounsfield unit(HU)to relative stopping power(RSP)values when using X-ray CT for positioning and treatment planning systems(TPSs).Following the development of FLASH proton therapy,there are increased requirements for accurate and rapid positioning in TPSs.Thus,a new rapid proton CT imaging mode is proposed based on sparsely sampled projections.The proton beam was boosted to 350 MeV by a compact proton linear accelerator(LINAC).In this study,the comparisons of the proton scattering with the energy of 350 MeV and 230 MeV are conducted based on GEANT4 simulations.As the sparsely sampled information associated with beam acquisitions at 12 angles is not enough for reconstruction,X-ray CT is used as a prior image.The RSP map generated by converting the X-ray CT was constructed based on Monte Carlo simulations.Considering the estimation of the most likely path(MLP),the prior image-constrained compressed sensing(PICCS)algorithm is used to reconstruct images from two different phantoms using sparse proton projections of 350 MeV parallel proton beam.The results show that it is feasible to realize the proton image reconstruction with the rapid proton CT imaging proposed in this paper.It can produce RSP maps with much higher accuracy for TPSs and fast positioning to achieve ultra-fast imaging for real-time image-guided radiotherapy(IGRT)in clinical proton therapy applications.

Subpixel Reconstruction Algorithm in Staring FPA Nonuniform Microscan Imaging

For the nonuniform microscan system where the interframe translation is no longer equivalent to accurate halfpixel, a 2-dimension non-interpolated subpixel algorithm is proposed to consider arhitrary value of microscanning. The aim of the proposed algorithm is to restore double resolution from 2 × 2 undersampled frames. To solve the ill-posed problem in the process of image reconstruction, the prior boundary condition is introduced, and the proposed subpixel reconstruction algorithm is reformulated into the form of line-by-line backward propagation iteration for reducing the calculation complexity. Since the direction of movement offset relative to the accurate halfpixel determines the transfer matrix of the image degradation process, the recon- struction is classified into 4 types when 2 × 2 mieroscan model is applied. All the simulation results and experiment data demonstrate the double resolution improvement compared with the undersampled images. The focus problem, scarcely any possibility of the operation with accurate halfpixel micromotion, is figured out for en-hancing the feasibility of subpixel reconstruction used in practice.

IMAGE RECONSTRUCTION AND OBJECT CLASSIFICATION IN CT IMAGING SYSTEM

By obtaining a feasible filter function,reconstructed images can be got with linear interpolation and liftered backprojection techniques.Considering the gray and spstial correlation neighbour informations of each pixel,a new supervised classification method is put forward for the reconstructed images,and an experiment with noise image is done,the result shows that the method is feasible and accurate compared with ideal phantoms.

Recent developments of the reconstruction in magnetic particle imaging

Magnetic particle imaging(MPI)is an emerging molecular imaging technique with high sensitivity and temporal-spatial resolution.Image reconstruction is an important research topic in MPI,which converts an induced voltage signal into the image of superparamagnetic iron oxide particles concentration distribution.MPI reconstruction primarily involves system matrix-and x-space-based methods.In this review,we provide a detailed overview of the research status and future research trends of these two methods.In addition,we review the application of deep learning methods in MPI reconstruction and the current open sources of MPI.Finally,research opinions on MPI reconstruction are presented.We hope this review promotes the use of MPI in clinical applications.

Digital Imaging Reconstruction from Multiple Angle Diversity Using Digital Filtering Technique

Microwave diffraction tomography is a process to infer the internal structure of an objectfrom multiple angle views of microwave diffraction shadow. Being sensitive to variations in refractive index of the object, the procedure can be used to measure permittivity distributions within dielectric objects and to image soft tissues for biomedical applications. The optimal resolution distance obtainable is half a wavelength, but this can rarely be achieved because of practical limitations. Some procedures, however, are available to improve the practical resolution. One, which is suitable for microwave tomography, is to use multiple angle views data and to combine the resulting images. The other, which is suitable for improving the image reconstruction resolution, is to use the digital filtering technique and the filtered backpropagation algorithm. A system operating over the X-band microwave frequency is described and some experimental results for objects in air are given.

Non-iterative image reconstruction from sparse magnetic resonance imaging radial data without priors

The state-of-the-art approaches for image reconstruction using under-sampled k-space data are compressed sensing based.They are iterative algorithms that optimize objective functions with spatial and/or temporal constraints.This paper proposes a non-iterative algorithm to estimate the un-measured data and then to reconstruct the image with the efficient filtered backprojection algorithm.The feasibility of the proposed method is demonstrated with a patient magnetic resonance imaging study.The proposed method is also compared with the state-of-the-art iterative compressed-sensing image reconstruction method using the total-variation optimization norm.

Oversample Reconstruction Based on a Strong Inter-Diagonal Matrix for an Optical Microscanning Thermal Microscope Imaging System

Based on a strong inter-diagonal matrix and Taylor series expansions,an oversample reconstruction method was proposed to calibrate the optical micro-scanning error. The technique can obtain regular 2 ×2 microscanning undersampling images from the real irregular undersampling images,and can then obtain a high spatial oversample resolution image. Simulations and experiments show that the proposed technique can reduce optical micro-scanning error and improve the system＇s spatial resolution. The algorithm is simple,fast and has low computational complexity. It can also be applied to other electro-optical imaging systems to improve their spatial resolution and has a widespread application prospect.

Comparison of Image Reconstruction Algorithms in EIT Imaging

Electrical Impedance Tomography (EIT) is a medical imaging technique which can be used to monitor the regional ventilation in patients utilizing voltage measurements made at the thorax. Several reconstruction algorithms have been developed during the last few years. In this manuscript we compare a well-established algorithm and a re-cently developed method for image reconstruction regarding EIT indices derived from the differently reconstructed images.

Preliminary landscape analysis of deep tomographic imaging patents

Over recent years,the importance of the patent literature has become increasingly more recognized in the aca-demic setting.In the context of artificial intelligence,deep learning,and data sciences,patents are relevant to not only industry but also academe and other communities.In this article,we focus on deep tomographic imaging and perform a preliminary landscape analysis of the related patent literature.Our search tool is PatSeer.Our patent biblio-metric data is summarized in various figures and tables.In particular,we qualitatively analyze key deep tomographic patent literature.

Rising role of artificial intelligence in image reconstruction for biomedical imaging

In this editorial,we review recent progress on the applications of artificial intelligence(AI)in image reconstruction for biomedical imaging.Because it abandons prior information of traditional artificial design and adopts a completely data-driven mode to obtain deeper prior information via learning,AI technology plays an increasingly important role in biomedical image reconstruction.The combination of AI technology and the biomedical image reconstruction method has become a hotspot in the field.Favoring AI,the performance of biomedical image reconstruction has been improved in terms of accuracy,resolution,imaging speed,etc.We specifically focus on how to use AI technology to improve the performance of biomedical image reconstruction,and propose possible future directions in this field.

Deep Learned Singular Residual Network for Super Resolution Reconstruction

Single image super resolution(SISR)techniques produce images of high resolution(HR)as output from input images of low resolution(LR).Motivated by the effectiveness of deep learning methods,we provide a framework based on deep learning to achieve super resolution(SR)by utilizing deep singular-residual neural network(DSRNN)in training phase.Residuals are obtained from the difference between HR and LR images to generate LR-residual example pairs.Singular value decomposition(SVD)is applied to each LR-residual image pair to decompose into subbands of low and high frequency components.Later,DSRNN is trained on these subbands through input and output channels by optimizing the weights and biases of the network.With fewer layers in DSRNN,the influence of exploding gradients is reduced.This speeds up the learning process and also improves accuracy by using skip connections.The trained DSRNN parameters yield residuals to recover the HR subbands in the testing phase.Experimental analysis shows that the proposed method results in superior performance to existingmethods in terms of subjective quality.Extensive testing results on popular benchmark datasets such as set5,set14,and urban100 for a scaling factor of 4 show the effectiveness of the proposed method across different qualitative evaluation metrics.

Principle of subtraction ghost imaging in scattering medium

Scattering medium in light path will cause distortion of the light field,resulting in poor signal-to-noise ratio(SNR)of ghost imaging.The disturbance is usually eliminated by the method of pre-compensation.We deduce the intensity fluctuation correlation function of the ghost imaging with the disturbance of the scattering medium,which proves that the ghost image consists of two correlated results:the image of scattering medium and the target object.The effect of the scattering medium can be eliminated by subtracting the correlated result between the light field after the scattering medium and the reference light from ghost image,which verifies the theoretical results.Our research may provide a new idea of ghost imaging in harsh environment.

Compressive near-field millimeter wave imaging algorithm based on Gini index and total variation mixed regularization

A compressive near-field millimeter wave(MMW)imaging algorithm is proposed.From the compressed sensing(CS)theory,the compressive near-field MMW imaging process can be considered to reconstruct an image from the under-sampled sparse data.The Gini index(GI)has been founded that it is the only sparsity measure that has all sparsity attributes that are called Robin Hood,Scaling,Rising Tide,Cloning,Bill Gates,and Babies.By combining the total variation(TV)operator,the GI-TV mixed regularization introduced compressive near-field MMW imaging model is proposed.In addition,the corresponding algorithm based on a primal-dual framework is also proposed.Experimental results demonstrate that the proposed GI-TV mixed regularization algorithm has superior convergence and stability performance compared with the widely used l1-TV mixed regularization algorithm.

Artificial Intelligence-Based Image Reconstruction for Computed Tomography: A Survey

Computed tomography has made significant advances since its intro-duction in the early 1970s,where researchers have mainly focused on the quality of image reconstruction in the early stage.However,radiation exposure poses a health risk,prompting the demand of the lowest possible dose when carrying out CT examinations.To acquire high-quality reconstruction images with low dose radiation,CT reconstruction techniques have evolved from conventional reconstruction such as analytical and iterative reconstruction,to reconstruction methods based on artificial intelligence(AI).All these efforts are devoted to con-structing high-quality images using only low doses with fast reconstruction speed.In particular,conventional reconstruction methods usually optimize one aspect,while AI-based reconstruction has finally managed to attain all goals in one shot.However,there are limitations such as the requirements on large datasets,unstable performance,and weak generalizability in AI-based reconstruction methods.This work presents the review and discussion on the classification,the commercial use,the advantages,and the limitations of AI-based image reconstruction methods in CT.

Accelerating SAGE algorithm in PET image reconstruction by rescaled block-iterative method

A new method to accelerate the convergent rate of the space-alternatinggeneralized expectation-maximization (SAGE) algorithm is proposed. The new rescaled block-iterativeSAGE (RBI-SAGE) algorithm combines the RBI algorithm with the SAGE algorithm for PET imagereconstruction. In the new approach, the projection data is partitioned into disjoint blocks; eachiteration step involves only one of these blocks. SAGE updates the parameters sequentially in eachblock. In experiments, the RBI-SAGE algorithm and classical SAGE algorithm are compared in theapplication on positron emission tomography (PET) image reconstruction. Simulation results show thatRBI-SAGE has better performance than SAGE in both convergence and image quality.

A generalized deep neural network approach for improving resolution of fluorescence microscopy images

Deep learning is capable of greatly promoting the progress of super-resolution imaging technology in terms of imaging and reconstruction speed,imaging resolution,and imagingflux.This paper proposes a deep neural network based on a generative adversarial network(GAN).The generator employs a U-Net-based network,which integrates Dense Net for the downsampling component.The proposed method has excellent properties,for example,the network model is trained with several different datasets of biological structures;the trained model can improve the imaging resolution of different microscopy imaging modalities such as confocal imaging and wide-field imaging;and the model demonstrates a generalized ability to improve the resolution of different biological structures even out of the datasets.In addition,experimental results showed that the method improved the resolution of caveolin-coated pits(CCPs)structures from 264 nm to 138 nm,a 1.91-fold increase,and nearly doubled the resolution of DNA molecules imaged while being transported through microfluidic channels.

Underwater image clarifying based on human visual colour constancy using double-opponency

Underwater images are often with biased colours and reduced contrast because of the absorption and scattering effects when light propagates in water.Such images with degradation cannot meet the needs of underwater operations.The main problem in classic underwater image restoration or enhancement methods is that they consume long calcu-lation time,and often,the colour or contrast of the result images is still unsatisfied.Instead of using the complicated physical model of underwater imaging degradation,we propose a new method to deal with underwater images by imitating the colour constancy mechanism of human vision using double-opponency.Firstly,the original image is converted to the LMS space.Then the signals are linearly combined,and Gaussian convolutions are per-formed to imitate the function of receptive fields(RFs).Next,two RFs with different sizes work together to constitute the double-opponency response.Finally,the underwater light is estimated to correct the colours in the image.Further contrast stretching on the luminance is optional.Experiments show that the proposed method can obtain clarified underwater images with higher quality than before,and it spends significantly less time cost compared to other previously published typical methods.