Triple-path feature transform network for ring-array photoacoustic tomography image reconstruction

Photoacoustic imaging(PAI)is a noninvasive emerging imaging method based on the photoacoustic effect,which provides necessary assistance for medical diagnosis.It has the characteristics of large imaging depth and high contrast.However,limited by the equipment cost and reconstruction time requirements,the existing PAI systems distributed with annular array transducers are difficult to take into account both the image quality and the imaging speed.In this paper,a triple-path feature transform network(TFT-Net)for ring-array photoacoustic tomography is proposed to enhance the imaging quality from limited-view and sparse measurement data.Specifically,the network combines the raw photoacoustic pressure signals and conventional linear reconstruction images as input data,and takes the photoacoustic physical model as a prior information to guide the reconstruction process.In addition,to enhance the ability of extracting signal features,the residual block and squeeze and excitation block are introduced into the TFT-Net.For further efficient reconstruction,the final output of photoacoustic signals uses‘filter-then-upsample’operation with a pixel-shuffle multiplexer and a max out module.Experiment results on simulated and in-vivo data demonstrate that the constructed TFT-Net can restore the target boundary clearly,reduce background noise,and realize fast and high-quality photoacoustic image reconstruction of limited view with sparse sampling.

Estimation-free spatial-domain image reconstruction of structured illumination microscopy

Structured illumination microscopy(SIM)achieves super-resolution(SR)by modulating the high-frequency information of the sample into the passband of the optical system and subsequent image reconstruction.The traditional Wiener-filtering-based reconstruction algorithm operates in the Fourier domain,it requires prior knowledge of the sinusoidal illumination patterns which makes the time-consuming procedure of parameter estimation to raw datasets necessary,besides,the parameter estimation is sensitive to noise or aberration-induced pattern distortion which leads to reconstruction artifacts.Here,we propose a spatial-domain image reconstruction method that does not require parameter estimation but calculates patterns from raw datasets,and a reconstructed image can be obtained just by calculating the spatial covariance of differential calculated patterns and differential filtered datasets(the notch filtering operation is performed to the raw datasets for attenuating and compensating the optical transfer function(OTF)).Experiments on reconstructing raw datasets including nonbiological,biological,and simulated samples demonstrate that our method has SR capability,high reconstruction speed,and high robustness to aberration and noise.

Artificial Intelligence-Based Image Reconstruction for Computed Tomography: A Survey

Computed tomography has made significant advances since its intro-duction in the early 1970s,where researchers have mainly focused on the quality of image reconstruction in the early stage.However,radiation exposure poses a health risk,prompting the demand of the lowest possible dose when carrying out CT examinations.To acquire high-quality reconstruction images with low dose radiation,CT reconstruction techniques have evolved from conventional reconstruction such as analytical and iterative reconstruction,to reconstruction methods based on artificial intelligence(AI).All these efforts are devoted to con-structing high-quality images using only low doses with fast reconstruction speed.In particular,conventional reconstruction methods usually optimize one aspect,while AI-based reconstruction has finally managed to attain all goals in one shot.However,there are limitations such as the requirements on large datasets,unstable performance,and weak generalizability in AI-based reconstruction methods.This work presents the review and discussion on the classification,the commercial use,the advantages,and the limitations of AI-based image reconstruction methods in CT.

Image Reconstruction of Ghost Imaging Based on Improved Generative Adversarial Networks

In this paper, we improve traditional generative adversarial networks (GAN) with reference to residual networks and convolutional neural networks to facilitate the reconstruction of complex objects that cannot be reconstructed by traditional associative imaging methods. Unlike traditional ghost imaging to reconstruct objects from bucket signals, our proposed method can use simple objects (such as EMNIST) as a training set for GAN, and then recognize objects (such as faces) of completely different complexity than the training set. We use traditional ghost imaging and neural network to reconstruct target objects respectively. According to the research results in this paper, the method based on neural network can reconstruct complex objects very well, but the method based on traditional ghost imaging cannot reconstruct complex objects. The research scheme in this paper is of great significance for the reconstruction of complex object-related imaging under low sampling conditions.

Method of lateral image reconstruction in structured illumination microscopy with super resolution

The image reconstruction process in super-resolution structured illumination microscopy(SIM)is investigated.The structured pattern is generated by the interference of two Gaussian beams to encode undetectable spectra into detectable region of microscope.After parameters estimation of the structured pattern,the encoded spectra are computationally decoded and recombined in Fourier domain to equivalently increase the cut-off frequency of microscope,resulting in the extension of detectable spectra and a reconstructed image with about two-fold enhanced resolution.Three di®erent methods to estimate the initial phase of structured pattern are compared,verifying the auto-correlation algorithm a®ords the fast,most precise and robust measurement.The artifacts sources and detailed reconstruction°owchart for both linear and nonlinear SIM are also presented.

Research on Multi-View Image Reconstruction Technology Based on Auto-Encoding Learning

Traditional three-dimensional(3D)image reconstruction method,which highly dependent on the environment and has poor reconstruction effect,is easy to lead to mismatch and poor real-time performance.The accuracy of feature extraction from multiple images affects the reliability and real-time performance of 3D reconstruction technology.To solve the problem,a multi-view image 3D reconstruction algorithm based on self-encoding convolutional neural network is proposed in this paper.The algorithm first extracts the feature information of multiple two-dimensional(2D)images based on scale and rotation invariance parameters of Scale-invariant feature transform(SIFT)operator.Secondly,self-encoding learning neural network is introduced into the feature refinement process to take full advantage of its feature extraction ability.Then,Fish-Net is used to replace the U-Net structure inside the self-encoding network to improve gradient propagation between U-Net structures,and Generative Adversarial Networks(GAN)loss function is used to replace mean square error(MSE)to better express image features,discarding useless features to obtain effective image features.Finally,an incremental structure from motion(SFM)algorithm is performed to calculate rotation matrix and translation vector of the camera,and the feature points are triangulated to obtain a sparse spatial point cloud,and meshlab software is used to display the results.Simulation experiments show that compared with the traditional method,the image feature extraction method proposed in this paper can significantly improve the rendering effect of 3D point cloud,with an accuracy rate of 92.5%and a reconstruction complete rate of 83.6%.

SDOCT IMAGE RECONSTRUCTION BY INTERFEROMETRIC SYNTHETIC APERTURE MICROSCOPY

Spectral domain optical coherence tomography(SDOCT)is a noninvasive,cross-sectional imaging technique that measures depth resolved reflectance of tissue by Fourier transforming the spectral interferogram with the scanning of the reference avoided.Interferometric synthetic aperture microscopy(ISAM)is an optical microscopy computed-imaging technique for measuring the optical properties of biological tissues,which can overcome the compromise between depth of focus and transverse resolution.This paper describes the principle of SDOCT and ISAM,which multiplexes raw acquisitions to provide quantitatively meaningful data with reliable spatially invariant resolution at all depths.A mathematical model for a coherent microscope with a planar scanning geometry and spectral detection was described.The two-dimensional fast Fourier transform(FFT)of spectral data in the transverse directions was calculated.Then the nonuniform ISAM resampling and filtering was implemented to yield the scattering potential within the scalar model.Inverse FFT was used to obtain the ISAM reconstruction.One scatterer,multiple scatterers,and noisy simulations were implemented by use of ISAM to catch spatially invariant resolution.ISAM images were compared to those obtained using standard optical coherence tomography(OCT)methods.The high quality of the results validates the rationality of the founded model and that diffraction limited resolution can be achieved outside the focal plane.

Multi-channel fast super-resolution image reconstruction based on matrix observation model

A multi-channel fast super-resolution image reconstruction algorithm based on matrix observation model is proposed in the paper,which consists of three steps to avoid the computational complexity: a single image SR reconstruction step,a registration step and a wavelet-based image fusion. This algorithm decomposes two large matrixes to the tensor product of two little matrixes and uses the natural isomorphism between matrix space and vector space to transform cost function based on matrix-vector products model to matrix form. Furthermore,we prove that the regularization part can be transformed to the matrix formed. The conjugate-gradient method is used to solve this new model. Finally,the wavelet fusion is used to integrate all the registered highresolution images obtained from the single image SR reconstruction step. The proposed algorithm reduces the storage requirement and the calculating complexity,and can be applied to large-dimension low-resolution images.

Non-iterative image reconstruction from sparse magnetic resonance imaging radial data without priors

The state-of-the-art approaches for image reconstruction using under-sampled k-space data are compressed sensing based.They are iterative algorithms that optimize objective functions with spatial and/or temporal constraints.This paper proposes a non-iterative algorithm to estimate the un-measured data and then to reconstruct the image with the efficient filtered backprojection algorithm.The feasibility of the proposed method is demonstrated with a patient magnetic resonance imaging study.The proposed method is also compared with the state-of-the-art iterative compressed-sensing image reconstruction method using the total-variation optimization norm.

Comparison of Image Reconstruction Algorithms in EIT Imaging

Electrical Impedance Tomography (EIT) is a medical imaging technique which can be used to monitor the regional ventilation in patients utilizing voltage measurements made at the thorax. Several reconstruction algorithms have been developed during the last few years. In this manuscript we compare a well-established algorithm and a re-cently developed method for image reconstruction regarding EIT indices derived from the differently reconstructed images.

Rising role of artificial intelligence in image reconstruction for biomedical imaging

In this editorial,we review recent progress on the applications of artificial intelligence(AI)in image reconstruction for biomedical imaging.Because it abandons prior information of traditional artificial design and adopts a completely data-driven mode to obtain deeper prior information via learning,AI technology plays an increasingly important role in biomedical image reconstruction.The combination of AI technology and the biomedical image reconstruction method has become a hotspot in the field.Favoring AI,the performance of biomedical image reconstruction has been improved in terms of accuracy,resolution,imaging speed,etc.We specifically focus on how to use AI technology to improve the performance of biomedical image reconstruction,and propose possible future directions in this field.

Image reconstruction for the coded aperture system in nuclear safety and security using a Monte Carlo-based system matrix

Purpose Accurate localization of radioactive materials is critical to nuclear safety and nuclear security.A coded aperture imaging system provides a visualization solution.However,the correlation method has poor reconstruction performance for sources with low counts and for extended sources.Methods In this study,a Monte Carlo optimization-based MLEM algorithm(MC-MLEM)is proposed.The system matrix was obtained by accurate Monte Carlo simulation,so the physical effects such as mask penetration that affect the imaging process were taken into account in the MLEM algorithm.In the simulation process,the normalization of the system matrix was realized by controlling the source at different position of the source plane to have the same activity and emission angle.Results The experimental results showed that compared with the correlation method,the MC-MLEM algorithm could improve the signal-to-noise ratio and angular resolution and locate the source position quickly and accurately under low count conditions.Furthermore,the MC-MLEM algorithm could reconstruct the shape of the extended source and the expected activity ratio of cold-hot sources with large activity differences.Conclusion The MC-MLEM algorithm improved the imaging results and enhanced the reconstruction performance.

Capsule networks embedded with prior known support information for image reconstruction

Compressed sensing(CS)has been successfully applied to realize image reconstruction.Neural networks have been introduced to the CS of images to exploit the prior known support information,which can improve the reconstruction quality.Capsule Network(Caps Net)is the latest achievement in neural networks,and can well represent the instantiation parameters of a specific type of entity or part of an object.This study aims to propose a Caps Net with a novel dynamic routing to embed the information within the CS framework.The output of the network represents the probability that the index of the nonzero entry exists on the support of the signal of interest.To lead the dynamic routing to the most likely index,a group of prediction vectors is designed determined by the information.Furthermore,the results of experiments on imaging signals are taken for a comparation of the performances among different algorithms.It is concluded that the proposed capsule network(Caps Net)creates higher reconstruction quality at nearly the same time with traditional Caps Net.

Multi-scale cross-domain alignment for person image generation

Person image generation aims to generate images that maintain the original human appearance in different target poses.Recent works have revealed that the critical element in achieving this task is the alignment of appearance domain and pose domain.Previous alignment methods,such as appearance flow warping,correspondence learning and cross attention,often encounter challenges when it comes to producing fine texture details.These approaches suffer from limitations in accurately estimating appearance flows due to the lack of global receptive field.Alternatively,they can only perform cross-domain alignment on high-level feature maps with small spatial dimensions since the computational complexity increases quadratically with larger feature sizes.In this article,the significance of multi-scale alignment,in both low-level and high-level domains,for ensuring reliable cross-domain alignment of appearance and pose is demonstrated.To this end,a novel and effective method,named Multi-scale Crossdomain Alignment(MCA)is proposed.Firstly,MCA adopts global context aggregation transformer to model multi-scale interaction between pose and appearance inputs,which employs pair-wise window-based cross attention.Furthermore,leveraging the integrated global source information for each target position,MCA applies flexible flow prediction head and point correlation to effectively conduct warping and fusing for final transformed person image generation.Our proposed MCA achieves superior performance on two popular datasets than other methods,which verifies the effectiveness of our approach.

High-speed image reconstruction for optically sectioned,super-resolution structured illumination microscopy

Super-resolution structured illumination microscopy(SR-SIM)is an outstanding method for visualizing the subcellular dynamics in living cells.To date,by using elaborately designed systems and algorithms,SR-SIM can achieve rapid,optically sectioned,SR observation with hundreds to thousands of time points.However,real-time observation is still out of reach for most SIM setups as conventional algorithms for image reconstruction involve a heavy computing burden.To address this limitation,an accelerated reconstruction algorithm was developed by implementing a simplified workflow for SR-SIM,termed joint space and frequency reconstruction.This algorithm results in an 80-fold improvement in reconstruction speed relative to the widely used Wiener-SIM.Critically,the increased processing speed does not come at the expense of spatial resolution or sectioning capability,as demonstrated by live imaging of microtubule dynamics and mitochondrial tubulation.

Reconstruction of electrical capacitance tomography images based on fast linearized alternating direction method of multipliers for two-phase flow system

Electrical capacitance tomography(ECT)has been applied to two-phase flow measurement in recent years.Image reconstruction algorithms play an important role in the successful applications of ECT.To solve the ill-posed and nonlinear inverse problem of ECT image reconstruction,a new ECT image reconstruction method based on fast linearized alternating direction method of multipliers(FLADMM)is proposed in this paper.On the basis of theoretical analysis of compressed sensing(CS),the data acquisition of ECT is regarded as a linear measurement process of permittivity distribution signal of pipe section.A new measurement matrix is designed and L1 regularization method is used to convert ECT inverse problem to a convex relaxation problem which contains prior knowledge.A new fast alternating direction method of multipliers which contained linearized idea is employed to minimize the objective function.Simulation data and experimental results indicate that compared with other methods,the quality and speed of reconstructed images are markedly improved.Also,the dynamic experimental results indicate that the proposed algorithm can ful fill the real-time requirement of ECT systems in the application.

Data-Driven Tight Frame for Multi-channel Images and Its Application to Joint Color-Depth Image Reconstruction

In image restoration,we usually assume that the underlying image has a good sparse approximation under a certain system.Wavelet tight frame system has been proven to be such an efficient system to sparsely approximate piecewise smooth images.Thus,it has been widely used in many practical image restoration problems.However,images from different scenarios are so diverse that no static wavelet tight frame system can sparsely approximate all of themwell.To overcome this,recently,Cai et.al.(Appl Comput Harmon Anal 37:89–105,2014)proposed a method that derives a data-driven tight frame adapted to the specific input image,leading to a better sparse approximation.The data-driven tight frame has been applied successfully to image denoising and CT image reconstruction.In this paper,we extend this data-driven tight frame construction method to multi-channel images.We construct a discrete tight frame system for each channel and assume their sparse coefficients have a joint sparsity.The multi-channel data-driven tight frame construction scheme is applied to joint color and depth image reconstruction.Experimental results show that the proposed approach has a better performance than state-of-the-art joint color and depth image reconstruction approaches.

A new inversion method for reconstruction of plasmaspheric He^(+)density from EUV images

The Computer Tomography(CT)method is used for remote sensing the Earth’s plasmasphere.One challenge for image reconstruction is insufficient projection data,mainly caused by limited projection angles.In this study,we apply the Algebraic Reconstruction Technique(ART)and the minimization of the image Total Variation(TV)method,with a combination of priori knowledge of north–south symmetry,to reconstruct plasmaspheric He+density from simulated EUV images.The results demonstrate that incorporating priori assumption can be particularly useful when the projection data is insufficient.This method has good performance even with a projection angle of less than 150 degrees.The method of our study is expected to have applications in the Soft X-ray Imager(SXI)reconstruction for the Solar wind–Magnetosphere–Ionosphere Link Explorer(SMILE)mission.

Finite Element Modeling of Human Thorax Based on MRI Images for EIT Image Reconstruction

Electrical impedance tomography(EIT)image reconstruction is a non-linear problem.In general,finite element model is the critical basis of EIT image reconstruction.A 3D human thorax modeling method for EIT image reconstruction is proposed herein to improve the accuracy and reduce the complexity of existing finite element modeling methods.The contours of human thorax and lungs are extracted from the layers of magnetic resonance imaging(MRI)images by an optimized Otsu’s method for the construction of the 3D human thorax model including the lung models.Furthermore,the GMSH tool is used for finite element subdivision to generate the 3D finite element model of human thorax.The proposed modeling method is fast and accurate,and it is universal for different types of MRI images.The effectiveness of the proposed method is validated by extensive numerical simulation in MATLAB.The results show that the individually oriented 3D finite element model can improve the reconstruction quality of the EIT images more effectively than the cylindrical model,the 2.5D model and other human chest models.

An image reconstruction algorithm of EIT based on pulmonary prior information

Using a CT scan of the pulmonary tissue,a human pulmonary model is established combined with the structure property of the human lung tissue using the software COMSOL.Combined with the conductivity contribution information of the human tissue and organ,an image reconstruction method of electrical impedance tomography based on pulmonary prior information is proposed using the conjugate gradient method.Simulation results show that the uniformity index of sensitivity distribution of the pulmonary model is 15.568,which is significantly reduced compared with 34.218 based on the round field.The proposed algorithm improves the uniformity of the sensing field,the image resolution of the conductivity distribution of pulmonary tissue and the quality of the reconstruction image based on pulmonary prior information.