Estimation-free spatial-domain image reconstruction of structured illumination microscopy

Structured illumination microscopy(SIM)achieves super-resolution(SR)by modulating the high-frequency information of the sample into the passband of the optical system and subsequent image reconstruction.The traditional Wiener-filtering-based reconstruction algorithm operates in the Fourier domain,it requires prior knowledge of the sinusoidal illumination patterns which makes the time-consuming procedure of parameter estimation to raw datasets necessary,besides,the parameter estimation is sensitive to noise or aberration-induced pattern distortion which leads to reconstruction artifacts.Here,we propose a spatial-domain image reconstruction method that does not require parameter estimation but calculates patterns from raw datasets,and a reconstructed image can be obtained just by calculating the spatial covariance of differential calculated patterns and differential filtered datasets(the notch filtering operation is performed to the raw datasets for attenuating and compensating the optical transfer function(OTF)).Experiments on reconstructing raw datasets including nonbiological,biological,and simulated samples demonstrate that our method has SR capability,high reconstruction speed,and high robustness to aberration and noise.

Triple-path feature transform network for ring-array photoacoustic tomography image reconstruction

Photoacoustic imaging(PAI)is a noninvasive emerging imaging method based on the photoacoustic effect,which provides necessary assistance for medical diagnosis.It has the characteristics of large imaging depth and high contrast.However,limited by the equipment cost and reconstruction time requirements,the existing PAI systems distributed with annular array transducers are difficult to take into account both the image quality and the imaging speed.In this paper,a triple-path feature transform network(TFT-Net)for ring-array photoacoustic tomography is proposed to enhance the imaging quality from limited-view and sparse measurement data.Specifically,the network combines the raw photoacoustic pressure signals and conventional linear reconstruction images as input data,and takes the photoacoustic physical model as a prior information to guide the reconstruction process.In addition,to enhance the ability of extracting signal features,the residual block and squeeze and excitation block are introduced into the TFT-Net.For further efficient reconstruction,the final output of photoacoustic signals uses‘filter-then-upsample’operation with a pixel-shuffle multiplexer and a max out module.Experiment results on simulated and in-vivo data demonstrate that the constructed TFT-Net can restore the target boundary clearly,reduce background noise,and realize fast and high-quality photoacoustic image reconstruction of limited view with sparse sampling.

Model-driven CT reconstruction algorithm for nano-resolution x-ray phase contrast imaging

The low-density imaging performance of a zone plate-based nano-resolution hard x-ray computed tomography(CT)system can be significantly improved by incorporating a grating-based Lau interferometer. Due to the diffraction, however,the acquired nano-resolution phase signal may suffer splitting problem, which impedes the direct reconstruction of phase contrast CT(nPCT) images. To overcome, a new model-driven nPCT image reconstruction algorithm is developed in this study. In it, the diffraction procedure is mathematically modeled into a matrix B, from which the projections without signal splitting can be generated invertedly. Furthermore, a penalized weighted least-square model with total variation(PWLSTV) is employed to denoise these projections, from which nPCT images with high accuracy are directly reconstructed.Numerical experiments demonstrate that this new algorithm is able to work with phase projections having any splitting distances. Moreover, results also reveal that nPCT images of higher signal-to-noise-ratio(SNR) could be reconstructed from projections having larger splitting distances. In summary, a novel model-driven nPCT image reconstruction algorithm with high accuracy and robustness is verified for the Lau interferometer-based hard x-ray nano-resolution phase contrast imaging.

Deep learning-based magnetic resonance imaging reconstruction for improving the image quality of reduced-field-of-view diffusionweighted imaging of the pancreas

BACKGROUND It has been reported that deep learning-based reconstruction(DLR)can reduce image noise and artifacts,thereby improving the signal-to-noise ratio and image sharpness.However,no previous studies have evaluated the efficacy of DLR in improving image quality in reduced-field-of-view(reduced-FOV)diffusionweighted imaging(DWI)[field-of-view optimized and constrained undistorted single-shot(FOCUS)]of the pancreas.We hypothesized that a combination of these techniques would improve DWI image quality without prolonging the scan time but would influence the apparent diffusion coefficient calculation.AIM To evaluate the efficacy of DLR for image quality improvement of FOCUS of the pancreas.METHODS This was a retrospective study evaluated 37 patients with pancreatic cystic lesions who underwent magnetic resonance imaging between August 2021 and October 2021.We evaluated three types of FOCUS examinations:FOCUS with DLR(FOCUS-DLR+),FOCUS without DLR(FOCUS-DLR−),and conventional FOCUS(FOCUS-conv).The three types of FOCUS and their apparent diffusion coefficient(ADC)maps were compared qualitatively and quantitatively.RESULTS FOCUS-DLR+(3.62,average score of two radiologists)showed significantly better qualitative scores for image noise than FOCUS-DLR−(2.62)and FOCUS-conv(2.88)(P<0.05).Furthermore,FOCUS-DLR+showed the highest contrast ratio and 600 s/mm^(2)(0.72±0.08 and 0.68±0.08)and FOCUS-DLR−showed the highest CR between cystic lesions and the pancreatic parenchyma for the b-values of 0 and 600 s/mm2(0.62±0.21 and 0.62±0.21)(P<0.05),respectively.FOCUS-DLR+provided significantly higher ADCs of the pancreas and lesion(1.44±0.24 and 3.00±0.66)compared to FOCUS-DLR−(1.39±0.22 and 2.86±0.61)and significantly lower ADCs compared to FOCUS-conv(1.84±0.45 and 3.32±0.70)(P<0.05),respectively.CONCLUSION This study evaluated the efficacy of DLR for image quality improvement in reduced-FOV DWI of the pancreas.DLR can significantly denoise images without prolonging the scan time or decreasing the spatial resolution.The denoising level of DWI can be controlled to make the images appear more natural to the human eye.However,this study revealed that DLR did not ameliorate pancreatic distortion.Additionally,physicians should pay attention to the interpretation of ADCs after DLR application because ADCs are significantly changed by DLR.

Image processing based three-dimensional model reconstruction for cross-platform numerical simulation

Numerical simulation is the most powerful computational and analysis tool for a large variety of engineering and physical problems.For a complex problem relating to multi-field,multi-process and multi-scale,different computing tools have to be developed so as to solve particular fields at different scales and for different processes.Therefore,the integration of different types of software is inevitable.However,it is difficult to perform the transfer of the meshes and simulated results among software packages because of the lack of shared data formats or encrypted data formats.An image processing based method for three-dimensional model reconstruction for numerical simulation was proposed,which presents a solution to the integration problem by a series of slice or projection images obtained by the post-processing modules of the numerical simulation software.By means of mapping image pixels to meshes of either finite difference or finite element models,the geometry contour can be extracted to export the stereolithography model.The values of results,represented by color,can be deduced and assigned to the meshes.All the models with data can be directly or indirectly integrated into other software as a continued or new numerical simulation.The three-dimensional reconstruction method has been validated in numerical simulation of castings and case studies were provided in this study.

Artificial Intelligence-Based Image Reconstruction for Computed Tomography: A Survey

Computed tomography has made significant advances since its intro-duction in the early 1970s,where researchers have mainly focused on the quality of image reconstruction in the early stage.However,radiation exposure poses a health risk,prompting the demand of the lowest possible dose when carrying out CT examinations.To acquire high-quality reconstruction images with low dose radiation,CT reconstruction techniques have evolved from conventional reconstruction such as analytical and iterative reconstruction,to reconstruction methods based on artificial intelligence(AI).All these efforts are devoted to con-structing high-quality images using only low doses with fast reconstruction speed.In particular,conventional reconstruction methods usually optimize one aspect,while AI-based reconstruction has finally managed to attain all goals in one shot.However,there are limitations such as the requirements on large datasets,unstable performance,and weak generalizability in AI-based reconstruction methods.This work presents the review and discussion on the classification,the commercial use,the advantages,and the limitations of AI-based image reconstruction methods in CT.

Multi-scale cross-domain alignment for person image generation

Person image generation aims to generate images that maintain the original human appearance in different target poses.Recent works have revealed that the critical element in achieving this task is the alignment of appearance domain and pose domain.Previous alignment methods,such as appearance flow warping,correspondence learning and cross attention,often encounter challenges when it comes to producing fine texture details.These approaches suffer from limitations in accurately estimating appearance flows due to the lack of global receptive field.Alternatively,they can only perform cross-domain alignment on high-level feature maps with small spatial dimensions since the computational complexity increases quadratically with larger feature sizes.In this article,the significance of multi-scale alignment,in both low-level and high-level domains,for ensuring reliable cross-domain alignment of appearance and pose is demonstrated.To this end,a novel and effective method,named Multi-scale Crossdomain Alignment(MCA)is proposed.Firstly,MCA adopts global context aggregation transformer to model multi-scale interaction between pose and appearance inputs,which employs pair-wise window-based cross attention.Furthermore,leveraging the integrated global source information for each target position,MCA applies flexible flow prediction head and point correlation to effectively conduct warping and fusing for final transformed person image generation.Our proposed MCA achieves superior performance on two popular datasets than other methods,which verifies the effectiveness of our approach.

Scene 3-D Reconstruction System in Scattering Medium

Research on neural radiance fields for novel view synthesis has experienced explosive growth with the development of new models and extensions.The NeRF(Neural Radiance Fields)algorithm,suitable for underwater scenes or scattering media,is also evolving.Existing underwater 3D reconstruction systems still face challenges such as long training times and low rendering efficiency.This paper proposes an improved underwater 3D reconstruction system to achieve rapid and high-quality 3D reconstruction.First,we enhance underwater videos captured by a monocular camera to correct the image quality degradation caused by the physical properties of the water medium and ensure consistency in enhancement across frames.Then,we perform keyframe selection to optimize resource usage and reduce the impact of dynamic objects on the reconstruction results.After pose estimation using COLMAP,the selected keyframes undergo 3D reconstruction using neural radiance fields(NeRF)based on multi-resolution hash encoding for model construction and rendering.In terms of image enhancement,our method has been optimized in certain scenarios,demonstrating effectiveness in image enhancement and better continuity between consecutive frames of the same data.In terms of 3D reconstruction,our method achieved a peak signal-to-noise ratio(PSNR)of 18.40 dB and a structural similarity(SSIM)of 0.6677,indicating a good balance between operational efficiency and reconstruction quality.

Evaluating the use of three-dimensional reconstruction visualization technology for precise laparoscopic resection in gastroesophageal junction cancer

BACKGROUND Laparoscopic gastrectomy for esophagogastric junction(EGJ)carcinoma enables the removal of the carcinoma at the junction between the stomach and esophagus while preserving the gastric function,thereby providing patients with better treatment outcomes and quality of life.Nonetheless,this surgical technique also presents some challenges and limitations.Therefore,three-dimensional reconstruction visualization technology(3D RVT)has been introduced into the procedure,providing doctors with more comprehensive and intuitive anatomical information that helps with surgical planning,navigation,and outcome evaluation.AIM To discuss the application and advantages of 3D RVT in precise laparoscopic resection of EGJ carcinomas.METHODS Data were obtained from the electronic or paper-based medical records at The First Affiliated Hospital of Hebei North University from January 2020 to June 2022.A total of 120 patients diagnosed with EGJ carcinoma were included in the study.Of these,68 underwent laparoscopic resection after computed tomography(CT)-enhanced scanning and were categorized into the 2D group,whereas 52 underwent laparoscopic resection after CT-enhanced scanning and 3D RVT and were categorized into the 3D group.This study had two outcome measures:the deviation between tumor-related factors(such as maximum tumor diameter and infiltration length)in 3D RVT and clinical reality,and surgical outcome indicators(such as operative time,intraoperative blood loss,number of lymph node dissections,R0 resection rate,postoperative hospital stay,postoperative gas discharge time,drainage tube removal time,and related complications)between the 2D and 3D groups.RESULTS Among patients included in the 3D group,27 had a maximum tumor diameter of less than 3 cm,whereas 25 had a diameter of 3 cm or more.In actual surgical observations,24 had a diameter of less than 3 cm,whereas 28 had a diameter of 3 cm or more.The findings were consistent between the two methods(χ^(2)=0.346,P=0.556),with a kappa consistency coefficient of 0.808.With respect to infiltration length,in the 3D group,23 patients had a length of less than 5 cm,whereas 29 had a length of 5 cm or more.In actual surgical observations,20 cases had a length of less than 5 cm,whereas 32 had a length of 5 cm or more.The findings were consistent between the two methods(χ^(2)=0.357,P=0.550),with a kappa consistency coefficient of 0.486.Pearson correlation analysis showed that the maximum tumor diameter and infiltration length measured using 3D RVT were positively correlated with clinical observations during surgery(r=0.814 and 0.490,both P<0.05).The 3D group had a shorter operative time(157.02±8.38 vs 183.16±23.87),less intraoperative blood loss(83.65±14.22 vs 110.94±22.05),and higher number of lymph node dissections(28.98±2.82 vs 23.56±2.77)and R0 resection rate(80.77%vs 61.64%)than the 2D group.Furthermore,the 3D group had shorter hospital stay[8(8,9)vs 13(14,16)],time to gas passage[3(3,4)vs 4(5,5)],and drainage tube removal time[4(4,5)vs 6(6,7)]than the 2D group.The complication rate was lower in the 3D group(11.54%)than in the 2D group(26.47%)(χ^(2)=4.106,P<0.05).CONCLUSION Using 3D RVT,doctors can gain a more comprehensive and intuitive understanding of the anatomy and related lesions of EGJ carcinomas,thus enabling more accurate surgical planning.

GPU-accelerated three-dimensional reconstruction method of the Compton camera and its application in radionuclide imaging

A novel and fast three-dimensional reconstruction method for a Compton camera and its performance in radionuclide imaging is proposed and analyzed in this study. The conical surface sampling back-projection method with scattering angle correction(CSS-BP-SC) can quickly perform the back-projection process of the Compton cone and can be used to precompute the list-mode maximum likelihood expectation maximization(LM-MLEM). A dedicated parallel architecture was designed for the graphics processing unit acceleration of the back-projection and iteration stage of the CSS-BP-SC-based LM-MLEM. The imaging results of the two-point source Monte Carlo(MC) simulation demonstrate that by analyzing the full width at half maximum along the three coordinate axes, the CSS-BP-SC-based LM-MLEM can obtain imaging results comparable to those of the traditional reconstruction algorithm, that is, the simple back-projection-based LM-MLEM. The imaging results of the mouse phantom MC simulation and experiment demonstrate that the reconstruction results obtained by the proposed method sufficiently coincide with the set radioactivity distribution, and the speed increased by more than 664 times compared to the traditional reconstruction algorithm in the mouse phantom experiment. The proposed method will further advance the imaging applications of Compton cameras.

Digital holographic imaging via direct quantum wavefunction reconstruction

Wavefunction is a fundamental concept of quantum theory.Recent studies have shown surprisingly that wavefunction can be directly reconstructed via the measurement of weak value.The weak value based direct wavefunction reconstruction not only gives the operational meaning of wavefunction,but also provides the possibility of realizing holographic imaging with a totally new quantum approach.Here,we review the basic background knowledge of weak value based direct wavefunction reconstruction combined with recent experimental demonstrations.The main purpose of this work focuses on the idea of holographic imaging via direct wavefunction reconstruction.Since research on this topic is still in its early stage,we hope that this work can attract interest in the field of traditional holographic imaging.In addition,the wavefunction holographic imaging may find important applications in quantum information science.

Image reconstruction based on total-variation minimization and alternating direction method in linear scan computed tomography

Linear scan computed tomography （LCT） is of great benefit to online industrial scanning and security inspection due to its characteristics of straight-line source trajectory and high scanning speed. However, in practical applications of LCT, there are challenges to image reconstruction due to limited-angle and insufficient data. In this paper, a new reconstruction algorithm based on total-variation （TV） minimization is developed to reconstruct images from limited-angle and insufficient data in LCT. The main idea of our approach is to reformulate a TV problem as a linear equality constrained problem where the objective function is separable, and then minimize its augmented Lagrangian function by using alternating direction method （ADM） to solve subproblems. The proposed method is robust and efficient in the task of reconstruction by showing the convergence of ADM. The numerical simulations and real data reconstructions show that the proposed reconstruction method brings reasonable performance and outperforms some previous ones when applied to an LCT imaging problem.

An algorithm for computed tomography image reconstruction from limited-view projections

With the development of the compressive sensing theory, the image reconstruction from the projections viewed in limited angles is one of the hot problems in the research of computed tomography technology. This paper develops an iterative algorithm for image reconstruction, which can fit the most cases. This method gives an image reconstruction flow with the difference image vector, which is based on the concept that the difference image vector between the reconstructed and the reference image is sparse enough. Then the l1-norm minimization method is used to reconstruct the difference vector to recover the image for flat subjects in limited angles. The algorithm has been tested with a thin planar phantom and a real object in limited-view projection data. Moreover, all the studies showed the satisfactory results in accuracy at a rather high reconstruction speed.

Three-dimensional positions of scattering centers reconstruction from multiple SAR images based on radargrammetry

A method and procedure is presented to reconstruct three-dimensional(3D) positions of scattering centers from multiple synthetic aperture radar(SAR) images. Firstly, two-dimensional(2D) attribute scattering centers of targets are extracted from 2D SAR images. Secondly, similarity measure is developed based on 2D attributed scatter centers' location, type, and radargrammetry principle between multiple SAR images. By this similarity, we can associate 2D scatter centers and then obtain candidate 3D scattering centers. Thirdly, these candidate scattering centers are clustered in 3D space to reconstruct final 3D positions. Compared with presented methods, the proposed method has a capability of describing distributed scattering center, reduces false and missing 3D scattering centers, and has fewer restrictionson modeling data. Finally, results of experiments have demonstrated the effectiveness of the proposed method.

Research on the Application of Super Resolution Reconstruction Algorithm for Underwater Image

Underwater imaging is widely used in ocean,river and lake exploration,but it is affected by properties of water and the optics.In order to solve the lower-resolution underwater image formed by the influence of water and light,the image super-resolution reconstruction technique is applied to the underwater image processing.This paper addresses the problem of generating super-resolution underwater images by convolutional neural network framework technology.We research the degradation model of underwater images,and analyze the lower-resolution factors of underwater images in different situations,and compare different traditional super-resolution image reconstruction algorithms.We further show that the algorithm of super-resolution using deep convolution networks(SRCNN)which applied to super-resolution underwater images achieves good results.

Towards novel regularization approaches to PET image reconstruction

The purpose of this study is to introduce a novel empirical iterative algorithm for medical image reconstruction, under the short name MRP-ISWLS (Median Root Prior Image Space Weighted Least Squares). Further, we assess the performance of the new algorithm by comparing it to the simultaneous version of known MRP algorithms. All algorithms are compared in terms of cross-correlation and CNRs (Contrast-to-Noise Ratios). As it turns out, MRP-ISWLS presents higher CNRs than the known algorithms for objects of different size. Also MRP-ISWLS has better noise manipulation.

Reconstruction of electrical capacitance tomography images based on fast linearized alternating direction method of multipliers for two-phase flow system

Electrical capacitance tomography(ECT)has been applied to two-phase flow measurement in recent years.Image reconstruction algorithms play an important role in the successful applications of ECT.To solve the ill-posed and nonlinear inverse problem of ECT image reconstruction,a new ECT image reconstruction method based on fast linearized alternating direction method of multipliers(FLADMM)is proposed in this paper.On the basis of theoretical analysis of compressed sensing(CS),the data acquisition of ECT is regarded as a linear measurement process of permittivity distribution signal of pipe section.A new measurement matrix is designed and L1 regularization method is used to convert ECT inverse problem to a convex relaxation problem which contains prior knowledge.A new fast alternating direction method of multipliers which contained linearized idea is employed to minimize the objective function.Simulation data and experimental results indicate that compared with other methods,the quality and speed of reconstructed images are markedly improved.Also,the dynamic experimental results indicate that the proposed algorithm can ful fill the real-time requirement of ECT systems in the application.

Geographic,Geometrical and Semantic Reconstruction of Urban Scene from High Resolution Oblique Aerial Images

An effective approach is proposed for 3D urban scene reconstruction in the form of point cloud with semantic labeling. Starting from high resolution oblique aerial images,our approach proceeds through three main stages: geographic reconstruction, geometrical reconstruction and semantic reconstruction. The absolute position and orientation of all the cameras relative to the real world are recovered in the geographic reconstruction stage. Then, in the geometrical reconstruction stage,an improved multi-view stereo matching method is employed to produce 3D dense points with color and normal information by taking into account the prior knowledge of aerial imagery.Finally the point cloud is classified into three classes(building,vegetation, and ground) by a rule-based hierarchical approach in the semantic reconstruction step. Experiments on complex urban scene show that our proposed 3-stage approach could generate reasonable reconstruction result robustly and efficiently.By comparing our final semantic reconstruction result with the manually labeled ground truth, classification accuracies from86.75% to 93.02% are obtained.

A new inversion method for reconstruction of plasmaspheric He^(+)density from EUV images

The Computer Tomography(CT)method is used for remote sensing the Earth’s plasmasphere.One challenge for image reconstruction is insufficient projection data,mainly caused by limited projection angles.In this study,we apply the Algebraic Reconstruction Technique(ART)and the minimization of the image Total Variation(TV)method,with a combination of priori knowledge of north–south symmetry,to reconstruct plasmaspheric He+density from simulated EUV images.The results demonstrate that incorporating priori assumption can be particularly useful when the projection data is insufficient.This method has good performance even with a projection angle of less than 150 degrees.The method of our study is expected to have applications in the Soft X-ray Imager(SXI)reconstruction for the Solar wind–Magnetosphere–Ionosphere Link Explorer(SMILE)mission.

Reduction of artifacts in dental cone beam CT images to improve the three dimensional image reconstruction

Cone-beam CT (CBCT) scanners are based on volumetric tomography, using a 2D extended digital array providing an area detector [1,2]. Compared to traditional CT, CBCT has many advantages, such as less X-ray beam limitation, and rapid scan time, etc. However, in CBCT images the x-ray beam has lower mean kilovolt (peak) energy, so the metal artifact is more pronounced on. The position of the shadowed region in other views can be tracked by projecting the 3D coordinates of the object. Automatic image segmentation was used to replace the pixels inside the metal object with the boundary pixels. The modified projection data, using synthetically Radon Transformation, were then used to reconstruct a new back projected CBCT image. In this paper, we present a method, based on the morphological, area and pixel operators, which we applied on the Radon transformed image, to reduce the metal artifacts in CBCT, then we built the Radon back project images using the radon invers transformation. The artifacts effects on the 3d-reconstruction is that, the soft tissues appears as bones or teeth. For the preprocessing of the CBCT images, two methods are used to recognize the noisy black areas that the first depends on thresholding and closing algorithm, and the second depends on tracing boundaries after using thresholding algorithm too. The intensity of these areas is the lowest in the image than other tissues, so we profit this property to detect the edges of these areas. These two methods are applied on phantom and patient image data. It deals with reconstructed CBCT dicom images and can effectively reduce such metal artifacts. Due to the data of the constructed images are corrupted by these metal artifacts, qualitative and quantitative analysis of CBCT images is very essential.