Model-driven CT reconstruction algorithm for nano-resolution x-ray phase contrast imaging

The low-density imaging performance of a zone plate-based nano-resolution hard x-ray computed tomography(CT)system can be significantly improved by incorporating a grating-based Lau interferometer. Due to the diffraction, however,the acquired nano-resolution phase signal may suffer splitting problem, which impedes the direct reconstruction of phase contrast CT(nPCT) images. To overcome, a new model-driven nPCT image reconstruction algorithm is developed in this study. In it, the diffraction procedure is mathematically modeled into a matrix B, from which the projections without signal splitting can be generated invertedly. Furthermore, a penalized weighted least-square model with total variation(PWLSTV) is employed to denoise these projections, from which nPCT images with high accuracy are directly reconstructed.Numerical experiments demonstrate that this new algorithm is able to work with phase projections having any splitting distances. Moreover, results also reveal that nPCT images of higher signal-to-noise-ratio(SNR) could be reconstructed from projections having larger splitting distances. In summary, a novel model-driven nPCT image reconstruction algorithm with high accuracy and robustness is verified for the Lau interferometer-based hard x-ray nano-resolution phase contrast imaging.

Estimation-free spatial-domain image reconstruction of structured illumination microscopy

Structured illumination microscopy(SIM)achieves super-resolution(SR)by modulating the high-frequency information of the sample into the passband of the optical system and subsequent image reconstruction.The traditional Wiener-filtering-based reconstruction algorithm operates in the Fourier domain,it requires prior knowledge of the sinusoidal illumination patterns which makes the time-consuming procedure of parameter estimation to raw datasets necessary,besides,the parameter estimation is sensitive to noise or aberration-induced pattern distortion which leads to reconstruction artifacts.Here,we propose a spatial-domain image reconstruction method that does not require parameter estimation but calculates patterns from raw datasets,and a reconstructed image can be obtained just by calculating the spatial covariance of differential calculated patterns and differential filtered datasets(the notch filtering operation is performed to the raw datasets for attenuating and compensating the optical transfer function(OTF)).Experiments on reconstructing raw datasets including nonbiological,biological,and simulated samples demonstrate that our method has SR capability,high reconstruction speed,and high robustness to aberration and noise.

Triple-path feature transform network for ring-array photoacoustic tomography image reconstruction

Photoacoustic imaging(PAI)is a noninvasive emerging imaging method based on the photoacoustic effect,which provides necessary assistance for medical diagnosis.It has the characteristics of large imaging depth and high contrast.However,limited by the equipment cost and reconstruction time requirements,the existing PAI systems distributed with annular array transducers are difficult to take into account both the image quality and the imaging speed.In this paper,a triple-path feature transform network(TFT-Net)for ring-array photoacoustic tomography is proposed to enhance the imaging quality from limited-view and sparse measurement data.Specifically,the network combines the raw photoacoustic pressure signals and conventional linear reconstruction images as input data,and takes the photoacoustic physical model as a prior information to guide the reconstruction process.In addition,to enhance the ability of extracting signal features,the residual block and squeeze and excitation block are introduced into the TFT-Net.For further efficient reconstruction,the final output of photoacoustic signals uses‘filter-then-upsample’operation with a pixel-shuffle multiplexer and a max out module.Experiment results on simulated and in-vivo data demonstrate that the constructed TFT-Net can restore the target boundary clearly,reduce background noise,and realize fast and high-quality photoacoustic image reconstruction of limited view with sparse sampling.

GPU-accelerated three-dimensional reconstruction method of the Compton camera and its application in radionuclide imaging

A novel and fast three-dimensional reconstruction method for a Compton camera and its performance in radionuclide imaging is proposed and analyzed in this study. The conical surface sampling back-projection method with scattering angle correction(CSS-BP-SC) can quickly perform the back-projection process of the Compton cone and can be used to precompute the list-mode maximum likelihood expectation maximization(LM-MLEM). A dedicated parallel architecture was designed for the graphics processing unit acceleration of the back-projection and iteration stage of the CSS-BP-SC-based LM-MLEM. The imaging results of the two-point source Monte Carlo(MC) simulation demonstrate that by analyzing the full width at half maximum along the three coordinate axes, the CSS-BP-SC-based LM-MLEM can obtain imaging results comparable to those of the traditional reconstruction algorithm, that is, the simple back-projection-based LM-MLEM. The imaging results of the mouse phantom MC simulation and experiment demonstrate that the reconstruction results obtained by the proposed method sufficiently coincide with the set radioactivity distribution, and the speed increased by more than 664 times compared to the traditional reconstruction algorithm in the mouse phantom experiment. The proposed method will further advance the imaging applications of Compton cameras.

Deep learning-based magnetic resonance imaging reconstruction for improving the image quality of reduced-field-of-view diffusionweighted imaging of the pancreas

BACKGROUND It has been reported that deep learning-based reconstruction(DLR)can reduce image noise and artifacts,thereby improving the signal-to-noise ratio and image sharpness.However,no previous studies have evaluated the efficacy of DLR in improving image quality in reduced-field-of-view(reduced-FOV)diffusionweighted imaging(DWI)[field-of-view optimized and constrained undistorted single-shot(FOCUS)]of the pancreas.We hypothesized that a combination of these techniques would improve DWI image quality without prolonging the scan time but would influence the apparent diffusion coefficient calculation.AIM To evaluate the efficacy of DLR for image quality improvement of FOCUS of the pancreas.METHODS This was a retrospective study evaluated 37 patients with pancreatic cystic lesions who underwent magnetic resonance imaging between August 2021 and October 2021.We evaluated three types of FOCUS examinations:FOCUS with DLR(FOCUS-DLR+),FOCUS without DLR(FOCUS-DLR−),and conventional FOCUS(FOCUS-conv).The three types of FOCUS and their apparent diffusion coefficient(ADC)maps were compared qualitatively and quantitatively.RESULTS FOCUS-DLR+(3.62,average score of two radiologists)showed significantly better qualitative scores for image noise than FOCUS-DLR−(2.62)and FOCUS-conv(2.88)(P<0.05).Furthermore,FOCUS-DLR+showed the highest contrast ratio and 600 s/mm^(2)(0.72±0.08 and 0.68±0.08)and FOCUS-DLR−showed the highest CR between cystic lesions and the pancreatic parenchyma for the b-values of 0 and 600 s/mm2(0.62±0.21 and 0.62±0.21)(P<0.05),respectively.FOCUS-DLR+provided significantly higher ADCs of the pancreas and lesion(1.44±0.24 and 3.00±0.66)compared to FOCUS-DLR−(1.39±0.22 and 2.86±0.61)and significantly lower ADCs compared to FOCUS-conv(1.84±0.45 and 3.32±0.70)(P<0.05),respectively.CONCLUSION This study evaluated the efficacy of DLR for image quality improvement in reduced-FOV DWI of the pancreas.DLR can significantly denoise images without prolonging the scan time or decreasing the spatial resolution.The denoising level of DWI can be controlled to make the images appear more natural to the human eye.However,this study revealed that DLR did not ameliorate pancreatic distortion.Additionally,physicians should pay attention to the interpretation of ADCs after DLR application because ADCs are significantly changed by DLR.

Digital holographic imaging via direct quantum wavefunction reconstruction

Wavefunction is a fundamental concept of quantum theory.Recent studies have shown surprisingly that wavefunction can be directly reconstructed via the measurement of weak value.The weak value based direct wavefunction reconstruction not only gives the operational meaning of wavefunction,but also provides the possibility of realizing holographic imaging with a totally new quantum approach.Here,we review the basic background knowledge of weak value based direct wavefunction reconstruction combined with recent experimental demonstrations.The main purpose of this work focuses on the idea of holographic imaging via direct wavefunction reconstruction.Since research on this topic is still in its early stage,we hope that this work can attract interest in the field of traditional holographic imaging.In addition,the wavefunction holographic imaging may find important applications in quantum information science.

Image super-resolution reconstruction based on sparse representation and residual compensation

A super-resolution reconstruction algorithm is proposed. The algorithm is based on the idea of the sparse representation of signals, by using the fact that the sparsest representation of a sig- nal is unique as the constraint of the patched-based reconstruction, and compensating residual errors of the reconstruction results both locally and globally to solve the distortion problem in patch-based reconstruction algorithms. Three reconstruction algorithms are compared. The results show that the images reconstructed with the new algorithm have the best quality.

Super-resolution image reconstruction based on three-step-training neural networks

A new method of super-resolution image reconstruction is proposed, which uses a three-step-training error backpropagation neural network （BPNN） to realize the super-resolution reconstruction （SRR） of satellite image. The method is based on BPNN. First, three groups learning samples with different resolutions are obtained according to image observation model, and then vector mappings are respectively used to those three group learning samples to speed up the convergence of BPNN, at last, three times consecutive training are carried on the BPNN. Training samples used in each step are of higher resolution than those used in the previous steps, so the increasing weights store a great amount of information for SRR, and network performance and generalization ability are improved greatly. Simulation and generalization tests are carried on the well-trained three-step-training NN respectively, and the reconstruction results with higher resolution images verify the effectiveness and validity of this method.

Multi-channel fast super-resolution image reconstruction based on matrix observation model

A multi-channel fast super-resolution image reconstruction algorithm based on matrix observation model is proposed in the paper,which consists of three steps to avoid the computational complexity: a single image SR reconstruction step,a registration step and a wavelet-based image fusion. This algorithm decomposes two large matrixes to the tensor product of two little matrixes and uses the natural isomorphism between matrix space and vector space to transform cost function based on matrix-vector products model to matrix form. Furthermore,we prove that the regularization part can be transformed to the matrix formed. The conjugate-gradient method is used to solve this new model. Finally,the wavelet fusion is used to integrate all the registered highresolution images obtained from the single image SR reconstruction step. The proposed algorithm reduces the storage requirement and the calculating complexity,and can be applied to large-dimension low-resolution images.

Super-resolution reconstruction of synthetic-aperture radar image using adaptive-threshold singular value decomposition technique

A super-resolution reconstruction approach of radar image using an adaptive-threshold singular value decomposition (SVD) technique was presented,and its performance was analyzed,compared and assessed detailedly.First,radar imaging model and super-resolution reconstruction mechanism were outlined.Then,the adaptive-threshold SVD super-resolution algorithm,and its two key aspects,namely the determination method of point spread function (PSF) matrix T and the selection scheme of singular value threshold,were presented.Finally,the super-resolution algorithm was demonstrated successfully using the measured synthetic-aperture radar (SAR) images,and a Monte Carlo assessment was carried out to evaluate the performance of the algorithm by using the input/output signal-to-noise ratio (SNR).Five versions of SVD algorithms,namely 1) using all singular values,2) using the top 80% singular values,3) using the top 50% singular values,4) using the top 20% singular values and 5) using singular values s such that s2≥max(s2)/rinSNR were tested.The experimental results indicate that when the singular value threshold is set as smax/(rinSNR)1/2,the super-resolution algorithm provides a good compromise between too much noise and too much bias and has good reconstruction results.

Hyperspectral Image Super-Resolution Meets Deep Learning:A Survey and Perspective

Hyperspectral image super-resolution,which refers to reconstructing the high-resolution hyperspectral image from the input low-resolution observation,aims to improve the spatial resolution of the hyperspectral image,which is beneficial for subsequent applications.The development of deep learning has promoted significant progress in hyperspectral image super-resolution,and the powerful expression capabilities of deep neural networks make the predicted results more reliable.Recently,several latest deep learning technologies have made the hyperspectral image super-resolution method explode.However,a comprehensive review and analysis of the latest deep learning methods from the hyperspectral image super-resolution perspective is absent.To this end,in this survey,we first introduce the concept of hyperspectral image super-resolution and classify the methods from the perspectives with or without auxiliary information.Then,we review the learning-based methods in three categories,including single hyperspectral image super-resolution,panchromatic-based hyperspectral image super-resolution,and multispectral-based hyperspectral image super-resolution.Subsequently,we summarize the commonly used hyperspectral dataset,and the evaluations for some representative methods in three categories are performed qualitatively and quantitatively.Moreover,we briefly introduce several typical applications of hyperspectral image super-resolution,including ground object classification,urban change detection,and ecosystem monitoring.Finally,we provide the conclusion and challenges in existing learning-based methods,looking forward to potential future research directions.

Scene 3-D Reconstruction System in Scattering Medium

Research on neural radiance fields for novel view synthesis has experienced explosive growth with the development of new models and extensions.The NeRF(Neural Radiance Fields)algorithm,suitable for underwater scenes or scattering media,is also evolving.Existing underwater 3D reconstruction systems still face challenges such as long training times and low rendering efficiency.This paper proposes an improved underwater 3D reconstruction system to achieve rapid and high-quality 3D reconstruction.First,we enhance underwater videos captured by a monocular camera to correct the image quality degradation caused by the physical properties of the water medium and ensure consistency in enhancement across frames.Then,we perform keyframe selection to optimize resource usage and reduce the impact of dynamic objects on the reconstruction results.After pose estimation using COLMAP,the selected keyframes undergo 3D reconstruction using neural radiance fields(NeRF)based on multi-resolution hash encoding for model construction and rendering.In terms of image enhancement,our method has been optimized in certain scenarios,demonstrating effectiveness in image enhancement and better continuity between consecutive frames of the same data.In terms of 3D reconstruction,our method achieved a peak signal-to-noise ratio(PSNR)of 18.40 dB and a structural similarity(SSIM)of 0.6677,indicating a good balance between operational efficiency and reconstruction quality.

Evaluating the use of three-dimensional reconstruction visualization technology for precise laparoscopic resection in gastroesophageal junction cancer

BACKGROUND Laparoscopic gastrectomy for esophagogastric junction(EGJ)carcinoma enables the removal of the carcinoma at the junction between the stomach and esophagus while preserving the gastric function,thereby providing patients with better treatment outcomes and quality of life.Nonetheless,this surgical technique also presents some challenges and limitations.Therefore,three-dimensional reconstruction visualization technology(3D RVT)has been introduced into the procedure,providing doctors with more comprehensive and intuitive anatomical information that helps with surgical planning,navigation,and outcome evaluation.AIM To discuss the application and advantages of 3D RVT in precise laparoscopic resection of EGJ carcinomas.METHODS Data were obtained from the electronic or paper-based medical records at The First Affiliated Hospital of Hebei North University from January 2020 to June 2022.A total of 120 patients diagnosed with EGJ carcinoma were included in the study.Of these,68 underwent laparoscopic resection after computed tomography(CT)-enhanced scanning and were categorized into the 2D group,whereas 52 underwent laparoscopic resection after CT-enhanced scanning and 3D RVT and were categorized into the 3D group.This study had two outcome measures:the deviation between tumor-related factors(such as maximum tumor diameter and infiltration length)in 3D RVT and clinical reality,and surgical outcome indicators(such as operative time,intraoperative blood loss,number of lymph node dissections,R0 resection rate,postoperative hospital stay,postoperative gas discharge time,drainage tube removal time,and related complications)between the 2D and 3D groups.RESULTS Among patients included in the 3D group,27 had a maximum tumor diameter of less than 3 cm,whereas 25 had a diameter of 3 cm or more.In actual surgical observations,24 had a diameter of less than 3 cm,whereas 28 had a diameter of 3 cm or more.The findings were consistent between the two methods(χ^(2)=0.346,P=0.556),with a kappa consistency coefficient of 0.808.With respect to infiltration length,in the 3D group,23 patients had a length of less than 5 cm,whereas 29 had a length of 5 cm or more.In actual surgical observations,20 cases had a length of less than 5 cm,whereas 32 had a length of 5 cm or more.The findings were consistent between the two methods(χ^(2)=0.357,P=0.550),with a kappa consistency coefficient of 0.486.Pearson correlation analysis showed that the maximum tumor diameter and infiltration length measured using 3D RVT were positively correlated with clinical observations during surgery(r=0.814 and 0.490,both P<0.05).The 3D group had a shorter operative time(157.02±8.38 vs 183.16±23.87),less intraoperative blood loss(83.65±14.22 vs 110.94±22.05),and higher number of lymph node dissections(28.98±2.82 vs 23.56±2.77)and R0 resection rate(80.77%vs 61.64%)than the 2D group.Furthermore,the 3D group had shorter hospital stay[8(8,9)vs 13(14,16)],time to gas passage[3(3,4)vs 4(5,5)],and drainage tube removal time[4(4,5)vs 6(6,7)]than the 2D group.The complication rate was lower in the 3D group(11.54%)than in the 2D group(26.47%)(χ^(2)=4.106,P<0.05).CONCLUSION Using 3D RVT,doctors can gain a more comprehensive and intuitive understanding of the anatomy and related lesions of EGJ carcinomas,thus enabling more accurate surgical planning.

IRMIRS:Inception-ResNet-Based Network for MRI Image Super-Resolution

Medical image super-resolution is a fundamental challenge due to absorption and scattering in tissues.These challenges are increasing the interest in the quality of medical images.Recent research has proven that the rapid progress in convolutional neural networks(CNNs)has achieved superior performance in the area of medical image super-resolution.However,the traditional CNN approaches use interpolation techniques as a preprocessing stage to enlarge low-resolution magnetic resonance(MR)images,adding extra noise in the models and more memory consumption.Furthermore,conventional deep CNN approaches used layers in series-wise connection to create the deeper mode,because this later end layer cannot receive complete information and work as a dead layer.In this paper,we propose Inception-ResNet-based Network for MRI Image Super-Resolution known as IRMRIS.In our proposed approach,a bicubic interpolation is replaced with a deconvolution layer to learn the upsampling filters.Furthermore,a residual skip connection with the Inception block is used to reconstruct a high-resolution output image from a low-quality input image.Quantitative and qualitative evaluations of the proposed method are supported through extensive experiments in reconstructing sharper and clean texture details as compared to the state-of-the-art methods.

Image processing based three-dimensional model reconstruction for cross-platform numerical simulation

Numerical simulation is the most powerful computational and analysis tool for a large variety of engineering and physical problems.For a complex problem relating to multi-field,multi-process and multi-scale,different computing tools have to be developed so as to solve particular fields at different scales and for different processes.Therefore,the integration of different types of software is inevitable.However,it is difficult to perform the transfer of the meshes and simulated results among software packages because of the lack of shared data formats or encrypted data formats.An image processing based method for three-dimensional model reconstruction for numerical simulation was proposed,which presents a solution to the integration problem by a series of slice or projection images obtained by the post-processing modules of the numerical simulation software.By means of mapping image pixels to meshes of either finite difference or finite element models,the geometry contour can be extracted to export the stereolithography model.The values of results,represented by color,can be deduced and assigned to the meshes.All the models with data can be directly or indirectly integrated into other software as a continued or new numerical simulation.The three-dimensional reconstruction method has been validated in numerical simulation of castings and case studies were provided in this study.

Artificial Intelligence-Based Image Reconstruction for Computed Tomography: A Survey

Computed tomography has made significant advances since its intro-duction in the early 1970s,where researchers have mainly focused on the quality of image reconstruction in the early stage.However,radiation exposure poses a health risk,prompting the demand of the lowest possible dose when carrying out CT examinations.To acquire high-quality reconstruction images with low dose radiation,CT reconstruction techniques have evolved from conventional reconstruction such as analytical and iterative reconstruction,to reconstruction methods based on artificial intelligence(AI).All these efforts are devoted to con-structing high-quality images using only low doses with fast reconstruction speed.In particular,conventional reconstruction methods usually optimize one aspect,while AI-based reconstruction has finally managed to attain all goals in one shot.However,there are limitations such as the requirements on large datasets,unstable performance,and weak generalizability in AI-based reconstruction methods.This work presents the review and discussion on the classification,the commercial use,the advantages,and the limitations of AI-based image reconstruction methods in CT.

Magnetic resonance imaging after anterior cruciate ligament reconstruction:A practical guide

Anterior cruciate ligament(ACL) reconstruction is one of the most common orthopedic procedures performed worldwide. In this regard, magnetic resonance imaging(MRI) represents a useful pre-operative tool to confirm a disruption of the ACL and to assess for potential associated injuries. However, MRI is also valuable postoperatively, as it is able to identify, in a non-invasive way, a number of aspects and situations that could suggest potential problems to clinicians. Graft signal and integrity, correct tunnel placement, tunnel widening, and problems with fixation devices or the donor site could all compromise the surgical outcomes and potentially predict the failure of the ACL reconstruction. Furthermore, several anatomical features of the knee could be associated to worst outcomes or higher risk of failure. This review provides a practical guide for the clinician to evaluate the post-surgical ACL through MRI, and to analyze all the parameters and features directly or indirectly related to ACL reconstruction, in order to assess for normal or pathologic conditions.

A FAST CONVERGING SPARSE RECONSTRUCTION ALGORITHM IN GHOST IMAGING

A fast converging sparse reconstruction algorithm in ghost imaging is presented. It utilizes total variation regularization and its formulation is based on the Karush-Kuhn-Tucker (KKT) theorem in the theory of convex optimization. Tests using experimental data show that, compared with the algorithm of Gradient Projection for Sparse Reconstruction (GPSR), the proposed algorithm yields better results with less computation work.

A rapid micro-magnetic resonance imaging scanning for three-dimensional reconstruction of peripheral nerve fascicles

The most common methods for three-dimensional reconstruction of peripheral nerve fascicles include histological and radiology techniques. Histological techniques have many drawbacks including an enormous manual workload and poor image registration. Micro-magnetic resonance imaging（Micro-MRI）, an emerging radiology technique, has been used to report results in the brain, liver and tumor tissues. However, micro-MRI usage for obtaining intraneural structures has not been reported. The aim of this study was to present a new imaging method for three-dimensional reconstruction of peripheral nerve fascicles by ~1T micro-MRI. Freshly harvested sciatic nerve samples from an amputated limb were divided into four groups. Two different scanning conditions（Mannerist Solution/GD-DTPA contrast agent, distilled water） were selected, and both T1 and T2 phases programmed for each scanning condition. Three clinical surgeons evaluated the quality of the images via a standardized scale. Moreover, to analyze deformation of the two-dimensional image, the nerve diameter and total area of the micro-MRI images were compared after hematoxylin-eosin staining. The results show that rapid micro-MRI imaging method can be used for three-dimensional reconstruction of the fascicle structure. Nerve sample immersed in contrast agent（Mannerist Solution/GD-DTPA） and scanned in the T1 phase was the best. Moreover, the nerve sample was scanned freshly and can be recycled for other procedures. MRI images show better stability and smaller deformation compared with histological images. In conclusion, micro-MRI provides a feasible and rapid method for three-dimensional reconstruction of peripheral nerve fascicles, which can clearly show the internal structure of the peripheral nerve.

Super-Resolution Imaging of Mammograms Based on the Super-Resolution Convolutional Neural Network

Purpose: To apply and evaluate a super-resolution scheme based on the super-resolution convolutional neural network (SRCNN) for enhancing image resolution in digital mammograms. Materials and Methods: A total of 711 mediolateral oblique (MLO) images including breast lesions were sampled from the Curated Breast Imaging Subset of the Digital Database for Screening Mammography (CBIS-DDSM). We first trained the super-resolution convolutional neural network (SRCNN), which is a deep-learning based super-resolution method. Using this trained SRCNN, high-resolution images were reconstructed from low-resolution images. We compared the image quality of the super-resolution method and that obtained using the linear interpolation methods (nearest neighbor and bilinear interpolations). To investigate the relationship between the image quality of the SRCNN-processed images and the clinical features of the mammographic lesions, we compared the image quality yielded by implementing the SRCNN, in terms of the breast density, the Breast Imaging-Reporting and Data System (BI-RADS) assessment, and the verified pathology information. For quantitative evaluation, peak signal-to-noise ratio (PSNR) and structural similarity (SSIM) were measured to assess the image restoration quality and the perceived image quality. Results: The super-resolution image quality yielded by the SRCNN was significantly higher than that obtained using linear interpolation methods (p p Conclusion: SRCNN can significantly outperform conventional interpolation methods for enhancing image resolution in digital mammography. SRCNN can significantly improve the image quality of magnified mammograms, especially in dense breasts, high-risk BI-RADS assessment groups, and pathology-verified malignant cases.