DiriNet:An Estimation Network for Spectral Response Function and Point Spread Function

Hyper-and multi-spectral image fusion is an important technology to produce hyper-spectral and hyper-resolution images,which always depends on the spectral response function andthe point spread function.However,few works have been payed on the estimation of the two degra-dation functions.To learn the two functions from image pairs to be fused,we propose a Dirichletnetwork,where both functions are properly constrained.Specifically,the spatial response function isconstrained with positivity,while the Dirichlet distribution along with a total variation is imposedon the point spread function.To the best of our knowledge,the neural network and the Dirichlet regularization are exclusively investigated,for the first time,to estimate the degradation functions.Both image degradation and fusion experiments demonstrate the effectiveness and superiority of theproposed Dirichlet network.

Analyzing the Effect of the Intra-Pixel Position of Small PSFs for Optimizing the PL of Optical Subpixel Localization

Subpixel localization techniques for estimating the positions of point-like images captured by pixelated image sensors have been widely used in diverse optical measurement fields.With unavoidable imaging noise,there is a precision limit(PL)when estimating the target positions on image sensors,which depends on the detected photon count,noise,point spread function(PSF)radius,and PSF’s intra-pixel position.Previous studies have clearly reported the effects of the first three parameters on the PL but have neglected the intra-pixel position information.Here,we develop a localization PL analysis framework for revealing the effect of the intra-pixel position of small PSFs.To accurately estimate the PL in practical applications,we provide effective PSF(e PSF)modeling approaches and apply the Cramér–Rao lower bound.Based on the characteristics of small PSFs,we first derive simplified equations for finding the best PL and the best intra-pixel region for an arbitrary small PSF;we then verify these equations on real PSFs.Next,we use the typical Gaussian PSF to perform a further analysis and find that the final optimum of the PL is achieved at the pixel boundaries when the Gaussian radius is as small as possible,indicating that the optimum is ultimately limited by light diffraction.Finally,we apply the maximum likelihood method.Its combination with e PSF modeling allows us to successfully reach the PL in experiments,making the above theoretical analysis effective.This work provides a new perspective on combining image sensor position control with PSF engineering to make full use of information theory,thereby paving the way for thoroughly understanding and achieving the final optimum of the PL in optical localization.

Single exposure passive three-dimensional information reconstruction based on an ordinary imaging system

Existing three-dimensional(3D) imaging technologies have issues such as requiring active illumination, multiple exposures, or coding modulation. We propose a passive single 3D imaging method based on an ordinary imaging system.Using the point spread function of the imaging system to realize the non-coding measurement on the target, the full-focus images and depth information of the 3D target can be extracted from a single two-dimensional(2D) image through the compressed sensing algorithm. Simulation and experiments show that this approach can complete passive 3D imaging based on an ordinary imaging system without any coding operations. This method can achieve millimeter-level vertical resolution under single exposure conditions and has the potential for real-time dynamic 3D imaging. It improves the efficiency of 3D information detection, reduces the complexity of the imaging system, and may be of considerable value to the field of computer vision and other related applications.

Impact of random and scattered coincidences from outside of field of view on positron emission tomography/computed tomography imaging with different reconstruction protocols

Image quality in positron emission tomography(PET)is affected by random and scattered coincidences and reconstruction protocols.In this study,we investigated the effects of scattered and random coincidences from outside the field of view(FOV)on PET image quality for different reconstruction protocols.Imaging was performed on the Discovery 690 PET/CT scanner,using experimental configurations including the NEMA phantom(a body phantom,with six spheres of different sizes)with a signal background ratio of 4:1.The NEMA phantom(phantom I)was scanned separately in a one-bed position.To simulate the effect of random and scatter coincidences from outside the FOV,six cylindrical phantoms with various diameters were added to the NEMA phantom(phantom II).The 18 emission datasets with mean intervals of 15 min were acquired(3 min/scan).The emission data were reconstructed using different techniques.The image quality parameters were evaluated by both phantoms.Variations in the signal-to-noise ratio(SNR)in a 28-mm(10-mm)sphere of phantom II were 37.9%(86.5%)for ordered-subset expectation maximization(OSEM-only),36.8%(81.5%)for point spread function(PSF),32.7%(80.7%)for time of flight(TOF),and 31.5%(77.8%)for OSEM+PSF+TOF,respectively,indicating that OSEM+PSF+TOF reconstruction had the lowest noise levels and lowest coefficient of variation(COV)values.Random and scatter coincidences from outside the FOV induced lower SNR,lower contrast,and higher COV values,indicating image deterioration and significantly impacting smaller sphere sizes.Amongst reconstruction protocols,OSEM+PSF+TOF and OSEM+PSF showed higher contrast values for sphere sizes of 22,28,and 37 mm and higher contrast recovery coefficient values for smaller sphere sizes of 10 and 13 mm.

Analysis of the optical quality by determining the modulation transfer function for anterior corneal surface in myopes

AIM: To describe the characteristics of modulation transfer function (MTF) of anterior corneal surface, and obtain the the normal reference range of MTF at different spatial frequencies and optical zones of the anterior corneal surface in myopes. METHODS: Four hundred eyes from 200 patients were examined under SIRIUS corneal topography system. Phoenis analysis software was applied to simulate the MTF curves of anterior corneal surface at vertical and horizontal meridians at the 3, 4, 5, 6, 7mm optical zones of cornea. The MTF values at spatial frequencies of 5, 10, 15, 20, 25, 30, 35, 40, 45, 50, 55 and 60 cycles/degree (c/d) were selected. RESULTS: The MTF curve of anterior corneal surface decreased rapidly from low to intermediate frequency (0-15cpd) at various optical zones of cornea, the value decreased to 0 slowly at higher frequency (>15cpd). With the increase of the optical zones of cornea, MTF curve decreased gradually. 3) In the range of 3 mm- 6 mm optical zones of the cornea, the MTF values measured at horizontal meridian were greater than the corresponding values at horizontal meridian of each spatial frequency, the difference was statistically significant (P<0.05). At 7 mm optical zones of cornea, the MTF values measured at horizontal meridian were less than the corresponding values at vertical meridian at 10-60 spatial frequencies (cpd), and the difference was statistically significant in 25, 30, 35, 40, 45, 50 cpd(P<0.05). CONCLUSION: MTF can be used to describe the imaging quality of optical systems at anterior corneal surface objectively in detail.

Broadband seismic illumination and resolution analyses based on staining algorithm

Seismic migration moves reflections to their true subsurface positions and yields seismic images of subsurface areas. However, due to limited acquisition aperture, complex overburden structure and target dipping angle, the migration often generates a distorted image of the actual subsurface structure. Seismic illumination and resolution analyses provide a quantitative description of how the above-mentioned factors distort the image. The point spread function （PSF） gives the resolution of the depth image and carries full information about the factors affecting the quality of the image. The staining algorithm establishes a correspondence between a certain structure and its relevant wavefield and reflected data. In this paper, we use the staining algorithm to calculate the PSFs, then use these PSFs for extracting the acquisition dip response and correcting the original depth image by deconvolution. We present relevant results of the SEG salt model. The staining algorithm provides an efficient tool for calculating the PSF and for conducting broadband seismic illumination and resolution analyses.

ROV Based Underwater Blurred Image Restoration

In this paper, we present a method of ROV based image processing to restore underwater blurry images from the theory of light and image transmission in the sea. Computer is used to simulate the maximum detection range of the ROV under different water body conditions. The receiving irradiance of the video camera at different detection ranges is also calculated. The ROV’s detection performance under different water body conditions is given by simulation. We restore the underwater blurry images using the Wiener filter based on the simulation. The Wiener filter is shown to be a simple useful method for underwater image restoration in the ROV underwater experiments. We also present examples of restored images of an underwater standard target taken by the video camera in these experiments.

PET image reconstruction with a system matrix containing point spread function derived from single photon incidence response

A point spread function（PSF） for the blurring component in positron emission tomography（PET） is studied. The PSF matrix is derived from the single photon incidence response function. A statistical iterative reconstruction（IR） method based on the system matrix containing the PSF is developed. More specifically, the gamma photon incidence upon a crystal array is simulated by Monte Carlo（MC） simulation, and then the single photon incidence response functions are calculated. Subsequently, the single photon incidence response functions are used to compute the coincidence blurring factor according to the physical process of PET coincidence detection. Through weighting the ordinary system matrix response by the coincidence blurring factors, the IR system matrix containing the PSF is finally established. By using this system matrix, the image is reconstructed by an ordered subset expectation maximization（OSEM） algorithm. The experimental results show that the proposed system matrix can substantially improve the image radial resolution, contrast,and noise property. Furthermore, the simulated single gamma-ray incidence response function depends only on the crystal configuration, so the method could be extended to any PET scanner with the same detector crystal configuration.

Parameter recognition for defocus blur image using cepstrum analysis

Successful restoration of blurred images depends primarily on the knowledge about the degradationparameter.Defocus blur model in the frequency domain is characterized by concentric rings and the blurradius of the point spread function(PSF)can be identified conveniently in the frequency field for peopleby manual means rather than for computer.This paper introduces a practical method for computer to esti-mate the defocus blur parameter in cepstrum area.Fourier transform plays an intermediate role in the pathto cepstrum domain.We suggest a weighted adjustment operation in the frequency domain and then con-vert it to the cepstrum field to increase the accuracy of recognition.

Reduced aliasing artifacts using shaking projection k-space sampling trajectory

Radial imaging techniques, such as projection-reconstruction （PR）, are used in magnetic resonance imaging （MRI） for dynamic imaging, angiography, and short-T2 imaging. They are less sensitive to flow and motion artifacts, and support fast imaging with short echo times. However, aliasing and streaking artifacts are two main sources which degrade radial imaging quality. For a given fixed number of k-space projections, data distributions along radial and angular directions will influence the level of aliasing and streaking artifacts. Conventional radial k-space sampling trajectory introduces an aliasing artifact at the first principal ring of point spread function （PSF）. In this paper, a shaking projection （SP） k-space sampling trajectory was proposed to reduce aliasing artifacts in MR images. SP sampling trajectory shifts the projection alternately along the k-space center, which separates k-space data in the azimuthal direction. Simulations based on conventional and SP sampling trajectories were compared with the same number projections. A significant reduction of aliasing artifacts was observed using the SP sampling trajectory. These two trajectories were also compared with different sampling frequencies. ASP trajectory has the same aliasing character when using half sampling frequency （or half data） for reconstruction. SNR comparisons with different white noise levels show that these two trajectories have the same SNR character. In conclusion, the SP trajectory can reduce the aliasing artifact without decreasing SNR and also provide a way for undersampling recon- struction. Furthermore, this method can be applied to three-dimensional （3D） hybrid or spherical radial k-space sampling for a more efficient reduction of aliasing artifacts.

Modified Approach to PGA Phase Averaging for ISAR Autofocus

A new approach to phase averaging in phase gradient algorithm (PGA) is proposed, which is based on the fundamental fact that the information of translational phase error is widely contained in every defocused scatterer in ISAR image. The new approach aims to choose strong scatterers for error phase averaging with a threshold rather than just simply to pick out the strongest point in each range cell, which is not necessarily real strong scatterers if in some range cells consists more than one strong scatterer and whereas in other range cells no scatterer at all. The results of processing real data are presented to confirm the validity of the proposed approach.

Bistatic Synthetic Aperture Radar Point Spread Function Characteristic Analysis

Based on the point spread function （PSF） theory, the side-lobe extension direction of the impulse response in bistatic synthetic aperture radar （BSAR） is analyzed in detail; in addition, the corresponding autofocus in BSAR should be considered along iso-range direction, not the traditional azimuth resolution （AR） direction. The conclusion is verified by the computer simulation.

Depth Estimation from a Single Image Based on Cauchy Distribution Model

Most approaches to estimate a scene’s 3D depth from a single image often model the point spread function (PSF) as a 2D Gaussian function. However, those methods are suffered from some noises, and difficult to get a high quality of depth recovery. We presented a simple yet effective approach to estimate exactly the amount of spatially varying defocus blur at edges, based on a Cauchy distribution model for the PSF. The raw image was re-blurred twice using two known Cauchy distribution kernels, and the defocus blur amount at edges could be derived from the gradient ratio between the two re-blurred images. By propagating the blur amount at edge locations to the entire image using the matting interpolation, a full depth map was then recovered. Experimental results on several real images demonstrated both feasibility and effectiveness of our method, being a non-Gaussian model for DSF, in providing a better estimation of the defocus map from a single un-calibrated defocused image. These results also showed that our method was robust to image noises, inaccurate edge location and interferences of neighboring edges. It could generate more accurate scene depth maps than the most of existing methods using a Gaussian based DSF model.

A Knife-edge Input Point Spread Function Estimation Method for Document Images

In this paper the progress of document image Point Spread Function （PSF） estimation will be presented. At the beginning of the paper, an overview of PSF estimation methods will be introduced and the reason why knife-edge input PSF estimation method is chosen will be explained. Then in the next section, the knife-edge input PSF estimation method will be detailed. After that, a simulation experiment is performed in order to verify the implemented PSF estimation method. Based on the simulation experiment, in next section we propose a procedure that makes automatic PSF estimation possible. A real document image is firstly taken as an example to illustrate the procedure and then be restored with the estimated PSF and Lucy-Richardson deconvolution method, and its OCR accuracy before and after deconvolution will be compared. Finally, we conclude the paper with the outlook for the future work.

Defect Detection in c-Si Photovoltaic Modules via Transient Thermography and Deconvolution Optimization

Defects may occur in photovoltaic(PV)modules during production and long-term use,thereby threatening the safe operation of PV power stations.Transient thermography is a promising defect detection technology;however,its detection is limited by transverse thermal diffusion.This phenomenon is particularly noteworthy in the panel glasses of PV modules.A dynamic thermography testing method via transient thermography and Wiener filtering deconvolution optimization is proposed.Based on the time-varying characteristics of the point spread function,the selection rules of the first-order difference image for deconvolution are given.Samples with a broken grid and artificial cracks were tested to validate the performance of the optimization method.Compared with the feature images generated by traditional methods,the proposed method significantly improved the visual quality.Quantitative defect size detection can be realized by combining the deconvolution optimization method with adaptive threshold segmentation.For the same batch of PV products,the detection error could be controlled to within 10%.

Adaptive-optical 3D microscopy for microfluidic multiphase flows

Measurements based on optical microscopy can be severely impaired if the access exhibits variations of the refractive index.In the case of fluctuating liquid-gas boundaries,refraction introduces dynamical aberrations that increase the measurement uncertainty.This is prevalent at multiphase flows(e.g.droplets,film flows)that occur in many technical applications as for example in coating and cleaning processes and the water management in fuel cells.In this paper,we present a novel approach based on adaptive optics for correcting the dynamical aberrations in real time and thus reducing the measurement uncertainty.The shape of the fluctuating water-air interface is sampled with a reflecting light beam(Fresnel Guide Star)and a Hartmann-Shack sensor which makes it possible to correct its influence with a deformable mirror in a closed loop.Three-dimensional flow measurements are achieved by using a double-helix point spread function.We measure the flow inside a sessile,oscillating 50-μl droplet on an opaque gas diffusion layer for fuel cells and show that the temporally varying refraction at the droplet surface causes a systematic underestimation of the flow field magnitude corresponding to the first droplet eigenmode which plays a major role in their detachment mechanism.We demonstrate that the adaptive optics correction is able to reduce this systematic error.Hence,the adaptive optics system can pave the way to a deeper understanding of water droplet formation and detachment which can help to improve the efficiency of fuels cells.

Physics-constrained deep-inverse point spread function model:toward non-line-of-sight imaging reconstruction

Non-line-of-sight(NLOS)imaging has emerged as a prominent technique for reconstructing obscured objects from images that undergo multiple diffuse reflections.This imaging method has garnered significant attention in diverse domains,including remote sensing,rescue operations,and intelligent driving,due to its wide-ranging potential applications.Nevertheless,accurately modeling the incident light direction,which carries energy and is captured by the detector amidst random diffuse reflection directions,poses a considerable challenge.This challenge hinders the acquisition of precise forward and inverse physical models for NLOS imaging,which are crucial for achieving high-quality reconstructions.In this study,we propose a point spread function(PSF)model for the NLOS imaging system utilizing ray tracing with random angles.Furthermore,we introduce a reconstruction method,termed the physics-constrained inverse network(PCIN),which establishes an accurate PSF model and inverse physical model by leveraging the interplay between PSF constraints and the optimization of a convolutional neural network.The PCIN approach initializes the parameters randomly,guided by the constraints of the forward PSF model,thereby obviating the need for extensive training data sets,as required by traditional deep-learning methods.Through alternating iteration and gradient descent algorithms,we iteratively optimize the diffuse reflection angles in the PSF model and the neural network parameters.The results demonstrate that PCIN achieves efficient data utilization by not necessitating a large number of actual ground data groups.Moreover,the experimental findings confirm that the proposed method effectively restores the hidden object features with high accuracy.

Mirror-enhanced super-resolution microscopy

Axial excitation confinement beyond the diffraction limit is crucial to the development of next-generation,super-resolution microscopy.STimulated Emission Depletion(STED)nanoscopy offers lateral super-resolution using a donut-beam depletion,but its axial resolution is still over 500 nm.Total internal reflection fluorescence microscopy is widely used for single-molecule localization,but its ability to detect molecules is limited to within the evanescent field of~100 nm from the cell attachment surface.We find here that the axial thickness of the point spread function(PSF)during confocal excitation can be easily improved to 110 nm by replacing the microscopy slide with a mirror.The interference of the local electromagnetic field confined the confocal PSF to a 110-nm spot axially,which enables axial super-resolution with all laser-scanning microscopes.Axial sectioning can be obtained with wavelength modulation or by controlling the spacer between the mirror and the specimen.With no additional complexity,the mirror-assisted excitation confinement enhanced the axial resolution six-fold and the lateral resolution two-fold for STED,which together achieved 19-nm resolution to resolve the inner rim of a nuclear pore complex and to discriminate the contents of 120 nm viral filaments.The ability to increase the lateral resolution and decrease the thickness of an axial section using mirror-enhanced STED without increasing the laser power is of great importance for imaging biological specimens,which cannot tolerate high laser power.

Systematic centroid error compensation for the simple Gaussian PSF in an electronic star map simulator

Simulated star maps serve as convenient inputs for the test of a star sensor, whose standardability mostly depends on the centroid precision of the simulated star image, so it is necessary to accomplish systematic error compensation for the simple Gaussian PSF（or SPSF, in which PSF denotes point spread function）. Firstly, the error mechanism of the SPSF is described, the reason of centroid deviations of the simulated star images based on SPSF lies in the unreasonable sampling positions（the centers of the covered pixels） of the Gaussian probability density function. Then in reference to the IPSF simulated star image spots regarded as ideal ones, and by means of normalization and numerical fitting, the pixel center offset function expressions are got, so the systematic centroid error compensation can be executed simply by substituting the pixel central position with the offset position in the SPSF. Finally, the centroid precision tests are conducted for the three big error cases of Gaussian radius r = 0.5, 0.6, 0.671 pixel, and the centroid accuracy with the compensated SPSF（when r = 0.5） is improved to 2.83 times that of the primitive SPSF, reaching a 0.008 pixel error, an equivalent level of the IPSF. Besides its simplicity, the compensated SPSF further increases both the shape similarity and the centroid precision of simulated star images, which helps to improve the image quality and the standardability of the outputs of an electronic star map simulator（ESS）.

Plasmon point spread functions： How do we model plasmon-mediated emission processes？

A major challenge with studying plasmon-mediated emission events is the small size of plasmonic nanoparticles relative to the wavelength of light. Objects smaller than roughly half the wavelength of light will appear as diffraction-limited spots in far-field optical images, presenting a significant experimental challenge for studying plasmonic processes on the nanoscale. Super-resolution imaging has recently been applied to plasmonic nanosystems and allows plasmon-mediated emission to be resolved on the order of ~5 nm. In super-resolution imaging, a diffraction-limited spot is fit to some model function in order to calculate the position of the emission centroid, which represents the loca- tion of the emitter. However, the accuracy of the centroid position strongly depends on how well the fitting function describes the data. This Perspective discusses the commonly used two-dimensional Gaussian fitting function applied to super-resolution imaging of plasmon-mediated emission, then introduces an alternative model based on dipole point spread flmctions. The two fitting models are compared and contrasted for super-resolution imaging of nanoparticle scattering/luminescence, surface-enhanced Raman scattering, and surface-enhanced fluorescence.