Speckle structured illumination endoscopy with enhanced resolution at wide field of view and depth of field

Structured illumination microscopy(SIM)is one of the most widely applied wide field super resolution imaging techniques with high temporal resolution and low phototoxicity.The spatial resolution of SIM is typically limited to two times of the diffraction limit and the depth of field is small.In this work,we propose and experimentally demonstrate a low cost,easy to implement,novel technique called speckle structured illumination endoscopy(SSIE)to enhance the resolution of a wide field endoscope with large depth of field.Here,speckle patterns are used to excite objects on the sample which is then followed by a blind-SIM algorithm for super resolution image reconstruction.Our approach is insensitive to the 3D morphology of the specimen,or the deformation of illuminations used.It greatly simplifies the experimental setup as there are no calibration protocols and no stringent control of illumination patterns nor focusing optics.We demonstrate that the SSIE can enhance the resolution 2–4.5 times that of a standard white light endoscopic(WLE)system.The SSIE presents a unique route to super resolution in endoscopic imaging at wide field of view and depth of field,which might be beneficial to the practice of clinical endoscopy.

Comparison of point detection and area detection for point-scanning structured illumination microscopy

Structured illumination microscopy(SIM)is suitable for biological samples because of its relatively low-peak illumination intensity requirement and high imaging speed.The system resolution is affected by two typical detection modes:Point detection and area detection.However,a systematic analysis of the imaging performance of the different detection modes of the system has rarely been conducted.In this study,we compared laser point scanning point detection(PS-PD)and point scanning area detection(PS-AD)imaging in nonconfocal microscopy through theoretical analysis and simulated imaging.The results revealed that the imaging resolutions of PSPD and PS-AD depend on excitation and emission point spread functions(PSFs),respectively.Especially,we combined the second harmonic generation(SHG)of point detection(P-SHG)and area detection(A-SHG)with SIM to realize a nonlinear SIM-imaging technique that improves the imaging resolution.Moreover,we analytically and experimentally compared the nonlinear SIM performance of P-SHG with that of A-SHG.

Complex-amplitude Fourier single-pixel imaging via coherent structured illumination

We propose a method of complex-amplitude Fourier single-pixel imaging(CFSI)with coherent structured illumination to acquire both the amplitude and phase of an object.In the proposed method,an object is illustrated by a series of coherent structured light fields,which are generated by a phase-only spatial light modulator,the complex Fourier spectrum of the object can be acquired sequentially by a single-pixel photodetector.Then the desired complex-amplitude image can be retrieved directly by applying an inverse Fourier transform.We experimentally implemented this CFSI with several different types of objects.The experimental results show that the proposed method provides a promising complex-amplitude imaging approach with high quality and a stable configuration.Thus,it might find broad applications in optical metrology and biomedical science.

Compact and robust dual-color linearly polarized illumination source for three-photon fluorescence imaging

The miniaturized femtosecond laser in near infrared-Ⅱregion is the core equipment of threephoton microscopy.In this paper,we design a compact and robust illumination source that emits dual-color linearly polarized light for three-photon microscopy.Based on an all-polarizationmaintaining passive mode-locked fiber laser,we shift the center wavelength of the pulses to the 1.7m band utilizing cascade Raman effect,thereby generate dual-wavelength pulses.To enhance clarity,the two wavelengths are separated through the graded-index multimode fiber.Then we obtain the dual-pulse sequences with 1639.4 nm and 1683.7 nm wavelengths,920 fs pulse duration,and 23.75 MHz pulse repetition rate.The average power of the signal is 53.64mW,corresponding to a single pulse energy of 2.25 nJ.This illumination source can be further amplified and compressed for three-photon fluorescence imaging,especially dual-color three-photon fluorescence imaging,making it an ideal option for biomedical applications.

Radial Basis Approximations Based BEMD for Enhancement of Non-Uniform Illumination Images

An image can be degraded due to many environmental factors like foggy or hazy weather,low light conditions,extra light conditions etc.Image captured under the poor light conditions is generally known as non-uniform illumination image.Non-uniform illumination hides some important information present in an image during the image capture Also,it degrades the visual quality of image which generates the need for enhancement of such images.Various techniques have been present in literature for the enhancement of such type of images.In this paper,a novel architecture has been proposed for enhancement of poor illumination images which uses radial basis approximations based BEMD(Bi-dimensional Empirical Mode Decomposition).The enhancement algorithm is applied on intensity and saturation components of image.Firstly,intensity component has been decomposed into various bi-dimensional intrinsic mode function and residue by using sifting algorithm.Secondly,some linear transformations techniques have been applied on various bidimensional intrinsic modes obtained and residue and further on joining the transformed modes with residue,enhanced intensity component is obtained.Saturation part of an image is then enhanced in accordance to the enhanced intensity component.Final enhanced image can be obtained by joining the hue,enhanced intensity and enhanced saturation parts of the given image.The proposed algorithm will not only give the visual pleasant image but maintains the naturalness of image also.

Efficacy and safety of Usights UC100 illuminated microcatheter in microcatheter-assisted trabeculotomy

AIM:To evaluate the efficacy and safety of Usights UC100 illuminated microcatheter in microcatheter-assisted trabeculotomy(MAT).METHODS:Totally 10 eyes of 10 patients with primary open angle glaucoma(POAG)who underwent MAT facilitated by Usights UC100(5 eyes)or iTrack(5 eyes)were reviewed.The success of this surgery was defined as intraocular pressure(IOP)<22 mm Hg with>30%reduction,without oral glaucoma medications,or additional glaucoma surgery.RESULTS:The mean pre-operative IOP was 25.38±10.22 mm Hg in the Usights UC100 group and 19.98±3.87 mm Hg in the iTrack group.MAT was achieved in all eyes in both groups.The success rates for the Usights UC100 group and iTrack groups were in all and 4 eyes,respectively.Both microcatheters produced a statistically significant reduction in IOP,and eyes using Usights UC100 achieved a lower IOP than the iTrack group at 3mo followup(12.58±1.52 and 14.84±1.89 mm Hg,respectively),but no statistical significance was there.No severe side effects were observed in either group.CONCLUSION:MAT using Usights UC100 or iTrack both achieve significant pressure reduction in cases of POAG,and Usights UC100 is as safe as iTrack.

DECREASING PITTING SUSCEPTIBILITY OF PASSIVE FILMS ON X70 PIPELINE STEEL IN NaCl SOLUTIONS BY ILLUMINATION

The influence of UV illumination on passivity and pitting susceptibility on X70 pipoeline steel in a borate buffer （pH=8.4 ） solution containing NaCl is described. It is observed that illumination of the sample leads to a decrease in its pitting susceptibility as indicated by pitting potential and incubation time measurements in chloride containing electrolytes. This effect is strongly dependent on the applied potential during passivation. The electronic properties of the passive films on X70 steel were studied by Mott-Schottky analysis and photocurrent transient measurements. The results indicated that illumination during passivation led to modifications in the electronic properties of the passive films, mainly to a decrease of the bulk doping and an increase in the surface state density. The cause for the decrease in the pitting susceptibility is preliminary explained in terms of such modifications of the passive flm.

Adaptive illumination light source for online machine vision inspection of tin steel strips

The different reflection characteristics of the surface of tin steel strips and the different speeds of the tinning line demand an adaptive illumination light source for online machine vision inspection. This light source can be integrated with a time delay integration charge-coupled device （TDI CCD ） to capture the images of moving objects and facilitate inspection of the surface quality of tin steel strips. On-site application show the effectiveness of the TDI camera with the adaptive illumination light source in detecting the surface defects on tin steel strips of three different materials and with different tin coating weights.

Gaussian Mixture Models for Human Face Recognition under Illumination Variations

The appearance of a face is severely altered by illumination conditions that makes automatic face recognition a challenging task. In this paper we propose a Gaussian Mixture Models (GMM)-based human face identification technique built in the Fourier or frequency domain that is robust to illumination changes and does not require “illumination normalization” (removal of illumination effects) prior to application unlike many existing methods. The importance of the Fourier domain phase in human face identification is a well-established fact in signal processing. A maximum a posteriori (or, MAP) estimate based on the posterior likelihood is used to perform identification, achieving misclassification error rates as low as 2% on a database that contains images of 65 individuals under 21 different illumination conditions. Furthermore, a misclassification rate of 3.5% is observed on the Yale database with 10 people and 64 different illumination conditions. Both these sets of results are significantly better than those obtained from traditional PCA and LDA classifiers. Statistical analysis pertaining to model selection is also presented.

Feature Patch Illumination Spaces and Karcher Compression for Face Recognition via Grassmannians

Recent work has established that digital images of a human face, when collected with a fixed pose but under a variety of illumination conditions, possess discriminatory information that can be used in classification. In this paper we perform classification on Grassmannians to demonstrate that sufficient discriminatory information persists in feature patch (e.g., nose or eye patch) illumination spaces. We further employ the use of Karcher mean on the Grassmannians to demonstrate that this compressed representation can accelerate computations with relatively minor sacrifice on performance. The combination of these two ideas introduces a novel perspective in performing face recognition.

Improvement in Resolution of Multiphoton Scanning Structured Illumination Microscopy via Harmonics

We describe a multiphoton(mP)-structured illumination microscopy(SIM)technique,which demonstrates substantial improvement in image resolution compared with linear SIM due to the nonlinear response of fluorescence.This nonlinear response is caused by the effect of nonsinusoidal structured illumination created by scanning a sinusoidally modulated illumination to excite an mP fluorescence signal.The harmonics of the structured fluorescence illumination are utilised to improve resolution.We present an mP-SIM theory for reconstructing the super-resolution image of the system.Theoretically,the resolution of our m P-SIM is unlimited if all the high-order harmonics of the nonlinear response of fluorescence are considered.Experimentally,we demonstrate an 86 nm lateral resolution for two-photon(2P)-SIM and a 72 nm lateral resolution for second-harmonic-generation(SHG)-SIM.We further demonstrate their application by imaging cells stained with F-actin and collagen fibres in mouse-tail tendon.Our method can be directly used in commercial mP microscopes and requires no specific fluorophores or high-intensity laser.

Structured Illumination Chip Based on Integrated Optics

A compact structured illumination chip based on integrated optics is proposed and fabricated on a silicon-on- insulator platform. Based on the simulation of Caussian beam interference, we adopt a chirped diffraction grating to achieve a specific interference pattern. The experimental results match well with the simulations. The portability and flexibility of the structured illumination chip can be increased greatly through horizontal encapsulation. High levels of integration, compared with the conventional structured illumination approach, make this chip very compact, with a footprint of only around 1 mm2. The chip has no optical lenses and can be easily combined with a microfluidic system. These properties would make the chip very suitable for portable 3D scanner and compact super-resolution microscopy applications.

Optimization of laser illumination configuration for directly driven inertial confinement fusion

Optimum laser configurations are presented to achieve high illumination uniformity with directly driven inertial confinement fusion targets.Assuming axisymmetric absorption pattern of individual laser beams,theoretical models are reviewed in terms of the number of laser beams,system imperfection,and laser beam patterns.Utilizing a self-organizing system of charged particles on a sphere,a simple numerical model is provided to give an optimal configuration for an arbitrary number of laser beams.As a result,such new configurations as“M48”and“M60”are found to show substantially higher illumination uniformity than any other existing direct drive systems.A new polar direct-drive scheme is proposed with the laser axes keeping off the target center,which can be applied to laser configurations designed for indirectly driven inertial fusion.

Quantum Illumination with Noiseless Linear Amplifier

Quantum illumination, that is, quantum target detection, is to detect the potential target with two-mode quan- tum entangled state. For a given transmitted energy, the quantum illumination can achieve a target-detection probability of error much lower than the illumination scheme without entanglement. We investigate the useful- ness of noiseless linear amplification （NLA） for quantum illumination. Our result shows that NLA can help to substantially reduce the number of quantum entangled states collected for joint measurement of multi-copy quan- tum state. Our analysis on the NLA-assisted scheme could help to develop more efficient schemes for quantum illumination.

Structured illumination microscopy based on asymmetric three-beam interference

Structured illumination microscopy(SIM)is a rapidly developing super-resolution technology.It has been widely used in various application fields of biomedicine due to its excellent two-and three-dimensional imaging capabilities.Furthermore,faster three-dimensional imaging methods are required to help enable more research-oriented living cell imaging.In this paper,a fast and sensitive three-dimensional structured illumination microscopy based on asymmetric three-beam interference is proposed.An innovative time-series acquisition method is employed to halve the time required to obtain each raw image.A segmented half-wave plate as a substantial linear polarization modulation method is applied to the three-dimensional SIM system for the first time.Although it needs to acquire 21 raw images instead of 15 to reconstruct one super-resolution image,the SIM setup proposed in this paper is 30%faster than the traditional spatial light modulator-SIM(SLM-SIM)in imaging each super-resolution image.The related theoretical derivation,hardware system,and verification experiment are elaborated in this paper.The stable and fast 3D super-resolution imaging method proposed in this paper is of great significance to the research of organelle interaction,intercellular communication,and other biomedical fields.

Nonlinear scanning structured illumination microscopy based on nonsinusoidal modulation

Structured illumination microscopy(SIM)is an essential super-resolution microscopy technique that enhances resolution.Several images are required to reconstruct a super-resolution image.However,linear SIM resolution enhancement can only increase the spatial resolution of micros-copy by a factor of two at most because the frequency of the structured illumination pattern is limited by the cutoff frequency of the excitation point spread function.The frequency of the pattern generated by the nonlinear response in samples is not limited;therefore,nonlinear SIM(NL-SIM),in theory,has no inherent limit to the resolution.In the present study,we describe a two-photon nonlinear SIM(2P-SIM)technique using a multiple harmonics scanning pattern that employs a composite structured illumination pattern,which can produce a higher order harmonic pattern based on the fluorescence nonlinear response in a 2P process.The theoretical models of super-resolution imaging were established through our simulation,which describes the working mechanism of the multi-frequency structure of the nonsinusoidal function to improve the reso-lution.The simulation results predict that a 5-fold improvement in resolution in the 2P-SIM is possible.

Modulated illumination localization microscopy-enabled sub-10 nm resolution

Optical microscopy is an essential tool for exploring the structures and activities of cells and tissues.To break the limit of resolution caused by diffraction,researchers have made continuous advances and innovations to improve the resolution of optical microscopy since the 1990s.These contributions,however,still make sub-10nm imaging an obstacle.Here,we name a series of technologies as modulated illumination localization microscopy(MILM),which makes ultra-high-resolution imaging practical.Besides,we review the recent progress since 2017 when MINFLUX was proposed and became the inspiration and foundation for the follow-up devel-opment of MILM.This review divides MILM into two types:point-scanning and wide-field.The schematics,principles and future research directions of MILM are discussed elaborately.

Research of global illumination algorithms rendering in glossy scene

In computer graphic （CG）, illumination rendering generated realistic effect at virtual scene is amazing. Not only plausible lighting effect is to show the relative position between of the objects, but also to reflect the material of visual appearance of the vir- tual objects. The diffuse-scene rendering reflectance credibility has gradually matured. Global illumination rendering method for the glossy material is still a challenge for the CG research. Because of the shiny materials is highly energy reflection between the com- plex light paths. Whether we trace glossy reflection paths, or use of one-reflection or multi-reflection approximate above complex il- lumination transmission is a difficult working. This paper we gather some commonly used global illumination algorithms recently year and its extension glossy scene improvements. And we introduce the limitation of classical algorithms rendering glossy scene and some extended solution. Finally, we will summarize the illumination rendering for specular scene, there are still some open prob- lems.

A Low-dimensional Illumination Space Representation of Human Faces for Arbitrary Lighting Conditions

The proposed method for low-dimensional illumination space representation (LDISR) of human faces can not only synthesize a virtual face image when given lighting conditions but also estimate lighting conditions when given a face image. The LDISR is based on the observation that 9 basis point light sources can represent almost arbitrary lighting conditions for face recognition application and di?erent human faces have a similar LDISR. The principal component analysis (PCA) and the nearest neighbor clustering method are adopted to obtain the 9 basis point light sources. The 9 basis images under the 9 basis point light sources are then used to construct an LDISR which can represent almost all face images under arbitrary lighting conditions. Illumination ratio image (IRI) is employed to generate virtual face images under diffierent illuminations. The LDISR obtained from face images of one person can be used for other people. Experimental results on image reconstruction and face recognition indicate the e?ciency of LDISR.

ILLUMINATION AND EXPOSITION OF A CONVEX n-DIMENSIONAL BODY DEPENDING ON ITS SHARPNESS

A convex n-body C is said to be exposable to a set D of a few directions if there is a linear transformation L : En → En such that L(C) arid each body isometric to L(C) is illuminated by D. Denote by En the minimum integer such that each C is exposable to a (fixed) set D of cardinality En. An upper bound for En is established here.