Structured illumination microscopy(SIM)achieves super-resolution(SR)by modulating the high-frequency information of the sample into the passband of the optical system and subsequent image reconstruction.The traditiona...Structured illumination microscopy(SIM)achieves super-resolution(SR)by modulating the high-frequency information of the sample into the passband of the optical system and subsequent image reconstruction.The traditional Wiener-filtering-based reconstruction algorithm operates in the Fourier domain,it requires prior knowledge of the sinusoidal illumination patterns which makes the time-consuming procedure of parameter estimation to raw datasets necessary,besides,the parameter estimation is sensitive to noise or aberration-induced pattern distortion which leads to reconstruction artifacts.Here,we propose a spatial-domain image reconstruction method that does not require parameter estimation but calculates patterns from raw datasets,and a reconstructed image can be obtained just by calculating the spatial covariance of differential calculated patterns and differential filtered datasets(the notch filtering operation is performed to the raw datasets for attenuating and compensating the optical transfer function(OTF)).Experiments on reconstructing raw datasets including nonbiological,biological,and simulated samples demonstrate that our method has SR capability,high reconstruction speed,and high robustness to aberration and noise.展开更多
Structured illumination microscopy(SIM)is one of the most widely applied wide field super resolution imaging techniques with high temporal resolution and low phototoxicity.The spatial resolution of SIM is typically li...Structured illumination microscopy(SIM)is one of the most widely applied wide field super resolution imaging techniques with high temporal resolution and low phototoxicity.The spatial resolution of SIM is typically limited to two times of the diffraction limit and the depth of field is small.In this work,we propose and experimentally demonstrate a low cost,easy to implement,novel technique called speckle structured illumination endoscopy(SSIE)to enhance the resolution of a wide field endoscope with large depth of field.Here,speckle patterns are used to excite objects on the sample which is then followed by a blind-SIM algorithm for super resolution image reconstruction.Our approach is insensitive to the 3D morphology of the specimen,or the deformation of illuminations used.It greatly simplifies the experimental setup as there are no calibration protocols and no stringent control of illumination patterns nor focusing optics.We demonstrate that the SSIE can enhance the resolution 2–4.5 times that of a standard white light endoscopic(WLE)system.The SSIE presents a unique route to super resolution in endoscopic imaging at wide field of view and depth of field,which might be beneficial to the practice of clinical endoscopy.展开更多
We propose a method of complex-amplitude Fourier single-pixel imaging(CFSI)with coherent structured illumination to acquire both the amplitude and phase of an object.In the proposed method,an object is illustrated by ...We propose a method of complex-amplitude Fourier single-pixel imaging(CFSI)with coherent structured illumination to acquire both the amplitude and phase of an object.In the proposed method,an object is illustrated by a series of coherent structured light fields,which are generated by a phase-only spatial light modulator,the complex Fourier spectrum of the object can be acquired sequentially by a single-pixel photodetector.Then the desired complex-amplitude image can be retrieved directly by applying an inverse Fourier transform.We experimentally implemented this CFSI with several different types of objects.The experimental results show that the proposed method provides a promising complex-amplitude imaging approach with high quality and a stable configuration.Thus,it might find broad applications in optical metrology and biomedical science.展开更多
Structured illumination microscopy(SIM)is suitable for biological samples because of its relatively low-peak illumination intensity requirement and high imaging speed.The system resolution is affected by two typical d...Structured illumination microscopy(SIM)is suitable for biological samples because of its relatively low-peak illumination intensity requirement and high imaging speed.The system resolution is affected by two typical detection modes:Point detection and area detection.However,a systematic analysis of the imaging performance of the different detection modes of the system has rarely been conducted.In this study,we compared laser point scanning point detection(PS-PD)and point scanning area detection(PS-AD)imaging in nonconfocal microscopy through theoretical analysis and simulated imaging.The results revealed that the imaging resolutions of PSPD and PS-AD depend on excitation and emission point spread functions(PSFs),respectively.Especially,we combined the second harmonic generation(SHG)of point detection(P-SHG)and area detection(A-SHG)with SIM to realize a nonlinear SIM-imaging technique that improves the imaging resolution.Moreover,we analytically and experimentally compared the nonlinear SIM performance of P-SHG with that of A-SHG.展开更多
Structured illumination microscopy(SIM)is an essential super-resolution microscopy technique that enhances resolution.Several images are required to reconstruct a super-resolution image.However,linear SIM resolution e...Structured illumination microscopy(SIM)is an essential super-resolution microscopy technique that enhances resolution.Several images are required to reconstruct a super-resolution image.However,linear SIM resolution enhancement can only increase the spatial resolution of micros-copy by a factor of two at most because the frequency of the structured illumination pattern is limited by the cutoff frequency of the excitation point spread function.The frequency of the pattern generated by the nonlinear response in samples is not limited;therefore,nonlinear SIM(NL-SIM),in theory,has no inherent limit to the resolution.In the present study,we describe a two-photon nonlinear SIM(2P-SIM)technique using a multiple harmonics scanning pattern that employs a composite structured illumination pattern,which can produce a higher order harmonic pattern based on the fluorescence nonlinear response in a 2P process.The theoretical models of super-resolution imaging were established through our simulation,which describes the working mechanism of the multi-frequency structure of the nonsinusoidal function to improve the reso-lution.The simulation results predict that a 5-fold improvement in resolution in the 2P-SIM is possible.展开更多
Structured illumination microscopy(SIM)is a rapidly developing super-resolution technology.It has been widely used in various application fields of biomedicine due to its excellent two-and three-dimensional imaging ca...Structured illumination microscopy(SIM)is a rapidly developing super-resolution technology.It has been widely used in various application fields of biomedicine due to its excellent two-and three-dimensional imaging capabilities.Furthermore,faster three-dimensional imaging methods are required to help enable more research-oriented living cell imaging.In this paper,a fast and sensitive three-dimensional structured illumination microscopy based on asymmetric three-beam interference is proposed.An innovative time-series acquisition method is employed to halve the time required to obtain each raw image.A segmented half-wave plate as a substantial linear polarization modulation method is applied to the three-dimensional SIM system for the first time.Although it needs to acquire 21 raw images instead of 15 to reconstruct one super-resolution image,the SIM setup proposed in this paper is 30%faster than the traditional spatial light modulator-SIM(SLM-SIM)in imaging each super-resolution image.The related theoretical derivation,hardware system,and verification experiment are elaborated in this paper.The stable and fast 3D super-resolution imaging method proposed in this paper is of great significance to the research of organelle interaction,intercellular communication,and other biomedical fields.展开更多
Optical microscopy allows us to observe the biological structures and processes within living cells.However,the spatial resolution of the optical microscopy is limited to about half of the wavelength by the light di...Optical microscopy allows us to observe the biological structures and processes within living cells.However,the spatial resolution of the optical microscopy is limited to about half of the wavelength by the light di®raction.Structured illumination microscopy(SIM),a type of new emerging super-resolution microscopy,doubles the spatial resolution by illuminating the specimen with a patterned light,and the sample and light source requirements of SIM are not as strict as the other super-resolution microscopy.In addition,SIM is easier to combine with the other imaging techniques to improve their imaging resolution,leading to the developments of diverse types of SIM.SIM has great potential to meet the various requirements of living cells imaging.Here,we review the recent developments of SIM and its combination with other imaging techniques.展开更多
A compact structured illumination chip based on integrated optics is proposed and fabricated on a silicon-on- insulator platform. Based on the simulation of Caussian beam interference, we adopt a chirped diffraction g...A compact structured illumination chip based on integrated optics is proposed and fabricated on a silicon-on- insulator platform. Based on the simulation of Caussian beam interference, we adopt a chirped diffraction grating to achieve a specific interference pattern. The experimental results match well with the simulations. The portability and flexibility of the structured illumination chip can be increased greatly through horizontal encapsulation. High levels of integration, compared with the conventional structured illumination approach, make this chip very compact, with a footprint of only around 1 mm2. The chip has no optical lenses and can be easily combined with a microfluidic system. These properties would make the chip very suitable for portable 3D scanner and compact super-resolution microscopy applications.展开更多
We describe a multiphoton(mP)-structured illumination microscopy(SIM)technique,which demonstrates substantial improvement in image resolution compared with linear SIM due to the nonlinear response of fluorescence.This...We describe a multiphoton(mP)-structured illumination microscopy(SIM)technique,which demonstrates substantial improvement in image resolution compared with linear SIM due to the nonlinear response of fluorescence.This nonlinear response is caused by the effect of nonsinusoidal structured illumination created by scanning a sinusoidally modulated illumination to excite an mP fluorescence signal.The harmonics of the structured fluorescence illumination are utilised to improve resolution.We present an mP-SIM theory for reconstructing the super-resolution image of the system.Theoretically,the resolution of our m P-SIM is unlimited if all the high-order harmonics of the nonlinear response of fluorescence are considered.Experimentally,we demonstrate an 86 nm lateral resolution for two-photon(2P)-SIM and a 72 nm lateral resolution for second-harmonic-generation(SHG)-SIM.We further demonstrate their application by imaging cells stained with F-actin and collagen fibres in mouse-tail tendon.Our method can be directly used in commercial mP microscopes and requires no specific fluorophores or high-intensity laser.展开更多
Structured illumination microscopy(SIM)is a promising super-resolution technique for imaging subcellular structures and dynamics due to its compatibility with most commonly usedffuorescent labeling methods.Structured ...Structured illumination microscopy(SIM)is a promising super-resolution technique for imaging subcellular structures and dynamics due to its compatibility with most commonly usedffuorescent labeling methods.Structured illumination can be obtained by either laser interference or projection of fringe patterns.Here,we proposed a fringe projector composed of a compact multiwavelength LEDs module and a digital micromirror device(DMD)which can be directly attached to most commercial invertedffuorescent microscopes and update it into a SIM system.The effects of the period and duty cycle of fringe patterns on the modulation depth of the structured lightfield were studied.With the optimized fringe pattern,1:6×resolution improvement could be obtained with high-end oil objectives.Multicolor imaging and dynamics of subcellular organelles in live cells were also demonstrated.Our method provides a low-cost solution for SIM setup to expand its wide range of applications to most research labs in thefield of life science and medicine.展开更多
Structured illumination microscopy has been a useful method for achieving lateral super-resolution,but it typically requires at least three precise phase shifts per orientation.In this paper,we propose a super-resolut...Structured illumination microscopy has been a useful method for achieving lateral super-resolution,but it typically requires at least three precise phase shifts per orientation.In this paper,we propose a super-resolution method that utilizes structured illumination without phase shift.The reconstruction process requires only a conventionally illuminated image and an image with structured illumination.This method achieves the same effect as the traditional phase shift method,and more than doubles the resolution by synthesizing a few reconstructions at different illumination frequencies.We verify the resolution improvement process using a combination of theoretical derivations and diagrams,and demonstrate its effectiveness with numerical simulations.展开更多
The image reconstruction process in super-resolution structured illumination microscopy(SIM)is investigated.The structured pattern is generated by the interference of two Gaussian beams to encode undetectable spectra ...The image reconstruction process in super-resolution structured illumination microscopy(SIM)is investigated.The structured pattern is generated by the interference of two Gaussian beams to encode undetectable spectra into detectable region of microscope.After parameters estimation of the structured pattern,the encoded spectra are computationally decoded and recombined in Fourier domain to equivalently increase the cut-off frequency of microscope,resulting in the extension of detectable spectra and a reconstructed image with about two-fold enhanced resolution.Three di®erent methods to estimate the initial phase of structured pattern are compared,verifying the auto-correlation algorithm a®ords the fast,most precise and robust measurement.The artifacts sources and detailed reconstruction°owchart for both linear and nonlinear SIM are also presented.展开更多
Wide-field linear structured illumination microscopy(LSIM)extends resolution beyond the diffraction limit by moving unresolvable high-frequency information into the passband of the microscopy in the form of moiré...Wide-field linear structured illumination microscopy(LSIM)extends resolution beyond the diffraction limit by moving unresolvable high-frequency information into the passband of the microscopy in the form of moiréfringes.However,due to the diffraction limit,the spatial frequency of the structured illumination pattern cannot be larger than the microscopy cutoff frequency,which results in a twofold resolution improvement over wide-field microscopes.This Letter presents a novel approach in point-scanning LSIM,aimed at achieving higher-resolution improvement by combining stimulated emission depletion(STED)with point-scanning structured illumination microscopy(ps SIM)(STED-ps SIM).The according structured illumination pattern whose frequency exceeds the microscopy cutoff frequency is produced by scanning the focus of the sinusoidally modulated excitation beam of STED microscopy.The experimental results showed a 1.58-fold resolution improvement over conventional STED microscopy with the same depletion laser power.展开更多
Far-¯eld°uorescence microscopy has made great progress in the spatial resolution,limited by light diffraction,since the super-resolution imaging technology appeared.And stimulated emission depletion(STED)mic...Far-¯eld°uorescence microscopy has made great progress in the spatial resolution,limited by light diffraction,since the super-resolution imaging technology appeared.And stimulated emission depletion(STED)microscopy and structured illumination microscopy(SIM)can be grouped into one class of the super-resolution imaging technology,which use pattern illumination strategy to circumvent the di®raction limit.We simulated the images of the beads of SIM imaging,the intensity distribution of STED excitation light and depletion light in order to observe effects of the polarized light on imaging quality.Compared to¯xed linear polarization,circularly polarized light is more suitable for SIM on reconstructed image.And right-handed circular polarization(CP)light is more appropriate for both the excitation and depletion light in STED system.Therefore the right-handed CP light would be the best candidate when the SIM and STED are combined into one microscope.Good understanding of the polarization will provide a reference for the patterned illumination experiment to achieve better resolution and better image quality.展开更多
Imaging three-dimensional,subcellular structures with high axial resolution has always been the core purpose of fluorescence microscopy.However,trade-offs exist between axial resolution and other important technical i...Imaging three-dimensional,subcellular structures with high axial resolution has always been the core purpose of fluorescence microscopy.However,trade-offs exist between axial resolution and other important technical indicators,such as temporal resolution,optical power density,and imaging process complexity.We report a new imaging modality,fluorescence interference structured illumination microscopy(FI-SIM),which is based on three-dimensional structured illumination microscopy for wide-field lateral imaging and fluorescence interference for axial reconstruction.FI-SIM can acquire images quickly within the order of hundreds of milliseconds and exhibit even 30 nm axial resolution in half the wavelength depth range without z-axis scanning.Moreover,the relatively low laser power density relaxes the requirements for dyes and enables a wide range of applications for observing fixed and live subcellular structures.展开更多
Super-resolution structured illumination microscopy(SR-SIM)is an outstanding method for visualizing the subcellular dynamics in living cells.To date,by using elaborately designed systems and algorithms,SR-SIM can achi...Super-resolution structured illumination microscopy(SR-SIM)is an outstanding method for visualizing the subcellular dynamics in living cells.To date,by using elaborately designed systems and algorithms,SR-SIM can achieve rapid,optically sectioned,SR observation with hundreds to thousands of time points.However,real-time observation is still out of reach for most SIM setups as conventional algorithms for image reconstruction involve a heavy computing burden.To address this limitation,an accelerated reconstruction algorithm was developed by implementing a simplified workflow for SR-SIM,termed joint space and frequency reconstruction.This algorithm results in an 80-fold improvement in reconstruction speed relative to the widely used Wiener-SIM.Critically,the increased processing speed does not come at the expense of spatial resolution or sectioning capability,as demonstrated by live imaging of microtubule dynamics and mitochondrial tubulation.展开更多
A woofer–tweeter adaptive optical structured illumination microscope(AOSIM) is presented. By combining a low-spatial-frequency large-stroke deformable mirror(woofer) with a high-spatial-frequency low-stroke deformabl...A woofer–tweeter adaptive optical structured illumination microscope(AOSIM) is presented. By combining a low-spatial-frequency large-stroke deformable mirror(woofer) with a high-spatial-frequency low-stroke deformable mirror(tweeter), we are able to remove both large-amplitude and high-order aberrations. In addition, using the structured illumination method, as compared to widefield microscopy, the AOSIM can accomplish highresolution imaging and possesses better sectioning capability. The AOSIM was tested by correcting a large aberration from a trial lens in the conjugate plane of the microscope objective aperture. The experimental results show that the AOSIM has a point spread function with an FWHM that is 140 nm wide(using a water immersion objective lens with NA=1.1) after correcting a large aberration(5.9 μm peak-to-valley wavefront error with 2.05 μm RMS aberration). After structured light illumination is applied, the results show that we are able to resolve two beads that are separated by 145 nm, 1.62× below the diffraction limit of 235 nm. Furthermore, we demonstrate the application of the AOSIM in the field of bioimaging. The sample under investigation was a green-fluorescentprotein-labeled Drosophila embryo. The aberrations from the refractive index mismatch between the microscope objective, the immersion fluid, the cover slip, and the sample itself are well corrected. Using AOSIM we were able to increase the SNR for our Drosophila embryo sample by 5×.展开更多
Hematologic malignancies are one of the most common malignant tumors caused by the clonal proliferation and differentiation of hematopoietic and lymphoid stem cells.The examination of bone marrow cells combined with i...Hematologic malignancies are one of the most common malignant tumors caused by the clonal proliferation and differentiation of hematopoietic and lymphoid stem cells.The examination of bone marrow cells combined with immunodeficiency typing is of great significance to the diagnostic type,treatment and prognosis of hematologic malignancies.Super-resolution fluorescence microscopy(SRM)is a special kind of optical microscopy technology,which breaks the resolution limit and was awarded the Nobel Prize in Chemistry in 2014.With the development of SRM,many related technologies have been applied to the diagnosis and treatment of clinical diseases.It was reported that a major type of SRM technique,single molecule localization microscopy(SMLM),is more sensitive than flow cytometry(FC)in detecting cell membrane antigens'expression,thus enabling better chances in detecting antigens on hematopoietic cells than traditional analytic tools.Furthermore,SRM may be applied to clinical pathology and may guide precision medicine and personalized medicine for clone hematopoietic cell diseases.In this paper,we mainly discuss the application of SRM in clone hematological malignancies.展开更多
In this Letter, we present a high-speed volumetric imaging system based on structured illumination and an electrically tunable lens(ETL), where the ETL performs fast axial scanning at hundreds of Hz. In the system,a...In this Letter, we present a high-speed volumetric imaging system based on structured illumination and an electrically tunable lens(ETL), where the ETL performs fast axial scanning at hundreds of Hz. In the system,a digital micro-mirror device(DMD) is utilized to rapidly generate structured images at the focal plane in synchronization with the axial scanning unit. The scanning characteristics of the ETL are investigated theoretically and experimentally. Imaging experiments on pollen samples are performed to verify the optical cross-sectioning and fast axial scanning capabilities. The results show that our system can perform fast axial scanning and threedimensional(3D) imaging when paired with a high-speed camera, presenting an economic solution for advanced biological imaging applications.展开更多
Holographic and 3D-measurement processes are an often-used tool in industry,medicine,and scientific applications.While small deviations of objects can be visualized by holographic means with high accuracy,optical syst...Holographic and 3D-measurement processes are an often-used tool in industry,medicine,and scientific applications.While small deviations of objects can be visualized by holographic means with high accuracy,optical systems with active structured illumination are a reliable source of absolute 3D-information in these fields.The combination of digital holography with structured illumination allows to simultaneously measure deformations and absolute 3D coordinates but also requires coherent light and has already been demonstrated in principle with a stereo camera setup.Multi-camera systems are limited to certain setup sizes given by the volume and distance of the detectors.Reducing the system to a one-camera(monocular)setup reduces space and acquisition costs.By using a multi-aperture illumination source an extremely high projection rate could be realized and reduced to a monocular approach with a novel voxel-calibration technique,while the projection system itself still requires a large amount of space.In this paper we present a miniaturized,monocular 3D-measurement system that works with repeatable,coherent speckles,generated by a fiber-coupled laser whose light was distributed by a fiber-switch to a diffuser plate connected with a measurement-head,also including a camera.By addressing different fibers through the switch,varying but repeatable patterns are generated.The size of the device(diameter<3 cm)is now mainly limited by the volume of the camera.A first 3D-reconstruction of an object and an outlook for a combination of this system with digital holography is given,allowing absolute 3D-coordinates and relative deviations of object points to be measured simultaneously.展开更多
基金funded by the National Natural Science Foundation of China(62125504,61827825,and 31901059)Zhejiang Provincial Ten Thousand Plan for Young Top Talents(2020R52001)Open Project Program of Wuhan National Laboratory for Optoelectronics(2021WNLOKF007).
文摘Structured illumination microscopy(SIM)achieves super-resolution(SR)by modulating the high-frequency information of the sample into the passband of the optical system and subsequent image reconstruction.The traditional Wiener-filtering-based reconstruction algorithm operates in the Fourier domain,it requires prior knowledge of the sinusoidal illumination patterns which makes the time-consuming procedure of parameter estimation to raw datasets necessary,besides,the parameter estimation is sensitive to noise or aberration-induced pattern distortion which leads to reconstruction artifacts.Here,we propose a spatial-domain image reconstruction method that does not require parameter estimation but calculates patterns from raw datasets,and a reconstructed image can be obtained just by calculating the spatial covariance of differential calculated patterns and differential filtered datasets(the notch filtering operation is performed to the raw datasets for attenuating and compensating the optical transfer function(OTF)).Experiments on reconstructing raw datasets including nonbiological,biological,and simulated samples demonstrate that our method has SR capability,high reconstruction speed,and high robustness to aberration and noise.
基金partially supported by the Gordon and Betty Moore Foundation Grant No.5722
文摘Structured illumination microscopy(SIM)is one of the most widely applied wide field super resolution imaging techniques with high temporal resolution and low phototoxicity.The spatial resolution of SIM is typically limited to two times of the diffraction limit and the depth of field is small.In this work,we propose and experimentally demonstrate a low cost,easy to implement,novel technique called speckle structured illumination endoscopy(SSIE)to enhance the resolution of a wide field endoscope with large depth of field.Here,speckle patterns are used to excite objects on the sample which is then followed by a blind-SIM algorithm for super resolution image reconstruction.Our approach is insensitive to the 3D morphology of the specimen,or the deformation of illuminations used.It greatly simplifies the experimental setup as there are no calibration protocols and no stringent control of illumination patterns nor focusing optics.We demonstrate that the SSIE can enhance the resolution 2–4.5 times that of a standard white light endoscopic(WLE)system.The SSIE presents a unique route to super resolution in endoscopic imaging at wide field of view and depth of field,which might be beneficial to the practice of clinical endoscopy.
基金Project supported by the Natural Science Foundation of Hebei Province,China(Grant Nos.A2022201039 and F2019201446)the MultiYear Research Grant of University of Macao,China(Grant No.MYRG2020-00082-IAPME)+2 种基金the Science and Technology Development Fund from Macao SAR(FDCT),China(Grant No.0062/2020/AMJ)the Advanced Talents Incubation Program of the Hebei University(Grant No.8012605)the National Natural Science Foundation of China(Grant Nos.11204062,61774053,and 11674273)。
文摘We propose a method of complex-amplitude Fourier single-pixel imaging(CFSI)with coherent structured illumination to acquire both the amplitude and phase of an object.In the proposed method,an object is illustrated by a series of coherent structured light fields,which are generated by a phase-only spatial light modulator,the complex Fourier spectrum of the object can be acquired sequentially by a single-pixel photodetector.Then the desired complex-amplitude image can be retrieved directly by applying an inverse Fourier transform.We experimentally implemented this CFSI with several different types of objects.The experimental results show that the proposed method provides a promising complex-amplitude imaging approach with high quality and a stable configuration.Thus,it might find broad applications in optical metrology and biomedical science.
基金supported by the National Natural Science Foundation of China (62275168,62275164,61905145)Guangdong Natural Science Foundation and Province Project (2021A1515011916)+1 种基金Shenzhen Science and Technology R&D and Innovation Foundation (JCYJ20200109105608771)the Science and Technology Planning Project of Shenzhen Municipality (ZDSYS20210623092006020).
文摘Structured illumination microscopy(SIM)is suitable for biological samples because of its relatively low-peak illumination intensity requirement and high imaging speed.The system resolution is affected by two typical detection modes:Point detection and area detection.However,a systematic analysis of the imaging performance of the different detection modes of the system has rarely been conducted.In this study,we compared laser point scanning point detection(PS-PD)and point scanning area detection(PS-AD)imaging in nonconfocal microscopy through theoretical analysis and simulated imaging.The results revealed that the imaging resolutions of PSPD and PS-AD depend on excitation and emission point spread functions(PSFs),respectively.Especially,we combined the second harmonic generation(SHG)of point detection(P-SHG)and area detection(A-SHG)with SIM to realize a nonlinear SIM-imaging technique that improves the imaging resolution.Moreover,we analytically and experimentally compared the nonlinear SIM performance of P-SHG with that of A-SHG.
基金This work Was supported by National Natural Science Foundation of China(grant nos.61775148,61527827,and 61905145)Guangdong Natural Science Foundation and Province Project(2021A1515011916)Shenzhen Science and Technology R&D and Innovation Foundation(grant nos.JCYJ20200109105608771.J CYJ20180305124754860 and JCYJ20180228162956597).
文摘Structured illumination microscopy(SIM)is an essential super-resolution microscopy technique that enhances resolution.Several images are required to reconstruct a super-resolution image.However,linear SIM resolution enhancement can only increase the spatial resolution of micros-copy by a factor of two at most because the frequency of the structured illumination pattern is limited by the cutoff frequency of the excitation point spread function.The frequency of the pattern generated by the nonlinear response in samples is not limited;therefore,nonlinear SIM(NL-SIM),in theory,has no inherent limit to the resolution.In the present study,we describe a two-photon nonlinear SIM(2P-SIM)technique using a multiple harmonics scanning pattern that employs a composite structured illumination pattern,which can produce a higher order harmonic pattern based on the fluorescence nonlinear response in a 2P process.The theoretical models of super-resolution imaging were established through our simulation,which describes the working mechanism of the multi-frequency structure of the nonsinusoidal function to improve the reso-lution.The simulation results predict that a 5-fold improvement in resolution in the 2P-SIM is possible.
基金This work was funded by The National Key R&D Program of China(2016YFF0102000)Scientific Research and Equipment Development Project of CAS(YJKYYQ20180032 and YJKYYQ20190048)Major Innovative Research Team of Suzhou(ZXT2019007).
文摘Structured illumination microscopy(SIM)is a rapidly developing super-resolution technology.It has been widely used in various application fields of biomedicine due to its excellent two-and three-dimensional imaging capabilities.Furthermore,faster three-dimensional imaging methods are required to help enable more research-oriented living cell imaging.In this paper,a fast and sensitive three-dimensional structured illumination microscopy based on asymmetric three-beam interference is proposed.An innovative time-series acquisition method is employed to halve the time required to obtain each raw image.A segmented half-wave plate as a substantial linear polarization modulation method is applied to the three-dimensional SIM system for the first time.Although it needs to acquire 21 raw images instead of 15 to reconstruct one super-resolution image,the SIM setup proposed in this paper is 30%faster than the traditional spatial light modulator-SIM(SLM-SIM)in imaging each super-resolution image.The related theoretical derivation,hardware system,and verification experiment are elaborated in this paper.The stable and fast 3D super-resolution imaging method proposed in this paper is of great significance to the research of organelle interaction,intercellular communication,and other biomedical fields.
基金This study was partly supported by the National Key Basic Research Program of China (973 Program)under Grant No.2015CB352006the National Natural Science Foundation of China under Grants Nos.61335011 and 61405035Program for Changjiang Scholars and Innovative Research Team in University under Grant No.IRT 15R10.
文摘Optical microscopy allows us to observe the biological structures and processes within living cells.However,the spatial resolution of the optical microscopy is limited to about half of the wavelength by the light di®raction.Structured illumination microscopy(SIM),a type of new emerging super-resolution microscopy,doubles the spatial resolution by illuminating the specimen with a patterned light,and the sample and light source requirements of SIM are not as strict as the other super-resolution microscopy.In addition,SIM is easier to combine with the other imaging techniques to improve their imaging resolution,leading to the developments of diverse types of SIM.SIM has great potential to meet the various requirements of living cells imaging.Here,we review the recent developments of SIM and its combination with other imaging techniques.
基金Supported by the National Natural Science Foundation of China under Grant No 61334008the National High-Technology Research and Development Program of China under Grant No 2015AA016904the Instrument Developing Project of the Chinese Academy of Sciences under Grant No YZ201301
文摘A compact structured illumination chip based on integrated optics is proposed and fabricated on a silicon-on- insulator platform. Based on the simulation of Caussian beam interference, we adopt a chirped diffraction grating to achieve a specific interference pattern. The experimental results match well with the simulations. The portability and flexibility of the structured illumination chip can be increased greatly through horizontal encapsulation. High levels of integration, compared with the conventional structured illumination approach, make this chip very compact, with a footprint of only around 1 mm2. The chip has no optical lenses and can be easily combined with a microfluidic system. These properties would make the chip very suitable for portable 3D scanner and compact super-resolution microscopy applications.
基金supported by the Project from the National Key Research and Development Program of China(2017YFB0403804)the National Natural Science Foundation of China(61775148 and61527827)the Shenzhen Science and Technology R&D and Innovation Foundation(JCYJ20180305124754860 and JCYJ20200109105608771)。
文摘We describe a multiphoton(mP)-structured illumination microscopy(SIM)technique,which demonstrates substantial improvement in image resolution compared with linear SIM due to the nonlinear response of fluorescence.This nonlinear response is caused by the effect of nonsinusoidal structured illumination created by scanning a sinusoidally modulated illumination to excite an mP fluorescence signal.The harmonics of the structured fluorescence illumination are utilised to improve resolution.We present an mP-SIM theory for reconstructing the super-resolution image of the system.Theoretically,the resolution of our m P-SIM is unlimited if all the high-order harmonics of the nonlinear response of fluorescence are considered.Experimentally,we demonstrate an 86 nm lateral resolution for two-photon(2P)-SIM and a 72 nm lateral resolution for second-harmonic-generation(SHG)-SIM.We further demonstrate their application by imaging cells stained with F-actin and collagen fibres in mouse-tail tendon.Our method can be directly used in commercial mP microscopes and requires no specific fluorophores or high-intensity laser.
基金The study was funded by the National Key Technologies R&D Program of China(2018YFC0114800 and 2017YFC0109900)the Natural Science Foundation of China(NSFC)(61405238)+1 种基金the Natural Science Foundation of Jiangsu Province(BK20141206)the Key Technologies R&D Program of Jiangsu Province(BE2018666).
文摘Structured illumination microscopy(SIM)is a promising super-resolution technique for imaging subcellular structures and dynamics due to its compatibility with most commonly usedffuorescent labeling methods.Structured illumination can be obtained by either laser interference or projection of fringe patterns.Here,we proposed a fringe projector composed of a compact multiwavelength LEDs module and a digital micromirror device(DMD)which can be directly attached to most commercial invertedffuorescent microscopes and update it into a SIM system.The effects of the period and duty cycle of fringe patterns on the modulation depth of the structured lightfield were studied.With the optimized fringe pattern,1:6×resolution improvement could be obtained with high-end oil objectives.Multicolor imaging and dynamics of subcellular organelles in live cells were also demonstrated.Our method provides a low-cost solution for SIM setup to expand its wide range of applications to most research labs in thefield of life science and medicine.
基金supported by the National Natural Science Foundation of China(Grant No.51775381)National Key Scientific Instrument and Equipment Development Project(Grant No.2017YFF0107001)
文摘Structured illumination microscopy has been a useful method for achieving lateral super-resolution,but it typically requires at least three precise phase shifts per orientation.In this paper,we propose a super-resolution method that utilizes structured illumination without phase shift.The reconstruction process requires only a conventionally illuminated image and an image with structured illumination.This method achieves the same effect as the traditional phase shift method,and more than doubles the resolution by synthesizing a few reconstructions at different illumination frequencies.We verify the resolution improvement process using a combination of theoretical derivations and diagrams,and demonstrate its effectiveness with numerical simulations.
基金This work is supported by National Natural Science Foundation of China (Nos.61361160418 and 61327902).
文摘The image reconstruction process in super-resolution structured illumination microscopy(SIM)is investigated.The structured pattern is generated by the interference of two Gaussian beams to encode undetectable spectra into detectable region of microscope.After parameters estimation of the structured pattern,the encoded spectra are computationally decoded and recombined in Fourier domain to equivalently increase the cut-off frequency of microscope,resulting in the extension of detectable spectra and a reconstructed image with about two-fold enhanced resolution.Three di®erent methods to estimate the initial phase of structured pattern are compared,verifying the auto-correlation algorithm a®ords the fast,most precise and robust measurement.The artifacts sources and detailed reconstruction°owchart for both linear and nonlinear SIM are also presented.
基金supported by the National Natural Science Foundation of China(Nos.62275168,62275164,61775148,and 61905145)the National Key Research and Development Program of China(No.2022YFA1206300)+5 种基金the Guangdong Natural Science Foundation and Province Project(Nos.2021A1515011916 and 2023A1515012250)the Foundation from Department of Science and Technology of Guangdong Province(No.2021QN02Y124)the Foundation from Department of Education of Guangdong Province(No.2023ZDZX2052)the Shenzhen Science and Technology R&D and Innovation Foundation(No.JCYJ20200109105608771)the Shenzhen Key Laboratory of Photonics and Biophotonics(No.ZDSYS20210623092006020)the Medical-Engineering Interdisciplinary Research Foundation of Shenzhen University。
文摘Wide-field linear structured illumination microscopy(LSIM)extends resolution beyond the diffraction limit by moving unresolvable high-frequency information into the passband of the microscopy in the form of moiréfringes.However,due to the diffraction limit,the spatial frequency of the structured illumination pattern cannot be larger than the microscopy cutoff frequency,which results in a twofold resolution improvement over wide-field microscopes.This Letter presents a novel approach in point-scanning LSIM,aimed at achieving higher-resolution improvement by combining stimulated emission depletion(STED)with point-scanning structured illumination microscopy(ps SIM)(STED-ps SIM).The according structured illumination pattern whose frequency exceeds the microscopy cutoff frequency is produced by scanning the focus of the sinusoidally modulated excitation beam of STED microscopy.The experimental results showed a 1.58-fold resolution improvement over conventional STED microscopy with the same depletion laser power.
基金This work was partly supported by the National Key Basic Research Program of China (973 project)under Grant No.2015CB352006the National Natural Science Foundation of China under Grant Nos.61335011 and 61405035Program for Changjiang Scholars and Innovative Research Team in University under Grant No.IRT 15R10.
文摘Far-¯eld°uorescence microscopy has made great progress in the spatial resolution,limited by light diffraction,since the super-resolution imaging technology appeared.And stimulated emission depletion(STED)microscopy and structured illumination microscopy(SIM)can be grouped into one class of the super-resolution imaging technology,which use pattern illumination strategy to circumvent the di®raction limit.We simulated the images of the beads of SIM imaging,the intensity distribution of STED excitation light and depletion light in order to observe effects of the polarized light on imaging quality.Compared to¯xed linear polarization,circularly polarized light is more suitable for SIM on reconstructed image.And right-handed circular polarization(CP)light is more appropriate for both the excitation and depletion light in STED system.Therefore the right-handed CP light would be the best candidate when the SIM and STED are combined into one microscope.Good understanding of the polarization will provide a reference for the patterned illumination experiment to achieve better resolution and better image quality.
基金sponsored by the National Natural Science Foundation of China(Grant Nos.62125504,61827825,and 31901059)STI 2030—Major Projects(Grant No.2021ZD0200401)+3 种基金Major Program of the Natural Science Foundation of Zhejiang Province(Grant No.LD21F050002)Zhejiang Provincial Ten Thousand Plan for Young Top Talents(Grant No.2020R52001)Croucher Foundation(Grant No.CM/CT/CF/CIA/0688/19ay)Hong Kong Innovation and Technology Fund(ITS/178/20FP and ITS/148/20).
文摘Imaging three-dimensional,subcellular structures with high axial resolution has always been the core purpose of fluorescence microscopy.However,trade-offs exist between axial resolution and other important technical indicators,such as temporal resolution,optical power density,and imaging process complexity.We report a new imaging modality,fluorescence interference structured illumination microscopy(FI-SIM),which is based on three-dimensional structured illumination microscopy for wide-field lateral imaging and fluorescence interference for axial reconstruction.FI-SIM can acquire images quickly within the order of hundreds of milliseconds and exhibit even 30 nm axial resolution in half the wavelength depth range without z-axis scanning.Moreover,the relatively low laser power density relaxes the requirements for dyes and enables a wide range of applications for observing fixed and live subcellular structures.
基金supported by the National Natural Science Foundation of China (NSFC) (Nos. 62005208, 62135003, and 61905189)Innovation Capability Support Program of Shaanxi (No. 2021TD-57)+1 种基金China Postdoctoral Science Foundation (Nos. 2020M673365 and 2019M663656)National Institutes of Health Grant GM100156 to PRB
文摘Super-resolution structured illumination microscopy(SR-SIM)is an outstanding method for visualizing the subcellular dynamics in living cells.To date,by using elaborately designed systems and algorithms,SR-SIM can achieve rapid,optically sectioned,SR observation with hundreds to thousands of time points.However,real-time observation is still out of reach for most SIM setups as conventional algorithms for image reconstruction involve a heavy computing burden.To address this limitation,an accelerated reconstruction algorithm was developed by implementing a simplified workflow for SR-SIM,termed joint space and frequency reconstruction.This algorithm results in an 80-fold improvement in reconstruction speed relative to the widely used Wiener-SIM.Critically,the increased processing speed does not come at the expense of spatial resolution or sectioning capability,as demonstrated by live imaging of microtubule dynamics and mitochondrial tubulation.
基金UC Office of the President(MR-15-327968)National Science Foundation(NSF)(1353461)National Institutes of Health(NIH)(R21MH101688)
文摘A woofer–tweeter adaptive optical structured illumination microscope(AOSIM) is presented. By combining a low-spatial-frequency large-stroke deformable mirror(woofer) with a high-spatial-frequency low-stroke deformable mirror(tweeter), we are able to remove both large-amplitude and high-order aberrations. In addition, using the structured illumination method, as compared to widefield microscopy, the AOSIM can accomplish highresolution imaging and possesses better sectioning capability. The AOSIM was tested by correcting a large aberration from a trial lens in the conjugate plane of the microscope objective aperture. The experimental results show that the AOSIM has a point spread function with an FWHM that is 140 nm wide(using a water immersion objective lens with NA=1.1) after correcting a large aberration(5.9 μm peak-to-valley wavefront error with 2.05 μm RMS aberration). After structured light illumination is applied, the results show that we are able to resolve two beads that are separated by 145 nm, 1.62× below the diffraction limit of 235 nm. Furthermore, we demonstrate the application of the AOSIM in the field of bioimaging. The sample under investigation was a green-fluorescentprotein-labeled Drosophila embryo. The aberrations from the refractive index mismatch between the microscope objective, the immersion fluid, the cover slip, and the sample itself are well corrected. Using AOSIM we were able to increase the SNR for our Drosophila embryo sample by 5×.
基金This work was supported by the Innovation Fund of WNLO(2018WNLOKF023)the Start-up Fund of Hainan University(KYQD(ZR)-20077).
文摘Hematologic malignancies are one of the most common malignant tumors caused by the clonal proliferation and differentiation of hematopoietic and lymphoid stem cells.The examination of bone marrow cells combined with immunodeficiency typing is of great significance to the diagnostic type,treatment and prognosis of hematologic malignancies.Super-resolution fluorescence microscopy(SRM)is a special kind of optical microscopy technology,which breaks the resolution limit and was awarded the Nobel Prize in Chemistry in 2014.With the development of SRM,many related technologies have been applied to the diagnosis and treatment of clinical diseases.It was reported that a major type of SRM technique,single molecule localization microscopy(SMLM),is more sensitive than flow cytometry(FC)in detecting cell membrane antigens'expression,thus enabling better chances in detecting antigens on hematopoietic cells than traditional analytic tools.Furthermore,SRM may be applied to clinical pathology and may guide precision medicine and personalized medicine for clone hematopoietic cell diseases.In this paper,we mainly discuss the application of SRM in clone hematological malignancies.
基金supported by the National Natural Science Foundation of China(NSFC),General Program(No.51375415)the Development of a Flexure-based Optical Scanning System and a Multimodal Nonlinear Endomicroscope for in vivo Biological Studiesthe HKSAR Research Grants Council(RGC)General Research Fund(CUHK 14202815)
文摘In this Letter, we present a high-speed volumetric imaging system based on structured illumination and an electrically tunable lens(ETL), where the ETL performs fast axial scanning at hundreds of Hz. In the system,a digital micro-mirror device(DMD) is utilized to rapidly generate structured images at the focal plane in synchronization with the axial scanning unit. The scanning characteristics of the ETL are investigated theoretically and experimentally. Imaging experiments on pollen samples are performed to verify the optical cross-sectioning and fast axial scanning capabilities. The results show that our system can perform fast axial scanning and threedimensional(3D) imaging when paired with a high-speed camera, presenting an economic solution for advanced biological imaging applications.
文摘Holographic and 3D-measurement processes are an often-used tool in industry,medicine,and scientific applications.While small deviations of objects can be visualized by holographic means with high accuracy,optical systems with active structured illumination are a reliable source of absolute 3D-information in these fields.The combination of digital holography with structured illumination allows to simultaneously measure deformations and absolute 3D coordinates but also requires coherent light and has already been demonstrated in principle with a stereo camera setup.Multi-camera systems are limited to certain setup sizes given by the volume and distance of the detectors.Reducing the system to a one-camera(monocular)setup reduces space and acquisition costs.By using a multi-aperture illumination source an extremely high projection rate could be realized and reduced to a monocular approach with a novel voxel-calibration technique,while the projection system itself still requires a large amount of space.In this paper we present a miniaturized,monocular 3D-measurement system that works with repeatable,coherent speckles,generated by a fiber-coupled laser whose light was distributed by a fiber-switch to a diffuser plate connected with a measurement-head,also including a camera.By addressing different fibers through the switch,varying but repeatable patterns are generated.The size of the device(diameter<3 cm)is now mainly limited by the volume of the camera.A first 3D-reconstruction of an object and an outlook for a combination of this system with digital holography is given,allowing absolute 3D-coordinates and relative deviations of object points to be measured simultaneously.