Single-cell volumetric imaging is essential for researching individual characteristics of cells.As a nonscanning imaging technique,lighteld microscopy(LFM)is a critical tool to achieve realtime three-dimensional imagi...Single-cell volumetric imaging is essential for researching individual characteristics of cells.As a nonscanning imaging technique,lighteld microscopy(LFM)is a critical tool to achieve realtime three-dimensional imaging with the advantage of single-shot.To address the inherent limits including nonuniform resolution and block-wise artifacts,various modied LFM strategies have been developed to provide new insights into the structural and functional information of cells.This review will introduce the principle and development of LFM,discuss the improved approaches based on hardware designs and 3D reconstruction algorithms,and present the applications in single-cell imaging.展开更多
In light-sheet fluorescence microscopy,the axial resolution and field of view are mutually constrained.Axially swept light-sheet microscopy(ASLM)can decouple the trade-off,but the confocal detection scheme using a rol...In light-sheet fluorescence microscopy,the axial resolution and field of view are mutually constrained.Axially swept light-sheet microscopy(ASLM)can decouple the trade-off,but the confocal detection scheme using a rolling shutter also rejects fluorescence signals from the specimen in the field of interest,which sacrifices the photon efficiency.Here,we report a laterally swept light-sheet microscopy(LSLM)scheme in which the focused beam is first scanned along the axial direction and subsequently laterally swept with the rolling shutter.We show that LSLM can obtain a higher photon efficiency when similar axial resolution and field of view can be achieved.Moreover,based on the principle of image scanning microscopy,applying the pixel reassignment to the LSLM images,hereby named iLSLM,improves the optical sectioning.Both simulation and experimental results demonstrate the higher photon efficiency with similar axial resolution and optical sectioning.Our proposed scheme is suitable for volumetric imaging of specimens that are susceptible to photobleaching or phototoxicity.展开更多
A key challenge when imaging whole biomedical specimens is how to quickly obtain massive cellular information over a large field of view(FOV).We report a subvoxel light-sheet microscopy(SLSM)method enabling high-throu...A key challenge when imaging whole biomedical specimens is how to quickly obtain massive cellular information over a large field of view(FOV).We report a subvoxel light-sheet microscopy(SLSM)method enabling high-throughput volumetric imaging of mesoscale specimens at cellular resolution.A nonaxial,continuous scanning strategy is developed to rapidly acquire a stack of large-FOV images with three-dimensional(3-D)nanoscale shifts encoded.Then,by adopting a subvoxel-resolving procedure,the SLSM method models these low-resolution,cross-correlated images in the spatial domain and can iteratively recover a 3-D image with improved resolution throughout the sample.This technique can surpass the optical limit of a conventional light-sheet microscope by more than three times,with high acquisition speeds of gigavoxels per minute.By fast reconstruction of 3-D cultured cells,intact organs,and live embryos,SLSM method presents a convenient way to circumvent the trade-off between mapping large-scale tissue(>100 mm3)and observing single cell(∼1-μm resolution).It also eliminates the need of complicated mechanical stitching or modulated illumination,using a simple light-sheet setup and fast graphics processing unit-based computation to achieve high-throughput,high-resolution 3-D microscopy,which could be tailored for a wide range of biomedical applications in pathology,histology,neuroscience,etc.展开更多
Recording the highly diverse and dynamic activities in large populations of neurons in behaving animals is crucial for a better understanding of how the brain works.To meet this challenge,extensive efforts have been d...Recording the highly diverse and dynamic activities in large populations of neurons in behaving animals is crucial for a better understanding of how the brain works.To meet this challenge,extensive efforts have been devoted to developing functional fluorescent indicators and optical imaging techniques to optically monitor neural activity.Indeed,optical imaging potentially has extremely high throughput due to its non-invasive access to large brain regions and capability to sample neurons at high density,but the readout speed,such as the scanning speed in two-photon scanning microscopy,is often limited by various practical considerations.Among different imaging methods,light field microscopy features a highly parallelized 3D fluorescence imaging scheme and therefore promises a novel and faster strategy for functional imaging of neural activity.Here,we briefly review the working principles of various types of light field microscopes and their recent developments and applications in neuroscience studies.We also discuss strategies and considerations of optimizing light field microscopy for different experimental purposes,with illustrative examples in imaging zebrafish and mouse brains.展开更多
Two novel ultrasound imaging techniques with imaging contrast mechanisms are in the works:X-ray-induced acoustic computed tomography(XACT),and nanoscale photoacoustic tomogra-phy(nPAT).XACT has incredible potential in...Two novel ultrasound imaging techniques with imaging contrast mechanisms are in the works:X-ray-induced acoustic computed tomography(XACT),and nanoscale photoacoustic tomogra-phy(nPAT).XACT has incredible potential in:(1)biomedical imaging,through which a 3D image can be generated using only a single X-ray projection,and(2)radiation dosimetry.nPATas a new alternative of super-resolution microscopy can break through the optical difraction limitand is capable of exploring sub-celular structures without reliance on fuorescence labeling.We expect these new imaging techniques to find widespread applications in both pre-clinical andclinical biomedical research.展开更多
The volumetric imaging of two-photon microscopy expands the focal depth and improves the throughput,which has unparalleled superiority for three-dimension samples,especially in neuroscience.However,emerging in volumet...The volumetric imaging of two-photon microscopy expands the focal depth and improves the throughput,which has unparalleled superiority for three-dimension samples,especially in neuroscience.However,emerging in volumetric imaging is still largely customized,which limits the integration with commercial two-photon systems.Here,we analyzed the key parameters that modulate the focal depth and lateral resolution of polarized annular imaging and proposed a volumetric imaging module that can be directly integrated into commercial two-photon systems using conventional optical elements.This design incorporates the beam diameter adjustment settings of commercial two-photon systems,allowing flexibility to adjust the depth of focus while maintaining the same lateral resolution.Further,the depth range and lateral resolution of the design were verified,and the imaging throughput was demonstrated by an increase in the number of imaging neurons in the awake mouse cerebral cortex.展开更多
Histopathology relies upon the staining and sectioning of biological tissues,which can be laborious and may cause artifacts and distort tissues.We develop label-free volumetric imaging of thick-tissue slides,exploitin...Histopathology relies upon the staining and sectioning of biological tissues,which can be laborious and may cause artifacts and distort tissues.We develop label-free volumetric imaging of thick-tissue slides,exploiting refractive index distributions as intrinsic imaging contrast.The present method systematically exploits label-free quantitative phase imaging techniques,volumetric reconstruction of intrinsic refractive index distributions in tissues,and numerical algorithms for the seamless stitching of multiple three-dimensional tomograms and for reducing scattering-induced image distortion.We demonstrated label-free volumetric imaging of thick tissues with the field of view of 2 mm×1.75 mm×0.2 mm with a spatial resolution of 170 nm×170 nm×1400 nm.The number of optical modes,calculated as the reconstructed volume divided by the size of the point spread function,was∼20 giga voxels.We have also demonstrated that different tumor types and a variety of precursor lesions and pathologies can be visualized with the present method.展开更多
Volumetric particle image velocimetry(VPIV) refers to a PIV-based technique which can obtain full velocity components in a three-dimensional measurement volume.A new VPIV method with a single lens was developed.A thre...Volumetric particle image velocimetry(VPIV) refers to a PIV-based technique which can obtain full velocity components in a three-dimensional measurement volume.A new VPIV method with a single lens was developed.A three-vision prism was used to make viewing from different angles using one camera.The technique was tested and successfully applied to a three-dimensional three-component(3D3C) measurement of a zero-net-mass-flux jet flow.The accuracy of the measurement was investigated,specifically in steps of calibration,self-calibration and particle triangulation.Time sequence of a vortex ring development was presented.It was shown that the measurement has high accuracy with validation rate of velocity vector reaching about 95%.The flow with vortex ring passing the measurement volume was studied using both swirl strength and vorticity magnitude criteria.Through comparison,the swirl criterion was found to be superior to the criterion of vorticity in differentiating the rotation motion and the free shear.展开更多
A novel approach using volumetric texture and reduced-spectral features is presented for hyperspectral image classification. Using this approach, the volumetric textural fea^res were extracted by volumetric gray-level...A novel approach using volumetric texture and reduced-spectral features is presented for hyperspectral image classification. Using this approach, the volumetric textural fea^res were extracted by volumetric gray-level co-occurrence matrices (VGLCM). The spectral features were extracted by minimum estimated abundance covar- iance (MEAC) and linear prediction (LP)-based band selection, and a semi-supervised k-means (SKM) cluster- ing method with deleting the worst cluster (SKMd) band- clustering algorithms. Moreover, four feature combination schemes were designed for hyperspectral image classifica- tion by using spectral and textural features. It has been proven that the proposed method using VGLCM outper- forms the gray-level co-occurrence matrices (GLCM) method, and the experimental results indicate that the combination of spectral information with volumetric textural features leads to an improved classification performance in hyperspectral imagery.展开更多
Three-dimensional particle reconstruction with limited two-dimensional projections is an under-determined inverse problem that the exact solution is often difficult to be obtained.In general,approximate solutions can ...Three-dimensional particle reconstruction with limited two-dimensional projections is an under-determined inverse problem that the exact solution is often difficult to be obtained.In general,approximate solutions can be obtained by iterative optimization methods.In the current work,a practical particle reconstruction method based on a convolutional neural network(CNN)with geometry-informed features is proposed.The proposed technique can refine the particle reconstruction from a very coarse initial guess of particle distribution that is generated by any traditional algebraic reconstruction technique(ART)based methods.Compared with available ART-based algorithms,the novel technique makes significant improvements in terms of reconstruction quality,robustness to noise,and at least an order of magnitude faster in the offline stage.展开更多
基金This paper was supported by Shenzhen Science and Technology Innovation grants(JCYJ20200109115633343,JCYJ20210324123610030).
文摘Single-cell volumetric imaging is essential for researching individual characteristics of cells.As a nonscanning imaging technique,lighteld microscopy(LFM)is a critical tool to achieve realtime three-dimensional imaging with the advantage of single-shot.To address the inherent limits including nonuniform resolution and block-wise artifacts,various modied LFM strategies have been developed to provide new insights into the structural and functional information of cells.This review will introduce the principle and development of LFM,discuss the improved approaches based on hardware designs and 3D reconstruction algorithms,and present the applications in single-cell imaging.
基金supported by the National Natural Science Foundation of China(62005116 and 51720105015)the Science and Technology Innovation Commission of Shenzhen(KQTD20170810110913065 and 20200925174735005).
文摘In light-sheet fluorescence microscopy,the axial resolution and field of view are mutually constrained.Axially swept light-sheet microscopy(ASLM)can decouple the trade-off,but the confocal detection scheme using a rolling shutter also rejects fluorescence signals from the specimen in the field of interest,which sacrifices the photon efficiency.Here,we report a laterally swept light-sheet microscopy(LSLM)scheme in which the focused beam is first scanned along the axial direction and subsequently laterally swept with the rolling shutter.We show that LSLM can obtain a higher photon efficiency when similar axial resolution and field of view can be achieved.Moreover,based on the principle of image scanning microscopy,applying the pixel reassignment to the LSLM images,hereby named iLSLM,improves the optical sectioning.Both simulation and experimental results demonstrate the higher photon efficiency with similar axial resolution and optical sectioning.Our proposed scheme is suitable for volumetric imaging of specimens that are susceptible to photobleaching or phototoxicity.
基金This research has received funding support from the 1000 Youth Talents Plan of China(P.F.)the Fundamental Research Program of Shenzhen(P.F.,JCYJ20160429182424047)+2 种基金and the National Heart Lung and Blood Institute[R01HL111437(T.K.H.)R01HL083015(T.K.H.),R01HL118650(T.K.H.)and EB U54 EB0220002(T.K.H.)].
文摘A key challenge when imaging whole biomedical specimens is how to quickly obtain massive cellular information over a large field of view(FOV).We report a subvoxel light-sheet microscopy(SLSM)method enabling high-throughput volumetric imaging of mesoscale specimens at cellular resolution.A nonaxial,continuous scanning strategy is developed to rapidly acquire a stack of large-FOV images with three-dimensional(3-D)nanoscale shifts encoded.Then,by adopting a subvoxel-resolving procedure,the SLSM method models these low-resolution,cross-correlated images in the spatial domain and can iteratively recover a 3-D image with improved resolution throughout the sample.This technique can surpass the optical limit of a conventional light-sheet microscope by more than three times,with high acquisition speeds of gigavoxels per minute.By fast reconstruction of 3-D cultured cells,intact organs,and live embryos,SLSM method presents a convenient way to circumvent the trade-off between mapping large-scale tissue(>100 mm3)and observing single cell(∼1-μm resolution).It also eliminates the need of complicated mechanical stitching or modulated illumination,using a simple light-sheet setup and fast graphics processing unit-based computation to achieve high-throughput,high-resolution 3-D microscopy,which could be tailored for a wide range of biomedical applications in pathology,histology,neuroscience,etc.
基金This work was supported by grants from the National Science and Technology Innovation 2030 Major Program(2021ZD0204503)National Key R&D Program of China(2017YFA0700504)+3 种基金the Strategic Priority Research Program of the Chinese Academy of Sciences(XDB32030200)the International Partnership Program of the Chinese Academy of Sciences(153D31KYSB20170059)Shanghai Municipal Science and Technology Major Project(2018SHZDZX05)the National Natural Science Foundation of China(31871086 and 32125020).
文摘Recording the highly diverse and dynamic activities in large populations of neurons in behaving animals is crucial for a better understanding of how the brain works.To meet this challenge,extensive efforts have been devoted to developing functional fluorescent indicators and optical imaging techniques to optically monitor neural activity.Indeed,optical imaging potentially has extremely high throughput due to its non-invasive access to large brain regions and capability to sample neurons at high density,but the readout speed,such as the scanning speed in two-photon scanning microscopy,is often limited by various practical considerations.Among different imaging methods,light field microscopy features a highly parallelized 3D fluorescence imaging scheme and therefore promises a novel and faster strategy for functional imaging of neural activity.Here,we briefly review the working principles of various types of light field microscopes and their recent developments and applications in neuroscience studies.We also discuss strategies and considerations of optimizing light field microscopy for different experimental purposes,with illustrative examples in imaging zebrafish and mouse brains.
文摘Two novel ultrasound imaging techniques with imaging contrast mechanisms are in the works:X-ray-induced acoustic computed tomography(XACT),and nanoscale photoacoustic tomogra-phy(nPAT).XACT has incredible potential in:(1)biomedical imaging,through which a 3D image can be generated using only a single X-ray projection,and(2)radiation dosimetry.nPATas a new alternative of super-resolution microscopy can break through the optical difraction limitand is capable of exploring sub-celular structures without reliance on fuorescence labeling.We expect these new imaging techniques to find widespread applications in both pre-clinical andclinical biomedical research.
基金supported by STI2030-Major Projects (2021ZD0201001 to H.G.)the National Natural Science Foundation of China (61890951 and 31871027 to W.Z.)+2 种基金Fundamental Research Funds for the Central Universities (HUST:2019KFYXMBZ011,2019KFYXMBZ039,2018KFYXMPT018,2019KFYXMBZ009 to H.G.)CAMS Innovation Fund for Medical Sciences (CIFMS,2019-I2M-5-014 to H.G.)the director fund of the WNLO.
文摘The volumetric imaging of two-photon microscopy expands the focal depth and improves the throughput,which has unparalleled superiority for three-dimension samples,especially in neuroscience.However,emerging in volumetric imaging is still largely customized,which limits the integration with commercial two-photon systems.Here,we analyzed the key parameters that modulate the focal depth and lateral resolution of polarized annular imaging and proposed a volumetric imaging module that can be directly integrated into commercial two-photon systems using conventional optical elements.This design incorporates the beam diameter adjustment settings of commercial two-photon systems,allowing flexibility to adjust the depth of focus while maintaining the same lateral resolution.Further,the depth range and lateral resolution of the design were verified,and the imaging throughput was demonstrated by an increase in the number of imaging neurons in the awake mouse cerebral cortex.
基金H.H.,R.H.H.,S.-M.H.,and Y.P.conceived the initial idea.H.H.developed the optical system and analysis methods.H.H.and Y.W.K.performed the experiments and analyzed the data.M.L.and S.S.provided the analysis methods and analyzed the data.All authors wrote and revised the manuscript.This work was supported by KAIST,Up Program,BK21+program,Tomocube,and National Research Foundation of Korea(2017M3C1A3013923,2015R1A3A2066550,and 2018K000396).Professor Park and Mr.Moosung Lee have financial interests in Tomocube Inc.,a company that commercializes optical diffraction tomography and quantitative phase imaging instruments and is one of the sponsors of the work.
文摘Histopathology relies upon the staining and sectioning of biological tissues,which can be laborious and may cause artifacts and distort tissues.We develop label-free volumetric imaging of thick-tissue slides,exploiting refractive index distributions as intrinsic imaging contrast.The present method systematically exploits label-free quantitative phase imaging techniques,volumetric reconstruction of intrinsic refractive index distributions in tissues,and numerical algorithms for the seamless stitching of multiple three-dimensional tomograms and for reducing scattering-induced image distortion.We demonstrated label-free volumetric imaging of thick tissues with the field of view of 2 mm×1.75 mm×0.2 mm with a spatial resolution of 170 nm×170 nm×1400 nm.The number of optical modes,calculated as the reconstructed volume divided by the size of the point spread function,was∼20 giga voxels.We have also demonstrated that different tumor types and a variety of precursor lesions and pathologies can be visualized with the present method.
基金supported by the National Natural Science Foundation of China (Grant Nos. 11102013,10832001)the "Weishi" Foundation of Beijing University of Aeronautics and Astronautics (Grant No. YWF-12-RHRS-008)
文摘Volumetric particle image velocimetry(VPIV) refers to a PIV-based technique which can obtain full velocity components in a three-dimensional measurement volume.A new VPIV method with a single lens was developed.A three-vision prism was used to make viewing from different angles using one camera.The technique was tested and successfully applied to a three-dimensional three-component(3D3C) measurement of a zero-net-mass-flux jet flow.The accuracy of the measurement was investigated,specifically in steps of calibration,self-calibration and particle triangulation.Time sequence of a vortex ring development was presented.It was shown that the measurement has high accuracy with validation rate of velocity vector reaching about 95%.The flow with vortex ring passing the measurement volume was studied using both swirl strength and vorticity magnitude criteria.Through comparison,the swirl criterion was found to be superior to the criterion of vorticity in differentiating the rotation motion and the free shear.
文摘A novel approach using volumetric texture and reduced-spectral features is presented for hyperspectral image classification. Using this approach, the volumetric textural fea^res were extracted by volumetric gray-level co-occurrence matrices (VGLCM). The spectral features were extracted by minimum estimated abundance covar- iance (MEAC) and linear prediction (LP)-based band selection, and a semi-supervised k-means (SKM) cluster- ing method with deleting the worst cluster (SKMd) band- clustering algorithms. Moreover, four feature combination schemes were designed for hyperspectral image classifica- tion by using spectral and textural features. It has been proven that the proposed method using VGLCM outper- forms the gray-level co-occurrence matrices (GLCM) method, and the experimental results indicate that the combination of spectral information with volumetric textural features leads to an improved classification performance in hyperspectral imagery.
基金supported by the National Key R&D Program of China(No.2020YFA040070)the National Natural Science Foundation of China(grant No.11721202)the Program of State Key Laboratory of Marine Equipment(No.SKLMEA-K201910)。
文摘Three-dimensional particle reconstruction with limited two-dimensional projections is an under-determined inverse problem that the exact solution is often difficult to be obtained.In general,approximate solutions can be obtained by iterative optimization methods.In the current work,a practical particle reconstruction method based on a convolutional neural network(CNN)with geometry-informed features is proposed.The proposed technique can refine the particle reconstruction from a very coarse initial guess of particle distribution that is generated by any traditional algebraic reconstruction technique(ART)based methods.Compared with available ART-based algorithms,the novel technique makes significant improvements in terms of reconstruction quality,robustness to noise,and at least an order of magnitude faster in the offline stage.