Noninvasive X-ray imaging of nanoscale three-dimensional objects,such as integrated circuits(ICs),generally requires two types of scanning:ptychographic,which is translational and returns estimates of the complex elec...Noninvasive X-ray imaging of nanoscale three-dimensional objects,such as integrated circuits(ICs),generally requires two types of scanning:ptychographic,which is translational and returns estimates of the complex electromagnetic field through the IC;combined with a tomographic scan,which collects these complex field projections from multiple angles.Here,we present Attentional Ptycho-Tomography(APT),an approach to drastically reduce the amount of angular scanning,and thus the total acquisition time.APT is machine learning-based,utilizing axial self-Attention for Ptycho-Tomographic reconstruction.APT is trained to obtain accurate reconstructions of the ICs,despite the incompleteness of the measurements.The training process includes regularizing priors in the form of typical patterns found in IC interiors,and the physics of X-ray propagation through the IC.We show that APT with×12 reduced angles achieves fidelity comparable to the gold standard Simultaneous Algebraic Reconstruction Technique(SART)with the original set of angles.When using the same set of reduced angles,then APT also outperforms Filtered Back Projection(FBP),Simultaneous Iterative Reconstruction Technique(SIRT)and SART.The time needed to compute the reconstruction is also reduced,because the trained neural network is a forward operation,unlike the iterative nature of these alternatives.Our experiments show that,without loss in quality,for a 4.48×93.2×3.92µm^(3) IC(≃6×10^(8) voxels),APT reduces the total data acquisition and computation time from 67.96 h to 38 min.We expect our physics-assisted and attention-utilizing machine learning framework to be applicable to other branches of nanoscale imaging,including materials science and biological imaging.展开更多
Founded only six years ago, the National Center for Nanoscience and Technology (NCNST) has developed rapidly withimportant achievements. We invited experts of NCNST in this field to introduce the research developments...Founded only six years ago, the National Center for Nanoscience and Technology (NCNST) has developed rapidly withimportant achievements. We invited experts of NCNST in this field to introduce the research developments by NCNST展开更多
The clinical manifestations of SARS-CoV-2 infection,which is the cause of the coronavirus disease 2019(COVID-19)pandemic,are highly variable and range from asymptomatic carriage or mild symptoms to severe disease invo...The clinical manifestations of SARS-CoV-2 infection,which is the cause of the coronavirus disease 2019(COVID-19)pandemic,are highly variable and range from asymptomatic carriage or mild symptoms to severe disease involving different organ systems.However,the specific factors influencing individual clinical outcomes remain unclear.Thus,to characterize the versatile interplay of mucosal and systemic immune responses with the local microbiome and the viral load,as well as its impact on the course of the disease,Smith et al.performed integrated analyses of nasopharyngeal swabs and plasma samples from COVID-19 patients with varying degrees of illness severity.They observed that spike-specific neutralizing antibodies were heterogeneous between paired plasma samples and nasopharyngeal swabs from individual SARS-CoV-2 patients,suggesting a tissuedependent regulation of humoral immune responses.展开更多
Titanium dioxide (TiO2) nanoparticles are produced for many different purposes, including development of therapeutic and diagnostic nanoparticles for cancer detection and treatment, drug delivery, induction of DNA d...Titanium dioxide (TiO2) nanoparticles are produced for many different purposes, including development of therapeutic and diagnostic nanoparticles for cancer detection and treatment, drug delivery, induction of DNA double-strand breaks, and imaging of specific cells and subcellular structures. Currently, the use of optical microscopy, an imaging technique most accessible to biology and medical patholog36 to detect TiO2 nanoparticles in cells and tissues ex vivo is limited with low detection limits, while more sensitive imaging methods (transmission electron microscopy, X-ray fluorescence microscop~ etc.) have low throughput and technical and operational complications. Herein, we describe two in situ post- treatment labeling approaches to stain TiO2 nanoparticles taken up by the cells. The first approach utilizes fluorescent biotin and fluorescent streptavidin to label the nanoparticles before and after cellular uptake; the second approach is based on the copper-catalyzed azide-alkyne cycloaddition, the so-called Click chemistry, for labeling and detection of azide-conjugated TiO2 nanoparticles with alkyne- conjugated fluorescent dyes such as Alexa Fluor 488. To confirm that optical fluorescence signals of these nanoparticles match the distribution of the Ti element, we used synchrotron X-ray fluorescence microscopy (XFM) at the Advanced Photon Source at Argonne National Laboratory. Titanium-specific XFM showed excellent overlap with the location of optical fluorescence detected by confocal microscopy. Therefore, future experiments with TiO2 nanoparticles may safely rely on confocal microscopy after in situ nanoparticle labeling using approaches described here.展开更多
基金We are grateful to Jung Ki Song,Mo Deng,Baoliang Ge,William Harrod,Ed Cole,Zachary Levine,Bradley Alpert,Nina Weisse-Bernstein,Lee Oesterling,and Antonio Orozco for helpful discussions and comments.Funding from the Intelligence Advanced Research Projects Activity,Office of the Director of National Intelligence(IARPA-ODNI),contract FA8650-17-C-9113 is gratefully acknowledged.The MIT SuperCloud and Lincoln Laboratory Supercomputing Center provided resources(high performance computing,database,consultation)that have contributed to the research results reported within this paperI.Kang acknowledges support from Korea Foundation for Advanced Studies(KFAS).This research used resources of the Advanced Photon Source,a U.S.Department of Energy(DOE)Office of Science User Facility,operated for the DOE Office of Science by Argonne National Laboratory under Contract No.DE-AC02-06CH11357.The views and conclusions contained herein are those of the authors and should not be interpreted as necessarily representing the official policies or endorsements,either expressed or implied,of the ODNI,IARPA,or the US Government.
文摘Noninvasive X-ray imaging of nanoscale three-dimensional objects,such as integrated circuits(ICs),generally requires two types of scanning:ptychographic,which is translational and returns estimates of the complex electromagnetic field through the IC;combined with a tomographic scan,which collects these complex field projections from multiple angles.Here,we present Attentional Ptycho-Tomography(APT),an approach to drastically reduce the amount of angular scanning,and thus the total acquisition time.APT is machine learning-based,utilizing axial self-Attention for Ptycho-Tomographic reconstruction.APT is trained to obtain accurate reconstructions of the ICs,despite the incompleteness of the measurements.The training process includes regularizing priors in the form of typical patterns found in IC interiors,and the physics of X-ray propagation through the IC.We show that APT with×12 reduced angles achieves fidelity comparable to the gold standard Simultaneous Algebraic Reconstruction Technique(SART)with the original set of angles.When using the same set of reduced angles,then APT also outperforms Filtered Back Projection(FBP),Simultaneous Iterative Reconstruction Technique(SIRT)and SART.The time needed to compute the reconstruction is also reduced,because the trained neural network is a forward operation,unlike the iterative nature of these alternatives.Our experiments show that,without loss in quality,for a 4.48×93.2×3.92µm^(3) IC(≃6×10^(8) voxels),APT reduces the total data acquisition and computation time from 67.96 h to 38 min.We expect our physics-assisted and attention-utilizing machine learning framework to be applicable to other branches of nanoscale imaging,including materials science and biological imaging.
文摘Founded only six years ago, the National Center for Nanoscience and Technology (NCNST) has developed rapidly withimportant achievements. We invited experts of NCNST in this field to introduce the research developments by NCNST
基金Open Access funding enabled and organized by Projekt DEAL.
文摘The clinical manifestations of SARS-CoV-2 infection,which is the cause of the coronavirus disease 2019(COVID-19)pandemic,are highly variable and range from asymptomatic carriage or mild symptoms to severe disease involving different organ systems.However,the specific factors influencing individual clinical outcomes remain unclear.Thus,to characterize the versatile interplay of mucosal and systemic immune responses with the local microbiome and the viral load,as well as its impact on the course of the disease,Smith et al.performed integrated analyses of nasopharyngeal swabs and plasma samples from COVID-19 patients with varying degrees of illness severity.They observed that spike-specific neutralizing antibodies were heterogeneous between paired plasma samples and nasopharyngeal swabs from individual SARS-CoV-2 patients,suggesting a tissuedependent regulation of humoral immune responses.
文摘Titanium dioxide (TiO2) nanoparticles are produced for many different purposes, including development of therapeutic and diagnostic nanoparticles for cancer detection and treatment, drug delivery, induction of DNA double-strand breaks, and imaging of specific cells and subcellular structures. Currently, the use of optical microscopy, an imaging technique most accessible to biology and medical patholog36 to detect TiO2 nanoparticles in cells and tissues ex vivo is limited with low detection limits, while more sensitive imaging methods (transmission electron microscopy, X-ray fluorescence microscop~ etc.) have low throughput and technical and operational complications. Herein, we describe two in situ post- treatment labeling approaches to stain TiO2 nanoparticles taken up by the cells. The first approach utilizes fluorescent biotin and fluorescent streptavidin to label the nanoparticles before and after cellular uptake; the second approach is based on the copper-catalyzed azide-alkyne cycloaddition, the so-called Click chemistry, for labeling and detection of azide-conjugated TiO2 nanoparticles with alkyne- conjugated fluorescent dyes such as Alexa Fluor 488. To confirm that optical fluorescence signals of these nanoparticles match the distribution of the Ti element, we used synchrotron X-ray fluorescence microscopy (XFM) at the Advanced Photon Source at Argonne National Laboratory. Titanium-specific XFM showed excellent overlap with the location of optical fluorescence detected by confocal microscopy. Therefore, future experiments with TiO2 nanoparticles may safely rely on confocal microscopy after in situ nanoparticle labeling using approaches described here.