Real-time and high-transmission middle-infrared optical imaging system based on a pixel-wise metasurface micro-polarization array

Real-time polarization medium-wave infrared(MIR)optical imaging systems enable the acquisition of infrared and polarization information for a target.At present,real-time polarization MIR devices face the following problems:poor real-time performance,low transmission and high requirements for fabrication and integration.Herein,we aim to improve the performance of real-time polarization imaging systems in the MIR waveband and solve the above-mentioned defects.Therefore,we propose a MIR polarization imaging system to achieve real-time polarization-modulated imaging with high transmission as well as improved performance based on a pixel-wise metasurface micro-polarization array(PMMPA).The PMMPA element comprises several linear polarization(LP)filters with different polarization angles.The optimization results demonstrate that the transmittance of the center field of view for the LP filters is up to 77%at a wavelength of4.0μm and an extinction ratio of 88 d B.In addition,a near-diffraction-limited real-time MIR imaging optical system is designed with a field of view of 5°and an F-number of 2.The simulation results show that an MIR polarization imaging system with excellent real-time performance and high transmission is achieved by using the optimized PMMPA element.Therefore,the method is compatible with the available optical system design technologies and provides a way to realize real-time polarization imaging in MIR wavebands.

Research on the model of high robustness computational optical imaging system

Computational optical imaging is an interdisciplinary subject integrating optics, mathematics, and information technology. It introduces information processing into optical imaging and combines it with intelligent computing, subverting the imaging mechanism of traditional optical imaging which only relies on orderly information transmission. To meet the high-precision requirements of traditional optical imaging for optical processing and adjustment, as well as to solve its problems of being sensitive to gravity and temperature in use, we establish an optical imaging system model from the perspective of computational optical imaging and studies how to design and solve the imaging consistency problem of optical system under the influence of gravity, thermal effect, stress, and other external environment to build a high robustness optical system. The results show that the high robustness interval of the optical system exists and can effectively reduce the sensitivity of the optical system to the disturbance of each link, thus realizing the high robustness of optical imaging.

Multi-aperture optical imaging systems and their mathematical light field acquisition models

Inspired by the compound eyes of insects,many multi-aperture optical imaging systems have been proposed to improve the imaging quality,e.g.,to yield a high-resolution image or an image with a large field-ofview.Previous research has reviewed existing multi-aperture optical imaging systems,but few papers emphasize the light field acquisition model which is essential to bridge the gap between configuration design and application.In this paper,we review typical multi-aperture optical imaging systems(i.e.,artificial compound eye,light field camera,and camera array),and then summarize general mathematical light field acquisition models for different configurations.These mathematical models provide methods for calculating the key indexes of a specific multiaperture optical imaging system,such as the field-of-view and sub-image overlap ratio.The mathematical tools simplify the quantitative design and evaluation of imaging systems for researchers.

Optical image encryption algorithm based on a new four-dimensional memristive hyperchaotic system and compressed sensing

Some existing image encryption schemes use simple low-dimensional chaotic systems, which makes the algorithms insecure and vulnerable to brute force attacks and cracking. Some algorithms have issues such as weak correlation with plaintext images, poor image reconstruction quality, and low efficiency in transmission and storage. To solve these issues,this paper proposes an optical image encryption algorithm based on a new four-dimensional memristive hyperchaotic system(4D MHS) and compressed sensing(CS). Firstly, this paper proposes a new 4D MHS, which has larger key space, richer dynamic behavior, and more complex hyperchaotic characteristics. The introduction of CS can reduce the image size and the transmission burden of hardware devices. The introduction of double random phase encoding(DRPE) enables this algorithm has the ability of parallel data processing and multi-dimensional coding space, and the hyperchaotic characteristics of 4D MHS make up for the nonlinear deficiency of DRPE. Secondly, a construction method of the deterministic chaotic measurement matrix(DCMM) is proposed. Using DCMM can not only save a lot of transmission bandwidth and storage space, but also ensure good quality of reconstructed images. Thirdly, the confusion method and diffusion method proposed are related to plaintext images, which require both four hyperchaotic sequences of 4D MHS and row and column keys based on plaintext images. The generation process of hyperchaotic sequences is closely related to the hash value of plaintext images. Therefore, this algorithm has high sensitivity to plaintext images. The experimental testing and comparative analysis results show that proposed algorithm has good security and effectiveness.

Observing single cells in whole organs with optical imaging

Cells are the basic unit of human organs that are not fully understood.The revolutionary advancements of optical imaging alowed us to observe single cells in whole organs,revealing the complicated composition of cells with spatial information.Therefore,in this review,we revisit the principles of optical contrast related to those biomolecules and the optical techniques that transform optical contrast into detectable optical signals.Then,we describe optical imaging to achieve threedimensional spatial discrimination for biological tisutes.Due to the milky appearance of tissues,the spatial information burred deep in the whole organ.Fortunately,strategies developed in the last decade could circumvent this issue and lead us into a new era of investigation of the cells with their original spatial information.

In Vivo Tumor-Targeted Dual-Modality PET/Optical Imaging with a Yolk/Shell-Structured Silica Nanosystem

Silica nanoparticles have been one of the most promising nanosystems for biomedical applications due to their facile surface chemistry and non-toxic nature. However, it is still challenging to effectively deliver them into tumor sites and noninvasively visualize their in vivo biodistribution with excellent sensitivity and accuracy for effective cancer diagnosis. In this study, we design a yolk/shell-structured silica nanosystem ^(64) Cu-NOTAQD@HMSN-PEG-TRC105, which can be employed for tumor vasculature targeting and dual-modality PET/optical imaging, leading to superior targeting specificity, excellentimaging capability and more reliable diagnostic outcomes.By combining vasculature targeting, pH-sensitive drug delivery, and dual-modality imaging into a single platform,as-designed yolk/shell-structured silica nanosystems may be employed for the future image-guided tumor-targeted drug delivery, to further enable cancer theranostics.

Wide-spectrum optical synthetic aperture imaging via spatial intensity interferometry

High resolution imaging is achieved using increasingly larger apertures and successively shorter wavelengths.Optical aperture synthesis is an important high-resolution imaging technology used in astronomy.Conventional long baseline amplitude interferometry is susceptible to uncontrollable phase fluctuations,and the technical difficulty increases rapidly as the wavelength decreases.The intensity interferometry inspired by HBT experiment is essentially insensitive to phase fluctuations,but suffers from a narrow spectral bandwidth which results in a lack of effective photons.In this study,we propose optical synthetic aperture imaging based on spatial intensity interferometry.This not only realizes diffraction-limited optical aperture synthesis in a single shot,but also enables imaging with a wide spectral bandwidth,which greatly improves the optical energy efficiency of intensity interferometry.And this method is insensitive to the optical path difference between the sub-apertures.Simulations and experiments present optical aperture synthesis diffraction-limited imaging through spatial intensity interferometry in a 100 nm spectral width of visible light,whose maximum optical path difference between the sub-apertures reaches 69λ.This technique is expected to provide a solution for optical aperture synthesis over kilometer-long baselines at optical wavelengths.

Optical coherence tomography enhanced depth imaging of chorioretinal folds in patients with orbital tumors

AIM:To characterize spectral-domain optical coherence tomography(SD-OCT)features of chorioretinal folds in orbital mass imaged using enhanced depth imaging(EDI).METHODS:Prospective observational case-control study was conducted in 20 eyes of 20 patients,the uninvolved eye served as a control.All the patients underwent clinical fundus photography,computed tomography,EDI SDOCT imaging before and after surgery.Two patients with cavernous hemangiomas underwent intratumoral injection of bleomycin A5;the remaining patients underwent tumor excision.Patients were followed 1 to 14mo following surgery(average follow up,5.8mo).RESULTS:Visual acuity prior to surgery ranged from 20/20 to 20/200.Following surgery,5 patients’visual acuity remained unchanged while the remaining 15 patients had a mean letter improvement of 10(range 4 to 26 letters).Photoreceptor inner/outer segment defects were found in 10 of 15 patients prior to surgery.Following surgical excision,photoreceptor inner/outer segment defects fully resolved in 8 of these 10 patients.CONCLUSION:Persistence of photoreceptor inner/outer segment defects caused by compression of the globe by an orbital mass can be associated with reduced visual prognosis.Our findings suggest that photoreceptor inner/outer segment defects on EDI SD-OCT could be an indicator for immediate surgical excision of an orbital mass causing choroidal compression.

Imaging assessment of photosensitizer emission induced by radionuclide-derived Cherenkov radiation using charge-coupled device optical imaging and long-pass filters

BACKGROUND Radionuclides produce Cherenkov radiation(CR),which can potentially activate photosensitizers(PSs)in phototherapy.Several groups have studied Cherenkov energy transfer to PSs using optical imaging;however,cost-effectively identifying whether PSs are excited by radionuclide-derived CR and detecting fluorescence emission from excited PSs remain a challenge.Many laboratories face the need for expensive dedicated equipment.AIM To cost-effectively confirm whether PSs are excited by radionuclide-derived CR and distinguish fluorescence emission from excited PSs.METHODS The absorbance and fluorescence spectra of PSs were measured using a microplate reader and fluorescence spectrometer to examine the photo-physical properties of PSs.To mitigate the need for expensive dedicated equipment and achieve the aim of the study,we developed a method that utilizes a chargecoupled device optical imaging system and appropriate long-pass filters of different wavelengths(manual sequential application of long-pass filters of 515,580,645,700,750,and 800 nm).Tetrakis(4-carboxyphenyl)porphyrin(TCPP)was utilized as a model PS.Different doses of copper-64(^(64)CuCl_(2))(4,2,and 1 mCi)were used as CR-producing radionuclides.Imaging and data acquisition were performed 0.5 h after sample preparation.Differential image analysis was conducted by using ImageJ software(National Institutes of Health)to visually evaluate TCPP fluorescence.RESULTS The maximum absorbance of TCPP was at 390-430 nm,and the emission peak was at 670 nm.The CR and CRinduced TCPP emissions were observed using the optical imaging system and the high-transmittance long-pass filters described above.The emission spectra of TCPP with a peak in the 645-700 nm window were obtained by calculation and subtraction based on the serial signal intensity(total flux)difference between^(64)CuCl_(2)+TCPP and^(64)CuCl_(2).Moreover,the differential fluorescence images of TCPP were obtained by subtracting the^(64)CuCl_(2)image from the^(64)CuCl_(2)+TCPP image.The experimental results considering different^(64)CuCl_(2)doses showed a dosedependent trend.These results demonstrate that a bioluminescence imaging device coupled with different longpass filters and subtraction image processing can confirm the emission spectra and differential fluorescence images of CR-induced TCPP.CONCLUSION This simple method identifies the PS fluorescence emission generated by radionuclide-derived CR and can contribute to accelerating the development of Cherenkov energy transfer imaging and the discovery of new PSs.

NIR-II fluorescence imaging in liver tumor surgery: A narrative review

In liver tumor surgery,the recognition of tumor margin and radical resection of microcancer focis have always been the crucial points to reduce postoperative recurrence of tumor.However,naked-eye inspection and palpation have limited effectiveness in identifying tumor boundaries,and traditional imaging techniques cannot consistently locate tumors in real time.As an intraoperative real-time navigation imaging method,NIRfluorescence imaging has been extensively studied for its simplicity,reliable safety,and superior sensitivity,and is expected to improve the accuracy of liver tumor surgery.In recent years,the research focus of NIRfluorescence has gradually shifted from the-rst near-infrared window(NIR-I,700–900 nm)to the second near-infrared window(NIR-II,1000–1700 nm).Fluorescence imaging in NIR-II reduces the scattering effect of deep tissue,providing a preferable detection depth and spatial resolution while signi-cantly eliminating liver autofluorescence background to clarify tumor margin.Developingfluorophores combined with tumor antibodies will further improve the precision offluorescence-guided surgical navigation.With the development of a bunch offluorophores with phototherapy ability,NIR-II can integrate tumor detection and treatment to explore a new therapeutic strategy for liver cancer.Here,we review the recent progress of NIR-IIfluorescence technology in liver tumor surgery and discuss its challenges and potential development direction.

Oversample Reconstruction Based on a Strong Inter-Diagonal Matrix for an Optical Microscanning Thermal Microscope Imaging System

Based on a strong inter-diagonal matrix and Taylor series expansions,an oversample reconstruction method was proposed to calibrate the optical micro-scanning error. The technique can obtain regular 2 ×2 microscanning undersampling images from the real irregular undersampling images,and can then obtain a high spatial oversample resolution image. Simulations and experiments show that the proposed technique can reduce optical micro-scanning error and improve the system＇s spatial resolution. The algorithm is simple,fast and has low computational complexity. It can also be applied to other electro-optical imaging systems to improve their spatial resolution and has a widespread application prospect.

Association of colorectal cancer with pathogenic Escherichia coli: Focus on mechanisms using optical imaging

AIM: To investigate the molecular or cellular mechanisms related to the infection of epithelial colonic mucosa by pks-positive Escherichia coli(E. coli) using optical imaging.METHODS: We choose to evaluate the tumor metabolic activity using a fluorodeoxyglucose analogue as 2-deoxyglucosone fluorescent probes and to correlate it with tumoral volume(mm^3). Inflammation measuring myeloperoxidase(MPO) activity and reactive oxygen species production was monitored by a bioluminescent(BLI) inflammation probe and related to histological examination and MPO levels by enzyme-linked immunosorbent assay(ELISA) on tumor specimens. The detection and quantitation of these two signals were validated on a xenograft model of human colon adenocarcinoma epithelial cells(HCT116) in nude mice infected with a pks-positive E. coli. The inflammatory BLI signal was validated intra-digestively in the colitisCEABAC10 DSS models, which mimicked Crohn's disease. RESULTS: Using a 2-deoxyglucosone fluorescent probe, we observed a high and specific HCT116 tumor uptake in correlation with tumoral volume(P = 0.0036). Using the inflammation probe targeting MPO, we detected a rapid systemic elimination and a significant increase of the BLI signal in the pks-positive E. coli-infected HCT116 xenograft group(P < 0.005). ELISA confirmed that MPO levels were significantly higher(1556 ± 313.6 vs 234.6 ± 121.6 ng/m L P = 0.001) in xenografts infected with the pathogenic E. coli strain. Moreover, histological examination of tumor samples confirmed massive infiltration of pks-positive E. coli-infected HCT116 tumors by inflammatory cells compared to the uninfected group. These data showed that infection with the pathogenic E. coli strain enhanced inflammation and ROS production in tumors before tumor growth. Moreover, we demonstrated that the intra-digestive monitoring of inflammation is feasible in a reference colitis murine model(CEABAC10/DSS).CONCLUSION: Using BLI and fluorescence optical imaging, we provided tools to better understand hostpathogen interactions at the early stage of disease, such as inflammatory bowel disease and colorectal cancer.

ACTIVATABLE SMART PROBES FOR MOLECULAR OPTICAL IMAGING AND THERAPY

Recent years have seen the design and implementation of many optical activatable smart probes.These probes are activatable because they change their optical properties and are smart because they can identify specific targets.This broad class of detection agents has allowed previously unperformed visualizations,facilitating the study of diverse biomolecules including enzymes,nucleic acids,ions and reactive oxygen species.Designed to be robust in an in vivo environment,these probes have been used in tissue culture cells and in live small animals.An emerging class of smart probes has been designed to harness the potency of singlet oxygen generating photosensitizers.Combining the discrimination of activatable agents with the toxicity of photosensitizers represents a new and powerful approach to disease treatment.This review highlights some applications of activatable smart probes with a focus on developments of the past decade.

Optical coherence tomography with or without enhanced depth imaging for peripapillary retinal nerve fiber layer and choroidal thickness

AIM：To assess peripapillary retinal nerve fiber layer（RNFL）and choroidal thickness obtained with enhanced depth imaging（EDI）mode compared with those obtained without EDI mode using Heidelberg Spectralis optical coherence tomography（OCT）.METHODS：Fifty eyes of 25 normal healthy subjects and32 eyes of 20 patients with different eye diseases were included in the study.All subjects underwent 3.4 mm diameter peripapillary circular OCT scan centered on the optic disc using both the conventional and the EDI OCT protocols.The visualization of RNFL and choroidoscleral junction was assessed using an ordinal scoring scale.The paired t-test,intraclass correlation coefficient（ICC）,95%limits of agreement（LoA）,and Bland and Altman plots were used to test the agreement of measurements.RESULTS：The visibility score of RNFL obtained with and without EDI was of no significant difference（P=0.532）,the visualization of choroidoscleral junction was better using EDI protocol than conventional protocol（P〈0.001）.Peripapillary RNFL thickness obtained with EDI was slightly thicker than that obtained without EDI（103.25±9.42μm vs 101.87±8.78μm,P=0.010）.The ICC of the two protocols was excellent with the value of 0.867 to 0.924,the 95%LoA of global RNFL thickness was between-10.0 to 7.4μm.Peripapillary choroidal thickness obtained with EDI was slightly thinner than that obtained without EDI（147.23±51.04μm vs 150.90±51.84μm,P〈0.001）.The ICC was also excellent with the value of 0.960 to 0.987,the 95%LoA of global choroidal thickness was between-12.5 to 19.8μm.CONCLUSION：Peripapillary circular OCT scan with or without EDI mode shows comparable results in the measurement of peripapillary RNFL and choroidal thickness.

Attack on Optical Double Random Phase Encryption Based on the Principle of Ptychographical Imaging

The principle of ptychography is applied in known plain text attack on the double random phase encoding （DRPE） system. We find that with several pairs of plain texts and cipher texts, the model of attack on DRPE can be converted to the model of ptyehographical imaging. Owing to the inherent merits of the ptyehographical imaging, the DRPE system can be breached totally in a fast and nearly perfect way, which is unavailable for currently existing attack methods. Further, since the decryption keys can be seen as an object to be imaged from the perspective of imaging, the ptychographical technique may be a kind of new direction to further analysis of the security of other encryption systems based on double random keys.

A Steganography-Based Optical Image Encryption System Using RGB Channel Integration

An optical image encryption system with adaptive steganography using red, green, and blue （RGB） channel integration is proposed. The optical image encryption system employs a double random phase encoding algorithm to encrypt and decrypt color images. The RGB channel in a color image is first integrated into a large grayscale image. Then the integrated image is encrypted by two random phase masks. The secret data is then embedded into the encrypted image with a specific hiding sequence generated by the zero-LSB （least significant bits） sorting technique which is a content-dependent and low distortion data embedding method. Experimental results show that the proposed, method has a good performance in both hiding capacity and decrypted image quality.

Optical neuroimaging:advancing transcranial magnetic stimulation treatments of psychiatric disorders

Transcranial magnetic stimulation(TMS)has been established as an important and effective treatment for various psychiatric disorders.However,its effectiveness has likely been limited due to the dearth of neuronavigational tools for targeting purposes,unclear ideal stimulation parameters,and a lack of knowledge regarding the physiological response of the brain to TMS in each psychiatric condition.Modern optical imaging modalities,such as functional near-infrared spectroscopy and diffuse optical tomography,are promising tools for the study of TMS optimization and functional targeting in psychiatric disorders.They possess a unique combination of high spatial and temporal resolutions,portability,real-time capability,and relatively low costs.In this mini-review,we discuss the advent of optical imaging techniques and their innovative use in several psychiatric conditions including depression,panic disorder,phobias,and eating disorders.With further investment and research in the development of these optical imaging approaches,their potential will be paramount for the advancement of TMS treatment protocols in psychiatry.

Separation of cortical arteries and veins in optical neurovascular imaging

Separation of arteries and veins in the cerebral cortex is of significant importance in the studies of cortical hemodynamics,such as the changes of cerebral blood flow,perfusion or oxygen con-centration in arteries and veins under different pathological and physiological conditions.Yet the cerebral vessel segmentation and vessel-type separation are challenging due to the complexity of cortical vessel characteristics and low spatial signal-to-noise ratio.In this work,we presented an effective full-field method to differentiate arteries and veins in cerebral cortex using dual-modal optical imaging technology including laser speckle imaging(LSI)and optical intrinsic signals(OIS)imaging.The raw contrast images were acquired by LSI and processed with enhanced laser speckle contrast analysis(eLASCA),algorithm.The vascular pattern was extracted and seg-mented using region growing algorithm from the eLASCA-based LSI.Meanwhile,OIS imageswere acquired altermatively with 630 and 870 nm to obtain an oxy hemoglobin concentration mapover cerebral cortex.Then the separation of arteries and veins was accomplished by Otsuthreshold segmentation algorithm based on the OIS information and segmentation of LSI.Finally,the segmentation and separation performances were assessed using area overlap measure(AOM).The segmentation and separation of cerebral vessels in cortical optical imaging have great potential applications in full-field cerebral hemodynamics monitoring and pathological study of cerebral vascular diseases,as well as in clinical intraoperative monitoring.

ACCURATELY DETERMINING PROPAGATION VELOCITY OF CORTICAL SPREADING DEPRESSION IN RATS BY OPTICAL INTRINSIC SIGNAL IMAGING

Cortical spreading depression(CSD)is a wave of neuronal and glial depolarization that propagates across the cortex at a rate of 2–5mm/min accompanied by reversible electroencephalogram(EEG)suppression,a negative shift of direct current(DC)potential,and change of optical intrinsic signals(OIS).Propagation velocity of CSD is an important parameter used to study this phenomenon.It is commonly determined in an electrophysiological way that measures the time required for a CSD wave to pass along two electrodes.Since the electrophysiology technique fails to reveal the spreading pattern of CSD,velocity calculated in this manner might be inaccurate.In this study,we combined the electrophysiological recording and OIS imaging(OISI)for detecting changes in DC potential and OIS during CSD simultaneously.An optical method based on OISI to determine the CSD velocity,which is measured by generating a series of regions of interest(ROI)perpendicular to the advancing wavefront along propagation direction of CSD at different time points and then dividing by the distance between ROIs over time,is presented.Comparison of the accuracy of the two approaches in determining the CSD velocity is made as well.The average rate of 33 CSDs is 3.52±0.87mm/min by use of the optical method and 4.36±1.65mm/min by use of the electrophysiological method.Because of the information about spreading pattern of CSD provided optically,the velocity determined by OISI is of smaller deviation and higher accuracy.

Fast in vivo bioluminescence tomography using a novel pure optical imaging technique

Bioluminescence tomography(BLT)is a novel opt ical molecular imaging technique that advanced the conventional planar bioluminescence imaging(BLI)into a quantifiable three-dimensional(3D)approach in preclinical living animal studies in oncology.In order to solve the inverse problem and reconstruct tumor lesions inside animal body accurately,the prior structural information is com-monly obtained from X ray computed tomography(CT).This strategy requires a complicated hybrid imaging system,extensive post imaging analysis and involvement of ionizing radiation.Moreover,the overall robustness highly depends on the fusion accuracy between the optical and structural information.Here,we present a pure optical bioluminescence tomographic(POBT)system and a novel BLT workfow based on multi-view projection acquisition and 3D surface reconstruction.This met hod can reconstruct the 3D surface of an imaging subject based on a sparse set of planar white-light and bioluminescent images,so that the prior structural information can be offered for 3D tumor lesion reconstruction without the involvement of CT.The performance of this novel technique was evaluated through the comparison with a conventional dual-modality tomo-graphic(DMT)system and a commercialized optical imaging system(IVIS Spectrum)using three breast cancer xenografts.The results revealed that the new technique offered comparable in vivo tomographic accuracy with the DMT system(P>0.05)in much shorter data analysis time.It also offered significantly better accuracy comparing with the IVIS system(P<0.04)without sacrificing too much time.