Some existing image encryption schemes use simple low-dimensional chaotic systems, which makes the algorithms insecure and vulnerable to brute force attacks and cracking. Some algorithms have issues such as weak corre...Some existing image encryption schemes use simple low-dimensional chaotic systems, which makes the algorithms insecure and vulnerable to brute force attacks and cracking. Some algorithms have issues such as weak correlation with plaintext images, poor image reconstruction quality, and low efficiency in transmission and storage. To solve these issues,this paper proposes an optical image encryption algorithm based on a new four-dimensional memristive hyperchaotic system(4D MHS) and compressed sensing(CS). Firstly, this paper proposes a new 4D MHS, which has larger key space, richer dynamic behavior, and more complex hyperchaotic characteristics. The introduction of CS can reduce the image size and the transmission burden of hardware devices. The introduction of double random phase encoding(DRPE) enables this algorithm has the ability of parallel data processing and multi-dimensional coding space, and the hyperchaotic characteristics of 4D MHS make up for the nonlinear deficiency of DRPE. Secondly, a construction method of the deterministic chaotic measurement matrix(DCMM) is proposed. Using DCMM can not only save a lot of transmission bandwidth and storage space, but also ensure good quality of reconstructed images. Thirdly, the confusion method and diffusion method proposed are related to plaintext images, which require both four hyperchaotic sequences of 4D MHS and row and column keys based on plaintext images. The generation process of hyperchaotic sequences is closely related to the hash value of plaintext images. Therefore, this algorithm has high sensitivity to plaintext images. The experimental testing and comparative analysis results show that proposed algorithm has good security and effectiveness.展开更多
Vascular segmentation is a crucial task in biomedical image processing,which is significant for analyzing and modeling vascular networks under physiological and pathological states.With advances in fluorescent labelin...Vascular segmentation is a crucial task in biomedical image processing,which is significant for analyzing and modeling vascular networks under physiological and pathological states.With advances in fluorescent labeling and mesoscopic optical techniques,it has become possible to map the whole-mouse-brain vascular networks at capillary resolution.However,segmenting vessels from mesoscopic optical images is a challenging task.The problems,such as vascular signal discontinuities,vessel lumens,and background fluorescence signals in mesoscopic optical images,belong to global semantic information during vascular segmentation.Traditional vascular segmentation methods based on convolutional neural networks(CNNs)have been limited by their insufficient receptive fields,making it challenging to capture global semantic information of vessels and resulting in inaccurate segmentation results.Here,we propose SegVesseler,a vascular segmentation method based on Swin Transformer.SegVesseler adopts 3D Swin Transformer blocks to extract global contextual information in 3D images.This approach is able to maintain the connectivity and topology of blood vessels during segmentation.We evaluated the performance of our method on mouse cerebrovascular datasets generated from three different labeling and imaging modalities.The experimental results demonstrate that the segmentation effect of our method is significantly better than traditional CNNs and achieves state-of-the-art performance.展开更多
The diversity of tree species and the complexity of land use in cities create challenging issues for tree species classification.The combination of deep learning methods and RGB optical images obtained by unmanned aer...The diversity of tree species and the complexity of land use in cities create challenging issues for tree species classification.The combination of deep learning methods and RGB optical images obtained by unmanned aerial vehicles(UAVs) provides a new research direction for urban tree species classification.We proposed an RGB optical image dataset with 10 urban tree species,termed TCC10,which is a benchmark for tree canopy classification(TCC).TCC10 dataset contains two types of data:tree canopy images with simple backgrounds and those with complex backgrounds.The objective was to examine the possibility of using deep learning methods(AlexNet,VGG-16,and ResNet-50) for individual tree species classification.The results of convolutional neural networks(CNNs) were compared with those of K-nearest neighbor(KNN) and BP neural network.Our results demonstrated:(1) ResNet-50 achieved an overall accuracy(OA) of 92.6% and a kappa coefficient of 0.91 for tree species classification on TCC10 and outperformed AlexNet and VGG-16.(2) The classification accuracy of KNN and BP neural network was less than70%,while the accuracy of CNNs was relatively higher.(3)The classification accuracy of tree canopy images with complex backgrounds was lower than that for images with simple backgrounds.For the deciduous tree species in TCC10,the classification accuracy of ResNet-50 was higher in summer than that in autumn.Therefore,the deep learning is effective for urban tree species classification using RGB optical images.展开更多
It is difficult to balance local details and global distribution using a single source image in marine target detection of a large scene.To solve this problem,a technique based on the fusion of optical image and synth...It is difficult to balance local details and global distribution using a single source image in marine target detection of a large scene.To solve this problem,a technique based on the fusion of optical image and synthetic aperture radar(SAR)image for the extraction of sea ice is proposed in this paper.The Band 2(B2 image of Sentinel-2(S2 in the research area is selected as optical image data.Preprocessing on the optical image,such as resampling,projection transformation and format conversion,are conducted to the S2 dataset before fusion.Imaging characteristics of the sea ice have been analyzed,and a new deep learning(DL)model,OceanTDL5,is built to detect sea ices.The fusion of the Sentinel-1(S1 and S2 images is realized by solving the optimal pixel values based on deriving Poisson Equation.The experimental results indicate that the use of a fused image improves the accuracy of sea ice detection compared with the use of a single data source.The fused image has richer spatial details and a clearer texture compared with the original optical image,and its material sense and color are more abundant.展开更多
Mountain glaciers are sensitive to environment. It is important to acquire ice flow velocities over time for glacier research and hazard forecast. For this paper, cross-correlating of optical images is used to monitor...Mountain glaciers are sensitive to environment. It is important to acquire ice flow velocities over time for glacier research and hazard forecast. For this paper, cross-correlating of optical images is used to monitor ice flow velocities, and an improvement, which is called "moving grid," is made to this method. For this research, two remote-sensing images in a certain glacier area, dur-ing different times are selected. The first image is divided into grids, and we calculated the correlation coefficient of each window in the grid with the window on the second image. The window with the highest correlation coefficient is considered the counter-part one on the first image. The displacement of the two corresponding windows is the movement of the glacier, and it is used to calculate glacier surface velocity. Compared to the traditional way of dividing an image with ascertain grid, this method uses small steps to move the grid from one location to another adjacent location until the whole glacier area is covered in the image, thus in-creasing corresponding point density. We selected a glacier in the Tianshan Mountains for this experiment and used two re-mote-sensing images with a 10-year interval to determine this method.展开更多
To verify the effectiveness of digital optical 3D image analyzer EvaSKIN in the objective and quantitative evaluation of wrinkles.A total of 115 subjects were recruited,the facial images of the subjects were collected...To verify the effectiveness of digital optical 3D image analyzer EvaSKIN in the objective and quantitative evaluation of wrinkles.A total of 115 subjects were recruited,the facial images of the subjects were collected by digital optical 3D image analyzer and manual camera,the changes of crow’s feet with age were analyzed.Pictures obtained by manual photography can be directly used for observation and preliminary grading of wrinkles.However,the requirements for evaluators are high,and the results are prone to errors,which will affect the accuracy of the evaluation.Therefore,skilled raters are needed.Compared with the manual photography method,the digital optical 3D image analyzer EvaSKIN can realize three-dimensional extraction of wrinkles,and obtain the change trend of crow’s feet with age.20~30 years old,wrinkles begin to appear slowly;wrinkles will increase rapidly at the age of 30~50;The length of 50~60 year old wrinkles is basically fixed,the wrinkles develop longitudewise,gradually widen and deepen,and the area,depth and volume increase is obvious,and the skin aging condition is intensified.the digital optical 3D image analyzer EvaSKIN realizes the 3D extraction of wrinkles,quantifies the circumference,area,average depth,maximum depth and volume of wrinkles,realizes the objective and quantitative evaluation of wrinkle state,is more accurate in the measurement of wrinkles,and provides a new instrument and method for the evaluation of wrinkles.it is a perfect and supplement to the traditional evaluation methods,and to a certain extent,it helps the research and development and evaluation institutions of cosmetics to obtain more abundant and three-dimensional data support.展开更多
To address the issue of imbalanced detection performance and detection speed in current mainstream object detection algorithms for optical remote sensing images,this paper proposes a multi-scale object detection model...To address the issue of imbalanced detection performance and detection speed in current mainstream object detection algorithms for optical remote sensing images,this paper proposes a multi-scale object detection model for remote sensing images on complex backgrounds,called DI-YOLO,based on You Only Look Once v7-tiny(YOLOv7-tiny).Firstly,to enhance the model’s ability to capture irregular-shaped objects and deformation features,as well as to extract high-level semantic information,deformable convolutions are used to replace standard convolutions in the original model.Secondly,a Content Coordination Attention Feature Pyramid Network(CCA-FPN)structure is designed to replace the Neck part of the original model,which can further perceive relationships between different pixels,reduce feature loss in remote sensing images,and improve the overall model’s ability to detect multi-scale objects.Thirdly,an Implicitly Efficient Decoupled Head(IEDH)is proposed to increase the model’s flexibility,making it more adaptable to complex detection tasks in various scenarios.Finally,the Smoothed Intersection over Union(SIoU)loss function replaces the Complete Intersection over Union(CIoU)loss function in the original model,resulting in more accurate prediction of bounding boxes and continuous model optimization.Experimental results on the High-Resolution Remote Sensing Detection(HRRSD)dataset demonstrate that the proposed DI-YOLO model outperforms mainstream target detection algorithms in terms of mean Average Precision(mAP)for optical remote sensing image detection.Furthermore,it achieves Frames Per Second(FPS)of 138.9,meeting fast and accurate detection requirements.展开更多
Internal solitary waves(ISWs)change the roughness of the sea surface,thus producing dark and bright bands in optical images.However,reasons for changes in imaging characteristics with the solar zenith angle remain unc...Internal solitary waves(ISWs)change the roughness of the sea surface,thus producing dark and bright bands in optical images.However,reasons for changes in imaging characteristics with the solar zenith angle remain unclear.In this paper,the optical imaging pattern of ISWs in sunglint under different zenith angles of the light source is investigated by collecting optical images of ISWs through physical simulation.The experiment involves setting 10 zenith angles of the light source,which are divided into area a the optical images of ISWs in the three areas show dark-bright mode,single bright band,and bright-dark mode,which are consistent with those observed by optical remote sensing.In addition,this study analyzed the percentage of the dark and bright areas of the bands and the change in the relative gray difference and found changes in both areas under different zenith angles of the light source.The MODIS and ASAR images display a similar brightness-darkness distance of the same ISWs.Therefore,the relationship between the brightness-darkness distance and the characteristic half-width of ISWs is determined in accordance with the eKdV theory and the imaging mechanism of ISWs of the SAR image.Overall,the relationship between them in the experiment is almost consistent with the theoretical result.展开更多
In a single-pixel fast imaging setup,the data collected by the single-pixel detector needs to be processed by a computer,but the speed of the latter will affect the image reconstruction time.Here we propose two kinds ...In a single-pixel fast imaging setup,the data collected by the single-pixel detector needs to be processed by a computer,but the speed of the latter will affect the image reconstruction time.Here we propose two kinds of setups which are able to transform non-visible into visible light imaging,wherein their computing process is replaced by a camera integration mode.The image captured by the camera has a low contrast,so here we present an algorithm that can realize a high quality image in near-infrared to visible cross-waveband imaging.The scheme is verified both by simulation and in actual experiments.The setups demonstrate the great potential for single-pixel imaging and high-speed cross-waveband imaging for future practical applications.展开更多
AIM:To investigate changes in choroidal thickness and vascularity in keratoconus patients treated with corneal crosslinking.METHODS:This study evaluated 28 eyes of 22 patients with keratoconus who underwent corneal cr...AIM:To investigate changes in choroidal thickness and vascularity in keratoconus patients treated with corneal crosslinking.METHODS:This study evaluated 28 eyes of 22 patients with keratoconus who underwent corneal crosslinking.The choroidal thicknesses were evaluated on enhanced depth imaging optical coherence tomography at the preoperative and postoperative 3d,1,and 3mo.Choroidal thickness in the four cardinal quadrants and the fovea were evaluated.The choroidal vascularity index was also calculated.RESULTS:There was no significant difference in central choroidal thickness between the preoperative and postoperative 3d,1mo(P>0.05).There was a significant increase in the 3mo(P=0.034)and a significant decrease in the horizontal choroidal vascularity index on the postoperative 3d(P=0.014),there was no statistically significant change in vertical axes and other visits in horizontal sections(P>0.05).CONCLUSION:This study sheds light on choroidal changes in postoperative corneal crosslinking for keratoconus.While it suggests the procedure’s relative safety for submacular choroid,more extensive research is necessary to confirm these findings and their clinical significance.展开更多
Bragg processing using a volume hologram offers an alternative in optical image processing in contrast to Fourier-plane processing. By placing a volume hologram near the object in an optical imaging setup, we achieve ...Bragg processing using a volume hologram offers an alternative in optical image processing in contrast to Fourier-plane processing. By placing a volume hologram near the object in an optical imaging setup, we achieve Bragg processing. In this review, we discuss various image processing methods achievable with acousto-optic modulators as dynamic and programmable volume holograms. In particular, we concentrate on the discussion of various differentiation operations leading to edge extraction capabilities.展开更多
Sea ice as a disaster has recently attracted a great deal of attention in China. Its monitoring has become a routine task for the maritime sector. Remote sensing, which depends mainly on SAR and optical sensors, has b...Sea ice as a disaster has recently attracted a great deal of attention in China. Its monitoring has become a routine task for the maritime sector. Remote sensing, which depends mainly on SAR and optical sensors, has become the primary means for sea-ice research. Optical images contain abundant sea-ice multi-spectral in-formation, whereas SAR images contain rich sea-ice texture information. If the characteristic advantages of SAR and optical images could be combined for sea-ice study, the ability of sea-ice monitoring would be im-proved. In this study, in accordance with the characteristics of sea-ice SAR and optical images, the transfor-mation and fusion methods for these images were chosen. Also, a fusion method of optical and SAR images was proposed in order to improve sea-ice identification. Texture information can play an important role in sea-ice classification. Haar wavelet transformation was found to be suitable for the sea-ice SAR images, and the texture information of the sea-ice SAR image from Advanced Synthetic Aperture Radar (ASAR) loaded on ENVISAT was documented. The results of our studies showed that, the optical images in the hue-intensi-ty-saturation (HIS) space could reflect the spectral characteristics of the sea-ice types more efficiently than in the red-green-blue (RGB) space, and the optical image from the China-Brazil Earth Resources Satellite (CBERS-02B) was transferred from the RGB space to the HIS space. The principal component analysis (PCA) method could potentially contain the maximum information of the sea-ice images by fusing the HIS and texture images. The fusion image was obtained by a PCA method, which included the advantages of both the sea-ice SAR image and the optical image. To validate the fusion method, three methods were used to evaluate the fused image, i.e., objective, subjective, and comprehensive evaluations. It was concluded that the fusion method proposed could improve the ability of image interpretation and sea-ice identification.展开更多
This paper presents a bathymetry inversion method using single-frame fine-resolution optical remote sensing imagery based on ocean-wave refraction and shallow-water wave theory. First, the relationship among water dep...This paper presents a bathymetry inversion method using single-frame fine-resolution optical remote sensing imagery based on ocean-wave refraction and shallow-water wave theory. First, the relationship among water depth, wavelength and wave radian frequency in shallow water was deduced based on shallow-water wave theory. Considering the complex wave distribution in the optical remote sensing imagery, Fast Fourier Transform (FFT) and spatial profile measurements were applied for measuring the wavelengths. Then, the wave radian frequency was calculated by analyzing the long-distance fluctuation in the wavelength, which solved a key problem in obtaining the wave radian frequency in a single-frame image. A case study was conducted for Sanya Bay of Hainan Island, China. Single-flame fine-resolution optical remote sensing imagery from QuickBird satellite was used to invert the bathymetry without external input parameters. The result of the digital elevation model (DEM) was evaluated against a sea chart with a scale of 1:25 000. The root-mean-square error of the inverted bathymetry was 1.07 m, and the relative error was 16.2%. Therefore, the proposed method has the advantages including no requirement for true depths and environmental parameters, and is feasible for mapping the bathymetry of shallow coastal water.展开更多
Pre-operative X ray mammography and int raoperative X-ray specimen radiography are routinely used to identify breast cancer pathology.Recent advances in optical coherence tomography(OCT)have enabled its 1use for the i...Pre-operative X ray mammography and int raoperative X-ray specimen radiography are routinely used to identify breast cancer pathology.Recent advances in optical coherence tomography(OCT)have enabled its 1use for the intraoperative assessment of surgical margins during breast cancer surgery.While each modality offers distinct contrast of normal and pathological features,there is an essential need to correlate image based features between the two modalities to take adv antage of the diagnostic capabilities of each technique.We compare OCT to X-ray images of resected human breast tissue and correlate different tissue features between modalities for future use in real-tine intraoperative OCT imaging.X ray imaging(specimen radiography)is currently used during surgical breast cancer procedures to verify tumor margins,but cannot image tissue in situ.OCT has the potential to solve this problem by providing intrao-perative imaging of the resected specimen as well as the in situ tumor cavity.OCT and micro-CT(X-ray)images are automatically segmented using different computational approaches,and quantitatively compared to determine the ability of these algorithms to automat ically differentiate regions of adipose tissue from tumor.Furthermore,two-dimensional(2D)and three-dimensional(3D)results are compared.These correlations,combined with real-time intraoperative OCT,have the potential to identify possible regions of tumor within breast tissue which correlate to tumor regions identified previously on X-ray imaging(mammography or specimen radiography).展开更多
High resolution imaging is achieved using increasingly larger apertures and successively shorter wavelengths.Optical aperture synthesis is an important high-resolution imaging technology used in astronomy.Conventional...High resolution imaging is achieved using increasingly larger apertures and successively shorter wavelengths.Optical aperture synthesis is an important high-resolution imaging technology used in astronomy.Conventional long baseline amplitude interferometry is susceptible to uncontrollable phase fluctuations,and the technical difficulty increases rapidly as the wavelength decreases.The intensity interferometry inspired by HBT experiment is essentially insensitive to phase fluctuations,but suffers from a narrow spectral bandwidth which results in a lack of effective photons.In this study,we propose optical synthetic aperture imaging based on spatial intensity interferometry.This not only realizes diffraction-limited optical aperture synthesis in a single shot,but also enables imaging with a wide spectral bandwidth,which greatly improves the optical energy efficiency of intensity interferometry.And this method is insensitive to the optical path difference between the sub-apertures.Simulations and experiments present optical aperture synthesis diffraction-limited imaging through spatial intensity interferometry in a 100 nm spectral width of visible light,whose maximum optical path difference between the sub-apertures reaches 69λ.This technique is expected to provide a solution for optical aperture synthesis over kilometer-long baselines at optical wavelengths.展开更多
The optical coherence structures of random optical fields can determine beam propagation behavior,light–matter interactions,etc.Their performance makes a light beam robust against turbulence,scattering,and distortion...The optical coherence structures of random optical fields can determine beam propagation behavior,light–matter interactions,etc.Their performance makes a light beam robust against turbulence,scattering,and distortion.Recently,we proposed optical coherence encryption and robust far-field optical imaging techniques.All related applications place a high demand on precision in the experimental measurements of complex optical coherence structures,including their real and imaginary parts.Past studies on these measurements have mainly adopted theoretical mathematical approximations,limited to Gaussian statistic involving speckle statistic(time-consuming),or used complicated and delicate optical systems in the laboratory.In this study,we provide:a robust,convenient,and fast protocol to measure the optical coherence structures of random optical fields via generalized Arago(or Poisson)spot experiments with rigorous mathematical solutions.Our proposal only requires to capture the intensity thrice,and is applicable to any optical coherence structures,regardless of their type or optical statistics.The theoretical and experimental results demonstrated that the real and imaginary parts of the structures could be simultaneously recovered with high precision.We believe that such a protocol can be widely employed in phase measurement,optical imaging,and image transfer.展开更多
Real-time polarization medium-wave infrared(MIR)optical imaging systems enable the acquisition of infrared and polarization information for a target.At present,real-time polarization MIR devices face the following pro...Real-time polarization medium-wave infrared(MIR)optical imaging systems enable the acquisition of infrared and polarization information for a target.At present,real-time polarization MIR devices face the following problems:poor real-time performance,low transmission and high requirements for fabrication and integration.Herein,we aim to improve the performance of real-time polarization imaging systems in the MIR waveband and solve the above-mentioned defects.Therefore,we propose a MIR polarization imaging system to achieve real-time polarization-modulated imaging with high transmission as well as improved performance based on a pixel-wise metasurface micro-polarization array(PMMPA).The PMMPA element comprises several linear polarization(LP)filters with different polarization angles.The optimization results demonstrate that the transmittance of the center field of view for the LP filters is up to 77%at a wavelength of4.0μm and an extinction ratio of 88 d B.In addition,a near-diffraction-limited real-time MIR imaging optical system is designed with a field of view of 5°and an F-number of 2.The simulation results show that an MIR polarization imaging system with excellent real-time performance and high transmission is achieved by using the optimized PMMPA element.Therefore,the method is compatible with the available optical system design technologies and provides a way to realize real-time polarization imaging in MIR wavebands.展开更多
Computational optical imaging is an interdisciplinary subject integrating optics, mathematics, and information technology. It introduces information processing into optical imaging and combines it with intelligent com...Computational optical imaging is an interdisciplinary subject integrating optics, mathematics, and information technology. It introduces information processing into optical imaging and combines it with intelligent computing, subverting the imaging mechanism of traditional optical imaging which only relies on orderly information transmission. To meet the high-precision requirements of traditional optical imaging for optical processing and adjustment, as well as to solve its problems of being sensitive to gravity and temperature in use, we establish an optical imaging system model from the perspective of computational optical imaging and studies how to design and solve the imaging consistency problem of optical system under the influence of gravity, thermal effect, stress, and other external environment to build a high robustness optical system. The results show that the high robustness interval of the optical system exists and can effectively reduce the sensitivity of the optical system to the disturbance of each link, thus realizing the high robustness of optical imaging.展开更多
The nonlinear properties of Tris(acetylacetonato) Manganese(III) are used to manipulate the spatial frequencies at the Fourier plane using 4f-z scan. The technique is a simple self-adaptive all-optical system, which p...The nonlinear properties of Tris(acetylacetonato) Manganese(III) are used to manipulate the spatial frequencies at the Fourier plane using 4f-z scan. The technique is a simple self-adaptive all-optical system, which performs image processing and nonlinear optical measurements at the same time. Preferred spatial frequencies can be selected by shifting the nonlinear sample through the focus. Edge enhancement was demonstrated by filtering of low frequency with the nonlinear material at the Fourier plane.展开更多
Cells are the basic unit of human organs that are not fully understood.The revolutionary advancements of optical imaging alowed us to observe single cells in whole organs,revealing the complicated composition of cells...Cells are the basic unit of human organs that are not fully understood.The revolutionary advancements of optical imaging alowed us to observe single cells in whole organs,revealing the complicated composition of cells with spatial information.Therefore,in this review,we revisit the principles of optical contrast related to those biomolecules and the optical techniques that transform optical contrast into detectable optical signals.Then,we describe optical imaging to achieve threedimensional spatial discrimination for biological tisutes.Due to the milky appearance of tissues,the spatial information burred deep in the whole organ.Fortunately,strategies developed in the last decade could circumvent this issue and lead us into a new era of investigation of the cells with their original spatial information.展开更多
文摘Some existing image encryption schemes use simple low-dimensional chaotic systems, which makes the algorithms insecure and vulnerable to brute force attacks and cracking. Some algorithms have issues such as weak correlation with plaintext images, poor image reconstruction quality, and low efficiency in transmission and storage. To solve these issues,this paper proposes an optical image encryption algorithm based on a new four-dimensional memristive hyperchaotic system(4D MHS) and compressed sensing(CS). Firstly, this paper proposes a new 4D MHS, which has larger key space, richer dynamic behavior, and more complex hyperchaotic characteristics. The introduction of CS can reduce the image size and the transmission burden of hardware devices. The introduction of double random phase encoding(DRPE) enables this algorithm has the ability of parallel data processing and multi-dimensional coding space, and the hyperchaotic characteristics of 4D MHS make up for the nonlinear deficiency of DRPE. Secondly, a construction method of the deterministic chaotic measurement matrix(DCMM) is proposed. Using DCMM can not only save a lot of transmission bandwidth and storage space, but also ensure good quality of reconstructed images. Thirdly, the confusion method and diffusion method proposed are related to plaintext images, which require both four hyperchaotic sequences of 4D MHS and row and column keys based on plaintext images. The generation process of hyperchaotic sequences is closely related to the hash value of plaintext images. Therefore, this algorithm has high sensitivity to plaintext images. The experimental testing and comparative analysis results show that proposed algorithm has good security and effectiveness.
基金supported by the STI2030-Major Projects (2021ZD0201002)the National Natural Science Foundation of China (82102137,T2122015)+2 种基金Natural Science Foundation of Shaanxi Provincial Department of Education (21JK0796)the Open Project Program of Wuhan National Laboratory for Optoelectronics (2021WNL OKF006)the Natural Science Foundation of Sichuan Province (2022NSFSC0964).
文摘Vascular segmentation is a crucial task in biomedical image processing,which is significant for analyzing and modeling vascular networks under physiological and pathological states.With advances in fluorescent labeling and mesoscopic optical techniques,it has become possible to map the whole-mouse-brain vascular networks at capillary resolution.However,segmenting vessels from mesoscopic optical images is a challenging task.The problems,such as vascular signal discontinuities,vessel lumens,and background fluorescence signals in mesoscopic optical images,belong to global semantic information during vascular segmentation.Traditional vascular segmentation methods based on convolutional neural networks(CNNs)have been limited by their insufficient receptive fields,making it challenging to capture global semantic information of vessels and resulting in inaccurate segmentation results.Here,we propose SegVesseler,a vascular segmentation method based on Swin Transformer.SegVesseler adopts 3D Swin Transformer blocks to extract global contextual information in 3D images.This approach is able to maintain the connectivity and topology of blood vessels during segmentation.We evaluated the performance of our method on mouse cerebrovascular datasets generated from three different labeling and imaging modalities.The experimental results demonstrate that the segmentation effect of our method is significantly better than traditional CNNs and achieves state-of-the-art performance.
基金supported by Joint Fund of Natural Science Foundation of Zhejiang-Qingshanhu Science and Technology City(Grant No.LQY18C160002)National Natural Science Foundation of China(Grant No.U1809208)+1 种基金Zhejiang Science and Technology Key R&D Program Funded Project(Grant No.2018C02013)Natural Science Foundation of Zhejiang Province(Grant No.LQ20F020005).
文摘The diversity of tree species and the complexity of land use in cities create challenging issues for tree species classification.The combination of deep learning methods and RGB optical images obtained by unmanned aerial vehicles(UAVs) provides a new research direction for urban tree species classification.We proposed an RGB optical image dataset with 10 urban tree species,termed TCC10,which is a benchmark for tree canopy classification(TCC).TCC10 dataset contains two types of data:tree canopy images with simple backgrounds and those with complex backgrounds.The objective was to examine the possibility of using deep learning methods(AlexNet,VGG-16,and ResNet-50) for individual tree species classification.The results of convolutional neural networks(CNNs) were compared with those of K-nearest neighbor(KNN) and BP neural network.Our results demonstrated:(1) ResNet-50 achieved an overall accuracy(OA) of 92.6% and a kappa coefficient of 0.91 for tree species classification on TCC10 and outperformed AlexNet and VGG-16.(2) The classification accuracy of KNN and BP neural network was less than70%,while the accuracy of CNNs was relatively higher.(3)The classification accuracy of tree canopy images with complex backgrounds was lower than that for images with simple backgrounds.For the deciduous tree species in TCC10,the classification accuracy of ResNet-50 was higher in summer than that in autumn.Therefore,the deep learning is effective for urban tree species classification using RGB optical images.
基金the Natural Science Foun-dation of Shandong Province(No.ZR2019MD034)。
文摘It is difficult to balance local details and global distribution using a single source image in marine target detection of a large scene.To solve this problem,a technique based on the fusion of optical image and synthetic aperture radar(SAR)image for the extraction of sea ice is proposed in this paper.The Band 2(B2 image of Sentinel-2(S2 in the research area is selected as optical image data.Preprocessing on the optical image,such as resampling,projection transformation and format conversion,are conducted to the S2 dataset before fusion.Imaging characteristics of the sea ice have been analyzed,and a new deep learning(DL)model,OceanTDL5,is built to detect sea ices.The fusion of the Sentinel-1(S1 and S2 images is realized by solving the optimal pixel values based on deriving Poisson Equation.The experimental results indicate that the use of a fused image improves the accuracy of sea ice detection compared with the use of a single data source.The fused image has richer spatial details and a clearer texture compared with the original optical image,and its material sense and color are more abundant.
基金supported by the National Basic Research Program of China (Grant No. 2009CB723901)863 program (2009AA12Z145)the Chinese Academy of Sciences (kzcx2-yw-301)
文摘Mountain glaciers are sensitive to environment. It is important to acquire ice flow velocities over time for glacier research and hazard forecast. For this paper, cross-correlating of optical images is used to monitor ice flow velocities, and an improvement, which is called "moving grid," is made to this method. For this research, two remote-sensing images in a certain glacier area, dur-ing different times are selected. The first image is divided into grids, and we calculated the correlation coefficient of each window in the grid with the window on the second image. The window with the highest correlation coefficient is considered the counter-part one on the first image. The displacement of the two corresponding windows is the movement of the glacier, and it is used to calculate glacier surface velocity. Compared to the traditional way of dividing an image with ascertain grid, this method uses small steps to move the grid from one location to another adjacent location until the whole glacier area is covered in the image, thus in-creasing corresponding point density. We selected a glacier in the Tianshan Mountains for this experiment and used two re-mote-sensing images with a 10-year interval to determine this method.
文摘To verify the effectiveness of digital optical 3D image analyzer EvaSKIN in the objective and quantitative evaluation of wrinkles.A total of 115 subjects were recruited,the facial images of the subjects were collected by digital optical 3D image analyzer and manual camera,the changes of crow’s feet with age were analyzed.Pictures obtained by manual photography can be directly used for observation and preliminary grading of wrinkles.However,the requirements for evaluators are high,and the results are prone to errors,which will affect the accuracy of the evaluation.Therefore,skilled raters are needed.Compared with the manual photography method,the digital optical 3D image analyzer EvaSKIN can realize three-dimensional extraction of wrinkles,and obtain the change trend of crow’s feet with age.20~30 years old,wrinkles begin to appear slowly;wrinkles will increase rapidly at the age of 30~50;The length of 50~60 year old wrinkles is basically fixed,the wrinkles develop longitudewise,gradually widen and deepen,and the area,depth and volume increase is obvious,and the skin aging condition is intensified.the digital optical 3D image analyzer EvaSKIN realizes the 3D extraction of wrinkles,quantifies the circumference,area,average depth,maximum depth and volume of wrinkles,realizes the objective and quantitative evaluation of wrinkle state,is more accurate in the measurement of wrinkles,and provides a new instrument and method for the evaluation of wrinkles.it is a perfect and supplement to the traditional evaluation methods,and to a certain extent,it helps the research and development and evaluation institutions of cosmetics to obtain more abundant and three-dimensional data support.
基金Funding for this research was provided by 511 Shaanxi Province’s Key Research and Development Plan(No.2022NY-087).
文摘To address the issue of imbalanced detection performance and detection speed in current mainstream object detection algorithms for optical remote sensing images,this paper proposes a multi-scale object detection model for remote sensing images on complex backgrounds,called DI-YOLO,based on You Only Look Once v7-tiny(YOLOv7-tiny).Firstly,to enhance the model’s ability to capture irregular-shaped objects and deformation features,as well as to extract high-level semantic information,deformable convolutions are used to replace standard convolutions in the original model.Secondly,a Content Coordination Attention Feature Pyramid Network(CCA-FPN)structure is designed to replace the Neck part of the original model,which can further perceive relationships between different pixels,reduce feature loss in remote sensing images,and improve the overall model’s ability to detect multi-scale objects.Thirdly,an Implicitly Efficient Decoupled Head(IEDH)is proposed to increase the model’s flexibility,making it more adaptable to complex detection tasks in various scenarios.Finally,the Smoothed Intersection over Union(SIoU)loss function replaces the Complete Intersection over Union(CIoU)loss function in the original model,resulting in more accurate prediction of bounding boxes and continuous model optimization.Experimental results on the High-Resolution Remote Sensing Detection(HRRSD)dataset demonstrate that the proposed DI-YOLO model outperforms mainstream target detection algorithms in terms of mean Average Precision(mAP)for optical remote sensing image detection.Furthermore,it achieves Frames Per Second(FPS)of 138.9,meeting fast and accurate detection requirements.
基金National Natural Science Foundation of China (Nos.61871353 and 42006164)for their support。
文摘Internal solitary waves(ISWs)change the roughness of the sea surface,thus producing dark and bright bands in optical images.However,reasons for changes in imaging characteristics with the solar zenith angle remain unclear.In this paper,the optical imaging pattern of ISWs in sunglint under different zenith angles of the light source is investigated by collecting optical images of ISWs through physical simulation.The experiment involves setting 10 zenith angles of the light source,which are divided into area a the optical images of ISWs in the three areas show dark-bright mode,single bright band,and bright-dark mode,which are consistent with those observed by optical remote sensing.In addition,this study analyzed the percentage of the dark and bright areas of the bands and the change in the relative gray difference and found changes in both areas under different zenith angles of the light source.The MODIS and ASAR images display a similar brightness-darkness distance of the same ISWs.Therefore,the relationship between the brightness-darkness distance and the characteristic half-width of ISWs is determined in accordance with the eKdV theory and the imaging mechanism of ISWs of the SAR image.Overall,the relationship between them in the experiment is almost consistent with the theoretical result.
文摘In a single-pixel fast imaging setup,the data collected by the single-pixel detector needs to be processed by a computer,but the speed of the latter will affect the image reconstruction time.Here we propose two kinds of setups which are able to transform non-visible into visible light imaging,wherein their computing process is replaced by a camera integration mode.The image captured by the camera has a low contrast,so here we present an algorithm that can realize a high quality image in near-infrared to visible cross-waveband imaging.The scheme is verified both by simulation and in actual experiments.The setups demonstrate the great potential for single-pixel imaging and high-speed cross-waveband imaging for future practical applications.
文摘AIM:To investigate changes in choroidal thickness and vascularity in keratoconus patients treated with corneal crosslinking.METHODS:This study evaluated 28 eyes of 22 patients with keratoconus who underwent corneal crosslinking.The choroidal thicknesses were evaluated on enhanced depth imaging optical coherence tomography at the preoperative and postoperative 3d,1,and 3mo.Choroidal thickness in the four cardinal quadrants and the fovea were evaluated.The choroidal vascularity index was also calculated.RESULTS:There was no significant difference in central choroidal thickness between the preoperative and postoperative 3d,1mo(P>0.05).There was a significant increase in the 3mo(P=0.034)and a significant decrease in the horizontal choroidal vascularity index on the postoperative 3d(P=0.014),there was no statistically significant change in vertical axes and other visits in horizontal sections(P>0.05).CONCLUSION:This study sheds light on choroidal changes in postoperative corneal crosslinking for keratoconus.While it suggests the procedure’s relative safety for submacular choroid,more extensive research is necessary to confirm these findings and their clinical significance.
基金The work was supported by the National Natural Science Foundation of China(Nos.11762009 and 61865007)the Natural Science Foundation of Yunnan Province,China(No.2018FB101)+1 种基金the Key Program of Science and Technology of Yunnan Province(No.2019FA025)the Yunnan Provincial Program for Foreign Talent(No.104126760027)。
文摘Bragg processing using a volume hologram offers an alternative in optical image processing in contrast to Fourier-plane processing. By placing a volume hologram near the object in an optical imaging setup, we achieve Bragg processing. In this review, we discuss various image processing methods achievable with acousto-optic modulators as dynamic and programmable volume holograms. In particular, we concentrate on the discussion of various differentiation operations leading to edge extraction capabilities.
基金The National Science Foundation for Young Scientists of China under contract No.41306193the National Special Research Fund for Non-Profit Marine Sector of China under contract No.201105016the ESA-MOST Dragon 3 Cooperation Programme under contract No.10501
文摘Sea ice as a disaster has recently attracted a great deal of attention in China. Its monitoring has become a routine task for the maritime sector. Remote sensing, which depends mainly on SAR and optical sensors, has become the primary means for sea-ice research. Optical images contain abundant sea-ice multi-spectral in-formation, whereas SAR images contain rich sea-ice texture information. If the characteristic advantages of SAR and optical images could be combined for sea-ice study, the ability of sea-ice monitoring would be im-proved. In this study, in accordance with the characteristics of sea-ice SAR and optical images, the transfor-mation and fusion methods for these images were chosen. Also, a fusion method of optical and SAR images was proposed in order to improve sea-ice identification. Texture information can play an important role in sea-ice classification. Haar wavelet transformation was found to be suitable for the sea-ice SAR images, and the texture information of the sea-ice SAR image from Advanced Synthetic Aperture Radar (ASAR) loaded on ENVISAT was documented. The results of our studies showed that, the optical images in the hue-intensi-ty-saturation (HIS) space could reflect the spectral characteristics of the sea-ice types more efficiently than in the red-green-blue (RGB) space, and the optical image from the China-Brazil Earth Resources Satellite (CBERS-02B) was transferred from the RGB space to the HIS space. The principal component analysis (PCA) method could potentially contain the maximum information of the sea-ice images by fusing the HIS and texture images. The fusion image was obtained by a PCA method, which included the advantages of both the sea-ice SAR image and the optical image. To validate the fusion method, three methods were used to evaluate the fused image, i.e., objective, subjective, and comprehensive evaluations. It was concluded that the fusion method proposed could improve the ability of image interpretation and sea-ice identification.
基金The Public Science and Technology Research Fund Project of Ocean under contract No.201105001the National Nature Science Foundation of China under contract No.41576174the Public Science and Technology Research Fund Project of Surveying,Mapping and Geoinformation under contract No.201512030
文摘This paper presents a bathymetry inversion method using single-frame fine-resolution optical remote sensing imagery based on ocean-wave refraction and shallow-water wave theory. First, the relationship among water depth, wavelength and wave radian frequency in shallow water was deduced based on shallow-water wave theory. Considering the complex wave distribution in the optical remote sensing imagery, Fast Fourier Transform (FFT) and spatial profile measurements were applied for measuring the wavelengths. Then, the wave radian frequency was calculated by analyzing the long-distance fluctuation in the wavelength, which solved a key problem in obtaining the wave radian frequency in a single-frame image. A case study was conducted for Sanya Bay of Hainan Island, China. Single-flame fine-resolution optical remote sensing imagery from QuickBird satellite was used to invert the bathymetry without external input parameters. The result of the digital elevation model (DEM) was evaluated against a sea chart with a scale of 1:25 000. The root-mean-square error of the inverted bathymetry was 1.07 m, and the relative error was 16.2%. Therefore, the proposed method has the advantages including no requirement for true depths and environmental parameters, and is feasible for mapping the bathymetry of shallow coastal water.
基金supported in part by a grant from the U.S.National Institutes of Health,R01 EB012479(S.A.B.).
文摘Pre-operative X ray mammography and int raoperative X-ray specimen radiography are routinely used to identify breast cancer pathology.Recent advances in optical coherence tomography(OCT)have enabled its 1use for the intraoperative assessment of surgical margins during breast cancer surgery.While each modality offers distinct contrast of normal and pathological features,there is an essential need to correlate image based features between the two modalities to take adv antage of the diagnostic capabilities of each technique.We compare OCT to X-ray images of resected human breast tissue and correlate different tissue features between modalities for future use in real-tine intraoperative OCT imaging.X ray imaging(specimen radiography)is currently used during surgical breast cancer procedures to verify tumor margins,but cannot image tissue in situ.OCT has the potential to solve this problem by providing intrao-perative imaging of the resected specimen as well as the in situ tumor cavity.OCT and micro-CT(X-ray)images are automatically segmented using different computational approaches,and quantitatively compared to determine the ability of these algorithms to automat ically differentiate regions of adipose tissue from tumor.Furthermore,two-dimensional(2D)and three-dimensional(3D)results are compared.These correlations,combined with real-time intraoperative OCT,have the potential to identify possible regions of tumor within breast tissue which correlate to tumor regions identified previously on X-ray imaging(mammography or specimen radiography).
基金supported by National Natural Foundation of China(Grant No.61991454)the project of CAS Interdisciplinary Innovation Team。
文摘High resolution imaging is achieved using increasingly larger apertures and successively shorter wavelengths.Optical aperture synthesis is an important high-resolution imaging technology used in astronomy.Conventional long baseline amplitude interferometry is susceptible to uncontrollable phase fluctuations,and the technical difficulty increases rapidly as the wavelength decreases.The intensity interferometry inspired by HBT experiment is essentially insensitive to phase fluctuations,but suffers from a narrow spectral bandwidth which results in a lack of effective photons.In this study,we propose optical synthetic aperture imaging based on spatial intensity interferometry.This not only realizes diffraction-limited optical aperture synthesis in a single shot,but also enables imaging with a wide spectral bandwidth,which greatly improves the optical energy efficiency of intensity interferometry.And this method is insensitive to the optical path difference between the sub-apertures.Simulations and experiments present optical aperture synthesis diffraction-limited imaging through spatial intensity interferometry in a 100 nm spectral width of visible light,whose maximum optical path difference between the sub-apertures reaches 69λ.This technique is expected to provide a solution for optical aperture synthesis over kilometer-long baselines at optical wavelengths.
基金This work was supported by the National Key Research and Development Program of China(2022YFA1404800,2019YFA0705000)National Natural Science Foundation of China(11974218,12004220,12104264,12192254,92250304)+2 种基金Regional Science and Technology Development Project of the Central Government(YDZX20203700001766)China Postdoctoral Science Foundation(2022T150392)the Natural Science Foundation of Shandong Province(ZR2021QA014,ZR2021ZD02).
文摘The optical coherence structures of random optical fields can determine beam propagation behavior,light–matter interactions,etc.Their performance makes a light beam robust against turbulence,scattering,and distortion.Recently,we proposed optical coherence encryption and robust far-field optical imaging techniques.All related applications place a high demand on precision in the experimental measurements of complex optical coherence structures,including their real and imaginary parts.Past studies on these measurements have mainly adopted theoretical mathematical approximations,limited to Gaussian statistic involving speckle statistic(time-consuming),or used complicated and delicate optical systems in the laboratory.In this study,we provide:a robust,convenient,and fast protocol to measure the optical coherence structures of random optical fields via generalized Arago(or Poisson)spot experiments with rigorous mathematical solutions.Our proposal only requires to capture the intensity thrice,and is applicable to any optical coherence structures,regardless of their type or optical statistics.The theoretical and experimental results demonstrated that the real and imaginary parts of the structures could be simultaneously recovered with high precision.We believe that such a protocol can be widely employed in phase measurement,optical imaging,and image transfer.
基金Project supported by the National Key R&D Program of China(Grant No.SKLA02020001A05)。
文摘Real-time polarization medium-wave infrared(MIR)optical imaging systems enable the acquisition of infrared and polarization information for a target.At present,real-time polarization MIR devices face the following problems:poor real-time performance,low transmission and high requirements for fabrication and integration.Herein,we aim to improve the performance of real-time polarization imaging systems in the MIR waveband and solve the above-mentioned defects.Therefore,we propose a MIR polarization imaging system to achieve real-time polarization-modulated imaging with high transmission as well as improved performance based on a pixel-wise metasurface micro-polarization array(PMMPA).The PMMPA element comprises several linear polarization(LP)filters with different polarization angles.The optimization results demonstrate that the transmittance of the center field of view for the LP filters is up to 77%at a wavelength of4.0μm and an extinction ratio of 88 d B.In addition,a near-diffraction-limited real-time MIR imaging optical system is designed with a field of view of 5°and an F-number of 2.The simulation results show that an MIR polarization imaging system with excellent real-time performance and high transmission is achieved by using the optimized PMMPA element.Therefore,the method is compatible with the available optical system design technologies and provides a way to realize real-time polarization imaging in MIR wavebands.
文摘Computational optical imaging is an interdisciplinary subject integrating optics, mathematics, and information technology. It introduces information processing into optical imaging and combines it with intelligent computing, subverting the imaging mechanism of traditional optical imaging which only relies on orderly information transmission. To meet the high-precision requirements of traditional optical imaging for optical processing and adjustment, as well as to solve its problems of being sensitive to gravity and temperature in use, we establish an optical imaging system model from the perspective of computational optical imaging and studies how to design and solve the imaging consistency problem of optical system under the influence of gravity, thermal effect, stress, and other external environment to build a high robustness optical system. The results show that the high robustness interval of the optical system exists and can effectively reduce the sensitivity of the optical system to the disturbance of each link, thus realizing the high robustness of optical imaging.
文摘The nonlinear properties of Tris(acetylacetonato) Manganese(III) are used to manipulate the spatial frequencies at the Fourier plane using 4f-z scan. The technique is a simple self-adaptive all-optical system, which performs image processing and nonlinear optical measurements at the same time. Preferred spatial frequencies can be selected by shifting the nonlinear sample through the focus. Edge enhancement was demonstrated by filtering of low frequency with the nonlinear material at the Fourier plane.
基金supported by the National Science and Technology Innovation 2030 Grant No. (2021ZD0200104)National Nature Science Foundation of China (81871082).
文摘Cells are the basic unit of human organs that are not fully understood.The revolutionary advancements of optical imaging alowed us to observe single cells in whole organs,revealing the complicated composition of cells with spatial information.Therefore,in this review,we revisit the principles of optical contrast related to those biomolecules and the optical techniques that transform optical contrast into detectable optical signals.Then,we describe optical imaging to achieve threedimensional spatial discrimination for biological tisutes.Due to the milky appearance of tissues,the spatial information burred deep in the whole organ.Fortunately,strategies developed in the last decade could circumvent this issue and lead us into a new era of investigation of the cells with their original spatial information.