Enhancing Hyper-Spectral Image Classification with Reinforcement Learning and Advanced Multi-Objective Binary Grey Wolf Optimization

Hyperspectral(HS)image classification plays a crucial role in numerous areas including remote sensing(RS),agriculture,and the monitoring of the environment.Optimal band selection in HS images is crucial for improving the efficiency and accuracy of image classification.This process involves selecting the most informative spectral bands,which leads to a reduction in data volume.Focusing on these key bands also enhances the accuracy of classification algorithms,as redundant or irrelevant bands,which can introduce noise and lower model performance,are excluded.In this paper,we propose an approach for HS image classification using deep Q learning(DQL)and a novel multi-objective binary grey wolf optimizer(MOBGWO).We investigate the MOBGWO for optimal band selection to further enhance the accuracy of HS image classification.In the suggested MOBGWO,a new sigmoid function is introduced as a transfer function to modify the wolves’position.The primary objective of this classification is to reduce the number of bands while maximizing classification accuracy.To evaluate the effectiveness of our approach,we conducted experiments on publicly available HS image datasets,including Pavia University,Washington Mall,and Indian Pines datasets.We compared the performance of our proposed method with several state-of-the-art deep learning(DL)and machine learning(ML)algorithms,including long short-term memory(LSTM),deep neural network(DNN),recurrent neural network(RNN),support vector machine(SVM),and random forest(RF).Our experimental results demonstrate that the Hybrid MOBGWO-DQL significantly improves classification accuracy compared to traditional optimization and DL techniques.MOBGWO-DQL shows greater accuracy in classifying most categories in both datasets used.For the Indian Pine dataset,the MOBGWO-DQL architecture achieved a kappa coefficient(KC)of 97.68%and an overall accuracy(OA)of 94.32%.This was accompanied by the lowest root mean square error(RMSE)of 0.94,indicating very precise predictions with minimal error.In the case of the Pavia University dataset,the MOBGWO-DQL model demonstrated outstanding performance with the highest KC of 98.72%and an impressive OA of 96.01%.It also recorded the lowest RMSE at 0.63,reinforcing its accuracy in predictions.The results clearly demonstrate that the proposed MOBGWO-DQL architecture not only reaches a highly accurate model more quickly but also maintains superior performance throughout the training process.

The Soft X-ray Imager(SXI)on the SMILE Mission

The Soft X-ray Imager(SXI)is part of the scientific payload of the Solar wind Magnetosphere Ionosphere Link Explorer(SMILE)mission.SMILE is a joint science mission between the European Space Agency(ESA)and the Chinese Academy of Sciences(CAS)and is due for launch in 2025.SXI is a compact X-ray telescope with a wide field-of-view(FOV)capable of encompassing large portions of Earth’s magnetosphere from the vantage point of the SMILE orbit.SXI is sensitive to the soft X-rays produced by the Solar Wind Charge eXchange(SWCX)process produced when heavy ions of solar wind origin interact with neutral particles in Earth’s exosphere.SWCX provides a mechanism for boundary detection within the magnetosphere,such as the position of Earth’s magnetopause,because the solar wind heavy ions have a very low density in regions of closed magnetic field lines.The sensitivity of the SXI is such that it can potentially track movements of the magnetopause on timescales of a few minutes and the orbit of SMILE will enable such movements to be tracked for segments lasting many hours.SXI is led by the University of Leicester in the United Kingdom(UK)with collaborating organisations on hardware,software and science support within the UK,Europe,China and the United States.

SMILE soft X-ray Imager flight model CCD370 pre-flight device characterisation

Throughout the SMILE mission the satellite will be bombarded by radiation which gradually damages the focal plane devices and degrades their performance.In order to understand the changes of the CCD370s within the soft X-ray Imager,an initial characterisation of the devices has been carried out to give a baseline performance level.Three CCDs have been characterised,the two flight devices and the flight spa re.This has been carried out at the Open University in a bespo ke cleanroom measure ment facility.The results show that there is a cluster of bright pixels in the flight spa re which increases in size with tempe rature.However at the nominal ope rating tempe rature(-120℃) it is within the procure ment specifications.Overall,the devices meet the specifications when ope rating at -120℃ in 6 × 6 binned frame transfer science mode.The se rial charge transfer inefficiency degrades with temperature in full frame mode.However any charge losses are recovered when binning/frame transfer is implemented.

Design and performance evaluation of a large field-of-view dual-particle time-encoded imager based on a depth-of-interaction detector

Time-encoded imaging is useful for identifying potential special nuclear materials and other radioactive sources at a distance.In this study,a large field-of-view time-encoded imager was developed for gamma-ray and neutron source hotspot imaging based on a depth-of-interaction(DOI)detector.The imager primarily consists of a DOI detector system and a rotary dual-layer cylindrical coded mask.An EJ276 plastic scintillator coupled with two SiPMs was designed as the DOI detector to increase the field of view and improve the imager performance.The difference in signal time at both ends and the log of the signal amplitude ratio were used to calculate the interaction position resolution.The position resolution of the DOI detector was calibrated using a collimated Cs-137 source,and the full width at half maximum of the reconstruction position of the Gaussian fitting curve was approximately 4.4 cm.The DOI detector can be arbitrarily divided into several units to independently reconstruct the source distribution images.The unit length was optimized via Am-Be source-location experiments.A multidetector filtering method is proposed for image denoising.This method can effectively reduce image noise caused by poor DOI detector position resolution.The vertical field of view of the imager was(-55°,55°)when the detector was placed in the center of the coded mask.A DT neutron source at 20 m standoff could be located within 2400 s with an angular resolution of 3.5°.

Simulation of the SMILE Soft X-ray Imager response to a southward interplanetary magnetic field turning

The Solar wind Magnetosphere Ionosphere Link Explorer(SMILE)Soft X-ray Imager(SXI)will shine a spotlight on magnetopause dynamics during magnetic reconnection.We simulate an event with a southward interplanetary magnetic field turning and produce SXI count maps with a 5-minute integration time.By making assumptions about the magnetopause shape,we find the magnetopause standoff distance from the count maps and compare it with the one obtained directly from the magnetohydrodynamic(MHD)simulation.The root mean square deviations between the reconstructed and MHD standoff distances do not exceed 0.2 RE(Earth radius)and the maximal difference equals 0.24 RE during the 25-minute interval around the southward turning.

End-to-end computational design for an EUV solar corona multispectral imager with stray light suppression

An extreme ultraviolet solar corona multispectral imager can allow direct observation of high temperature coronal plasma,which is related to solar flares,coronal mass ejections and other significant coronal activities.This manuscript proposes a novel end-to-end computational design method for an extreme ultraviolet(EUV)solar corona multispectral imager operating at wavelengths near 100 nm,including a stray light suppression design and computational image recovery.To suppress the strong stray light from the solar disk,an outer opto-mechanical structure is designed to protect the imaging component of the system.Considering the low reflectivity(less than 70%)and strong-scattering(roughness)of existing extreme ultraviolet optical elements,the imaging component comprises only a primary mirror and a curved grating.A Lyot aperture is used to further suppress any residual stray light.Finally,a deep learning computational imaging method is used to correct the individual multi-wavelength images from the original recorded multi-slit data.In results and data,this can achieve a far-field angular resolution below 7",and spectral resolution below 0.05 nm.The field of view is±3 R_(☉)along the multi-slit moving direction,where R☉represents the radius of the solar disk.The ratio of the corona's stray light intensity to the solar center's irradiation intensity is less than 10-6 at the circle of 1.3 R_(☉).

Lossless Compression Method for the Magnetic and Helioseismic Imager(MHI)Payload

The Solar Polar-orbit Observatory(SPO),proposed by Chinese scientists,is designed to observe the solar polar regions in an unprecedented way with a spacecraft traveling in a large solar inclination angle and a small ellipticity.However,one of the most significant challenges lies in ultra-long-distance data transmission,particularly for the Magnetic and Helioseismic Imager(MHI),which is the most important payload and generates the largest volume of data in SPO.In this paper,we propose a tailored lossless data compression method based on the measurement mode and characteristics of MHI data.The background out of the solar disk is removed to decrease the pixel number of an image under compression.Multiple predictive coding methods are combined to eliminate the redundancy utilizing the correlation(space,spectrum,and polarization)in data set,improving the compression ratio.Experimental results demonstrate that our method achieves an average compression ratio of 3.67.The compression time is also less than the general observation period.The method exhibits strong feasibility and can be easily adapted to MHI.

Construction and Validation of a Geometry-based Mathematical Model for the Hard X-Ray Imager

Quantitative and analytical analysis of the modulation process of the collimator is a great challenge,and is also of great value to the design and development of Fourier transform imaging telescopes.The Hard X-ray Imager(HXI),as one of the three payloads onboard the Advanced Space-based Solar Observatory(ASO-S) mission,adopts modulating Fourier-Transformation imaging technique and will be used to explore the mechanism of energy release and transmission in solar flare activities.As an important step to reconstruct the images of solar flares,accurate modulation functions of HXI are needed.In this paper,a mathematical model is developed to analyze the modulation function under a simplified condition first.Then its behavior under six degrees of freedom is calculated after adding the rotation matrix and translation change to the model.In addition,unparalleled light and extended sources are also considered so that our model can be used to analyze the X-ray beam experiment.Next,applied to the practical HXI conditions,the model has been confirmed not only by Geant4 simulations but also by some verification experiments.Furthermore,how this model helps to improve the image reconstruction process after the launch of ASO-S is also presented.

Dendritic Learning-Incorporated Vision Transformer for Image Recognition

Dear Editor,This letter proposes to integrate dendritic learnable network architecture with Vision Transformer to improve the accuracy of image recognition.In this study,based on the theory of dendritic neurons in neuroscience,we design a network that is more practical for engineering to classify visual features.Based on this,we propose a dendritic learning-incorporated vision Transformer(DVT),which out-performs other state-of-the-art methods on three image recognition benchmarks.

Background removal from global auroral images:Data-driven dayglow modeling

Global images of auroras obtained by cameras on spacecraft are a key tool for studying the near-Earth environment.However,the cameras are sensitive not only to auroral emissions produced by precipitating particles,but also to dayglow emissions produced by photoelectrons induced by sunlight.Nightglow emissions and scattered sunlight can contribute to the background signal.To fully utilize such images in space science,background contamination must be removed to isolate the auroral signal.Here we outline a data-driven approach to modeling the background intensity in multiple images by formulating linear inverse problems based on B-splines and spherical harmonics.The approach is robust,flexible,and iteratively deselects outliers,such as auroral emissions.The final model is smooth across the terminator and accounts for slow temporal variations and large-scale asymmetries in the dayglow.We demonstrate the model by using the three far ultraviolet cameras on the Imager for Magnetopause-to-Aurora Global Exploration(IMAGE)mission.The method can be applied to historical missions and is relevant for upcoming missions,such as the Solar wind Magnetosphere Ionosphere Link Explorer(SMILE)mission.

Using restored two-dimensional X-ray images to reconstruct the three-dimensional magnetopause

Astronomical imaging technologies are basic tools for the exploration of the universe,providing basic data for the research of astronomy and space physics.The Soft X-ray Imager(SXI)carried by the Solar wind Magnetosphere Ionosphere Link Explorer(SMILE)aims to capture two-dimensional(2-D)images of the Earth’s magnetosheath by using soft X-ray imaging.However,the observed 2-D images are affected by many noise factors,destroying the contained information,which is not conducive to the subsequent reconstruction of the three-dimensional(3-D)structure of the magnetopause.The analysis of SXI-simulated observation images shows that such damage cannot be evaluated with traditional restoration models.This makes it difficult to establish the mapping relationship between SXIsimulated observation images and target images by using mathematical models.We propose an image restoration algorithm for SXIsimulated observation images that can recover large-scale structure information on the magnetosphere.The idea is to train a patch estimator by selecting noise–clean patch pairs with the same distribution through the Classification–Expectation Maximization algorithm to achieve the restoration estimation of the SXI-simulated observation image,whose mapping relationship with the target image is established by the patch estimator.The Classification–Expectation Maximization algorithm is used to select multiple patch clusters with the same distribution and then train different patch estimators so as to improve the accuracy of the estimator.Experimental results showed that our image restoration algorithm is superior to other classical image restoration algorithms in the SXI-simulated observation image restoration task,according to the peak signal-to-noise ratio and structural similarity.The restoration results of SXI-simulated observation images are used in the tangent fitting approach and the computed tomography approach toward magnetospheric reconstruction techniques,significantly improving the reconstruction results.Hence,the proposed technology may be feasible for processing SXI-simulated observation images.

Two-Staged Method for Ice Channel Identification Based on Image Segmentation and Corner Point Regression

Identification of the ice channel is the basic technology for developing intelligent ships in ice-covered waters,which is important to ensure the safety and economy of navigation.In the Arctic,merchant ships with low ice class often navigate in channels opened up by icebreakers.Navigation in the ice channel often depends on good maneuverability skills and abundant experience from the captain to a large extent.The ship may get stuck if steered into ice fields off the channel.Under this circumstance,it is very important to study how to identify the boundary lines of ice channels with a reliable method.In this paper,a two-staged ice channel identification method is developed based on image segmentation and corner point regression.The first stage employs the image segmentation method to extract channel regions.In the second stage,an intelligent corner regression network is proposed to extract the channel boundary lines from the channel region.A non-intelligent angle-based filtering and clustering method is proposed and compared with corner point regression network.The training and evaluation of the segmentation method and corner regression network are carried out on the synthetic and real ice channel dataset.The evaluation results show that the accuracy of the method using the corner point regression network in the second stage is achieved as high as 73.33%on the synthetic ice channel dataset and 70.66%on the real ice channel dataset,and the processing speed can reach up to 14.58frames per second.

Magnetic resonance imaging of extraocular rectus muscles abnormalities in acute acquired concomitant esotropia

AIM:To investigate the difference of medial rectus(MR)and lateral rectus(LR)between acute acquired concomitant esotropia(AACE)and the healthy controls(HCs)detected by magnetic resonance imaging(MRI).METHODS:A case-control study.Eighteen subjects with AACE and eighteen HCs were enrolled.MRI scanning data were conducted in target-controlled central gaze with a 3-Tesla magnetic resonance scanner.Extraocular muscles(EOMs)were scanned in contiguous image planes 2-mm thick spanning the EOM origins to the globe equator.To form posterior partial volumes(PPVs),the LR and MR cross-sections in the image planes 8,10,12,and 14 mm posterior to the globe were summed and multiplied by the 2-mm slice thickness.The data were classified according to the right eye,left eye,dominant eye,and non-dominant eye,and the differences in mean cross-sectional area,maximum cross-sectional area,and PPVs of the MR and LR muscle in the AACE group and HCs group were compared under the above classifications respectively.RESULTS:There were no significant differences between the two groups of demographic characteristics.The mean cross-sectional area of the LR muscle was significantly greater in the AACE group than that in the HCs group in the non-dominant eyes(P=0.028).The maximum cross-sectional area of the LR muscle both in the dominant and non-dominant eye of the AACE group was significantly greater than the HCs group(P=0.009,P=0.016).For the dominant eye,the PPVs of the LR muscle were significantly greater in the AACE than that in the HCs group(P=0.013),but not in the MR muscle(P=0.698).CONCLUSION:The size and volume of muscles dominant eyes of AACE subjects change significantly to overcome binocular diplopia.The LR muscle become larger to compensate for the enhanced convergence in the AACE.

Estimation-free spatial-domain image reconstruction of structured illumination microscopy

Structured illumination microscopy(SIM)achieves super-resolution(SR)by modulating the high-frequency information of the sample into the passband of the optical system and subsequent image reconstruction.The traditional Wiener-filtering-based reconstruction algorithm operates in the Fourier domain,it requires prior knowledge of the sinusoidal illumination patterns which makes the time-consuming procedure of parameter estimation to raw datasets necessary,besides,the parameter estimation is sensitive to noise or aberration-induced pattern distortion which leads to reconstruction artifacts.Here,we propose a spatial-domain image reconstruction method that does not require parameter estimation but calculates patterns from raw datasets,and a reconstructed image can be obtained just by calculating the spatial covariance of differential calculated patterns and differential filtered datasets(the notch filtering operation is performed to the raw datasets for attenuating and compensating the optical transfer function(OTF)).Experiments on reconstructing raw datasets including nonbiological,biological,and simulated samples demonstrate that our method has SR capability,high reconstruction speed,and high robustness to aberration and noise.

Spatial-Aware Supervised Learning for Hyper-Spectral Image Classification Comprehensive Assessment

A comprehensive assessment of the spatial-aware supervised learning algorithms for hyper-spectral image(HSI)classification was presented.For this purpose,standard support vector machines(SVMs),multinomial logistic regression(MLR)and sparse representation(SR) based supervised learning algorithm were compared both theoretically and experimentally.Performance of the discussed techniques was evaluated in terms of overall accuracy,average accuracy,kappa statistic coefficients,and sparsity of the solutions.Execution time,the computational burden,and the capability of the methods were investigated by using probabilistic analysis.For validating the accuracy a classical benchmark AVIRIS Indian pines data set was used.Experiments show that integrating spectral-spatial context can further improve the accuracy,reduce the misclassification error although the cost of computational time will be increased.

Assessment of Cork Oak Decline Using Digital Multispectral Imagery in Relation with in Situ Crown Condition

Cork oak in Maamora forest is experiencing the dieback phenomenon. The evaluation of the latter in this forest has gained the importance over time and with the solicitation of managers to objectify its phytosanitary situation. Aiming at prioritizing management actions, remote sensing seems to be an effective tool to inquire about stands’ health conditions and their evolution. To this end, this study aims at mapping and validating health status of cork oak stands in Maamora. Sentinel 2 images in 2015 and 2020 were processed to calculate the differential normalized difference water index (NDWI), revealing vegetation moisture variation caused by drought. A statistical method based on thresholds was used to map cork oak dieback stands, those with no changes and those recovered. Results have shown that 54.63% of cork oak in Maamora forest have not changed in terms of phytosanitary situation between 2015 and 2020, 31.10% of oak stands are afflicted by a slight decline and 12.97% by a severe decline. Areas with slight or strong recovery remain minimal and represent 1.04% and 0.25% respectively. Ground data indicated that the map generated displayed a good distinction between stands severely and slightly declined with a global accuracy of 66.66%. Therefore, further research elaborating an advanced vegetation index reflecting the various factors of dieback would be of much importance.

Analysis of Remotely Sensed Imagery and Architecture Environment for Modelling 3D Detailed Buildings Using Geospatial Techniques

The use of three-dimensional maps is more effective than two-dimensional maps in representing the Earth’s surface. However, the traditional methods used to create digital surface models are not efficient for capturing the details of Earth’s features. This is because they represent only three-dimensional objects in a single texture and do not provide a realistic representation of the real world. Additionally, there is a growing demand for up-to-date and accurate geo-information, particularly in urban areas. To address this challenge, a new technique is proposed in this study that involves integrating remote sensing, Geographic Information System, and Architecture Environment software to generate a highly-detailed three-dimensional model. The method described in this study includes several steps such as acquiring high-resolution satellite imagery, gathering ground truth data, performing radiometric and geometric corrections during image preprocessing, producing a 2D map of the region of interest, constructing a digital surface model by extending the building outlines, and transforming the model into multi-patch layers to create a 3D model for each object individually. The research findings indicate that the digital surface model obtained with comprehensive information is suitable for different purposes, such as environmental research, urban development and expansion planning, and shape recognition tasks.

In vivo imaging reveals a synchronized correlation among neurotransmitter dynamics during propofol and sevoflurane anesthesia

General anesthesia is widely applied in clinical practice.However,the precise mechanism of loss of consciousness induced by general anesthetics remains unknown.Here,we measured the dynamics of five neurotransmitters,includingγ-aminobutyric acid,glutamate,norepinephrine,acetylcholine,and dopamine,in the medial prefrontal cortex and primary visual cortex of C57BL/6 mice through in vivo fiber photometry and genetically encoded neurotransmitter sensors under anesthesia to reveal the mechanism of general anesthesia from a neurotransmitter perspective.Results revealed that the concentrations of γ-aminobutyric acid,glutamate,norepinephrine,and acetylcholine increased in the cortex during propofol-induced loss of consciousness.Dopamine levels did not change following the hypnotic dose of propofol but increased significantly following surgical doses of propofol anesthesia.Notably,the concentrations of the five neurotransmitters generally decreased during sevoflurane-induced loss of consciousness.Furthermore,the neurotransmitter dynamic networks were not synchronized in the non-anesthesia groups but were highly synchronized in the anesthetic groups.These findings suggest that neurotransmitter dynamic network synchronization may cause anesthetic-induced loss of consciousness.

Intravascular photoacoustic and optical coherence tomography imaging dual-mode system for detecting spontaneous coronary artery dissection: A feasibility study

In this work,we present an intravascular dual-mode endoscopic system capable of both intravascular photoacoustic imaging(IVPAI)and intravascular optical coherence tomography(IVOCT)for recognizing spontaneous coronary artery dissection(SCAD)phantoms.IVPAI provides high-resolution and high-penetration images of intramural hematoma(IMH)at different depths,so it is especially useful for imaging deep blood clots associated with imaging phantoms.IVOCT can readily visualize the double-lumen morphology of blood vessel walls to identify intimal tears.We also demonstrate the capability of this dual-mode endoscopic system using mimicking phantoms and biological samples of blood clots in ex vivo porcine arteries.The results of the experiments indicate that the combined IVPAI and IVOCT technique has the potential to provide a more accurate SCAD assessment method for clinical applications.

Exploring the spatiotemporal relationship between green infrastructure and urban heat island under multi‐source remote sensing imagery:A case study of Fuzhou City

Green Infrastructure(GI)has garnered increasing attention from various regions due to its potential to mitigate urban heat island(UHI),which has been exacerbated by global climate change.This study focuses on the central area of Fuzhou city,one of the“furnace”cities,and aims to explore the correlation between the GI pattern and land surface temperature(LST)in the spring and autumn seasons.The research adopts a multiscale approach,starting from the urban scale and using urban geographic spatial characteristics,multispectral remote sensing data,and morphological spatial pattern analysis(MSPA).Significant MSPA elements were tested and combined with LST to conduct a geographic weighted regression(GWR)experiment.The findings reveal that the UHI in the central area of Fuzhou city has a spatial characteristic of“high temperature in the middle and low temperature around,”which is coupled with a“central scattered and peripheral concentrated”distribution of GI.This suggests that remote sensing data can effectively be utilised for UHI inversion.Additionally,the study finds that the complexity of GI,whether from the perspective of the overall GI pattern or the classification study based on the proportion of the core area,has an impact on the alleviation of UHI in both seasons.In conclusion,this study underscores the importance of a reasonable layout of urban green infrastructure for mitigating UHI.