Unified deep learning model for predicting fundus fluorescein angiography image from fundus structure image

The prediction of fundus fluorescein angiography(FFA)images from fundus structural images is a cutting-edge research topic in ophthalmological image processing.Prediction comprises estimating FFA from fundus camera imaging,single-phase FFA from scanning laser ophthalmoscopy(SLO),and three-phase FFA also from SLO.Although many deep learning models are available,a single model can only perform one or two of these prediction tasks.To accomplish three prediction tasks using a unified method,we propose a unified deep learning model for predicting FFA images from fundus structure images using a supervised generative adversarial network.The three prediction tasks are processed as follows:data preparation,network training under FFA supervision,and FFA image prediction from fundus structure images on a test set.By comparing the FFA images predicted by our model,pix2pix,and CycleGAN,we demonstrate the remarkable progress achieved by our proposal.The high performance of our model is validated in terms of the peak signal-to-noise ratio,structural similarity index,and mean squared error.

In vivo quantification of human aqueous veins by enhanced depth imaging optical coherence tomography and optical coherence tomography angiography images

AIM:To investigate the aqueous vein in vivo by using enhanced depth imaging optical coherence tomography(EDI-OCT)and optical coherence tomography angiography(OCTA).METHODS:In this cross-sectional comparative study,30 healthy participants were enrolled.Images of the aqueous and conjunctival veins were captured by EDI-OCT and OCTA before and after water loading.The area,height,width,location depth and blood flow of the aqueous vein and conjunctival vein were measured by Image J software.RESULTS:In the static state,the area of the aqueous vein was 8166.7±3272.7μm^(2),which was smaller than that of the conjunctival vein(13690±7457μm^(2),P<0.001).The mean blood flow density of the aqueous vein was 35.3%±12.6%,which was significantly less than that of the conjunctival vein(51.5%±10.6%,P<0.001).After water loading,the area of the aqueous vein decreased significantly from 8725.8±779.4μm^(2)(baseline)to 7005.2±566.2μm^(2)at 45min but rose to 7863.0±703.2μm^(2)at 60min(P=0.032).The blood flow density of the aqueous vein decreased significantly from 41.2%±4.5%(baseline)to 35.4%±3.2%at 30min but returned to 45.6%±3.6%at 60min(P=0.021).CONCLUSION:The structure and blood flow density of the aqueous vein can be effectively evaluated by OCT and OCTA.These may become biological indicators to evaluate aqueous vein changes and aqueous outflow resistance under different interventions in glaucoma patients.

Dendritic Learning-Incorporated Vision Transformer for Image Recognition

Dear Editor,This letter proposes to integrate dendritic learnable network architecture with Vision Transformer to improve the accuracy of image recognition.In this study,based on the theory of dendritic neurons in neuroscience,we design a network that is more practical for engineering to classify visual features.Based on this,we propose a dendritic learning-incorporated vision Transformer(DVT),which out-performs other state-of-the-art methods on three image recognition benchmarks.

The Soft X-ray Imager(SXI)on the SMILE Mission

The Soft X-ray Imager(SXI)is part of the scientific payload of the Solar wind Magnetosphere Ionosphere Link Explorer(SMILE)mission.SMILE is a joint science mission between the European Space Agency(ESA)and the Chinese Academy of Sciences(CAS)and is due for launch in 2025.SXI is a compact X-ray telescope with a wide field-of-view(FOV)capable of encompassing large portions of Earth’s magnetosphere from the vantage point of the SMILE orbit.SXI is sensitive to the soft X-rays produced by the Solar Wind Charge eXchange(SWCX)process produced when heavy ions of solar wind origin interact with neutral particles in Earth’s exosphere.SWCX provides a mechanism for boundary detection within the magnetosphere,such as the position of Earth’s magnetopause,because the solar wind heavy ions have a very low density in regions of closed magnetic field lines.The sensitivity of the SXI is such that it can potentially track movements of the magnetopause on timescales of a few minutes and the orbit of SMILE will enable such movements to be tracked for segments lasting many hours.SXI is led by the University of Leicester in the United Kingdom(UK)with collaborating organisations on hardware,software and science support within the UK,Europe,China and the United States.

Background removal from global auroral images:Data-driven dayglow modeling

Global images of auroras obtained by cameras on spacecraft are a key tool for studying the near-Earth environment.However,the cameras are sensitive not only to auroral emissions produced by precipitating particles,but also to dayglow emissions produced by photoelectrons induced by sunlight.Nightglow emissions and scattered sunlight can contribute to the background signal.To fully utilize such images in space science,background contamination must be removed to isolate the auroral signal.Here we outline a data-driven approach to modeling the background intensity in multiple images by formulating linear inverse problems based on B-splines and spherical harmonics.The approach is robust,flexible,and iteratively deselects outliers,such as auroral emissions.The final model is smooth across the terminator and accounts for slow temporal variations and large-scale asymmetries in the dayglow.We demonstrate the model by using the three far ultraviolet cameras on the Imager for Magnetopause-to-Aurora Global Exploration(IMAGE)mission.The method can be applied to historical missions and is relevant for upcoming missions,such as the Solar wind Magnetosphere Ionosphere Link Explorer(SMILE)mission.

Using restored two-dimensional X-ray images to reconstruct the three-dimensional magnetopause

Astronomical imaging technologies are basic tools for the exploration of the universe,providing basic data for the research of astronomy and space physics.The Soft X-ray Imager(SXI)carried by the Solar wind Magnetosphere Ionosphere Link Explorer(SMILE)aims to capture two-dimensional(2-D)images of the Earth’s magnetosheath by using soft X-ray imaging.However,the observed 2-D images are affected by many noise factors,destroying the contained information,which is not conducive to the subsequent reconstruction of the three-dimensional(3-D)structure of the magnetopause.The analysis of SXI-simulated observation images shows that such damage cannot be evaluated with traditional restoration models.This makes it difficult to establish the mapping relationship between SXIsimulated observation images and target images by using mathematical models.We propose an image restoration algorithm for SXIsimulated observation images that can recover large-scale structure information on the magnetosphere.The idea is to train a patch estimator by selecting noise–clean patch pairs with the same distribution through the Classification–Expectation Maximization algorithm to achieve the restoration estimation of the SXI-simulated observation image,whose mapping relationship with the target image is established by the patch estimator.The Classification–Expectation Maximization algorithm is used to select multiple patch clusters with the same distribution and then train different patch estimators so as to improve the accuracy of the estimator.Experimental results showed that our image restoration algorithm is superior to other classical image restoration algorithms in the SXI-simulated observation image restoration task,according to the peak signal-to-noise ratio and structural similarity.The restoration results of SXI-simulated observation images are used in the tangent fitting approach and the computed tomography approach toward magnetospheric reconstruction techniques,significantly improving the reconstruction results.Hence,the proposed technology may be feasible for processing SXI-simulated observation images.

SMILE soft X-ray Imager flight model CCD370 pre-flight device characterisation

Throughout the SMILE mission the satellite will be bombarded by radiation which gradually damages the focal plane devices and degrades their performance.In order to understand the changes of the CCD370s within the soft X-ray Imager,an initial characterisation of the devices has been carried out to give a baseline performance level.Three CCDs have been characterised,the two flight devices and the flight spa re.This has been carried out at the Open University in a bespo ke cleanroom measure ment facility.The results show that there is a cluster of bright pixels in the flight spa re which increases in size with tempe rature.However at the nominal ope rating tempe rature(-120℃) it is within the procure ment specifications.Overall,the devices meet the specifications when ope rating at -120℃ in 6 × 6 binned frame transfer science mode.The se rial charge transfer inefficiency degrades with temperature in full frame mode.However any charge losses are recovered when binning/frame transfer is implemented.

Two-Staged Method for Ice Channel Identification Based on Image Segmentation and Corner Point Regression

Identification of the ice channel is the basic technology for developing intelligent ships in ice-covered waters,which is important to ensure the safety and economy of navigation.In the Arctic,merchant ships with low ice class often navigate in channels opened up by icebreakers.Navigation in the ice channel often depends on good maneuverability skills and abundant experience from the captain to a large extent.The ship may get stuck if steered into ice fields off the channel.Under this circumstance,it is very important to study how to identify the boundary lines of ice channels with a reliable method.In this paper,a two-staged ice channel identification method is developed based on image segmentation and corner point regression.The first stage employs the image segmentation method to extract channel regions.In the second stage,an intelligent corner regression network is proposed to extract the channel boundary lines from the channel region.A non-intelligent angle-based filtering and clustering method is proposed and compared with corner point regression network.The training and evaluation of the segmentation method and corner regression network are carried out on the synthetic and real ice channel dataset.The evaluation results show that the accuracy of the method using the corner point regression network in the second stage is achieved as high as 73.33%on the synthetic ice channel dataset and 70.66%on the real ice channel dataset,and the processing speed can reach up to 14.58frames per second.

Estimation-free spatial-domain image reconstruction of structured illumination microscopy

Structured illumination microscopy(SIM)achieves super-resolution(SR)by modulating the high-frequency information of the sample into the passband of the optical system and subsequent image reconstruction.The traditional Wiener-filtering-based reconstruction algorithm operates in the Fourier domain,it requires prior knowledge of the sinusoidal illumination patterns which makes the time-consuming procedure of parameter estimation to raw datasets necessary,besides,the parameter estimation is sensitive to noise or aberration-induced pattern distortion which leads to reconstruction artifacts.Here,we propose a spatial-domain image reconstruction method that does not require parameter estimation but calculates patterns from raw datasets,and a reconstructed image can be obtained just by calculating the spatial covariance of differential calculated patterns and differential filtered datasets(the notch filtering operation is performed to the raw datasets for attenuating and compensating the optical transfer function(OTF)).Experiments on reconstructing raw datasets including nonbiological,biological,and simulated samples demonstrate that our method has SR capability,high reconstruction speed,and high robustness to aberration and noise.

Automatic diagnosis of diabetic retinopathy using vision transformer based on wide-field optical coherence tomography angiography

Diabetic retinopathy(DR)is one of the major causes of visual impairment in adults with diabetes.Optical coherence tomography angiography(OCTA)is nowadays widely used as the golden criterion for diagnosing DR.Recently,wide-field OCTA(WF-OCTA)provided more abundant information including that of the peripheral retinal degenerative changes and it can contribute in accurately diagnosing DR.The need for an automatic DR diagnostic system based on WF-OCTA pictures attracts more and more attention due to the large diabetic population and the prevalence of retinopathy cases.In this study,automatic diagnosis of DR using vision transformer was performed using WF-OCTA images(12 mm×12 mm single-scan)centered on the fovea as the dataset.WF-OCTA images were automatically classified into four classes:No DR,mild nonproliferative diabetic retinopathy(NPDR),moderate to severe NPDR,and proliferative diabetic retinopathy(PDR).The proposed method for detecting DR on the test set achieves accuracy of 99.55%,sensitivity of 99.49%,and specificity of 99.57%.The accuracy of the method for DR staging reaches up to 99.20%,which has been proven to be higher than that attained by classical convolutional neural network models.Results show that the automatic diagnosis of DR based on vision transformer and WF-OCTA pictures is more effective for detecting and staging DR.

Epidemiological, Clinical and Coronary Angiography Aspects of Acute Coronary Syndrome in the Cardiology Department of the Hospital Mother-Child “Le Luxembourg”Mali

Introduction: Cardiac catheterisation plays a fundamental role in the management of acute coronary syndrome. These explorations require heavy, complex and costly equipment and a large team of doctors, nurses and technicians with highly specialized training. Aims: To describe epidemiological, clinical and coronary angiography aspects of patients with acute coronary syndrome. Patients and Methods: Descriptive study from September 2019 to December 2023 in the Cardiology Department of the Hôpital Mère-Enfant of Bamako. Inclusion criteria were patients admitted for coronary angiography with the diagnosis of acute coronary syndrome. Results: During the study period, 1253 patients underwent coronary angiography, 596 of whom had acute coronary syndrome as an indication, representing a hospital frequency of 47%. Sex-ratio was 2.10. Mean age of patients was 58.5 ± 11.39 years. ST elevation acute coronary syndrome was the most common indication with 63.92% of cases. High blood pressure was the main cardiovascular risk factor with 58.7% of cases, and radial access approach was used in 98% of cases. Coronary angiography was pathological in 91.70% of cases (n = 548). Patients with lesions of anterior interventricular artery were 73.73% of cases. Tritruncal lesions accounted for 40.63% of cases. Conclusion: ST elevation acute coronary syndrome is the most frequent manifestation of acute coronary syndrome. Anterior interventricular artery is most often the culprit lesion for our patients.

Design and performance evaluation of a large field-of-view dual-particle time-encoded imager based on a depth-of-interaction detector

Time-encoded imaging is useful for identifying potential special nuclear materials and other radioactive sources at a distance.In this study,a large field-of-view time-encoded imager was developed for gamma-ray and neutron source hotspot imaging based on a depth-of-interaction(DOI)detector.The imager primarily consists of a DOI detector system and a rotary dual-layer cylindrical coded mask.An EJ276 plastic scintillator coupled with two SiPMs was designed as the DOI detector to increase the field of view and improve the imager performance.The difference in signal time at both ends and the log of the signal amplitude ratio were used to calculate the interaction position resolution.The position resolution of the DOI detector was calibrated using a collimated Cs-137 source,and the full width at half maximum of the reconstruction position of the Gaussian fitting curve was approximately 4.4 cm.The DOI detector can be arbitrarily divided into several units to independently reconstruct the source distribution images.The unit length was optimized via Am-Be source-location experiments.A multidetector filtering method is proposed for image denoising.This method can effectively reduce image noise caused by poor DOI detector position resolution.The vertical field of view of the imager was(-55°,55°)when the detector was placed in the center of the coded mask.A DT neutron source at 20 m standoff could be located within 2400 s with an angular resolution of 3.5°.

Extravasated contrast volumetric assessment on computed tomography angiography in gastrointestinal bleeding:A useful predictor of positive angiographic findings

BACKGROUND Gastrointestinal bleeding(GIB)is a severe and potentially life-threatening condition,especially in cases of delayed treatment.Computed tomography angiography(CTA)plays a pivotal role in the early identification of upper and lower GIB and in the prompt treatment of the haemorrhage.AIM To determine whether a volumetric estimation of the extravasated contrast at CTA in GIB may be a predictor of subsequent positive angiographic findings.METHODS In this retrospective single-centre study,35 patients(22 men;median age 69 years;range 16-92 years)admitted to our institution for active GIB detected at CTA and further submitted to catheter angiography between January 2018 and February 2022 were enrolled.Twenty-three(65.7%)patients underwent endoscopy before CTA.Bleeding volumetry was evaluated in both arterial and venous phases via a semi-automated dedicated software.Bleeding rate was obtained from volume change between the two phases and standardised for unit time.Patients were divided into two groups,according to the angiographic signs and their concordance with CTA.RESULTS Upper bleeding accounted for 42.9%and lower GIB for 57.1%.Mean haemoglobin value at the admission was 7.7 g/dL.A concordance between positive CTA and direct angiographic bleeding signs was found in 19(54.3%)cases.Despite no significant differences in terms of bleeding volume in the arterial phase(0.55 mL vs 0.33 mL,P=0.35),a statistically significant volume increase in the venous phase was identified in the group of patients with positive angiography(2.06 mL vs 0.9 mL,P=0.02).In the latter patient group,a significant increase in bleeding rate was also detected(2.18 mL/min vs 0.19 mL/min,P=0.02).CONCLUSION In GIB of any origin,extravasated contrast volumetric analysis at CTA could be a predictor of positive angiography and may help in avoiding further unnecessary procedures.

Infrared and Visible Image Fusion Based on Res2Net-Transformer Automatic Encoding and Decoding

A novel image fusion network framework with an autonomous encoder and decoder is suggested to increase thevisual impression of fused images by improving the quality of infrared and visible light picture fusion. The networkcomprises an encoder module, fusion layer, decoder module, and edge improvementmodule. The encoder moduleutilizes an enhanced Inception module for shallow feature extraction, then combines Res2Net and Transformerto achieve deep-level co-extraction of local and global features from the original picture. An edge enhancementmodule (EEM) is created to extract significant edge features. A modal maximum difference fusion strategy isintroduced to enhance the adaptive representation of information in various regions of the source image, therebyenhancing the contrast of the fused image. The encoder and the EEM module extract features, which are thencombined in the fusion layer to create a fused picture using the decoder. Three datasets were chosen to test thealgorithmproposed in this paper. The results of the experiments demonstrate that the network effectively preservesbackground and detail information in both infrared and visible images, yielding superior outcomes in subjectiveand objective evaluations.

Coronary Artery Patterns in Diabetic Patients Undergoing Diagnostic Coronary Angiography-Data from a Major Cardiac Center in Yemen

Background: Diabetes mellitus (DM) is independently associated with an increased risk of cardiovascular mortality and morbidity, including coronary artery disease (CAD). CAD is a shared burden disease and the leading cause of death in developed and developing countries. We aimed to assess the angiographic patterns of coronary arteries in patients with DM in a developing country (Yemen) as the first study. Methods: This study is a cross-sectional, prospective, observational study that includes a total of 250 patients who were admitted for elective diagnostic coronary angiography. Results: 96 (38.4%) patients were diabetics;68% were male;mean age was 57 ± 11 years. The incidence of three-vessel disease was 31.2% of patients. Considering the severity of lumen occlusion, (11.2%) of patients had non-significant lesions, (37.6%) of patients had significant lesions, and (32%) had total occlusive lesions. Lesions were of LAD in 76%, RCA in 60%, and LCX in 52% of the population. Among diabetics, two and 3-vessel diseases (33.3% vs. 20.8% & 50% vs. 19.5%, P = 0.001), left main lesion (10.4% vs. 2.6%, P = 0.012), significant stenosis (41.7% vs. 35.1%, P = 0.032), total occlusion of coronary arteries (43.8% vs. 19.5%, P = 0.032) and type C lesion (66.7% vs. 35.1%, P = 0.010) were more frequent than non-DM patients. Conclusion: The burden of significant and severe coronary lesions is more common among DM, which may be the major cause of morbidity and mortality of DM in developing countries.

The diagnostic yield for computed tomography pulmonary angiography in patients with anticoagulation

BACKGROUND:Patients who present to the emergency department(ED)for suspected pulmonary embolism(PE)are often on active oral anticoagulation(AC).However,the diagnostic yield of computed tomography pulmonary angiography(CTPA)in screening for PE in patients who present on AC has not been well characterized.We aim to investigate the diagnostic yield of CTPA in diagnosing PE depending on AC status.METHODS:We reviewed and analyzed the electronic medical records of patients who underwent CTPA for PE at a university hospital ED from June 1,2019,to March 25,2022.Primary outcome was the incidence of PE on CTPA depending on baseline AC status and indication for AC.RESULTS:Of 2,846 patients,242 were on AC for a history of venous thromboembolism(VTE),210 were on AC for other indications,and 2,394 were not on AC.The incidence of PE on CTPA was significantly lower in patients on AC for other indications(5.7%)when compared to patients on AC for prior VTE(24.3%)and patients not on AC at presentation(9.8%)(P<0.001).In multivariable analysis among the whole cohort,AC was associated with a positive CTPA(odds ratio[OR]0.26,95%confidence interval[CI]:0.15-0.45,P<0.001).CONCLUSION:The incidence of PE among patients undergoing CTPA in the ED is lower in patients previously on AC for indications other than VTE when compared to those not on AC or those on AC for history of VTE.AC status and indication for AC may affect pre-test probability of a positive CTPA,and AC status therefore warrants consideration as part of future diagnostic algorithms among patients with suspected PE.

A Systematic Literature Review of Machine Learning and Deep Learning Approaches for Spectral Image Classification in Agricultural Applications Using Aerial Photography

Recently,there has been a notable surge of interest in scientific research regarding spectral images.The potential of these images to revolutionize the digital photography industry,like aerial photography through Unmanned Aerial Vehicles(UAVs),has captured considerable attention.One encouraging aspect is their combination with machine learning and deep learning algorithms,which have demonstrated remarkable outcomes in image classification.As a result of this powerful amalgamation,the adoption of spectral images has experienced exponential growth across various domains,with agriculture being one of the prominent beneficiaries.This paper presents an extensive survey encompassing multispectral and hyperspectral images,focusing on their applications for classification challenges in diverse agricultural areas,including plants,grains,fruits,and vegetables.By meticulously examining primary studies,we delve into the specific agricultural domains where multispectral and hyperspectral images have found practical use.Additionally,our attention is directed towards utilizing machine learning techniques for effectively classifying hyperspectral images within the agricultural context.The findings of our investigation reveal that deep learning and support vector machines have emerged as widely employed methods for hyperspectral image classification in agriculture.Nevertheless,we also shed light on the various issues and limitations of working with spectral images.This comprehensive analysis aims to provide valuable insights into the current state of spectral imaging in agriculture and its potential for future advancements.

Performance optimization of the neutron-sensitive image intensifier used in neutron imaging

As a non-destructive testing technology,neutron imaging plays an important role in various fields,including material science,nuclear engineering,and fundamental science.An imaging detector with a neutron-sensitive image intensifier has been developed and demonstrated to achieve good spatial resolution and timing resolution.However,the influence of the working voltage on the performance of the neutron-sensitive imaging intensifier has not been studied.To optimize the performance of the neutron-sensitive image intensifier at different voltages,experiments have been performed at the China Spallation Neutron Source(CSNS)neutron beamline.The change in the light yield and imaging quality with different voltages has been acquired.It is shown that the image quality benefits from the high gain of the microchannel plate(MCP)and the high accelerating electric field between the MCP and the screen.Increasing the accelerating electric field is more effective than increasing the gain of MCPs for the improvement of the imaging quality.Increasing the total gain of the MCP stack can be realized more effectively by improving the gain of the standard MCP than that of the n MCP.These results offer a development direction for image intensifiers in the future.

Color Image Compression and Encryption Algorithm Based on 2D Compressed Sensing and Hyperchaotic System

With the advent of the information security era,it is necessary to guarantee the privacy,accuracy,and dependable transfer of pictures.This study presents a new approach to the encryption and compression of color images.It is predicated on 2D compressed sensing(CS)and the hyperchaotic system.First,an optimized Arnold scrambling algorithm is applied to the initial color images to ensure strong security.Then,the processed images are con-currently encrypted and compressed using 2D CS.Among them,chaotic sequences replace traditional random measurement matrices to increase the system’s security.Third,the processed images are re-encrypted using a combination of permutation and diffusion algorithms.In addition,the 2D projected gradient with an embedding decryption(2DPG-ED)algorithm is used to reconstruct images.Compared with the traditional reconstruction algorithm,the 2DPG-ED algorithm can improve security and reduce computational complexity.Furthermore,it has better robustness.The experimental outcome and the performance analysis indicate that this algorithm can withstand malicious attacks and prove the method is effective.

Integer multiple quantum image scaling based on NEQR and bicubic interpolation

As a branch of quantum image processing,quantum image scaling has been widely studied.However,most of the existing quantum image scaling algorithms are based on nearest-neighbor interpolation and bilinear interpolation,the quantum version of bicubic interpolation has not yet been studied.In this work,we present the first quantum image scaling scheme for bicubic interpolation based on the novel enhanced quantum representation(NEQR).Our scheme can realize synchronous enlargement and reduction of the image with the size of 2^(n)×2^(n) by integral multiple.Firstly,the image is represented by NEQR and the original image coordinates are obtained through multiple CNOT modules.Then,16 neighborhood pixels are obtained by quantum operation circuits,and the corresponding weights of these pixels are calculated by quantum arithmetic modules.Finally,a quantum matrix operation,instead of a classical convolution operation,is used to realize the sum of convolution of these pixels.Through simulation experiments and complexity analysis,we demonstrate that our scheme achieves exponential speedup over the classical bicubic interpolation algorithm,and has better effect than the quantum version of bilinear interpolation.