Unsupervised multi-modal image translation based on the squeeze-and-excitation mechanism and feature attention module

The unsupervised multi-modal image translation is an emerging domain of computer vision whose goal is to transform an image from the source domain into many diverse styles in the target domain.However,the multi-generator mechanism is employed among the advanced approaches available to model different domain mappings,which results in inefficient training of neural networks and pattern collapse,leading to inefficient generation of image diversity.To address this issue,this paper introduces a multi-modal unsupervised image translation framework that uses a generator to perform multi-modal image translation.Specifically,firstly,the domain code is introduced in this paper to explicitly control the different generation tasks.Secondly,this paper brings in the squeeze-and-excitation(SE)mechanism and feature attention(FA)module.Finally,the model integrates multiple optimization objectives to ensure efficient multi-modal translation.This paper performs qualitative and quantitative experiments on multiple non-paired benchmark image translation datasets while demonstrating the benefits of the proposed method over existing technologies.Overall,experimental results have shown that the proposed method is versatile and scalable.

A synthetic diagnostics platform for microwave imaging diagnostics in tokamaks

Interpreting experimental diagnostics data in tokamaks,while considering non-ideal effects,is challenging due to the complexity of plasmas.To address this challenge,a general synthetic diagnostics(GSD)platform has been established that facilitates microwave imaging reflectometry and electron cyclotron emission imaging.This platform utilizes plasma profiles as input and incorporates the finite-difference time domain,ray tracing and the radiative transfer equation to calculate the propagation of plasma spontaneous radiation and the external electromagnetic field in plasmas.Benchmark tests for classical cases have been conducted to verify the accuracy of every core module in the GSD platform.Finally,2D imaging of a typical electron temperature distribution is reproduced by this platform and the results are consistent with the given real experimental data.This platform also has the potential to be extended to 3D electromagnetic field simulations and other microwave diagnostics such as cross-polarization scattering.

Self-confocal NIR-II fluorescence microscopy for multifunctional in vivo imaging

Fluorescence imaging in the second near-infrared window(NIR-II,900–1880 nm)with less scattering background in biological tissues has been combined with the confocal microscopic system for achieving deep in vivo imaging with high spatial resolution.However,the traditional NIR-IIfluorescence confocal microscope with separate excitation focus and detection pinhole makes it possess low confocal e±ciency,as well as di±cultly to adjust.Two types of upgraded NIR-IIfluorescence confocal microscopes,sharing the same pinhole by excitation and emission focus,leading to higher confocal e±ciency,are built in this work.One type is-ber-pinhole-based confocal microscope applicable to CW laser excitation.It is constructed forfluorescence intensity imaging with large depth,high stabilization and low cost,which could replace multiphotonfluorescence microscopy in some applications(e.g.,cerebrovascular and hepatocellular imaging).The other type is air-pinhole-based confocal microscope applicable to femtosecond(fs)laser excitation.It can be employed not only for NIR-IIfluorescence intensity imaging,but also for multi-channelfluorescence lifetime imaging to recognize different structures with similarfluorescence spectrum.Moreover,it can be facilely combined with multiphotonfluorescence microscopy.A single fs pulsed laser is utilized to achieve up-conversion(visible multiphotonfluorescence)and down-conversion(NIR-II one-photonfluorescence)excitation simultaneously,extending imaging spectral channels,and thus facilitates multi-structure and multi-functional observation.

Microwave-induced thermoacoustic elastic imaging:A simulation study

Microwave-induced thermoacoustic imaging(MTI)has the advantages of high resolution,high contrast,non-ionization,and non-invasive.Recently,MTI was used in the¯eld of breast cancer screening.In this paper,based on the¯nite element method(FEM)and COMSOL Multiphysics software,a three-dimensional breast cancer model suitable for exploring the MTI process is proposed to investigate the in°uence of Young's modulus(YM)of breast cancer tissue on MTI.It is found that the process of electromagnetic heating and initial pressure generation of the entire breast tissue is earlier in time than the thermal expansion process.Besides,compared with normal breast tissue,tumor tissue has a greater temperature rise,displacement,and pressure rise.In particular,YM of the tumor is related to the speed of thermal expansion.In particular,the larger the YM of the tumor is,the higher the heating and contraction frequency is,and the greater the maximum pressure is.Di®erent Young's moduli correspond to di®erent thermoacoustic signal spectra.In MTI,this study can be used to judge di®erent degrees of breast cancer based on elastic imaging.In addition,this study is helpful in exploring the possibility of microwave-induced thermoacoustic elastic imaging(MTAE).

Efficient single-pixel imaging encrypted transmission based on 3D Arnold transformation

Single-pixel imaging(SPI)can transform 2D or 3D image data into 1D light signals,which offers promising prospects for image compression and transmission.However,during data communication these light signals in public channels will easily draw the attention of eavesdroppers.Here,we introduce an efficient encryption method for SPI data transmission that uses the 3D Arnold transformation to directly disrupt 1D single-pixel light signals and utilizes the elliptic curve encryption algorithm for key transmission.This encryption scheme immediately employs Hadamard patterns to illuminate the scene and then utilizes the 3D Arnold transformation to permutate the 1D light signal of single-pixel detection.Then the transformation parameters serve as the secret key,while the security of key exchange is guaranteed by an elliptic curve-based key exchange mechanism.Compared with existing encryption schemes,both computer simulations and optical experiments have been conducted to demonstrate that the proposed technique not only enhances the security of encryption but also eliminates the need for complicated pattern scrambling rules.Additionally,this approach solves the problem of secure key transmission,thus ensuring the security of information and the quality of the decrypted images.

Topic highlight on texture and color enhancement imaging in gastrointestinal diseases

Olympus Corporation developed texture and color enhancement imaging(TXI)as a novel image-enhancing endoscopic technique.This topic highlights a series of hot-topic articles that investigated the efficacy of TXI for gastrointestinal disease identification in the clinical setting.A randomized controlled trial demonstrated improvements in the colorectal adenoma detection rate(ADR)and the mean number of adenomas per procedure(MAP)of TXI compared with those of white-light imaging(WLI)observation(58.7%vs 42.7%,adjusted relative risk 1.35,95%CI:1.17-1.56;1.36 vs 0.89,adjusted incident risk ratio 1.48,95%CI:1.22-1.80,respectively).A cross-over study also showed that the colorectal MAP and ADR in TXI were higher than those in WLI(1.5 vs 1.0,adjusted odds ratio 1.4,95%CI:1.2-1.6;58.2%vs 46.8%,1.5,1.0-2.3,respectively).A randomized controlled trial demonstrated non-inferiority of TXI to narrow-band imaging in the colorectal mean number of adenomas and sessile serrated lesions per procedure(0.29 vs 0.30,difference for non-inferiority-0.01,95%CI:-0.10 to 0.08).A cohort study found that scoring for ulcerative colitis severity using TXI could predict relapse of ulcerative colitis.A cross-sectional study found that TXI improved the gastric cancer detection rate compared to WLI(0.71%vs 0.29%).A cross-sectional study revealed that the sensitivity and accuracy for active Helicobacter pylori gastritis in TXI were higher than those of WLI(69.2%vs 52.5%and 85.3%vs 78.7%,res-pectively).In conclusion,TXI can improve gastrointestinal lesion detection and qualitative diagnosis.Therefore,further studies on the efficacy of TXI in clinical practice are required.

Fake News Detection Based on Text-Modal Dominance and Fusing Multiple Multi-Model Clues

In recent years,how to efficiently and accurately identify multi-model fake news has become more challenging.First,multi-model data provides more evidence but not all are equally important.Secondly,social structure information has proven to be effective in fake news detection and how to combine it while reducing the noise information is critical.Unfortunately,existing approaches fail to handle these problems.This paper proposes a multi-model fake news detection framework based on Tex-modal Dominance and fusing Multiple Multi-model Cues(TD-MMC),which utilizes three valuable multi-model clues:text-model importance,text-image complementary,and text-image inconsistency.TD-MMC is dominated by textural content and assisted by image information while using social network information to enhance text representation.To reduce the irrelevant social structure’s information interference,we use a unidirectional cross-modal attention mechanism to selectively learn the social structure’s features.A cross-modal attention mechanism is adopted to obtain text-image cross-modal features while retaining textual features to reduce the loss of important information.In addition,TD-MMC employs a new multi-model loss to improve the model’s generalization ability.Extensive experiments have been conducted on two public real-world English and Chinese datasets,and the results show that our proposed model outperforms the state-of-the-art methods on classification evaluation metrics.

Five-view three-dimensional reconstructionfor ultrafast dynamic imaging of pulsedradiation sources

Multiaxial neutron/x-ray imaging and three-dimensional (3D) reconstruction techniques play a crucial role in gaining valuable insights intothe generation and evolution mechanisms of pulsed radiation sources. Owing to the short emission time (∼200 ns) and drastic changes of thepulsed radiation source, it is necessary to acquire projection data within a few nanoseconds in order to achieve clear computed tomography3D imaging. As a consequence, projection data that can be used for computed tomography image reconstruction at a certain moment are oftenavailable for only a few angles. Traditional algorithms employed in the process of reconstructing 3D images with extremely incomplete datamay introduce significant distortions and artifacts into the final image. In this paper, we propose an iterative image reconstruction methodusing cylindrical harmonic decomposition and a self-supervised denoising network algorithm based on the deep image prior method. Weaugment the prior information with a 2D total variation prior and a 3D deep image prior. Single-wire Z-pinch imaging experiments have beencarried out at Qin-1 facility in five views and four frames, with a time resolution of 3 ns for each frame and a time interval of 40 ns betweenadjacent frames. Both numerical simulations and experiments verify that our proposed algorithm can achieve high-quality reconstructionresults and obtain the 3D intensity distribution and evolution of extreme ultraviolet and soft x-ray emission from plasma.

Investigating the relationship between intracranial atherosclerotic plaque remodelling and diabetes using high-resolution vessel wall imaging

BACKGROUND Intracranial atherosclerosis,a leading cause of stroke,involves arterial plaque formation.This study explores the link between plaque remodelling patterns and diabetes using high-resolution vessel wall imaging(HR-VWI).AIM To investigate the factors of intracranial atherosclerotic remodelling patterns and the relationship between intracranial atherosclerotic remodelling and diabetes mellitus using HR-VWI.METHODS Ninety-four patients diagnosed with middle cerebral artery or basilar artery INTRODUCTION Intracranial atherosclerotic disease is one of the main causes of ischaemic stroke in the world,accounting for approx-imately 10%of transient ischaemic attacks and 30%-50%of ischaemic strokes[1].It is the most common factor among Asian people[2].The adaptive changes in the structure and function of blood vessels that can adapt to changes in the internal and external environment are called vascular remodelling,which is a common and important pathological mechanism in atherosclerotic diseases,and the remodelling mode of atherosclerotic plaques is closely related to the occurrence of stroke.Positive remodelling(PR)is an outwards compensatory remodelling where the arterial wall grows outwards in an attempt to maintain a constant lumen diameter.For a long time,it was believed that the degree of stenosis can accurately reflect the risk of ischaemic stroke[3-5].Previous studies have revealed that lesions without significant luminal stenosis can also lead to acute events[6,7],as summarized in a recent meta-analysis study in which approximately 50%of acute/subacute ischaemic events were due to this type of lesion[6].Research[8,9]has pointed out that the PR of plaques is more dangerous and more likely to cause acute ischaemic stroke.Previous studies[10-13]have found that there are specific vascular remodelling phenomena in the coronary and carotid arteries of diabetic patients.However,due to the deep location and small lumen of intracranial arteries and limitations of imaging techniques,the relationship between intracranial arterial remodelling and diabetes is still unclear.In recent years,with the development of magnetic resonance technology and the emergence of high-resolution(HR)vascular wall imaging,a clear and multidimensional display of the intracranial vascular wall has been achieved.Therefore,in this study,HR wall imaging(HR-VWI)was used to display the remodelling characteristics of bilateral middle cerebral arteries and basilar arteries and to explore the factors of intracranial vascular remodelling and its relationship with diabetes.

Activatable fluorescent probes for imaging and diagnosis of rheumatoid arthritis

Rheumatoid arthritis(RA)is a systemic autoimmune disease that is primarily manifested as synovitis and polyarticular opacity and typically leads to serious joint damage and irreversible disability,thus adversely affecting locomotion ability and life quality.Consequently,good prognosis heavily relies on the early diagnosis and effective therapeutic monitoring of RA.Activatable fluorescent probes play vital roles in the detection and imaging of biomarkers for disease diagnosis and in vivo imaging.Herein,we review the fluorescent probes developed for the detection and imaging of RA biomarkers,namely reactive oxygen/nitrogen species(hypochlorous acid,peroxynitrite,hydroxyl radical,nitroxyl),pH,and cysteine,and address the related challenges and prospects to inspire the design of novel fluorescent probes and the improvement of their performance in RA studies.

Two-photon live imaging of direct glia-to-neuron conversion in the mouse cortex

Over the past decade,a growing number of studies have reported transcription factor-based in situ reprogramming that can directly conve rt endogenous glial cells into functional neurons as an alternative approach for n euro regeneration in the adult mammalian central ne rvous system.Howeve r,many questions remain regarding how a terminally differentiated glial cell can transform into a delicate neuron that forms part of the intricate brain circuitry.In addition,concerns have recently been raised around the absence of astrocyte-to-neuron conversion in astrocytic lineage-tra cing mice.In this study,we employed repetitive two-photon imaging to continuously capture the in situ astrocyte-to-neuron conversion process following ecto pic expression of the neural transcription factor NeuroD1 in both prolife rating reactive astrocytes and lineage-tra ced astrocytes in the mouse cortex.Time-lapse imaging over several wee ks revealed the ste p-by-step transition from a typical astrocyte with numero us short,tapered branches to a typical neuro n with a few long neurites and dynamic growth cones that actively explored the local environment.In addition,these lineage-converting cells were able to migrate ra dially or to ngentially to relocate to suitable positions.Furthermore,two-photon Ca2+imaging and patch-clamp recordings confirmed that the newly generated neuro ns exhibited synchronous calcium signals,repetitive action potentials,and spontaneous synaptic responses,suggesting that they had made functional synaptic connections within local neural circuits.In conclusion,we directly visualized the step-by-step lineage conversion process from astrocytes to functional neurons in vivo and unambiguously demonstrated that adult mammalian brains are highly plastic with respect to their potential for neuro regeneration and neural circuit reconstruction.

Laser spectroscopy imaging technique coupled withnanomaterials for cancer diagnosis: A review

Laser spectroscopic imaging techniques have received tremendous attention in the-eld of cancer diagnosis due to their high sensitivity,high temporal resolution,and short acquisition time.However,the limited tissue penetration of the laser is still a challenge for the in vivo diagnosis of deep-seated lesions.Nanomaterials have been universally integrated with spectroscopic imaging techniques for deeper cancer diagnosis in vivo.The components,morphology,and sizes of nanomaterials are delicately designed,which could realize cancer diagnosis in vivo or in situ.Considering the enhanced signal emitting from the nanomaterials,we emphasized their combination with spectroscopic imaging techniques for cancer diagnosis,like the surface-enhanced Raman scattering(SERS),photoacoustic,fluorescence,and laser-induced breakdown spectroscopy(LIBS).Applications ofthe above spectroscopic techniques offer new prospectsfor cancer diagnosis.

RepDNet:A re-parameterization despeckling network for autonomous underwater side-scan sonar imaging with prior-knowledge customized convolution

Side-scan sonar(SSS)is now a prevalent instrument for large-scale seafloor topography measurements,deployable on an autonomous underwater vehicle(AUV)to execute fully automated underwater acoustic scanning imaging along a predetermined trajectory.However,SSS images often suffer from speckle noise caused by mutual interference between echoes,and limited AUV computational resources further hinder noise suppression.Existing approaches for SSS image processing and speckle noise reduction rely heavily on complex network structures and fail to combine the benefits of deep learning and domain knowledge.To address the problem,Rep DNet,a novel and effective despeckling convolutional neural network is proposed.Rep DNet introduces two re-parameterized blocks:the Pixel Smoothing Block(PSB)and Edge Enhancement Block(EEB),preserving edge information while attenuating speckle noise.During training,PSB and EEB manifest as double-layered multi-branch structures,integrating first-order and secondorder derivatives and smoothing functions.During inference,the branches are re-parameterized into a 3×3 convolution,enabling efficient inference without sacrificing accuracy.Rep DNet comprises three computational operations:3×3 convolution,element-wise summation and Rectified Linear Unit activation.Evaluations on benchmark datasets,a real SSS dataset and Data collected at Lake Mulan aestablish Rep DNet as a well-balanced network,meeting the AUV computational constraints in terms of performance and latency.

Data-driven polarimetric imaging: a review

This study reviews the recent advances in data-driven polarimetric imaging technologies based on a wide range of practical applications.The widespread international research and activity in polarimetric imaging techniques demonstrate their broad applications and interest.Polarization information is increasingly incorporated into convolutional neural networks(CNN)as a supplemental feature of objects to improve performance in computer vision task applications.Polarimetric imaging and deep learning can extract abundant information to address various challenges.Therefore,this article briefly reviews recent developments in data-driven polarimetric imaging,including polarimetric descattering,3D imaging,reflection removal,target detection,and biomedical imaging.Furthermore,we synthetically analyze the input,datasets,and loss functions and list the existing datasets and loss functions with an evaluation of their advantages and disadvantages.We also highlight the significance of data-driven polarimetric imaging in future research and development.

Development of a toroidal soft x-ray imaging system and application for investigating three-dimensional plasma on J-TEXT

A toroidal soft x-ray imaging(T-SXRI)system has been developed to investigate threedimensional(3D)plasma physics on J-TEXT.This T-SXRI system consists of three sets of SXR arrays.Two sets are newly developed and located on the vacuum chamber wall at toroidal positionsφof 126.4°and 272.6°,respectively,while one set was established previously atφ=65.50.Each set of SXR arrays consists of three arrays viewing the plasma poloidally,and hence can be used separately to obtain SXR images via the tomographic method.The sawtooth precursor oscillations are measured by T-SXRI,and the corresponding images of perturbative SXR signals are successfully reconstructed at these three toroidal positions,hence providing measurement of the 3D structure of precursor oscillations.The observed 3D structure is consistent with the helical structure of the m/n=1/1 mode.The experimental observation confirms that the T-SXRI system is able to observe 3D structures in the J-TEXT plasma.

NIR-II fluorescence imaging in liver tumor surgery: A narrative review

In liver tumor surgery,the recognition of tumor margin and radical resection of microcancer focis have always been the crucial points to reduce postoperative recurrence of tumor.However,naked-eye inspection and palpation have limited effectiveness in identifying tumor boundaries,and traditional imaging techniques cannot consistently locate tumors in real time.As an intraoperative real-time navigation imaging method,NIRfluorescence imaging has been extensively studied for its simplicity,reliable safety,and superior sensitivity,and is expected to improve the accuracy of liver tumor surgery.In recent years,the research focus of NIRfluorescence has gradually shifted from the-rst near-infrared window(NIR-I,700–900 nm)to the second near-infrared window(NIR-II,1000–1700 nm).Fluorescence imaging in NIR-II reduces the scattering effect of deep tissue,providing a preferable detection depth and spatial resolution while signi-cantly eliminating liver autofluorescence background to clarify tumor margin.Developingfluorophores combined with tumor antibodies will further improve the precision offluorescence-guided surgical navigation.With the development of a bunch offluorophores with phototherapy ability,NIR-II can integrate tumor detection and treatment to explore a new therapeutic strategy for liver cancer.Here,we review the recent progress of NIR-IIfluorescence technology in liver tumor surgery and discuss its challenges and potential development direction.

Epileptic brain network mechanisms and neuroimaging techniques for the brain network

Epilepsy can be defined as a dysfunction of the brain network,and each type of epilepsy involves different brain-network changes that are implicated diffe rently in the control and propagation of interictal or ictal discharges.Gaining more detailed information on brain network alterations can help us to further understand the mechanisms of epilepsy and pave the way for brain network-based precise therapeutic approaches in clinical practice.An increasing number of advanced neuroimaging techniques and electrophysiological techniques such as diffusion tensor imaging-based fiber tra ctography,diffusion kurtosis imaging-based fiber tractography,fiber ball imagingbased tra ctography,electroencephalography,functional magnetic resonance imaging,magnetoencephalography,positron emission tomography,molecular imaging,and functional ultrasound imaging have been extensively used to delineate epileptic networks.In this review,we summarize the relevant neuroimaging and neuroelectrophysiological techniques for assessing structural and functional brain networks in patients with epilepsy,and extensively analyze the imaging mechanisms,advantages,limitations,and clinical application ranges of each technique.A greater focus on emerging advanced technologies,new data analysis software,a combination of multiple techniques,and the construction of personalized virtual epilepsy models can provide a theoretical basis to better understand the brain network mechanisms of epilepsy and make surgical decisions.

Multimodal imaging in the diagnosis of bone giant cell tumors:A retrospective study

BACKGROUND Giant cell tumor of bone is a locally aggressive and rarely metastasizing tumor,and also a potential malignant tumor that may develop into a primary malignant giant cell tumor.AIM To evaluate the role of multimodal imaging in the diagnosis of giant cell tumors of bone.METHODS The data of 32 patients with giant cell tumor of bone confirmed by core-needle biopsy or surgical pathology at our hospital between March 2018 and March 2023 were retrospectively selected.All the patients with giant cell tumors of the bone were examined by X-ray,computed tomography(CT)and magnetic resonance imaging(MRI),and 7 of them were examined by positron emission tomography(PET)-CT.RESULTS X-ray imaging can provide overall information on giant cell tumor lesions.CT and MRI can reveal the characteristics of the internal structure of the tumor as well as the adjacent relationships of the tumor,and these methods have unique advantages for diagnosing tumors and determining the scope of surgery.PET-CT can detect small lesions and is highly valuable for identifying benign and malignant tumors to aid in the early diagnosis of metastasis.CONCLUSION Multimodal imaging plays an important role in the diagnosis of giant cell tumor of bone and can provide a reference for the treatment of giant cell tumors.

In vivo imaging of the neuronal response to spinal cord injury:a narrative review

Deciphering the neuronal response to injury in the spinal cord is essential for exploring treatment strategies for spinal cord injury(SCI).However,this subject has been neglected in part because appropriate tools are lacking.Emerging in vivo imaging and labeling methods offer great potential for observing dynamic neural processes in the central nervous system in conditions of health and disease.This review first discusses in vivo imaging of the mouse spinal cord with a focus on the latest imaging techniques,and then analyzes the dynamic biological response of spinal cord sensory and motor neurons to SCI.We then summarize and compare the techniques behind these studies and clarify the advantages of in vivo imaging compared with traditional neuroscience examinations.Finally,we identify the challenges and possible solutions for spinal cord neuron imaging.

Near-Infrared Fluorescence Imaging Contrast Agents for Clinical Research: Limitations and Alternatives

Introduction: Near-infrared fluorescence imaging is a technique that will establish itself in the short term at the international level because it is recognized for its potential to improve the performance of surgical interventions, its moderate investment and operating costs and its portability. Although the technology is now mature, there is currently the problem of the availability of contrast agents to be injected IV. The aim of this methodology article is to propose an alternative solution to the need for contrast agents for clinical research, particularly in oncology. Methodology: They consist of coupling a fluorescent marker in the form of an NHS derivative, such as IR DYE manufactured in compliance with GMP, with therapeutic monoclonal antibodies having marketing authorization for molecular imaging. For a given antibody, the marking procedure must be the subject of a validation file on the final preparation filtered on a sterilizing membrane at 0.22 μm. Once the procedure has been validated, it would be unnecessary to repeat the tests before each clinical research examination. A check of the marking by thin-layer chromatography (TLC) and place it in a sample bank at +4˚C for 1 month of each injected formulation would be sufficient for additional tests if necessary. Conclusion: Molecular near-infrared fluorescence imaging is experiencing development, the process of which could be accelerated by greater availability of clinical contrast agents. Alternative solutions are therefore necessary to promote clinical research in this area. These methods must be shared to make it easier for researchers.