An End-To-End Hyperbolic Deep Graph Convolutional Neural Network Framework

Graph Convolutional Neural Networks(GCNs)have been widely used in various fields due to their powerful capabilities in processing graph-structured data.However,GCNs encounter significant challenges when applied to scale-free graphs with power-law distributions,resulting in substantial distortions.Moreover,most of the existing GCN models are shallow structures,which restricts their ability to capture dependencies among distant nodes and more refined high-order node features in scale-free graphs with hierarchical structures.To more broadly and precisely apply GCNs to real-world graphs exhibiting scale-free or hierarchical structures and utilize multi-level aggregation of GCNs for capturing high-level information in local representations,we propose the Hyperbolic Deep Graph Convolutional Neural Network(HDGCNN),an end-to-end deep graph representation learning framework that can map scale-free graphs from Euclidean space to hyperbolic space.In HDGCNN,we define the fundamental operations of deep graph convolutional neural networks in hyperbolic space.Additionally,we introduce a hyperbolic feature transformation method based on identity mapping and a dense connection scheme based on a novel non-local message passing framework.In addition,we present a neighborhood aggregation method that combines initial structural featureswith hyperbolic attention coefficients.Through the above methods,HDGCNN effectively leverages both the structural features and node features of graph data,enabling enhanced exploration of non-local structural features and more refined node features in scale-free or hierarchical graphs.Experimental results demonstrate that HDGCNN achieves remarkable performance improvements over state-ofthe-art GCNs in node classification and link prediction tasks,even when utilizing low-dimensional embedding representations.Furthermore,when compared to shallow hyperbolic graph convolutional neural network models,HDGCNN exhibits notable advantages and performance enhancements.

Pluggable multitask diffractive neural networks based on cascaded metasurfaces

Optical neural networks have significant advantages in terms of power consumption,parallelism,and high computing speed,which has intrigued extensive attention in both academic and engineering communities.It has been considered as one of the powerful tools in promoting the fields of imaging processing and object recognition.However,the existing optical system architecture cannot be reconstructed to the realization of multi-functional artificial intelligence systems simultaneously.To push the development of this issue,we propose the pluggable diffractive neural networks(P-DNN),a general paradigm resorting to the cascaded metasurfaces,which can be applied to recognize various tasks by switching internal plug-ins.As the proof-of-principle,the recognition functions of six types of handwritten digits and six types of fashions are numerical simulated and experimental demonstrated at near-infrared regimes.Encouragingly,the proposed paradigm not only improves the flexibility of the optical neural networks but paves the new route for achieving high-speed,low-power and versatile artificial intelligence systems.

Emerging strategies for nerve repair and regeneration in ischemic stroke:neural stem cell therapy

Ischemic stroke is a major cause of mortality and disability worldwide,with limited treatment options available in clinical practice.The emergence of stem cell therapy has provided new hope to the field of stroke treatment via the restoration of brain neuron function.Exogenous neural stem cells are beneficial not only in cell replacement but also through the bystander effect.Neural stem cells regulate multiple physiological responses,including nerve repair,endogenous regeneration,immune function,and blood-brain barrier permeability,through the secretion of bioactive substances,including extracellular vesicles/exosomes.However,due to the complex microenvironment of ischemic cerebrovascular events and the low survival rate of neural stem cells following transplantation,limitations in the treatment effect remain unresolved.In this paper,we provide a detailed summary of the potential mechanisms of neural stem cell therapy for the treatment of ischemic stroke,review current neural stem cell therapeutic strategies and clinical trial results,and summarize the latest advancements in neural stem cell engineering to improve the survival rate of neural stem cells.We hope that this review could help provide insight into the therapeutic potential of neural stem cells and guide future scientific endeavors on neural stem cells.

Recent advances in the application of MXenes for neural tissue engineering and regeneration

Transition metal carbides and nitrides(MXenes)are crystal nanomaterials with a number of surface functional groups such as fluorine,hydroxyl,and oxygen,which can be used as carriers for proteins and drugs.MXenes have excellent biocompatibility,electrical conductivity,surface hydrophilicity,mechanical properties and easy surface modification.However,at present,the stability of most MXenes needs to be improved,and more synthesis methods need to be explored.MXenes are good substrates for nerve cell regeneration and nerve reconstruction,which have broad application prospects in the repair of nervous system injury.Regarding the application of MXenes in neuroscience,mainly at the cellular level,the long-term in vivo biosafety and effects also need to be further explored.This review focuses on the progress of using MXenes in nerve regeneration over the last few years;discussing preparation of MXenes and their biocompatibility with different cells as well as the regulation by MXenes of nerve cell regeneration in two-dimensional and three-dimensional environments in vitro.MXenes have great potential in regulating the proliferation,differentiation,and maturation of nerve cells and in promoting regeneration and recovery after nerve injury.In addition,this review also presents the main challenges during optimization processes,such as the preparation of stable MXenes and long-term in vivo biosafety,and further discusses future directions in neural tissue engineering.

Metabolic and proteostatic differences in quiescent and active neural stem cells

Adult neural stem cells are neurogenesis progenitor cells that play an important role in neurogenesis.Therefore,neural regeneration may be a promising target for treatment of many neurological illnesses.The regenerative capacity of adult neural stem cells can be chara cterized by two states:quiescent and active.Quiescent adult neural stem cells are more stable and guarantee the quantity and quality of the adult neural stem cell pool.Active adult neural stem cells are chara cterized by rapid proliferation and differentiation into neurons which allow for integration into neural circuits.This review focuses on diffe rences between quiescent and active adult neural stem cells in nutrition metabolism and protein homeostasis.Furthermore,we discuss the physiological significance and underlying advantages of these diffe rences.Due to the limited number of adult neural stem cells studies,we refe rred to studies of embryonic adult neural stem cells or non-mammalian adult neural stem cells to evaluate specific mechanisms.

A Review of Computing with Spiking Neural Networks

Artificial neural networks(ANNs)have led to landmark changes in many fields,but they still differ significantly fromthemechanisms of real biological neural networks and face problems such as high computing costs,excessive computing power,and so on.Spiking neural networks(SNNs)provide a new approach combined with brain-like science to improve the computational energy efficiency,computational architecture,and biological credibility of current deep learning applications.In the early stage of development,its poor performance hindered the application of SNNs in real-world scenarios.In recent years,SNNs have made great progress in computational performance and practicability compared with the earlier research results,and are continuously producing significant results.Although there are already many pieces of literature on SNNs,there is still a lack of comprehensive review on SNNs from the perspective of improving performance and practicality as well as incorporating the latest research results.Starting from this issue,this paper elaborates on SNNs along the complete usage process of SNNs including network construction,data processing,model training,development,and deployment,aiming to provide more comprehensive and practical guidance to promote the development of SNNs.Therefore,the connotation and development status of SNNcomputing is reviewed systematically and comprehensively from four aspects:composition structure,data set,learning algorithm,software/hardware development platform.Then the development characteristics of SNNs in intelligent computing are summarized,the current challenges of SNNs are discussed and the future development directions are also prospected.Our research shows that in the fields of machine learning and intelligent computing,SNNs have comparable network scale and performance to ANNs and the ability to challenge large datasets and a variety of tasks.The advantages of SNNs over ANNs in terms of energy efficiency and spatial-temporal data processing have been more fully exploited.And the development of programming and deployment tools has lowered the threshold for the use of SNNs.SNNs show a broad development prospect for brain-like computing.

RWNeRF:Robust Watermarking Scheme for Neural Radiance Fields Based on Invertible Neural Networks

As neural radiance fields continue to advance in 3D content representation,the copyright issues surrounding 3D models oriented towards implicit representation become increasingly pressing.In response to this challenge,this paper treats the embedding and extraction of neural radiance field watermarks as inverse problems of image transformations and proposes a scheme for protecting neural radiance field copyrights using invertible neural network watermarking.Leveraging 2D image watermarking technology for 3D scene protection,the scheme embeds watermarks within the training images of neural radiance fields through the forward process in invertible neural networks and extracts them from images rendered by neural radiance fields through the reverse process,thereby ensuring copyright protection for both the neural radiance fields and associated 3D scenes.However,challenges such as information loss during rendering processes and deliberate tampering necessitate the design of an image quality enhancement module to increase the scheme’s robustness.This module restores distorted images through neural network processing before watermark extraction.Additionally,embedding watermarks in each training image enables watermark information extraction from multiple viewpoints.Our proposed watermarking method achieves a PSNR(Peak Signal-to-Noise Ratio)value exceeding 37 dB for images containing watermarks and 22 dB for recovered watermarked images,as evaluated on the Lego,Hotdog,and Chair datasets,respectively.These results demonstrate the efficacy of our scheme in enhancing copyright protection.

Uncertainty-Aware Physical Simulation of Neural Radiance Fields for Fluids

This paper presents a novel framework aimed at quantifying uncertainties associated with the 3D reconstruction of smoke from2Dimages.This approach reconstructs color and density fields from 2D images using Neural Radiance Field(NeRF)and improves image quality using frequency regularization.The NeRF model is obtained via joint training ofmultiple artificial neural networks,whereby the expectation and standard deviation of density fields and RGB values can be evaluated for each pixel.In addition,customized physics-informed neural network(PINN)with residual blocks and two-layer activation functions are utilized to input the density fields of the NeRF into Navier-Stokes equations and convection-diffusion equations to reconstruct the velocity field.The velocity uncertainties are also evaluated through ensemble learning.The effectiveness of the proposed algorithm is demonstrated through numerical examples.The presentmethod is an important step towards downstream tasks such as reliability analysis and robust optimization in engineering design.

MarkINeRV: A Robust Watermarking Scheme for Neural Representation for Videos Based on Invertible Neural Networks

Recent research advances in implicit neural representation have shown that a wide range of video data distributions are achieved by sharing model weights for Neural Representation for Videos(NeRV).While explicit methods exist for accurately embedding ownership or copyright information in video data,the nascent NeRV framework has yet to address this issue comprehensively.In response,this paper introduces MarkINeRV,a scheme designed to embed watermarking information into video frames using an invertible neural network watermarking approach to protect the copyright of NeRV,which models the embedding and extraction of watermarks as a pair of inverse processes of a reversible network and employs the same network to achieve embedding and extraction of watermarks.It is just that the information flow is in the opposite direction.Additionally,a video frame quality enhancement module is incorporated to mitigate watermarking information losses in the rendering process and the possibility ofmalicious attacks during transmission,ensuring the accurate extraction of watermarking information through the invertible network’s inverse process.This paper evaluates the accuracy,robustness,and invisibility of MarkINeRV through multiple video datasets.The results demonstrate its efficacy in extracting watermarking information for copyright protection of NeRV.MarkINeRV represents a pioneering investigation into copyright issues surrounding NeRV.

NeurstrucEnergy:A bi-directional GNN model for energy prediction of neural networks in IoT

A significant demand rises for energy-efficient deep neural networks to support power-limited embedding devices with successful deep learning applications in IoT and edge computing fields.An accurate energy prediction approach is critical to provide measurement and lead optimization direction.However,the current energy prediction approaches lack accuracy and generalization ability due to the lack of research on the neural network structure and the excessive reliance on customized training dataset.This paper presents a novel energy prediction model,NeurstrucEnergy.NeurstrucEnergy treats neural networks as directed graphs and applies a bi-directional graph neural network training on a randomly generated dataset to extract structural features for energy prediction.NeurstrucEnergy has advantages over linear approaches because the bi-directional graph neural network collects structural features from each layer's parents and children.Experimental results show that NeurstrucEnergy establishes state-of-the-art results with mean absolute percentage error of 2.60%.We also evaluate NeurstrucEnergy in a randomly generated dataset,achieving the mean absolute percentage error of 4.83%over 10 typical convolutional neural networks in recent years and 7 efficient convolutional neural networks created by neural architecture search.Our code is available at https://github.com/NEUSoftGreenAI/NeurstrucEnergy.git.

Prediction of Porous Media Fluid Flow with Spatial Heterogeneity Using Criss-Cross Physics-Informed Convolutional Neural Networks

Recent advances in deep neural networks have shed new light on physics,engineering,and scientific computing.Reconciling the data-centered viewpoint with physical simulation is one of the research hotspots.The physicsinformedneural network(PINN)is currently the most general framework,which is more popular due to theconvenience of constructing NNs and excellent generalization ability.The automatic differentiation(AD)-basedPINN model is suitable for the homogeneous scientific problem;however,it is unclear how AD can enforce fluxcontinuity across boundaries between cells of different properties where spatial heterogeneity is represented bygrid cells with different physical properties.In this work,we propose a criss-cross physics-informed convolutionalneural network(CC-PINN)learning architecture,aiming to learn the solution of parametric PDEs with spatialheterogeneity of physical properties.To achieve the seamless enforcement of flux continuity and integration ofphysicalmeaning into CNN,a predefined 2D convolutional layer is proposed to accurately express transmissibilitybetween adjacent cells.The efficacy of the proposedmethodwas evaluated through predictions of several petroleumreservoir problems with spatial heterogeneity and compared against state-of-the-art(PINN)through numericalanalysis as a benchmark,which demonstrated the superiority of the proposed method over the PINN.

Expression Recognition Method Based on Convolutional Neural Network and Capsule Neural Network

Convolutional neural networks struggle to accurately handle changes in angles and twists in the direction of images,which affects their ability to recognize patterns based on internal feature levels. In contrast, CapsNet overcomesthese limitations by vectorizing information through increased directionality and magnitude, ensuring that spatialinformation is not overlooked. Therefore, this study proposes a novel expression recognition technique calledCAPSULE-VGG, which combines the strengths of CapsNet and convolutional neural networks. By refining andintegrating features extracted by a convolutional neural network before introducing theminto CapsNet, ourmodelenhances facial recognition capabilities. Compared to traditional neural network models, our approach offersfaster training pace, improved convergence speed, and higher accuracy rates approaching stability. Experimentalresults demonstrate that our method achieves recognition rates of 74.14% for the FER2013 expression dataset and99.85% for the CK+ expression dataset. By contrasting these findings with those obtained using conventionalexpression recognition techniques and incorporating CapsNet’s advantages, we effectively address issues associatedwith convolutional neural networks while increasing expression identification accuracy.

Application of Convolutional Neural Networks in Classification of GBM for Enhanced Prognosis

The lethal brain tumor “Glioblastoma” has the propensity to grow over time. To improve patient outcomes, it is essential to classify GBM accurately and promptly in order to provide a focused and individualized treatment plan. Despite this, deep learning methods, particularly Convolutional Neural Networks (CNNs), have demonstrated a high level of accuracy in a myriad of medical image analysis applications as a result of recent technical breakthroughs. The overall aim of the research is to investigate how CNNs can be used to classify GBMs using data from medical imaging, to improve prognosis precision and effectiveness. This research study will demonstrate a suggested methodology that makes use of the CNN architecture and is trained using a database of MRI pictures with this tumor. The constructed model will be assessed based on its overall performance. Extensive experiments and comparisons with conventional machine learning techniques and existing classification methods will also be made. It will be crucial to emphasize the possibility of early and accurate prediction in a clinical workflow because it can have a big impact on treatment planning and patient outcomes. The paramount objective is to not only address the classification challenge but also to outline a clear pathway towards enhancing prognosis precision and treatment effectiveness.

Evidence of the Great Attractor and Great Repeller from Artificial Neural Network Imputation of Sloan Digital Sky Survey

The Sloane Digital Sky Survey (SDSS) has been in the process of creating a 3D digital map of the Universe, since 2000AD. However, it has not been able to map that portion of the sky which is occluded by the dust gas and stars of our own Milkyway Galaxy. This research builds on work from a previous paper that sought to impute this missing galactic information using Inpainting, polar transforms and Linear Regression ANNs. In that paper, the author only attempted to impute the data in the Northern hemisphere using the ANN model, which subsequently confirmed the existence of the Great Attractor and the homogeneity of the Universe. In this paper, the author has imputed the Southern Hemisphere and discovered a region that is mostly devoid of stars. Since this area appears to be the counterpart to the Great Attractor, the author refers to it as the Great Repeller and postulates that it is an area of physical repulsion, inline with the work of GerdPommerenke and others. Finally, the paper investigates large scale structures in the imputed galaxies.

2015年3月特大磁暴期间中国区域电离层TEC NeuralProphet预报模型研究

延迟是全球卫星导航定位中重要的误差源之一,提高电离层TEC建模和预报精度对改善卫星导航定位精度至关重要.本文构建了以太阳辐射通量指数F_(10.7)、地磁活动指数Dst、地理坐标和中国科学院(Chinese Academy of Sciences,CAS)GIM数据为输入参数的NeuralProphet神经网络模型(NP模型),实现在2015年3月特大磁暴期中国区域电离层TEC短期预报.为验证NP模型的预报精度,本文同时构建了长短期记忆神经网络(Long Short-term Memory Neural Network,LSTM)模型进行对比分析.结果统计分析表明,NP模型在磁暴期(2015年DOY076-078)TEC预报值RMSE和RD分别为0.83 TECU和3.13%,绝对和相对精度较LSTM模型分别提高1.49 TECU和10.25%;且NP模型RMSE优于1.5 TECU的比例达97.24%,远高于LSTM模型.NP模型预报值与CAS具有较好一致性和无偏性,偏差均值仅为-0.01 TECU,而LSTM模型预报值的均值偏大,偏差均值为1.49 TECU.从低纬到中纬度的三个纬度带内,NP模型RMSE分别为1.12、0.83和0.44 TECU,精度比LSTM模型提高1.94、1.56和1.23 TECU.整体上,在磁暴期NP模型预报性能明显优于LSTM模型,能够精细描述中国区域电离层TEC时空变化.

Autophagy in neural stem cells and glia for brain health and diseases

Autophagy is a multifaceted cellular process that not only maintains the homeostatic and adaptive responses of the brain but is also dynamically involved in the regulation of neural cell generation,maturation,and survival.Autophagy facilities the utilization of energy and the microenvironment for developing neural stem cells.Autophagy arbitrates structural and functional remodeling during the cell differentiation process.Autophagy also plays an indispensable role in the maintenance of stemness and homeostasis in neural stem cells during essential brain physiology and also in the instigation and progression of diseases.Only recently,studies have begun to shed light on autophagy regulation in glia(microglia,astrocyte,and oligodendrocyte)in the brain.Glial cells have attained relatively less consideration despite their unquestioned influence on various aspects of neural development,synaptic function,brain metabolism,cellular debris clearing,and restoration of damaged or injured tissues.Thus,this review composes pertinent information regarding the involvement of autophagy in neural stem cells and glial regulation and the role of this connexion in normal brain functions,neurodevelopmental disorders,and neurodegenerative diseases.This review will provide insight into establishing a concrete strategic approach for investigating pathological mechanisms and developing therapies for brain diseases.

Biomaterials and tissue engineering in traumatic brain injury:novel perspectives on promoting neural regeneration

Traumatic brain injury is a serious medical condition that can be attributed to falls, motor vehicle accidents, sports injuries and acts of violence, causing a series of neural injuries and neuropsychiatric symptoms. However, limited accessibility to the injury sites, complicated histological and anatomical structure, intricate cellular and extracellular milieu, lack of regenerative capacity in the native cells, vast variety of damage routes, and the insufficient time available for treatment have restricted the widespread application of several therapeutic methods in cases of central nervous system injury. Tissue engineering and regenerative medicine have emerged as innovative approaches in the field of nerve regeneration. By combining biomaterials, stem cells, and growth factors, these approaches have provided a platform for developing effective treatments for neural injuries, which can offer the potential to restore neural function, improve patient outcomes, and reduce the need for drugs and invasive surgical procedures. Biomaterials have shown advantages in promoting neural development, inhibiting glial scar formation, and providing a suitable biomimetic neural microenvironment, which makes their application promising in the field of neural regeneration. For instance, bioactive scaffolds loaded with stem cells can provide a biocompatible and biodegradable milieu. Furthermore, stem cells-derived exosomes combine the advantages of stem cells, avoid the risk of immune rejection, cooperate with biomaterials to enhance their biological functions, and exert stable functions, thereby inducing angiogenesis and neural regeneration in patients with traumatic brain injury and promoting the recovery of brain function. Unfortunately, biomaterials have shown positive effects in the laboratory, but when similar materials are used in clinical studies of human central nervous system regeneration, their efficacy is unsatisfactory. Here, we review the characteristics and properties of various bioactive materials, followed by the introduction of applications based on biochemistry and cell molecules, and discuss the emerging role of biomaterials in promoting neural regeneration. Further, we summarize the adaptive biomaterials infused with exosomes produced from stem cells and stem cells themselves for the treatment of traumatic brain injury. Finally, we present the main limitations of biomaterials for the treatment of traumatic brain injury and offer insights into their future potential.

Transplantation of fibrin-thrombin encapsulated human induced neural stem cells promotes functional recovery of spinal cord injury rats through modulation of the microenvironment

Recent studies have mostly focused on engraftment of cells at the lesioned spinal cord,with the expectation that differentiated neurons facilitate recovery.Only a few studies have attempted to use transplanted cells and/or biomaterials as major modulators of the spinal cord injury microenvironment.Here,we aimed to investigate the role of microenvironment modulation by cell graft on functional recovery after spinal cord injury.Induced neural stem cells reprogrammed from human peripheral blood mononuclear cells,and/or thrombin plus fibrinogen,were transplanted into the lesion site of an immunosuppressed rat spinal cord injury model.Basso,Beattie and Bresnahan score,electrophysiological function,and immunofluorescence/histological analyses showed that transplantation facilitates motor and electrophysiological function,reduces lesion volume,and promotes axonal neurofilament expression at the lesion core.Examination of the graft and niche components revealed that although the graft only survived for a relatively short period(up to 15 days),it still had a crucial impact on the microenvironment.Altogether,induced neural stem cells and human fibrin reduced the number of infiltrated immune cells,biased microglia towards a regenerative M2 phenotype,and changed the cytokine expression profile at the lesion site.Graft-induced changes of the microenvironment during the acute and subacute stages might have disrupted the inflammatory cascade chain reactions,which may have exerted a long-term impact on the functional recovery of spinal cord injury rats.

Neural stem cells promote neuroplasticity: a promising therapeutic strategy for the treatment of Alzheimer’s disease

Recent studies have demonstrated that neuroplasticity,such as synaptic plasticity and neurogenesis,exists throughout the normal lifespan but declines with age and is significantly impaired in individuals with Alzheimer’s disease.Hence,promoting neuroplasticity may represent an effective strategy with which Alzheimer’s disease can be alleviated.Due to their significant ability to self-renew,differentiate,and migrate,neural stem cells play an essential role in reversing synaptic and neuronal damage,reducing the pathology of Alzheimer’s disease,including amyloid-β,tau protein,and neuroinflammation,and secreting neurotrophic factors and growth factors that are related to plasticity.These events can promote synaptic plasticity and neurogenesis to repair the microenvironment of the mammalian brain.Consequently,neural stem cells are considered to represent a potential regenerative therapy with which to improve Alzheimer’s disease and other neurodegenerative diseases.In this review,we discuss how neural stem cells regulate neuroplasticity and optimize their effects to enhance their potential for treating Alzheimer’s disease in the clinic.

Long non-coding RNA H19 regulates neurogenesis of induced neural stem cells in a mouse model of closed head injury

Stem cell-based therapies have been proposed as a potential treatment for neural regeneration following closed head injury.We previously reported that induced neural stem cells exert beneficial effects on neural regeneration via cell replacement.However,the neural regeneration efficiency of induced neural stem cells remains limited.In this study,we explored differentially expressed genes and long non-coding RNAs to clarify the mechanism underlying the neurogenesis of induced neural stem cells.We found that H19 was the most downregulated neurogenesis-associated lnc RNA in induced neural stem cells compared with induced pluripotent stem cells.Additionally,we demonstrated that H19 levels in induced neural stem cells were markedly lower than those in induced pluripotent stem cells and were substantially higher than those in induced neural stem cell-derived neurons.We predicted the target genes of H19 and discovered that H19 directly interacts with mi R-325-3p,which directly interacts with Ctbp2 in induced pluripotent stem cells and induced neural stem cells.Silencing H19 or Ctbp2 impaired induced neural stem cell proliferation,and mi R-325-3p suppression restored the effect of H19 inhibition but not the effect of Ctbp2 inhibition.Furthermore,H19 silencing substantially promoted the neural differentiation of induced neural stem cells and did not induce apoptosis of induced neural stem cells.Notably,silencing H19 in induced neural stem cell grafts markedly accelerated the neurological recovery of closed head injury mice.Our results reveal that H19 regulates the neurogenesis of induced neural stem cells.H19 inhibition may promote the neural differentiation of induced neural stem cells,which is closely associated with neurological recovery following closed head injury.