Network fault diagnosis methods play a vital role in maintaining network service quality and enhancing user experience as an integral component of intelligent network management.Considering the unique characteristics ...Network fault diagnosis methods play a vital role in maintaining network service quality and enhancing user experience as an integral component of intelligent network management.Considering the unique characteristics of edge networks,such as limited resources,complex network faults,and the need for high real-time performance,enhancing and optimizing existing network fault diagnosis methods is necessary.Therefore,this paper proposes the lightweight edge-side fault diagnosis approach based on a spiking neural network(LSNN).Firstly,we use the Izhikevich neurons model to replace the Leaky Integrate and Fire(LIF)neurons model in the LSNN model.Izhikevich neurons inherit the simplicity of LIF neurons but also possess richer behavioral characteristics and flexibility to handle diverse data inputs.Inspired by Fast Spiking Interneurons(FSIs)with a high-frequency firing pattern,we use the parameters of FSIs.Secondly,inspired by the connection mode based on spiking dynamics in the basal ganglia(BG)area of the brain,we propose the pruning approach based on the FSIs of the BG in LSNN to improve computational efficiency and reduce the demand for computing resources and energy consumption.Furthermore,we propose a multiple iterative Dynamic Spike Timing Dependent Plasticity(DSTDP)algorithm to enhance the accuracy of the LSNN model.Experiments on two server fault datasets demonstrate significant precision,recall,and F1 improvements across three diagnosis dimensions.Simultaneously,lightweight indicators such as Params and FLOPs significantly reduced,showcasing the LSNN’s advanced performance and model efficiency.To conclude,experiment results on a pair of datasets indicate that the LSNN model surpasses traditional models and achieves cutting-edge outcomes in network fault diagnosis tasks.展开更多
Phase transitions widely exist in nature and occur when some control parameters are changed. In neural systems, their macroscopic states are represented by the activity states of neuron populations, and phase transiti...Phase transitions widely exist in nature and occur when some control parameters are changed. In neural systems, their macroscopic states are represented by the activity states of neuron populations, and phase transitions between different activity states are closely related to corresponding functions in the brain. In particular, phase transitions to some rhythmic synchronous firing states play significant roles on diverse brain functions and disfunctions, such as encoding rhythmical external stimuli, epileptic seizure, etc. However, in previous studies, phase transitions in neuronal networks are almost driven by network parameters （e.g., external stimuli）, and there has been no investigation about the transitions between typical activity states of neuronal networks in a self-organized way by applying plastic connection weights. In this paper, we discuss phase transitions in electrically coupled and lattice-based small-world neuronal networks （LBSW networks） under spike-timing-dependent plasticity （STDP）. By applying STDP on all electrical synapses, various known and novel phase transitions could emerge in LBSW networks, particularly, the phenomenon of self-organized phase transitions （SOPTs）： repeated transitions between synchronous and asynchronous firing states. We further explore the mechanics generating SOPTs on the basis of synaptic weight dynamics.展开更多
现有计算机体系架构下的神经网络难以对多任务复杂数据进行高效处理,成为制约人工智能技术发展的瓶颈之一,而人脑的并行运算方式具有高效率、低功耗和存算一体的特点,被视为打破传统冯·诺依曼计算体系最具潜力的运算体系.突触仿生...现有计算机体系架构下的神经网络难以对多任务复杂数据进行高效处理,成为制约人工智能技术发展的瓶颈之一,而人脑的并行运算方式具有高效率、低功耗和存算一体的特点,被视为打破传统冯·诺依曼计算体系最具潜力的运算体系.突触仿生器件是指从硬件层面上实现人脑神经拟态的器件,它可以模拟脑神经对信息的处理方式,即“记忆”和“信息处理”过程在同一硬件上实现,这对于构建新的运算体系具有重要的意义.近年,制备仿生突触器件的忆阻材料已获得进展,但多聚焦于神经突触功能的模拟,对于时空信息感知和传递的关键研究较为缺乏.本文通过制备一种双层结构忆阻器,实现了突触仿生器件的基本功能包括双脉冲易化和抑制、脉冲时间依赖突触可塑性(spiking time dependent plasticity,STDP)和经验式学习等,还对器件的信息感知、传递特性和稳定性进行了研究,发现该器件脉冲测试结果满足神经网络处理时空信息的基本要求,这一结果可以为忆阻器在类脑芯片中的应用提供参考.展开更多
Both external and endogenous electrical fields widely exist in the environment of cortical neurons. The effects of a weak alternating current （AC） field on a neural network model with synaptic plasticity are studied...Both external and endogenous electrical fields widely exist in the environment of cortical neurons. The effects of a weak alternating current （AC） field on a neural network model with synaptic plasticity are studied. It is found that self-sustained rhythmic firing patterns, which are closely correlated with the cognitive functions, are significantly modified due to the self-organizing of the network in the weak AC field. The activities of the neural networks are affected by the synaptic connection strength, the exterrtal stimuli, and so on. In the presence of learning rules, the synaptic connections can be modulated by the external stimuli, which will further enhance the sensitivity of the network to the external signal. The properties of the external AC stimuli can serve as control parameters in modulating the evolution of the neural network.展开更多
基金supported by National Key R&D Program of China(2019YFB2103202).
文摘Network fault diagnosis methods play a vital role in maintaining network service quality and enhancing user experience as an integral component of intelligent network management.Considering the unique characteristics of edge networks,such as limited resources,complex network faults,and the need for high real-time performance,enhancing and optimizing existing network fault diagnosis methods is necessary.Therefore,this paper proposes the lightweight edge-side fault diagnosis approach based on a spiking neural network(LSNN).Firstly,we use the Izhikevich neurons model to replace the Leaky Integrate and Fire(LIF)neurons model in the LSNN model.Izhikevich neurons inherit the simplicity of LIF neurons but also possess richer behavioral characteristics and flexibility to handle diverse data inputs.Inspired by Fast Spiking Interneurons(FSIs)with a high-frequency firing pattern,we use the parameters of FSIs.Secondly,inspired by the connection mode based on spiking dynamics in the basal ganglia(BG)area of the brain,we propose the pruning approach based on the FSIs of the BG in LSNN to improve computational efficiency and reduce the demand for computing resources and energy consumption.Furthermore,we propose a multiple iterative Dynamic Spike Timing Dependent Plasticity(DSTDP)algorithm to enhance the accuracy of the LSNN model.Experiments on two server fault datasets demonstrate significant precision,recall,and F1 improvements across three diagnosis dimensions.Simultaneously,lightweight indicators such as Params and FLOPs significantly reduced,showcasing the LSNN’s advanced performance and model efficiency.To conclude,experiment results on a pair of datasets indicate that the LSNN model surpasses traditional models and achieves cutting-edge outcomes in network fault diagnosis tasks.
基金Project supported by the National Natural Science Foundation of China(Grant Nos.11135001 and 11174034)
文摘Phase transitions widely exist in nature and occur when some control parameters are changed. In neural systems, their macroscopic states are represented by the activity states of neuron populations, and phase transitions between different activity states are closely related to corresponding functions in the brain. In particular, phase transitions to some rhythmic synchronous firing states play significant roles on diverse brain functions and disfunctions, such as encoding rhythmical external stimuli, epileptic seizure, etc. However, in previous studies, phase transitions in neuronal networks are almost driven by network parameters （e.g., external stimuli）, and there has been no investigation about the transitions between typical activity states of neuronal networks in a self-organized way by applying plastic connection weights. In this paper, we discuss phase transitions in electrically coupled and lattice-based small-world neuronal networks （LBSW networks） under spike-timing-dependent plasticity （STDP）. By applying STDP on all electrical synapses, various known and novel phase transitions could emerge in LBSW networks, particularly, the phenomenon of self-organized phase transitions （SOPTs）： repeated transitions between synchronous and asynchronous firing states. We further explore the mechanics generating SOPTs on the basis of synaptic weight dynamics.
文摘现有计算机体系架构下的神经网络难以对多任务复杂数据进行高效处理,成为制约人工智能技术发展的瓶颈之一,而人脑的并行运算方式具有高效率、低功耗和存算一体的特点,被视为打破传统冯·诺依曼计算体系最具潜力的运算体系.突触仿生器件是指从硬件层面上实现人脑神经拟态的器件,它可以模拟脑神经对信息的处理方式,即“记忆”和“信息处理”过程在同一硬件上实现,这对于构建新的运算体系具有重要的意义.近年,制备仿生突触器件的忆阻材料已获得进展,但多聚焦于神经突触功能的模拟,对于时空信息感知和传递的关键研究较为缺乏.本文通过制备一种双层结构忆阻器,实现了突触仿生器件的基本功能包括双脉冲易化和抑制、脉冲时间依赖突触可塑性(spiking time dependent plasticity,STDP)和经验式学习等,还对器件的信息感知、传递特性和稳定性进行了研究,发现该器件脉冲测试结果满足神经网络处理时空信息的基本要求,这一结果可以为忆阻器在类脑芯片中的应用提供参考.
基金Project supported by the National Natural Science Foundation of China (Grant Nos. 61072012, 60901035, 50907044, and 61172009)
文摘Both external and endogenous electrical fields widely exist in the environment of cortical neurons. The effects of a weak alternating current （AC） field on a neural network model with synaptic plasticity are studied. It is found that self-sustained rhythmic firing patterns, which are closely correlated with the cognitive functions, are significantly modified due to the self-organizing of the network in the weak AC field. The activities of the neural networks are affected by the synaptic connection strength, the exterrtal stimuli, and so on. In the presence of learning rules, the synaptic connections can be modulated by the external stimuli, which will further enhance the sensitivity of the network to the external signal. The properties of the external AC stimuli can serve as control parameters in modulating the evolution of the neural network.
