Human information processing depends mainly on billions of neurons which constitute a complex neural network,and the information is transmitted in the form of neural spikes.In this paper,we propose a spiking neural ne...Human information processing depends mainly on billions of neurons which constitute a complex neural network,and the information is transmitted in the form of neural spikes.In this paper,we propose a spiking neural network(SNN),named MD-SNN,with three key features:(1) using receptive field to encode spike trains from images;(2) randomly selecting partial spikes as inputs for each neuron to approach the absolute refractory period of the neuron;(3) using groups of neurons to make decisions.We test MD-SNN on the MNIST data set of handwritten digits,and results demonstrate that:(1) Different sizes of receptive fields influence classification results significantly.(2) Considering the neuronal refractory period in the SNN model,increasing the number of neurons in the learning layer could greatly reduce the training time,effectively reduce the probability of over-fitting,and improve the accuracy by 8.77%.(3) Compared with other SNN methods,MD-SNN achieves a better classification;compared with the convolution neural network,MD-SNN maintains flip and rotation invariance(the accuracy can remain at 90.44% on the test set),and it is more suitable for small sample learning(the accuracy can reach 80.15%for 1000 training samples,which is 7.8 times that of CNN).展开更多
基金Project supported by the Chinese Academy of Engi- neering, the National Natural Science Foundation of China (No. L1522023), the National Basic Research Program (973) of China (No. 2015CB351703), and the National Key Research and Development Plan (Nos. 2016YFB1001004 and 2016YFB1000903)
基金supported by the National Natural Science Foundation of China(Nos.61773312,61773307,and L1522023)the China Postdoctoral Science Foundation(No.2016M590949)the National Basic Research Program(973)of China(No.2015CB351703)
文摘Human information processing depends mainly on billions of neurons which constitute a complex neural network,and the information is transmitted in the form of neural spikes.In this paper,we propose a spiking neural network(SNN),named MD-SNN,with three key features:(1) using receptive field to encode spike trains from images;(2) randomly selecting partial spikes as inputs for each neuron to approach the absolute refractory period of the neuron;(3) using groups of neurons to make decisions.We test MD-SNN on the MNIST data set of handwritten digits,and results demonstrate that:(1) Different sizes of receptive fields influence classification results significantly.(2) Considering the neuronal refractory period in the SNN model,increasing the number of neurons in the learning layer could greatly reduce the training time,effectively reduce the probability of over-fitting,and improve the accuracy by 8.77%.(3) Compared with other SNN methods,MD-SNN achieves a better classification;compared with the convolution neural network,MD-SNN maintains flip and rotation invariance(the accuracy can remain at 90.44% on the test set),and it is more suitable for small sample learning(the accuracy can reach 80.15%for 1000 training samples,which is 7.8 times that of CNN).