摘要
This paper addresses a new kind of neuron model, which has trainable activation function (TAF) in addition to only trainable weights in the conventional M-P model. The final neuron activation function can be derived from a primitive neuron activation function by training. The BP like learning al-gorithm has been presented for MFNN constructed by neurons of TAP model. Several simulation ex-amples are given to show the network capacity and performance advantages of the new MFNN in com-parison with that of conventional sigmoid MFNN.
This paper addresses a new kind of neuron model, which has trainable activation function (TAF) in addition to only trainable weights in the conventional M-P model. The final neuron activation function can be derived from a primitive neuron activation function by training. The BP like learning al-gorithm has been presented for MFNN constructed by neurons of TAP model. Several simulation ex-amples are given to show the network capacity and performance advantages of the new MFNN in com-parison with that of conventional sigmoid MFNN.
基金
This work was supported by the National Natural Science Foundation of China (Grant Nos. 69831030 and 630003014).