摘要
针对BP神经网络存在收敛速度慢、易陷入局部极小等缺陷,提出了一种自适应调节学习率和动态调整S型激励函数相结合的改进BP算法。该算法将学习率与误差函数相关联,再对每个隐单元和输出单元的激励函数的斜率进行自动调整。通过实例仿真,将改进算法与标准BP算法、加动量项法和自适应学习率法进行比较,来验证所提出方法的有效性。实验结果表明,联合优化的BP算法能有效加快网络的收敛过程,并具有较强的泛化能力。
In view of the BP neural network existence convergence rate slow and easy to fall into local minimum,this paper presents an adaptive learning rate adjustment and dynamic adjustment S-type activation function combination of improved BP algorithm.The proposed algorithm connects the learning rate with the error function and the slope of the activation function of each hidden and output unit is automatically adjusted.Finally through the example simulation,the validity of the proposed method is verified compared to the standard BP algorithm,the momentum method and adaptive learning rate method.The experimental results show that the joint optimization of BP algorithm can effectively speed up the network convergence process and has strong generalization ability.
出处
《计算机工程与应用》
CSCD
北大核心
2009年第12期50-51,54,共3页
Computer Engineering and Applications
关键词
BP算法
学习率
误差函数
激励函数
back-propagation algorithm
learning rate
error function
activation function
