摘要
通过对传统BP神经网络缺点的分析,从参数选取、BP算法、激活函数、网络结构4个方面综述了其改进方法。介绍了各种方法的原理、应用背景及其在BP神经网络中的应用,同时分析了各种方法的优缺点。指出不断提高网络的训练速度、收敛性和泛化能力仍是今后的研究方向,并展望了BP神经网络的研究重点。
With explaining the shortcoming of BP neural networks, four advanced methods are reviewed, such as choosing parameters, BP algorithm, transfer function and structure of neural network. The principle, application backgrounds and their apphcation to BP neural network are introduced. At the same time their advantages and disadvantages are analyzed. Enhancing training speed, the convergence ability and the generalization ability still are the directions and the key points of research in the future.
出处
《控制工程》
CSCD
2006年第5期449-451,456,共4页
Control Engineering of China
关键词
BP算法
梯度下降法
激活函数
网络结构
BP algorithm
method of negative gradient descent
transfer function
structure of neural network