期刊文献+

一种新的全局优化BP网络 被引量:6

A Global Optimization BP Neural Networks
下载PDF
导出
摘要 将L-M算法与填充函数法相结合,提出一种训练前向网络的混合型全局优化GOBP(G lobalOptim izationBP)算法。L-M算法的收敛速度快,利用它先得到一个局部极小点,然后利用填充函数算法跳出局部最小,得到一个更低的局部极小点,重复计算即可得到全局最优点。经实验验证,该算法收敛速度很快,避免了局部收敛,而且性能稳定。 Proposes GOBP(Global Optimization BP) neural networks in which combines the filled function method and Levenberg-Marquardt algorithm for training feed forward neural networks. With the L-M algorithm whose astringency is good, it can find one of local minimal points quickly. Afterwards, the filled function method will be used to find the point that is lower than the minimal point previously found. By repeating these processes, a global minimal point can be obtained at last. Practical examples indicate that the method has a higher accuracy in astringency and works well in avoiding sticking in local minima.
出处 《计算机应用研究》 CSCD 北大核心 2006年第2期211-212,255,共3页 Application Research of Computers
基金 山东省自然科学基金重大项目(Z2004G02) 山东省中青年科学家奖励基金资助项目(03BS003)
关键词 L-M算法 填充函数 全局优化 BP网络 L-M Algorithm Fitted Function Global Optimization BP Neural Networks
  • 相关文献

参考文献8

  • 1FAN J Y, An Approach to Fault Diagnosis of Chemical Processes via Neural Networks[J]. Journal of AICHE, 1993,39 (1) :82- 87.
  • 2Horinik K, Stinehcombe M, White H, Muhilayer Feedforward Networks are U aivenal Approximators [J]. Neural Networks, 1989,2 ( 5 ) : 359-366.
  • 3Ge R, Qin Y. A Class of Filled Functions for Finding Global Minimizers of a Function of Several Variables[J]. Journal of Optimization Theory and Applications,1987,54(2):241-252.
  • 4Ge R, A Filled Function Method for Finding a Global Minimizer of a Function of Several Variables [J]. Mathematical Programming, 1990,46 : 191-204.
  • 5Ge R, Qin Y, The Globally Convexized Filled Functions for Global Optimization[J]. Applied Mathematics and Computation, 1990,35 :131-158.
  • 6Ge R. The Filled Function Transformations for Constrained Global Optimization [J]. Applied Mathematics and Computation, 1990,39 : 1-20.
  • 7SimonHaykin 叶世伟 史忠植.Neural Networks.神经网络原理[M].北京:机械工业出版社,2004..
  • 8李换琴,万百五.训练前向神经网络的全局优化新算法及其应用[J].系统工程理论与实践,2003,23(8):42-47. 被引量:9

二级参考文献13

  • 1邢进生.[D].西安:西安交通大学,2000.
  • 2Horinik K, Stinchcombe M, White H. Multilayer feedforward networks are universal approximators[J]. Neural Networks, 1989, 2(5): 359--366.
  • 3Willamson R C, Helmke U. Existence and uniqueness results for neural network approximation[J]. IEEE Trans on Neural Networks, 1995, 6(1):2--13.
  • 4Chen T, Chen H. Universal approximation to nonlinear operators by neural networks with arbitrary activation functions and its application to dynamical systems[J]. IEEE Trans on Neural Networks, 1995, 6(4):911--917.
  • 5Anderssen R S, Bloomfield P. Properties of the random search in global optimization[J]. Journal of Optimization Theory and Applications, 1975, 16 : 383-- 398.
  • 6David J J, Frenzel J F. Training product unit neural networks with genetic algorithms[J]. IEEE Expert, 1993, 8(5) :26--33.
  • 7Kirkpatrick S, Gelatt C D, Vecchi M P. Optimization by simulated annealing[J].Science, 1983, 220(4598): 671--680.
  • 8Babe N, Mogami Y, Kohzake M, Shiraishi Y, Yoshida Y. A hybrid algorithms for finding the global minimum of error function of neural networks and its applications[J]. Neural Networks, 1994, 7(8): 1253--1265.
  • 9Nelder J A, Mead R. A simplex method for function minimization[J]. The Computer Journal, 1965, 7:308--313.
  • 10Ge R, Qin Y. A class of filled functions for finding global minimizers of a function of several variables[J]. Journal of Optimization Theory and Applications, 1987, 54 (2) : 241-- 252.

共引文献8

同被引文献30

引证文献6

二级引证文献8

相关作者

内容加载中请稍等...

相关机构

内容加载中请稍等...

相关主题

内容加载中请稍等...

浏览历史

内容加载中请稍等...
;
使用帮助 返回顶部