期刊文献+

自底向上优化神经网络的方法

A Heuristic Approach for Improving Performance of Neural Network with the Cascade-Correlation
下载PDF
导出
摘要 引荐了一种自动优化神经网络的新方法。这种启迪方法综合采用了相关有效算法,通过快速自底向上构造神经网络算法,可以获得优化结构的神经网络,即时选定参数算法动态优化神经网络的学习参数,并且快速交叉校验算法为解决过度适应问题提供了捷径。实验证明,这种启迪方法能自动有效地优化神经网络,与其它算法相较而言,具有更好的归纳性能、优化的网络结构和更快的学习速度。 A new approach for the automated design of optimal neural network is presented.The heuristic approach employs several efficient algorithms,such as construction of optimal network architecture via fast cascade-correlation,dynamic optimization of learning parameters via simultaneous determination,avoiding overfitting problem via fast cross-validation.The experimental results show that the heuristic approach can automatically design optimal neural network with good generalization capability and optimal network and short training time in comparison with other algorithms.
作者 杨钟瑾
出处 《计算机工程与应用》 CSCD 北大核心 2006年第23期34-37,77,共5页 Computer Engineering and Applications
关键词 神经网络 瀑流关联 自底向上 学习参数优化 交叉校验 Neural Network,cascade-correlation,bottom-up,learning parameters optimization,cross-validation
  • 相关文献

参考文献16

  • 1Haykin S.Neural Networks,A Comprehensive Foundation[M].New York:Macmillan,1994
  • 2Fletcher R.Practical Methods of Optimization[M].New York:Wiley,1990
  • 3哈根等著.戴葵等译.神经网络设计[M].北京:机械工业出版社,2002
  • 4Rumelhart D E,Hinton G E,Williams R J.Learning Internal Representations by Error Propagation[C].In:Rumelhart D E,McClelland J L eds.Parallel Distributed Processing:Explanations in the Microstructure of Cognition,Cambridge,MA:MIT Press,1986; 1:318~362
  • 5Kung S,Fallside F,Sorenson J A et al.Neural Networks for Signal Processing[C].In:Proceeding of the 1992 IEEE Workshop,1992; Ⅱ:255~266
  • 6Guyon I,Wang P S P.Special Issue on Neural Networks and Pattern Recognition[J].Pattem Recognition Artificial Intelligence,1993;7(4):849~872
  • 7Friedman J H.An Overview of Predictive Learning and Function Approximation[C].In:Friedman J H,Wechsler H eds.From Statistics to Neural Networks:Theory and Pattern Recognition Applications,Proceeding of the ASI Conference,Subseries F,New York:Springer-Verlag,1994
  • 8杨钟瑾,史忠科.神经网络结构优化方法[J].计算机工程与应用,2004,40(25):52-54. 被引量:9
  • 9Moody J.Prediction Risk and Architecture Selection for Neural Networks[C].In:Cherkassky V,Friedman J,Wechsler H eds.From Statistics to Neural Networks:Theory and Pattern Recognition Applications,NATO ASI Series F,New York:Springer-Verlag,1994; 136:147~165
  • 10Fahlman S E,Lebiere C.The Cascade-Correlation Learning Architecture[C].In:Touretzky D S ed.Advances in Neural Information Processing Systems,San Mateo,CA:Morgan Kaufmann,1990; 2:524~532

二级参考文献54

  • 1S Haykin,Neural Networks.A Comprehensive Foundation[M].New York:Macmillan, 1994
  • 2R Fletcher. Practical Methods of Optimization[M].New York :Wiley,1990
  • 3D E Rumelhart,G E Hinton,R J Williams.Learning Internal Representations by Error Propagation[C].In :D E Rumelhart,J L McClelland eds.Parallel Distributed Processing:Explanations in the Microstructure of Cognition, Cambridge, MA: MIT Press, 1986-01: 318~362
  • 4S Kung,F Fallside,J A Sorenson et al. Neural Networks for Signal Processing[C].In:Proceedings of the 1992 IEEE Workshop, 1992:255~266
  • 5I Guyon,P S P Wang. Special Issue on Neural Networks and Pattern Recognition [J].Pattern Recognition Artificial Intelligence,1993;7(4):849~872
  • 6J H Friedman. An Overview of Predictive Learning and Function Approximation[C].In:J H Friedman,H Wechsler eds. From Statistics to Neural Networks:Theory and Pattern Recognition Applications,Proceedings of the ASI Conference,Subseries F,New York :Springer-Verlag,1994
  • 7J Moody. Prediction Risk and Architecture Selection for Neural Networks[C].In :V Cherkassky,J Friedman,H Wechsler eds. From Statistics to Neural Networks :Theory and Pattern Recognition Applications,NATO ASI Series F, New York: Springer-Verlag, 1994:136,147~165
  • 8S E Fahlman,C Lebiere.The Cascade-Correlation Learning Architecture[C].In:D S Touretzky ed.Advances in Neural Information Processing Systems,San Mateo,CA: Morgan Kaufmann, 1990-02: 524~532
  • 9R Reed.Pruning Algorithms-A Survey [J].IEEE Transaction on Neural Networks, 1993 ;4(5 ) :740~747
  • 10S A Harp,T Samad,A Guha. Designing Application-Specific Neural Networks Using the Genetic Algorithm[C].In:D S Touretzky ed.Advances in Neural Information Processing Systems ,San Mateo, CA:Morgan Kaufmann, 1989-02: 447~454

共引文献14

相关作者

内容加载中请稍等...

相关机构

内容加载中请稍等...

相关主题

内容加载中请稍等...

浏览历史

内容加载中请稍等...
;
使用帮助 返回顶部