期刊文献+

基于自适应在线极限学习机模型的预测方法 被引量:8

Study on Prediction Method Based on Adaptive Ensemble Online Sequential Extreme learning machine
下载PDF
导出
摘要 本文针对单个在线极限学习机输出不稳定的情况,提出一种自适应集成在线极限学习机算法(ASEOSELM)。算法首先初始化多个在线极限学习机模型,然后根据到达的每一批次数据的训练误差及其方差自适应地调整各个在线极限学习机的集成权重,并动态删除那些小于设定阈值的模型以提高算法的训练速度,最后选择准确度高、泛化能力好的模型用于集成预测。通过函数拟合、UCI数据集以及真实股价预测实验表明,文中提出的ASE-OSELM算法相比传统的OSELM、LS-SVM和BPNN算法具有更高的预测准确度和抗干扰能力。 Since the single online sequential extreme learning machine' s performance is unstable,it propose an adaptive and selective OSELM. Firstly,it initializes the multiple online sequential extreme learning machine model,then adjustes adaptively the integrated weight of every online sequential extreme learning machine according to their training error and variance for each batch of data,and deletes the model that its integrated weight is smaller than the threshold to improve the training speed dynamically. Finally,the high accuracy and good generalization' s model will be selected for integrated prediction. Experimental results show that the ASE-OSELM has higher forecast accuracy and generalization ability than BPNN、LS-SVM and OSELM.
出处 《统计研究》 CSSCI 北大核心 2016年第7期103-109,共7页 Statistical Research
基金 国家社会科学基金规划项目“跨媒体用户生成内容情感倾向挖掘及其应用研究”(15BTQ043) 安徽省自然科学基金项目“云环境移动位置服务中的应用轨迹隐私保护问题研究”(1408085MF127) 教育部人文社会科学研究规划基金项目“云计算一半下企业数据外包服务中的用户隐私保护问题研究”(12YJA630136)资助
关键词 人工神经网络 自适应集成 选择性集成 在线极限学习机 artificial neural network adaptive ensemble selective ensemble OSELM
  • 相关文献

参考文献16

  • 1邓万宇,郑庆华,陈琳,许学斌.神经网络极速学习方法研究[J].计算机学报,2010,33(2):279-287. 被引量:163
  • 2Huang G. - B. , Zhu Q. - Y. , Siew C. K. Extreme Learning Machine: A New Learning Scheme of Feedforward Neural Networks [ C ]. IEEE International Joint Conference on Neural Networks ( IJCNN). Budapest, HUNGARY, 2004,256 - 267.
  • 3Bartlett P L. The sample complexity of pattern classification with neural networks: The size of the weights is more important than the size of the network[ J]. IEEE Transactions on Information Theory, 1998, 44 (2) :525 -536.
  • 4Liang N. Y., Huang G. - B. A Fast and Accurate Online Sequential Learning Algorithm for Feedforward Networks[ J]. IEEE Transactions on Neural Networks. 2006, 17(6) : 1411 - 1423.
  • 5陆慧娟,安春霖,马小平,郑恩辉,杨小兵.基于输出不一致测度的极限学习机集成的基因表达数据分类[J].计算机学报,2013,36(2):341-348. 被引量:41
  • 6Huang GB, Chen L, Siew CK. Universal approximation using incremental constructive fecdforward networks with random hidden nodes[ JJ. IEEE Transactions on Neural Networks. 2006,17 (4) : 879 - 892.
  • 7Huang G B,Chena L. Convex incremental extreme learningmachine [ J]. Neurocomputing. 2007,70 ( 16 - 18 ) :3056 - 3062.
  • 8Feng G,Huang G. - B. , Lin Q, , et al. Error Minimized Extreme Learning Machine With Growth of Hidden Nodes and Incremental Learning[J]. IEEE Transactions on Neural Networks. 2009,20 (8) :1352 -1357.
  • 9Fan Y.T. ,Yang W.Y. ,Fan Q.W., et al. A pruning algorithm with LI/2 regularizer for extreme learning machine [ J ]. Zhejiang University-SCIENCE C ( Computers & Electronics). 2014,15 (2) : 119 - 125.
  • 10Lan Y. ,Soh H. C. , Huang G. - B. Ensemble of online sequential extreme learning machine [ J ]. Neurocomputlng. 2009,72 ( 13 - 15) :3391 -3395.

二级参考文献22

  • 1Hornik K. Approximation capabilities of multilayer feedforward networks. Neural Networks, 1991, 4(2): 251-257.
  • 2Leshno M, Lin V Y, Pinkus A, Schocken S. Multilayer feedforward networks with a nonpolynomial activation function can approximate any function. Neural Networks, 1993, 6(6) : 861-867.
  • 3Huang G-B, Babri H A. Upper bounds on the number of hidden neurons in feedforward networks with arbitrary bounded nonlinear activation functions. IEEE Transactions on Neural Networks, 1998, 9(1): 224-229.
  • 4Huang G-B. Learning capability and storage capacity of two hidden-layer feedforward networks. IEEE Transactions on Neural Networks, 2003, 14(2): 274-281.
  • 5Huang G-B, Zhu Q-Y, Siew C-K. Extreme learning machine: Theory and applications. Neurocomputing, 2006, 70 (1-3): 489-501.
  • 6Vapnik V N. The Nature of Statistical Learning Theory. New York: Springer, 1995.
  • 7Rousseeuw P J, Leroy A. Robust Regression and Outlier Detection. New York: Wiley, 1987.
  • 8Rumelhart D E, McClelland J L. Parallel Distributed Processing. Cambridge.. MIT Press, 1986, 1(2): 125-187.
  • 9Cristianini N, Shawe-Taylor J. An Introduction to Support Vector Machines. Cambridge: Cambridge University Press, 2000.
  • 10Tamura S, Tateishi M. Capabilities of a four-layered feedforward neural network: Four layers versus three. IEEE Transactions on Neural Networks, 1997, 8(2): 251-255.

共引文献197

同被引文献77

引证文献8

二级引证文献11

相关作者

内容加载中请稍等...

相关机构

内容加载中请稍等...

相关主题

内容加载中请稍等...

浏览历史

内容加载中请稍等...
;
使用帮助 返回顶部