期刊文献+

A Double-Weighted Deterministic Extreme Learning Machine Based on Sparse Denoising Autoencoder and Its Applications

A Double-Weighted Deterministic Extreme Learning Machine Based on Sparse Denoising Autoencoder and Its Applications
下载PDF
导出
摘要 Extreme learning machine (ELM) is a feedforward neural network-based machine learning method that has the benefits of short training times, strong generalization capabilities, and will not fall into local minima. However, due to the traditional ELM shallow architecture, it requires a large number of hidden nodes when dealing with high-dimensional data sets to ensure its classification performance. The other aspect, it is easy to degrade the classification performance in the face of noise interference from noisy data. To improve the above problem, this paper proposes a double pseudo-inverse extreme learning machine (DPELM) based on Sparse Denoising AutoEncoder (SDAE) namely, SDAE-DPELM. The algorithm can directly determine the input weight and output weight of the network by using the pseudo-inverse method. As a result, the algorithm only requires a few hidden layer nodes to produce superior classification results when classifying data. And its combination with SDAE can effectively improve the classification performance and noise resistance. Extensive numerical experiments show that the algorithm has high classification accuracy and good robustness when dealing with high-dimensional noisy data and high-dimensional noiseless data. Furthermore, applying such an algorithm to Miao character recognition substantiates its excellent performance, which further illustrates the practicability of the algorithm. Extreme learning machine (ELM) is a feedforward neural network-based machine learning method that has the benefits of short training times, strong generalization capabilities, and will not fall into local minima. However, due to the traditional ELM shallow architecture, it requires a large number of hidden nodes when dealing with high-dimensional data sets to ensure its classification performance. The other aspect, it is easy to degrade the classification performance in the face of noise interference from noisy data. To improve the above problem, this paper proposes a double pseudo-inverse extreme learning machine (DPELM) based on Sparse Denoising AutoEncoder (SDAE) namely, SDAE-DPELM. The algorithm can directly determine the input weight and output weight of the network by using the pseudo-inverse method. As a result, the algorithm only requires a few hidden layer nodes to produce superior classification results when classifying data. And its combination with SDAE can effectively improve the classification performance and noise resistance. Extensive numerical experiments show that the algorithm has high classification accuracy and good robustness when dealing with high-dimensional noisy data and high-dimensional noiseless data. Furthermore, applying such an algorithm to Miao character recognition substantiates its excellent performance, which further illustrates the practicability of the algorithm.
作者 Liang Luo Bolin Liao Cheng Hua Rongbo Lu Liang Luo;Bolin Liao;Cheng Hua;Rongbo Lu(College of Computer Science and Engineering, Jishou University, Jishou, China;College of Computer and Artificial Intelligence, Huaihua University, Huaihua, China)
出处 《Journal of Computer and Communications》 2022年第11期138-153,共16页 电脑和通信(英文)
关键词 Extreme Learning Machine Sparse Denoising Autoencoder Pseudo-Inverse Method Miao Character Recognition Extreme Learning Machine Sparse Denoising Autoencoder Pseudo-Inverse Method Miao Character Recognition
  • 相关文献

参考文献2

二级参考文献17

  • 1Huang G B, Zhu Q Y, Siew C K. Extreme learning machine., theory and applications[J]. Neurocomputing, 2006, 70(1 - 3) : 489 - 501.
  • 2Huang G B, Ding X J, Zhou H M. Optimization method based extreme learning machine for classification[J]. Neurocompu ting, 2010, 74(1): 155-163.
  • 3Huang G B, Zhou H M, Ding X J, et al. Extreme learning machine for regression and multiclass classification[J]. IEEE Trans. on Sys- tems, Man, and Cybernetics-Part B : Cybernetics, 2012, 42 (2) 513 - 529.
  • 4Zong W W, Huang G B, Chen Y Q. Weighted extreme learning machine for imbalance learning [J]. Neurocomputing, 2013, 101: 229 - 242.
  • 5Horata P, Chiewchanwattana S, Sunat K. Robust extreme learning machine[J]. Neurocomputing, 2013,102 : 31 - 44.
  • 6Lan Y, Hu Z J, Soh Y C, et al. An extreme learning machineapproach for speaker recognition[J]. Neural Computing and Applications, 2013, 22(3/4): 417-425.
  • 7Xu Y, Dai Y Y, Dong Z Y, et al. Extreme learning machine based predictor for real-time frequency stability assessment of electric power systems[J]. Neural Computing and Applica tions, 2013, 22(3/4): 501-508.
  • 8Rong H J, Ong Y S, Tan A H, et al. A fast pruned-extreme learning machine for classification problem [J]. Neurocompu ting, 2008, 72(1): 359-366.
  • 9Miche Y, Sorjamaa A. OP ELM.- optimally pruned extreme learning machine[J]. IEEE Trans. on Neural Networks ,2010,21(1) :158 - 162.
  • 10Lanckriet O R G, Cristianini N, Bartlett P, et al. Learning the kernel matrix with semidefinite programming[J]. Journal of Machine Learning Research, 2004, 5(1) : 27 - 72.

共引文献112

相关作者

内容加载中请稍等...

相关机构

内容加载中请稍等...

相关主题

内容加载中请稍等...

浏览历史

内容加载中请稍等...
;
使用帮助 返回顶部