期刊文献+

基于门控权重单元的多变量时间序列预测 被引量:3

Multivariate Time Series Prediction Based on Gating Weight Unit
下载PDF
导出
摘要 多变量时间序列各变量间依赖性较强,数据变化趋势不明显,预测难度高.传统研究采用带门控机制的循环神经网络及变体进行预测,但序列间存在相互依赖关系,突变数据段建模预测不精确.基于信息熵,本文提出一种新的改进门控权重单元,利用信息熵技术量化数据序列的变化程度,动态调整权重矩阵刻画数据的变化趋势.基于4个公开数据集分别进行实验,实验结果表明新模型比传统循环神经网络模型具有更好的预测性能. There is strong dependence among the variables of multivariate time series,which makes the data trend unobvious and the prediction difficult.Traditionally,recurrent neural network with gating mechanisms and its variants are used for prediction.But the interdependence between sequences makes the prediction result of mutation data not accurate.Based on information entropy,a new modified gating weight unit is presented.The change degree of data is quantified by using information entropy to dynamically adjust the weight matrix and describe the trend of data.The experiment is conducted with four public data sets.The experimental results show that the proposed model has better prediction performance than the traditional recurrent neural network.
作者 张冬梅 李金平 李江 余想 宋凯旋 ZHANG Dongmei;LI Jinping;LI Jiang;YU Xiang;SONG Kaixuan(School of Computer Science,China University of Geosciences,Wuhan 430074,China;Information Center,Department of Natural Resources of Hubei Province,Wuhan 430071,China)
出处 《湖南大学学报(自然科学版)》 EI CAS CSCD 北大核心 2021年第10期105-112,共8页 Journal of Hunan University:Natural Sciences
基金 国家自然科学基金联合基金重点支持项目(U1911205) 国家重大科技专项(2016ZX05014-003-003)。
关键词 多变量时间序列 门控机制 循环神经网络 门控权重单元 信息熵 multivariate time series gated mechanism recurrent neural network gating weight unit information entropy
  • 相关文献

参考文献3

二级参考文献35

  • 1Y. LeCun, L. Bottou, Y. Bengio, P. Haffner. Gradient-based learning applied to document recognition. Proceedings of the 1EEE, vol. 86, no. 11, pp. 2278-2324, 1998.
  • 2A. Krizhevsky, I. Sutskever, G. E. Hinton. ImageNet clas- sification with deep convolutional neural networks. In Pro- ceedings of Advances in Neural Information Processing Sys- tems 25, NIPS, Lake Tahoe, Nevada, USA, pp. 1091105, 2012.
  • 3K. Cho, B. van Merinboer, C. Gulcehre, D. Bahdanau, F. Bougares, H. Schwenk, Y. Bengio. Learning phrase repre- sentations using RNN encoder-decoder for statistical ma- chine translation. In Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing, Association for Computational Linguistics, Doha, Qatar, pp. 1721734, 2014.
  • 4I. Sutskever, O. Vinyals, Q. V. Le. Sequence to sequence learning with neural networks. In Proceedings of Advances in Neural Information Processing Systems 27, NIPS, Mon- treal, Canada, pp. 3104-3112, 2014.
  • 5D. Bahdanau, K. Cho, Y. Bengio. Neural machine transla- tion by jointly learning to align and translate. In Interna- tional Conference on Learning Representations 2015, San Diego, USA, 2015.
  • 6A. Graves, A. R. Mohamed, G. Hinton. Speech recogni- tion with deep recurrent neural networks. In Proceedings of International Conference on Acoustics, Speech and Sig- nal Processing, IEEE, Vancouver, Canada, pp. 6645-6649, 2013.
  • 7K. Xu, J. L. Ba, R. Kiros, K. Cho, A. Courville, R. Salakhudinov, R. S. Zemel, Y. Bengio. Show, attend and tell: Neural image caption generation with visual atten- tion. In Proceedings of the 32nd International Conference on Machine Learning, Lille, prance, vol. 37, pp. 2048 2057, 2015.
  • 8A. Karpathy, F. F. Li. Deep visual-semantic alignments for generating image descriptions. In Proceedings of IEEE In- ternational Conference on Computer Vision and Pattern Recognition, IEEE, Boston, USA, pp. 3128 3137, 2015.
  • 9R. Lebret, P. O. Pinheiro, R. Collobert. Phrase-based im- age captioning. In Proceedings of the 32nd International Conference on Machine Learning, Lille, Prance, voh 37, pp. 2085 2094, 2015.
  • 10J. Donahue, L. A. Hendricks, S. Guadarrama, M. Rohrbach, S. Venugopalan, K. Saenko, T. Darrell. Long-term recurrent convolutional networks for visual recognition and descrip- tion. In Proceedings of IEEE International Conference on Computer Vision and Pattern Recognition, IEEE, Boston, USA, pp. 2625-2634, 2015.

共引文献52

同被引文献23

引证文献3

二级引证文献4

相关作者

内容加载中请稍等...

相关机构

内容加载中请稍等...

相关主题

内容加载中请稍等...

浏览历史

内容加载中请稍等...
;
使用帮助 返回顶部