期刊文献+

融合RoBERTa和注意力机制的隐喻方面级情感分析 被引量:1

Metaphorical Aspect Sentiment Analysis Based on RoBERTa and Attention Mechanism
下载PDF
导出
摘要 针对目前大多数隐喻情感分析方法存在对方面情感注意力引入不足的问题,提出一种用于隐喻方面级情感分类的模型.模型首先通过RoBERTa对具有方面情感信息的文本进行编码,将编码后的方面信息和多层情感注意力信息融合,形成多层方面注意力表征向量.将该表征向量与隐喻句的关联结果作为文本原始特征,利用注意力机制和方面信息对其解码,然后通过卷积网络计算隐喻句与方面词的关联度.将池化层输出结果和卷积计算结果合并,最后计算隐喻句不同方面词的情感极性的概率,完成隐喻情感分析.实验结果表明该模型对3种情感极性的平均判断准确率分别达到了83.26%,81.69%和56.68%,与基线实验相比均有所提升. Aiming at the problem that most of the current metaphor sentiment analysis methods lack the introduction of aspect emotional attention,a model for metaphor aspect-level sentiment classification is proposed.The model first encodes the text with aspect emotional information through RoBERTa,and fuses the encoded aspect information and multi-level emotional attention information to form a multi-level aspect attention representation vector.The correlation between the representation vector and the metaphorical sentence is used as the original feature of the text,and the attention mechanism and aspect information are used to decode it.Then the correlation between the metaphorical sentence and aspect words is calculated by convolution network.The pool layer output results and convolution calculation results are combined.Finally,the probability of emotional polarity of words in different aspects of metaphorical sentences is calculated to complete metaphorical sentiment analysis.The experimental results show that the average judgment accuracy of the model for the three emotional polarity reaches 83.26%,81.69%and 56.68%,respectively,which is improved compared with the baseline experiment.
作者 马圆圆 禹龙 田生伟 钱梦莹 张立强 MA Yuan-yuan;YU Long;TIAN Sheng-wei;QIAN Meng-ying;ZHANG Li-qiang(College of Software,Xinjiang University,Urumqi 830008,China;Network and Information Center,Xinjiang University,Urumqi 830008,China)
出处 《小型微型计算机系统》 CSCD 北大核心 2023年第10期2236-2241,共6页 Journal of Chinese Computer Systems
基金 国家自然科学基金项目(61962057)资助 国家自然科学基金重点项目(U2003208)资助 自治区重大科技项目(2020A03004-4)资助.
关键词 隐喻情感分析 方面级情感分析 多层注意力机制 RoBERTa metaphorical sentiment analysis aspect-based sentiment analysis multi-layer attention mechanism RoBERTa
  • 相关文献

参考文献5

二级参考文献74

  • 1Deerwester S C, Dumais S T, Landauer T K, et al. Indexing by latent semantic analysis. Journal of the American Society for Information Science, 1990.
  • 2Hofmann T. Probabilistic latent semantic indexing//Proceedings of the 22nd Annual International SIGIR Conference. New York: ACM Press, 1999:50-57.
  • 3Blei D, Ng A, Jordan M. Latent Dirichlet allocation. Journal of Machine Learning Research, 2003, 3: 993-1022.
  • 4Griffiths T L, Steyvers M. Finding scientific topics//Proceedings of the National Academy of Sciences, 2004, 101: 5228 5235.
  • 5Steyvers M, Gritfiths T. Probabilistic topic models. Latent Semantic Analysis= A Road to Meaning. Laurence Erlbaum, 2006.
  • 6Teh Y W, Jordan M I, Beal M J, Blei D M. Hierarchical dirichlet processes. Technical Report 653. UC Berkeley Statistics, 2004.
  • 7Dempster A P, Laird N M, Rubin D B. Maximum likelihood from incomplete data via the EM algorithm. Journal of the Royal Statistical Society, 1977, B39(1): 1-38.
  • 8Bishop C M. Pattern Recognition and Machine Learning. New York, USA: Springer, 2006.
  • 9Roweis S. EM algorithms for PCA and SPCA//Advances in Neural Information Processing Systems. Cambridge, MA, USA: The MIT Press, 1998, 10.
  • 10Hofmann T. Probabilistic latent semantic analysis//Proceedings of the Fifteenth Conference on Uncertainty in Artificial Intelligence. Stockholm, Sweden, 1999:289- 296.

共引文献384

同被引文献30

引证文献1

相关作者

内容加载中请稍等...

相关机构

内容加载中请稍等...

相关主题

内容加载中请稍等...

浏览历史

内容加载中请稍等...
;
使用帮助 返回顶部