基于自注意力和胶囊网络的短文本情感分析

Short Text Sentiment Analysis Based on Self-attention and Capsule Network

短文本的情感分析是一项具有挑战性的任务。针对传统的基于卷积神经网络和循环神经网络无法全面获取文本中蕴含的语义信息的缺点,本文提出一种使用多头自注意力层作为特征提取器,再以胶囊网络作为分类层的模型。该模型可以提取丰富的文本信息。在中文文本上进行实验结果表明,与传统深度学习方法相比,本文提出的模型提高了情感分析的精度,在小样本数据集和跨领域迁移中,相比传统方法精度都有较大的提高。

Sentiment analysis of short texts is a challenging task.Aiming at the shortcomings of traditional convolutional neural networks and recurrent neural networks that can not fully obtain the semantic information contained in texts,this paper proposed a model that used the multi-head self-attention layer as the feature extractor and used the capsule network as the classification layer.The model can extract rich text information and has strong expressive ability.Experimental results on Chinese text showed that compared with the traditional deep learning method,the proposed model improved the accuracy of sentiment analysis.In the small dataset and cross-domain migration,compared with traditional method,the accuracy was greatly improved.