采用注意力门控卷积网络模型的目标情感分析

Analysis of targeted sentiment by the attention gated convolutional network model

针对传统目标情感分析采用循环神经网络模型导致训练时间长且其他替代模型未能使得上下文和目标词之间实现良好交互等问题,提出了一种用于目标情感分析的注意力门控卷积网络模型。该模型首先将上下文和目标词通过多头注意力机制加强上下文和目标词之间的交互;其次采用门控卷积机制进一步提取关于目标词的情感特征;最后通过Softmax分类器将情感特征进行分类,输出情感极性。实验结果显示,与循环神经网络模型中准确率最高的循环注意力网络模型相比,在SemEval 2014任务四的餐厅和笔记本电脑数据集上的准确率分别提高了1.29%和0.12%;与循环神经网络模型中收敛速度较快的基于注意力的长短期记忆网络模型相比,收敛时间下降了约29.17s。

The recurrent neural networks are used for traditional targeted sentiment analysis and usually lead to a long training time.And other alternative models are unable to make a good interaction between context and target words.An attention gated convolutional network model for targeted sentiment analysis is proposed.First,context and target words are processed by the multiple attention mechanism to enhance their interactions.Second,the gated convolution mechanism is used to selectively generate emotional features.Finally,the emotional features are classified by the Softmax classifier to output the emotional polarity.Experimental results show that compared with the Recurrent Attention Network model,which has the highest accuracy rate in the recurrent neural network models,the proposed model improves the accuracy rate by 1.29%and 0.12%respectively on the Restaurant and Laptop datasets of SemEval 2014 Task4.Compared with the Attention-based Long Short-Term Memory Network model,which has a faster convergence rate in the recurrent neural network model,the convergence time is reduced by 29.17 s.