基于预训练语言模型的早期微博谣言检测

Early Microblog Rumor Detection Based on Pre-trained Language Model

该文基于微博数据以实现早期谣言检测为目的,挖掘微博内容的深层语义信息。为提高谣言检测效率,该文使用预训练语言模型对部分参数进行了预训练,提高了模型的训练速度,同时解决了一词多义情况的词向量表示问题,优化了深层语义信息的表达能力。结合BiGRU-MHA模型学习微博内容的深层语义信息,最后输出微博事件的分类结果。实验结果表明,XLNet+BiGRU-MHA模型的F1值达到95.5%,在任何时间阶段内均处于领先地位。

Based on microblog data,this paper aims to realize early rumor detection and mining the deep semantic information of microblog content.In order to improve the efficiency of rumor detection,a pretrained language model is used to pre-train some parameters and improve the training speed of the model.At the same time,the problem of word vector representation in the case of polysemy is solved,and the expression ability of deep semantic information is optimized.Combined with Bigru-MHA model to learn the deep semantic information of microblog content,and finally output the classification results of microblog events.The experimental results show that the F1 value of XLNET+Bigru-MHA model reaches 95.5%,which is in the leading position in any time period.