基于Doc2Vec与SVM的聊天内容过滤

Chat Content Filtering Based on Doc2Vec and SVM

直播系统中用户聊天内容的实时拦截具有非常重大的意义,为了提高分类的准确率和效率,提出了一种基于Doc2Vec与SVM结合的文本分类模型对聊天内容分类,判断聊天内容是否应该被拦截.首先使用Doc2Vec模型将聊天内容表示成密集数值向量的形式,第二部分使用SVM分类器进行分类.通过实验表明,该模型有效地减少了文本表示的维度,提高了训练效率,而且具有的97%的准确率和89.82%召回率,性能优于朴素贝叶斯和基于Doc2Vec的Logistic模型.

The real-time interception of user chat content in live broadcast system is of great significance.In order to improve the accuracy and efficiency of the classification,a text classification model based on the combination of Doc2Vec and SVM is proposed to classify the chat content and judge whether the chat content should be intercepted.The First part uses the Doc2Vec model to represent the chat content as a dense numeric vector,and then an SVM classifier is used to classify.The experimental results show that the model greatly reduces the dimension of text representation with high efficiency,and it has excellent accuracy rate（97%）and recall rate（89.82%）,which are superior to Naive Bayes and the logistic based on Doc2Vec.