基于Word2vec和句法规则的自动问答系统问句相似度研究

QUESTION SIMILARITY OF AUTOMATIC QUESTION ANSWERING SYSTEM BASED ON WORD2VEC AND SYNTACTIC RULES

自动问答系统问句相似度计算的准确率直接影响系统返回答案的准确率,对此提出一种基于Word2vec和句法规则的问句相似度计算方法。构造Text-CNN问句分类模型将问句进行分类,再构造Word2vec词向量模型将问句中词与词的空间向量相似度转换成语义相似度,并加入句法规则的分析。随机从搜狗公开问答数据集中抽取200条数据进行测试,结果表明,该方法与TF-IDF方法相比,自动问答系统返回答案的准确率和召回率分别提高了0.259和0.154。

The accuracy of question similarity calculation in the automatic question answering system directly affects the accuracy of the answers returned by the system.Therefore,a question similarity calculation method based on Word2vec and syntactic rules is proposed.This method constructed the Text-CNN questions classification model to classify questions,and then constructed the Word2vec word vector model to convert the spatial vector similarity of words and words in questions into semantic similarity,and added the analysis of syntactic rules.The 200 data were randomly extracted from Sogou public Q&A data set for testing.The results show that compared with TF-IDF method,the accuracy rate and recall rate of the automatic question answering system are improved by 0.259 and 0.154 respectively.