基于朴素贝叶斯模型的单词语义相似度度量

Word Semantic Similarity Measurement Based on Naïve Bayes Model

单词语义相似度度量是自然语言处理领域的经典和热点问题.通过结合朴素贝叶斯模型和知识库,提出一个新颖的度量单词语义相似度度量途径.首先借助通用本体WordNet获取属性变量,然后使用统计和分段线性插值生成条件概率分布列,继而通过贝叶斯推理实现信息融合获得后验概率,并在此基础上量化单词语义相似度.主要贡献是定义了单词对距离和深度,并将朴素贝叶斯模型用于单词语义相似度度量.在基准数据集R＆G（65）上,对比算法评判结果与人类评判结果的相关度,采用5折交叉验证对算法进行分析,样本Pearson相关度达到0.912,比当前最优方法高出0.4%,比经典算法高出7%~13%;Spearman相关度达到0.873,比经典算法高出10%~20%;且算法的运行效率和经典算法相当.实验结果显示将朴素贝叶斯模型和知识库相结合解决单词语义相似度问题是合理有效的.

Measuring semantic similarity between words is a classical and hot problem in nature language processing,the achievement of which has great impact on many applications such as word sense disambiguation,machine translation,ontology mapping,computational linguistics,etc.A novel approach is proposed to measure words semantic similarity by combining Nave Bayes model with knowledge base.To start,extract attribute variables based on WordNet;then,generate conditional probability distribution by statistics and piecewise linear interpolation technique;after that,obtain posteriori through Bayesian inference;at last,quantify word semantic similarity.The main contributions are definition of distance and depth between word pairs with small amount of computation and high degree of distinguishing the characteristics from words＇sense,and word semantic similarity measurement based on nave Bayesian model.On benchmark data set RG（65）,the experiment is conducted through 5-fold cross validation.The sample Pearson correlation between test results and human judgments is 0.912,with 0.4%improvement over existing best practice,and7%~13%improvement over classical methods.Spearman correlation between test results and human judgments is 0.873,with 10% ~20% improvement over classical methods.And the computational complexity of the method is as efficient as the classical methods,which indicates that integrating Nave Bayes model with knowledge base to measure word semantic similarity is reasonable and effective.