一种改进的Lucene语义相似度检索算法

An Improved Retrieve Algorithm Incorporated Semantic Similarity for Lucene

在Lucene的基础上,结合检索词项的语义信息,利用外部词典Wordnet分析检索词项与被检索文档中词项的语义相似度,在此基础上实现对文档语义信息的检索。通过分析现有的相似度量函数的核心特征,选择合适的语义相似度量方法,提出了一种新的词项语义相似度检索函数,该函数能够对检索文档按照语义相似度进行排序。实验结果表明,所提出的方法能够有效地提升文献检索的准确度。

A retrieve algorithm that incorporates the semantic information of the words into traditional retrieve function of Lucene is proposed.The proposed method improves the important components of existing retrieve similarity functions with semantic information,and selects the appropriate measure of semantic similarity to compute the semantic similarity between the query words and text corpus by using the external dictionary Wordnet.With the semantic similarity,the algorithm implements semantic information retrieve and can sort the retrieved text documents according to the semantic similarity between query words and text documents.The experimental results show that the proposed method can improve the precision of document retrieval effectively.