期刊文献+

一种基于依存句法和WRD的句子相似计算方法

A Sentence Similarity Calculation Method based on Dependency Parsing and WRD
下载PDF
导出
摘要 句子相似计算技术能够得到两个句子的相似关系,在敏感数据检测领域具有广阔的应用前景。因此,提出了一种融合依存句法和Word Rotator’s Distance语义距离的句子相似计算方法。通过依存句法分析句子结构并提取各种依存关系词集,计算对应依存关系词集间的Word Rotator’s Distance语义距离,并最终得到两个句子的相似指数。实验证明,该方法能够得到比较准确的句子相似计算结果,适用于多种敏感数据检测场景。 Sentence similarity computing technology can obtain the similarity of two sentences,which has a broad application prospect in the field of sensitive data detection.This paper proposes a sentence similarity calculation method that combines dependency parsing and Word Rotator’s Distance semantic distance.This method analyzes the sentence structure through dependency parsing and extracts various dependency relation word sets,and calculates the Word Rotator’s Distance semantic distance between the dependency relation word sets and finally obtains the similarity index of the two sentences.Experiments prove that this method can obtain relatively accurate sentence similarity calculation results,and is suitable for a variety of sensitive data detection scenarios.
作者 周俊 石元兵 魏忠 金贵涛 郭红 ZHOU Jun;SHI Yuanbing;WEI Zhong;JIN Guitao;GUO Hong(Westone Information Industry Ltd.,Chengdu Sichuan 610041,China)
出处 《通信技术》 2021年第1期181-187,共7页 Communications Technology
关键词 句子相似 依存句法 Word Mover’s Distance Word Rotator’s Distance Word2vec sentence similarity dependency parsing Word Mover’s Distance Word Rotator’s Distance Word2vec
  • 相关文献

参考文献4

二级参考文献50

  • 1夏天,樊孝忠,刘林,骆正华.基于ALICE的汉语自然语言接口[J].北京理工大学学报,2004,24(10):885-889. 被引量:11
  • 2吴健,吴朝晖,李莹,邓水光.基于本体论和词汇语义相似度的Web服务发现[J].计算机学报,2005,28(4):595-602. 被引量:218
  • 3朱嫣岚,闵锦,周雅倩,黄萱菁,吴立德.基于HowNet的词汇语义倾向计算[J].中文信息学报,2006,20(1):14-20. 被引量:326
  • 4李峰,李芳.中文词语语义相似度计算——基于《知网》2000[J].中文信息学报,2007,21(3):99-105. 被引量:106
  • 5刘群,李素建.基于《知网》的词汇语义相似度的计算[C].台北:第三届汉语词汇语义学研讨会,2002.
  • 6董振东,董强.知网[DB/OL],http://www.keenage.com.
  • 7Dekang Lin. An Information-Theoretic Definition of Similarity Semantic distance in WordNet [C]//Proceedings of the Fifteenth International Conference on Machine Learning. 1998.
  • 8Eneko Agirre, German Rigau. A Proposal for Word Sense Disambiguation using Conceptual Distance[C]// Proceedings of the First International Conference on Recent Advanced in NLP. 1995.
  • 9BUDANITSKY, A. AND HIRST, G. Semantic distance in WordNet: An experimental, application-oriented evaluation of five measures [C]//Workshop on WordNet and Other Lexical Resources, Second meeting of the North American Chapter of the Association for Computational Linguistics. 2001.
  • 10Resnik P. Semantic similarity in a taxonomy an information based measure and its application to problems of ambiguity in natural language[J]. Journal of Artificial Intelligence Research1999,11:95-130.

共引文献129

相关作者

内容加载中请稍等...

相关机构

内容加载中请稍等...

相关主题

内容加载中请稍等...

浏览历史

内容加载中请稍等...
;
使用帮助 返回顶部