期刊文献+

基于最大熵模型的汉语问句语义组块分析 被引量:5

Chinese Question Sentence Semantic Chunk Parsing Based on Maximum Entropy Model
下载PDF
导出
摘要 问句分析是问答系统的关键,为降低问句完整语法分析的复杂度,该文应用浅层句法分析理论,采用问句语义组块方式来分析问句。以“知网”知识库为基础,提取和定义了表达汉语问句的6种语义块,定义了语义组块最大熵模型的特征表示,通过最大熵原理实现了语义组块特征抽取和特征选取学习算法,并以模型为基础实现了真实问句的语义块的标注,从而为在语义层面上理解汉语问句奠定了基础。实验结果说明最大熵模型应用于汉语问句语义组块分析具有较好的效果。 The key of question-answering system is question parsing. This paper applies shallow sentence parsing theory and adopts the method of question semantic chunk to analyze question in order to decrease the complexity of full syntax parsing. Based on the knowledge database of Hownet, this paper defines six kinds of semantic chunks expressing Chinese question and the feature representation of semantic chunk in maximum entropy model. A learning arithmetic of feature extraction and feature selection of semantic chunks are implemented. The semantic chunks of true question are recognized based on maximum entropy model. The experiment results show that the maximum entropy model has a very good effect on semantic chunk parsing to Chinese question sentence.
出处 《计算机工程》 EI CAS CSCD 北大核心 2005年第17期3-5,8,共4页 Computer Engineering
基金 云南省信息技术基金资助项目(2002IT03)
关键词 最大熵模型 问句分析 句法分析 组块分析 语义块 Maximum entropy model Question sentence parsing Sentence parsing Chunk parsing Semantic chunk
  • 相关文献

参考文献7

二级参考文献67

  • 1孙宏林,俞士汶.浅层句法分析方法概述[J].当代语言学,2000,2(2):74-83. 被引量:38
  • 2周强,俞士汶.汉语短语标注标记集的确定[J].中文信息学报,1996,10(4):1-11. 被引量:35
  • 3陈凯江 刘秉伟 黄萱菁 等.基于隐马尔可夫模型的实体名识别[A]..见:863计划智能计算机主题学术会议论文集[C].北京:清华大学出版社,2001.443~453.
  • 4[1]Erik F, Tjong Kim Sang,Buchholz S. Introduction to the CoNLL-2000 Shared Task: Chunking. In: Proceedings of CoNLL2000 and LLL-2000, Lisbon, Portugal, 2000. 127~132
  • 5[2]Steven A. Parsing by Chunks. In: Berwick, Abney, Tenny eds. Principle-Based Parsing: Kluwer Academic Publishers,1991. 257~278
  • 6[5]Ratnaparkhi A. A maximum entropy model for part-of-speech tagging. In: Proceedings of the Conference on Empirical Methods in Natural Language Processing, 1996
  • 7[6]Ratnaparkhi A. A simple introduction to maximum entropy models for natural language processing. Institute for Research in Cognitive Science, University of Pennsylvania : Technical Report 9708, 1997
  • 8[7]Berger A, Pietra S D, Pietra V D. A maximum entropy approach to natural language processing. Computational Linguistics, 1996,22(1):39~71
  • 9[8]Skut, Wojciech, Thorsten Brants. A maximum entropy partial parser for unrestricted text. In:Proceedings of the 6th Workshop on Very Large Corpora, Montreal, Canada, 1998. 143~151
  • 10[10]Abney S. Part-of-speech tagging and partial parsing. In:Church K, Young S, Bloothooft G eds. Corpus-Based Methods in Language and Speech, An ELSNET volume, Dordrecht:Kluwer Academic Publishers, 1996. 119~136

共引文献194

同被引文献75

引证文献5

二级引证文献77

相关作者

内容加载中请稍等...

相关机构

内容加载中请稍等...

相关主题

内容加载中请稍等...

浏览历史

内容加载中请稍等...
;
使用帮助 返回顶部