期刊文献+

四种基本统计句法分析模型在汉语句法分析中的性能比较 被引量:10

A Comparative Study of Four Primary Statistical Models in Chinese Parsing
下载PDF
导出
摘要 统计模型的选择是统计句法分析的关键。目前句法分析常用的有四种经典统计模型—PCFG模型 ,基于历史模型、分层渐近式模型和头驱动模型。本文通过实验 ,在已有的 10 0 0 0句汉语树库基础上 ,测试了这四种经典模型在现有数据规模下各自的性能 ,并论述了这四种经典模型的各自特点。本文旨在通过对四种基本模型的比较研究 ,为具体应用中句法分析模型的选择提供参考和依据。 Choosing the statistical model is the key problem in statistical parsing. Statistical model lies in the core of NLP parsing. This paper investigates 4 primary statistical parsing models, namely PCFG, history-based model, cascading parsing model and head-driven parsing model, and compares their performances in a 10000 Chinese treebank. The analysis based on the experiment were shown in the paper. The comparative study of these models can be exploited to build the practical and effective Chinese parser.
出处 《中文信息学报》 CSCD 北大核心 2003年第3期1-8,共8页 Journal of Chinese Information Processing
基金 国家自然科学基金资助项目 ( 69775 0 17) 国家"八六三"高技术研究发展计划基金资助项目( 863- 30 6- 12 0 0 1AA11410 1)
关键词 计算机应用 中文信息处理 统计句法分析 基本模型 汉语分析 computer application Chinese information processing statistical parsing primary statistical models Chinese parsing
  • 相关文献

参考文献9

  • 1杨沐昀 赵铁军 于浩.自底向上的汉语句法标注体系设计与实践[A].黄昌宁主编.自然语言理解与机器翻译[C].南京清华大学出版社,2001.160—166.
  • 2C.D. Manning H. Schutze Foundations of statistical natural language processing The MIT Press. Cambridge, Massachusetts, London, England,.
  • 3T. L. Booth and R. A. Thompson. Applying Probability Measures to Abstract Languages. IEEE Transactions on Computers, 1973,C- 22(5), :442-450.
  • 4E, Black F. Jelinek J. Lafferty D, Magerman Towerds history-based grammars: using richer models for probabilistic parsing in Proc.ACL'93,Columbus,OH,1993:31-37
  • 5David M. Magerman. Natural Language Parsing as Statistical Pattern Recognition. Ph.D. thesis Stanford University. 1994.
  • 6Marcus, Mitehell Deterministic Parsing and Description Theory in P. Whitelock, M. Wood, H. Somers & P.Bennett (eds) Linguistie Theory and Computer Applications, New York, Academic Press, 1980:69-112.
  • 7Steve Abney. Rapid incremental parsing with repair. In Proceedings of the 6th New OED Conference:Electronic Text Research, 1990:1-9.
  • 8A. Ratnaparkhi Learning to parse natural language with naximum entropy models Machine learning 1999(34) :151-178.
  • 9M. Collins. Head-Driven Statistical Models for Natural Language Parsing. Ph.D. Thesis, The University of Pennsylvania. 1999.

同被引文献97

引证文献10

二级引证文献61

相关作者

内容加载中请稍等...

相关机构

内容加载中请稍等...

相关主题

内容加载中请稍等...

浏览历史

内容加载中请稍等...
;
使用帮助 返回顶部