期刊文献+

基于多层最大熵模型的句子主干分析 被引量:4

Skeleton Parsing Based on Multi-layer Maximum Entropy Model
下载PDF
导出
摘要 句子主干分析的主要任务是自动识别句子的主干成分。鉴于汉语句子之间成分的相关性,提出一种多层最大熵模型,它的底层最大熵利用句子的上下文特征识别主干词候选项,高层最大熵利用底层最大熵模型的计算结果,结合句子内的远距离特征和句子之间的关系,对底层最大熵模型识别出的主干词候选集进行分析。实验证明,该模型对于简单的主干成分识别正确率较高,对训练语料有一定的依赖;随着语料规模的增长,模型性能缓慢提升。 The main task of Skeleton Parsing is to identify the skeleton of a sentence automatically.Chinese Skeleton Parsing is a key problem in NLP.Because of the interrelation of the skeleton in the same context,a Multi-layer Maximum Entropy Model(MMEM) for the skeleton parsing was proposed.The low-layer ME analyzed skeleton by the context features while the high-layer ME analyzed skeleton by both the result of the low-layer ME and the features between sentences.The experiment showed that MMEM was efficient for Chinese skeleton parsing.A high precision was achieved under a small corpus while it was dependable on the scale of corpus.With the increasing of the corpus,the precision of MMEM improves slowly.
机构地区 国防科技大学C
出处 《计算机科学》 CSCD 北大核心 2010年第12期156-160,共5页 Computer Science
基金 国家自然科学基金项目(60903225 60172012) 湖南省自然科学基金项目(03JJY3110)资助
关键词 最大熵 多层最大熵模型 主干词 主干分析 自然语言理解 Maximum entropy Multi-layer maximum entropy model Skeleton word Skeleton parsing Natural language processing
  • 相关文献

参考文献3

二级参考文献25

  • 1孙茂松,邹嘉彦.汉语自动分词研究评述[J].当代语言学,2001,3(1):22-32. 被引量:101
  • 2D. D. Lewis. Naive (Bayes) at forty: The independence assumption in information retrieval. In: Proc. of the 10th European Conf. on Machine Learning. New York: Springer,1998, 4-15.
  • 3Y. Yang, X. Lin. A re-examination of text categorization methods. In: The 22nd Annual Int'l ACM SIGIR Conf. onResearch and Development in the Information Retrieval. NewYork: ACM Press, 1999.
  • 4Y. Yang, C. G. Chute. An example based mapping method for text categorization and retrieval. ACM Trans. on Information Systems, 1994, 12(3): 252 -277.
  • 5E. Wiener. A neural network approach to topic spotting. The 4th Annual Syrup. on Document Analysis and Information Retrieval,Las Vegas, NV, 1995.
  • 6R. E. Schapire, Y. Singer. Improved boosting algorithms using confidence-rated predications. In: Proc. of the 11th Annual Conf.on Computational Learning Theory. New York: ACM Press,1998. 80--91.
  • 7T. Joachims. Text categorization with support vector machines:Learning with many relevant features. In: Proc. of the 10th European Conf. on Machine Learning. New York: Springer,1998. 137-142.
  • 8Y. Yang. An evaluation of statistical approaches to text categorization. Information Retrieval, 1999, 1 ( 1 ) : 76-- 88.
  • 9R. Adwait. Maximum entropy models for natural language ambiguity resolution: [ Ph. D. dissertation ] . Pennsylvania:University of Pennsylvania, 1998.
  • 10R. Adwait. A maximum entropy model for part-of-speech tagging. The Empirical Methods in Natural Language Processing Conference, Philadelphia, USA, 1996.

共引文献99

同被引文献43

引证文献4

二级引证文献13

相关作者

内容加载中请稍等...

相关机构

内容加载中请稍等...

相关主题

内容加载中请稍等...

浏览历史

内容加载中请稍等...
;
使用帮助 返回顶部