期刊文献+

基于神经网络的统计机器翻译的预调序模型 被引量:5

A Neural Pre-reordering Model for Statistical MT
下载PDF
导出
摘要 长距离调序是统计机器翻译的一个主要挑战。之前的研究工作表明预调序是解决这个问题的一个可能的途径。在该工作中,我们沿着预调序这个研究方向,将神经网络建模结合到线性排序的框架之下,提出了一个基于神经网络的预调序模型。这个的预调序模型能够利用从海量未标注数据中抽取的句法和语意信息,从而更好的对不同语言之间的语序差异进行预测。我们在中文到英文以及日文到英文的机器翻译任务上进行了实验,实验结果表明了该方法的有效性。 Long distance reordering is a major challenge in statistical machine translation. Previous work has shown that pre-reordering is a promising way to tackle this problem. In this work, we extend this line of research and pro- pose a neural network based pre-reorder model, which integrates neural network modeling into a linear ordering framework. The neural network based model can leverage syntactic and semantic information extracted from unla- hel.ed data to predict the word order difference between languages. Experiments on Chinese-English, and Japanese- English machine translation tasks show the effectiveness of our approach.
作者 杨南 李沐
出处 《中文信息学报》 CSCD 北大核心 2016年第3期103-110,共8页 Journal of Chinese Information Processing
关键词 统计机器翻译 预调序 神经网络 statistical machine translation pre-reorder neural network
  • 相关文献

参考文献19

  • 1Philipp-Koehn,Franz Josef Och,Daniel Marcu. Statistical phrase-based translation[C]//Proceedings of the 2003 Conference of the North American Chapter of the Association for Computational Linguistics on Human Language Technology.2003,1: 48-54.
  • 2Deyi-Xiong,Qun Liu,Shouxun Lin. Maximum entropy based phrase reordering model for statistical machine translation[C]//Proceedings of the 21st International Conference on Computational Linguistics and the 44th annual meeting of the Association for Computational Linguistics.2006: 521-528.
  • 3David-Chiang. A hierarchical phrase-based model for statistical machine translation[C]//Proceedings of the 43rd Annual Meeting on Association for Computational Linguistics.2005: 263-270.
  • 4Yang-Liu,Qun Liu,Shouxun Lin. Tree-to-string alignment template for statistical machine translation[C]// Proceedings of the 21st International Conference on Computational Linguistics and the 44th annual meeting of the Association for Computational Linguistics.2006: 609-616.
  • 5Roy-Tromble,Jason Eisner. Learning linear ordering problems for better translation[C]//Proceedings of the 2009 Conference on Empirical Methods in Natural Language Processing.2009,1: 1007-1016.
  • 6Yoshua-Bengio,Holger Schwenk,Jean-Sébastien Senécal,et al. Neural probabilistic language models[J]. Innovations in Machine Learning,2006,194: 137-186.
  • 7冯洋,张冬冬,刘群.层次短语翻译模型的介词短语调序[J].中文信息学报,2012,26(1):31-36. 被引量:3
  • 8肖欣延,刘洋,刘群,林守勋.面向层次短语翻译的词汇化调序方法研究[J].中文信息学报,2012,26(1):37-41. 被引量:6
  • 9Michael-Collins,Philipp Koehn,Ivona Kucerova. Clause restructuring for statistical machine translation[C]//Proceedings of the 43rd annual meeting on association for computational linguistics.2005: 531-540.
  • 10Peng Xu, Jaeho Kang, Michael Ringgaard, et al.Using a dependency parser to improve SMT for sub- ject-object-verb languages[C]//Proceedings of human language technologies: The 2009 annual conference of the North American chapter of the association for computational linguistics. 2009: 245-253.

二级参考文献27

  • 1Heidi Fox. Phrasal Cohesion and Statistical Machine Translation[C]//Proceedings of EMNLP, 2002: 304- 311.
  • 2David Chiang. Hierarchical phrase-based translation [J]. Computational Linguistics, 2007: 201-228.
  • 3John Lafferty, Andrew McCallum, Fernando Pereira. Conditional Random Fields: Probabilistic Models for Segmenting and Labeling Sequence Data[C]//Proceed-ings of ICML, 2001: 282-289.
  • 4Ben Taskar, Pieter Abbeel, Daphne Koller. Discrimi- native Probabilistic Models for Relational Data[C]// Proceedings of Eighteenth Conference on Uncertainty in Artificial Intelligence, 2002.
  • 5Fei Sha, Fernando Pereira. Shallow Parsing with Con- ditional Random Fields [ C ]//Proceedings of HLT- NAACL, 2003: 134-141.
  • 6Liang Huang and David Chiang. Better k-best parsing [C]//Proeeeding of IWPT,2005 : 53-64.
  • 7Franz Josef Och, Hermann Ney. Improved Statistical Alignment Models[C]//Proceedings of the 38th ACL, 2000.
  • 8Michael Collins, Philipp Koehn, Ivona Kucerova. Clause restructuring for statistical machine translation [C]//Proceeding of ACL, 2005: 531-540.
  • 9Kishore Papineni, Salim Roukos, Todd Ward, et al.. Bleu.. a Method for Automatic Evaluation of Machine Translation [C]//Proceedings of the 40th ACL, 2002: 311-318.
  • 10Frans J. Och. Minimum error rate training in statisti cal machine translation [C]//Proceeding of ACL, 2003: 160-167.

共引文献6

同被引文献43

引证文献5

二级引证文献45

相关作者

内容加载中请稍等...

相关机构

内容加载中请稍等...

相关主题

内容加载中请稍等...

浏览历史

内容加载中请稍等...
;
使用帮助 返回顶部