期刊文献+

应用随机特征码检测雷同译文 被引量:2

Applying Random Feature Code to Similarity Detection in Translations
原文传递
导出
摘要 试卷自动评分研究中有个十分重要却常被忽略的环节——对于雷同内容的自动检测。翻译考试的雷同译文与一般的重复文档有着不同的特点。通过对比各种文档相似算法,最终选择了特征码的方法用于检测汉译英雷同译文,并结合翻译考试的特点,提出了随机特征码的方法,解决了特征码选取位置难以确定的问题,同时降低了特征码对于编辑差异的敏感度,提高了雷同内容检测的查准率和查全率。该算法的复杂度为线性,适用于大规模翻译试卷的快速检查。 One of the extremely important but always neglected aspects in auto-scoring for tests is the automatic detection of similar answers. The feature of similar answer versions in translation tests is different from that of common duplicated documents. Compared with several document similarity algorithms, the feature code algorithm is finally selected for detection of similar English translations from Chinese. According to the features of similar translations, we propose random feature code approach to solve the problem of feature code position, reducing the sensitivity for trivial differences in feature code fixing while improving precision and recall of detection. The algorithm has linear complexity which is competent for similarity detection in a large-scaled translation exam.
出处 《外语电化教学》 CSSCI 2009年第6期14-17,共4页 Technology Enhanced Foreign Language Education
基金 教育部基地2007年度项目:大规模考试主观题(英汉互译)自动评分系统的研制(编号:07JJD740070)
关键词 自动评分 雷同内容检测 文本相似度 特征码 Auto-scoring Similarity Detection Document Similarity Feature Code
  • 相关文献

参考文献6

  • 1Kenji Tateishi and Dai Kusui. Fast Duplicate Document Detection using Multi-level Prefix-filter[ C]. The Third International Joint Conference on Natural Language Processing, 2008.1.
  • 2Kishore Papineni, Salim Roukos, Todd Ward, and Wei-Jing Zhu. BLEU: a Method for Automatic Evaluation of Machine Translation[ C ]. Proceedings of the 40th Annual Meeting of the Association for Computational Linguistics (ACL) , Philadelphia, July 2002.
  • 3王金铨.中国学生汉译英机助评分模型的研究与创建[D].北京:北京外国语大学博士论文,2008.
  • 4张剑,吴际,周明.机器翻译评测的新进展[J].中文信息学报,2003,17(6):1-8. 被引量:15
  • 5孙健,王伟,钟义信.基于K-最近距离的自动文本分类的研究[J].北京邮电大学学报,2001,24(1):42-46. 被引量:13
  • 6张刚,刘挺,郑实福,等.大规模网页快速去重算法[C].中国中文信息学学会二十周年学术会议论文集(续集),2001.

二级参考文献15

  • 1俞士汶.Automatic Evaluation of Output Quality for Machine Translation Systems .Machine Translation,1993,8:17-126.
  • 2俞士汶 姜新 朱学锋.基于测试集与测试点的机译系统评估[A].见陈肇雄主编.机器翻译研究进展[C].电子工业出版社,1992年.524—537.
  • 3俞士汶 段慧明.英汉机器翻译译文质量测试大纲[J].计算机世界(D版技术专题D10-D11),1998,(13).
  • 4BLEU: a method for automatic evaluation of machine translation [C]. Kishore Papieni, Salim Roukos,Todd Ward, Wei - Jing Zhu, 232 - 240,ACL 2002.
  • 5Hovy, E.H. 1999. Toward Finely Differentiated Evaluation Metrics for Machine Translation [ C]. Proceedings of the EAGLES Workshop on Standards and Evaluation, 439 - 446 Pisa, Italy.
  • 6JEIDA 1992. JEIDA Methodology and Criteria on Machine Translation Evaluation (JEIDA Report)[R]. H. Ncanura (editor). 108- 120, Japan Electronic Industry Development Association.
  • 7King, M. and K. Falkedal. 1990. Using Test Suites in Evaluation of Machine Translation Systems[C]. Proceedings of the 18th (X)LING Conference vol. 2. 18 - 32 Helsinki, Finland.
  • 8Language and Machines. Computers in Translation and Linguistics. (ALPAC report, 1966) , [R]. National Academy of Sciences.
  • 9The EAGLES MT Evaluation Working Group. 1996. EAGLES Evaluation of Natural Language Processing Systems [ R]. Final Report. EAGLES Document EAG- EWG - PR 2, ISBN 87 - 90708 - 00- 8. 550 - 583, Center for Sprogteknologi, Copenhagen.
  • 10Vogel,- S., Niessen S., Hermann Ney. 2000. Automatic Extrapolation of Human Assessment of Translation Quality [ C]. LREC-2000, 487- 499, Athens, Greece.

共引文献40

同被引文献15

  • 1管建和,甘剑峰.基于Lucene全文检索引擎的应用研究与实现[J].计算机工程与设计,2007,28(2):489-491. 被引量:71
  • 2Bachman, L. F. and Palmer, A. S. Language Testing in Practice [ M]. Oxford : Oxford University Press, 1996.
  • 3Chapelle, Carol A. Computer Applications in Second Language Acquisition [ M ]. Cambridge : Cambridge University Press,2001.
  • 4Weigle, Sara Cushing. Assessing Writing [ M ]. Cambridge : Cambridge University Press,2002.
  • 5Weir, Cyril J. Language Testing and Validation -- An Evidence- Based Approach [ M ]. Basingstoke : Palgrave Macmillan,2005.
  • 6《高等学校英语专业英语教学大纲》[z].上海外语教育出版社、北京外语教学与研究出版社,2000.
  • 7梁茂成.英语作文自动评分系统的研制[R].全国英语专业四、八级考试暨计算机信息技术应用专题研讨会主题报告,2009.
  • 8陆远.探索网阅环境下的英语写作评分员培训[P].全国英语专业四、八级考试暨计算机信息技术应用专题研讨会论文,2009.
  • 9TEM考试效度研究[M].上海外语教育出版社,1997.
  • 10邹申.英语专业四、八级考试的发展历程--回顾与展望[z].外语教育名家谈(1978-2008)庄智象主编.上海:上海外语教育出版社,2008.

引证文献2

相关作者

内容加载中请稍等...

相关机构

内容加载中请稍等...

相关主题

内容加载中请稍等...

浏览历史

内容加载中请稍等...
;
使用帮助 返回顶部