机器翻译测评的实践与分析

Practice and Analysis in Evaluation of Machine Translation

机器翻译是人工智能领域中一项有挑战性的研究课题 ,而对机器翻译系统的测评也越来越受到重视。为了考察现今机器翻译系统的翻译质量及其出现的问题 ,提出了采用大规模语料库作为测试集的方法 ,对六个机器翻译系统进行了半自动测评 ,分析了机器翻译系统在词法和句法上存在的问题 ,并将测评结果与NIST自动测评进行比较 。

Machine Translation is one of the most challenging problems in artificial intelligence and recently its evaluation gets more and more attention.In order to assess the translation quality and to pinpoint the problems in current Machine Translation System,this paper presents a method of using a large-scale corpus as a testing set by which we have semi-automatically evaluated six Machine Translation Systems.Finally we have analysed the problems of morphology and syntax in Machine Translation Systems,and have proved the objectivity of our evaluation result by comparing with automatic evaluation of NIST.