翻译测试的评分员信度研究——TEM8翻译项目评分员问卷调查记略

Rater Reliability of Translation Testing

对文本翻译测试这样的主观性测试来说,评分员信度是衡量测试质量,确保其公平、公正使用的主要指标。本文在2010年全国TEM8翻译项目评分员问卷调查的基础上,探讨提高翻译测试评分员信度的策略,用调查数据证实评分员对细化评分标准、网上试评(培训评分员)以及使用网上阅卷自查功能的积极反映,并进行对新评分方案的试验性信度验证。

How to obtain a reliable rating is a most stubborn problem, nevertheless, it is the essential problem in subjective translation testing. This paper reports on a survey on TEM8 raters and discusses how rater reliability can be improved. The survey results indicate that computer-aided rating training, pilot rating and instruction of the details of the rating schemes, which are all put into practice in 2010＇s TEM8 scoring, play an important role in guaranteeing rater reliability. The author also makes sample experiments to prove the rater reliability coefficient. The paper is hopefully of some theoretical and practical significance for popularization of training and testing of translators.