高风险英语考试作文评分员社会心理因素研究

High-stake English test raters' social psychological considerations in the essay rating process

社会认知观指导下的作文评分过程研究重视考试机构规约对评分过程的制约,却忽视评分员社会心理因素对评分过程产生的影响。以英语专业八级考试为例,采用有声思维和跟进访谈的形式对后者进行探究。结果表明,有六类评分员社会心理因素影响评分员对文本的打分,分别是考试机制意识、阅卷系统知识、阅卷环境的心理感受、考试认识、考生预期和伦理价值判断。随后就这些因素对评分过程施加影响的机制进行讨论,并提出改进评分员培训效果的建议。

Views on the nature of human essay rating process have evolved from the behaviorism to the cognitive and to the recent social cognitive view. The recent view witnesses a number of studies on the interference of test institutional constraints on essay raters＇ behavior. There are,however,few studies investigating raters＇ social psychological considerations when rating an essay. The purpose of the present study was to explore the TEM8（ tests for English majors） raters＇ social psychological considerations in the essay rating process through analyzing raters＇ think aloud protocols while doing rating and their reports on the follow up interviews. All the think aloud reports and interview reports were analyzed using Nvivo. Data analysis revealed six types of social psychological considerations raters will take in the rating process： Institutional awareness,knowledge of rating system,Physical condition,Test knowledge,Test taker expectation,Ethical consideration. Although those considerations are irrelevant to text quality,they play a role in the scoring of a text,making the actual score not the real reflection of text quality.Those elements are related either to test institution or to raters＇ personal features. Based on the findings,several suggestions on rater training were made： 1） Improving the standard in choosing raters; 2） establishing raters＇ rating files to recruit those with good recordings and exclude the unqualified raters; 3） including mechanism of the test institution,rating supervision methods into rater training content; 4） unifying raters＇ understanding on test purpose,test nature and test impact; 5） improving raters＇ professional morality and test fairness awareness.