接受型语言考试与语言标准对接的效度问题——来自标准设定过程的证据

Validity Issues in Linking Tests of Receptive Language Skills to Language Standards:Evidence from the Standard Setting Process

本文以对接使用论证(LUA)为效度验证框架,从培训师职责的视角,探讨接受型语言考试与语言标准对接的效度问题。通过分析普思考试听力卷与中国英语等级量表对接标准设定会议的录音,发现培训师担任了讲介者、协调者、反馈者和管理者等角色:在进行讲介和反馈时做到了清楚明确,对专家间的讨论和互动进行了良好协调,对流程和人员分工安排较为合理,且能严格把控整体流程并监督相关规则的执行。整体而言,培训师能够有效帮助专家正确理解和应用相关概念和方法,从而确保其判断结果有意义。本研究构成了LUA框架下效度验证证据链条中的重要环节,从标准设定过程的视角为对接结果提供了效度证据。研究发现为改进标准设定会议的实施及其他LUA框架指导下的对接研究提供了参考。

This study seeks to provide evidence for the validity of linking tests of receptive language skills to Chinas Standards of English(CSE) by investigating the standard-setting process under the framework of Linking Use Argument(LUA). Specifically, it focuses on facilitators roles in the process by collecting and analyzing the recordings during the process of linking Aptis listening section to CSE. Findings show that facilitators played the roles of instructors, coordinators, feedback providers and managers. They gave clear introductions and feedback, facilitated panelistsdiscussion effectively, made proper arrangement for the procedures and supervised the process rigorously, all of which served to guarantee panelists adequate and sufficient understanding and application of the important concepts and methods in question and helped enhance the meaningfulness of their judgment. Implications are also drawn for validating standard setting results by providing process-based evidence in other linking projects of English tests to CSE.