语言能力自我评价的效度研究

Validation of Self-assessment of Second Language Ability

本文对两种不同提问方式的语言能力自我评价调查问卷的效度进行了研究。我们所定义的语言能力包括听说读写四种特质。在研究中我们使用HSK考试作为效标调查了问卷的效标关联效度,使用MTMM和因素分析两种方法检验问卷的构想效度。结果表明,自我评价是一种可靠而且有效的评估工具,我们获得了较高的信度指标(Alpher系数),效标关联效度和构想效度也都比较好。在因素分析中我们提取了两个相对独立的因素,分别命名为“口头能力”和“书面能力”,这一结果和以往的HSK因素分析研究十分相似。MTMM的分析显示,听和读的自我评价效果要好于说和写。另外,研究结果发现两种提问方式没有质的区别,“Can-do”的提问方式稍好。

Using two different question types, this study makes an inquiry into the validity of self-assessment questionnaires of foreign learner＇ s ability. The language ability we attempt to measure comprises four skills： listening, speaking, reading and writing. The subjects were 201 non-native Chinese speakers from 20 different countries, most of whom have taken the Chinese Proficiency Test （HSK）. So we use HSK as the criterion to investigate the concurrent validity of self-assessment. At the same time the construct validity is investigated through MTMM design and factor analysis procedure . The result of this study indicates that self-assessment is a reliable and valid measure of second language ability. The obtained reliabilities （ Alpher coefficient） are higher than has been expected, and both the concurrent and construct validity are fairly good. Through factor analysis we extract two independent factors which are named “oral ability” including listening and speaking and “written ability”including reading and writing. In addition, the self-assessment appears to be more reliable for the measuring of listening and reading skills than for the measuring of reading and writing skills. Of the two question types used, the traditional “can-do”type is a little better than “difficulty” type.