期刊文献+

评分人培训的研究现状及展望 被引量:5

Rater Training in Language Assessment: Present and Future
下载PDF
导出
摘要 评分人培训是保证做事测试分数信、效度的重要方法,一直是国际语言测试界关注的重点。本文首先从理论框架、培训方法和培训效果等方面对评分人培训研究的现状进行了回顾,然后指出了当前研究中的两个问题:培训过程及内容不清楚,培训产生作用的机制不明确。最后,文章就下一步的研究进行了展望,希望能引起我国语言测试工作者对评分人培训的重视。 Rater training is generally viewed as a crucial method to ensure reliability and validity of the given score in the performance assessment, which has attracted public attention from a number of researchers in the international language testing circle. This article first reviews rater training studies in term of theoretical framework, training methods and training effects. Then it points out two under-researched issues: the vagueness of content and procedure of rater training, and the unknown nature of rater training mechanism.Finally, suggestions for future research are discussed. It is hoped that rater training will receive more attention from researchers at home.
作者 徐鹰 曾用强
出处 《中国考试》 2014年第2期10-18,共9页 journal of China Examinations
关键词 做事测试 评分人培训 培训效果 Performance Assessment Rater Training Training Effects
  • 相关文献

参考文献56

  • 1Aldereon, C., Clapham,C. & Wall, D. Language Test Constructionand Evaluation [M]. CambridgerCambridge University Press, 1995.
  • 2Bachman, L. F. Modem language testing at the turn of the century:Assuring that what we count counts [J]. Language testing, 2000, 17(1):1-42..
  • 3Bachman, L, F. & A. S. Palmer. Language Testing in Practice [M].Oxford University Press, 1996.
  • 4Baker, B. A. Individual differences in rater decision-making style:An exploratory mixed- methods study [J]. Language AssessmentQuarterly, 2012, 9: 225-248.
  • 5Barkaoui, K. Think-aloud protocols in research on essay rating: Anempirical study of their veridicality and reactivity [J]. LanguageTesting, 2011,28(1):51-75.
  • 6Bejar, 1.1. Hater cognition: Implications for validity [J]. EducationalMeasurement: Issues and Practice, 2012, 31(3): 2-9.
  • 7Crisp, V. An investigation of rater cognition in the assessment ofprojects [J]. Educational Measurement: Issues and Practice, 2012,31(3): 10 - 20.
  • 8Congdon, P. J. & J. McQueen. The stability of rater severity insurement, 2000, 37(2): 163-17..
  • 9Gumming, A., R. Kantor and D. E. Powers. Decision making whilerating ESL/EFL writing tasks: A descriptive framework [Jj. TheModem Language Journal, 2002, 86(1): 67-96.
  • 10D.myei, Z. Individual differences in second language acquisition[J]. Aila Review, 2006, 19(1):42-68.

二级参考文献37

  • 1L.F.Bachman,A.S.Pal mer.″The Construct Validation of the FSI Oral Interview,″. Language Learning Journal . 1981
  • 2L.F.Bachman,A.S.Pal mer.″The Construct Validation of Some Components of CommunicativeProficiency,″. Tesol Quarterly . 1982
  • 3L.Llosa.″Validating a Standards-Based Classroom Assessment of English Proficiency:A Multitrait-Multi methodApproach,″. Language Testing . 2007
  • 4Y.Sawaki.″Construct Validation of Analytic Rating Scales in a Speaking Assessment:Reporting a ScoreProfile and a Composite,″. Language Testing . 2007
  • 5A.Strauss.Qualitative Analysis for Social Scientists. . 1987
  • 6G.Fulcher.″Does Thick Description Lead to Smart Tests?A Data-Based Approach to Rating ScaleConstruction,″. Language Testing . 1996
  • 7U.Knoch.″Diagnostic Assessment of Writing:A Comparison of Two Rating Scales,″. Language Testing . 2009
  • 8Y.Wu.″What Do Tests of Listening Comprehension Test?A Retrospection Study of EFL Test-TakersPerforming a Multiple-Choice Task,″. Language Testing . 1998
  • 9G.J.Ockey.″Construct I mplications of Including Still I mage or Video in Computer-Based Listening Tests,″. Language Testing . 2007
  • 10A.Lazaraton.″Interlocutor Support in Oral Proficiency Interviews:The Case of CASE,″. Language Testing . 1996

共引文献8

同被引文献66

  • 1王保云.外语口试的形式评析——面试、录音口试和机助测试[J].外语电化教学,2006(1):60-64. 被引量:14
  • 2王海贞.基于评分过程证据的英语专业四级口试效度研究[J].解放军外国语学院学报,2007,30(4):49-53. 被引量:25
  • 3McNamara,T.,Knoch,U..The Rasch Wars:The Emergence of Rasch Measurement in Language Testing [J].Language Testing,2012 (4) :555-576.
  • 4Bachman, L.F..Statistical Analyses for Language Assessment [M].Cambridge :Cambridge University Press,2004.
  • 5Fulcher, G., Davidson,F..The Routledge Handbook of Language Testing [M].London & New York :Routledge,2012.
  • 6Bachman,L.F.,Lynch,B.K.,Mason,M..Investigating Variability in Tasks and Rater Judgements in a Performance Test of Foreign Language Speaking [J].Language Testing, 1995, (2) :238~257.
  • 7Lynch,B.K.,McNamara,T.F..Using G-Theory and Many-Facet Rasch Measurement in the Development of Performance Assessments of the ESL Speaking Skills of Immigrants [J].Language Testing, 1998, (2) : 158-180.
  • 8Kozaki,Y..Using GENOVA and FACETS to Set Multiple Standards on Performance Assessment for Certification in MedicalTranslation from Japanese into English [J].Language Testing, 2004, ( 1 ) : 1-27.
  • 9Sudweeks,R.R.,Reeve,S.,Bradshaw,W.S..A Comparison of Generalizability Theory and Many-facet Rasch Measurement in an Analysis of College Sophomore Writing [J].Assessing Writing, 2004, (3) :239-261.
  • 10Linacre, J.M..A User' s Guide to FACETS : Rasch-model Computer Programs [M].Chicago : MESA Press, 2005.

引证文献5

二级引证文献10

相关作者

内容加载中请稍等...

相关机构

内容加载中请稍等...

相关主题

内容加载中请稍等...

浏览历史

内容加载中请稍等...
;
使用帮助 返回顶部