英语口语行为测试中评卷员效应的多侧面Rasch模型研究
摘要
在语言行为测试中,考生分数易受评卷员效应的影响,控制评卷员效应对考生分数的效度与信度是十分重要的:本文用多侧NRasch模型分析了某省一次英语口语测试的主要的评卷员效应。研究结果表明,多层面Rasch模型可以很好的帮助研究评卷员效应,本研究中各个评卷员的严厉度是不同的。评卷员总体上表现出了集中趋势,总体上并耒表现出晕轮效应,但是四位评卷员出现了晕轮效应。同时,大部分评卷员在应用评分标准时,都表现了较好的内部一致性,但是也有两位评卷员的内部一致性超出了模型的预测范围。
出处
《时代经贸》
2014年第2期263-263,共1页
TIMES OF ECONOMY & TRADE
参考文献10
-
1Bachman,L.F,Lynch,B.K,Mason.M. Investigating variability in tasks and rater judgements in a performance test of foreign language speaking[J].Language Testing,1995.238-257.
-
2Congdon,P.J,McQueen,J,. The stability of rater severity in large-scale assessment programs[J].Journal of Educational Measurement,2000,(02):163-178.
-
3Engelhard,G,Jr,. Examining rater errors in the assessment of written composition with a many-faceted Rasch model[J].Journal of Educational Measurement,1994.93-112.
-
4Engelhard,G,Jr,Myford, C.M,. Monitoring faculty consultant performance in the Advanced Placement English Literature and Composition Program with a many-faceted Rasch model(college Board Research Report No.2003-1)[M].New York:college Entrance Examination Board,2003.
-
5Linacre, J.M,. Many-faceted Rasch Measurement[M].Chicago:MESA Press,1989.
-
6Myford, C.M,Dobria,L,. Facets Workshop[M].Chicago,2006.
-
7Myfor d,C. M,Wolfe,E.W,. Understanding Rasch measurement:Detecting and measuring rater ef ects using many-facet Rasch measurement:Part II[J].Journal of Applied Measurement,2004,(02):189-227.
-
8Weigle, S.C,. Assessing writing[M].Cambridge:Cambridge University Press,2002.
-
9Yang,R,. A multi-facet Rasch analysis of rater effects on an oral English proifciency test.OEPP Technical Papers[M].West Lafayette:Purdue University,2010.
-
10刘建达.评卷人效应的多层面Rasch模型研究[J].现代外语,2010,33(2):185-193. 被引量:36
二级参考文献34
-
1Eckes, T. 2005. Examining rater effects in TestDaf writing and speaking performance assessments: A many-facet Rasch analysis [J]. Language Assessment Quarterly 2, 3: 197-221.
-
2Eckes, T. 2008. Rater types in writing performance assessments: A classification approach to rater variability [J]. Language Testing 25: 155-185.
-
3Elder, C., U. Knoch, G. Barkhuizen & J. yon Randow. 2005. Individual feedback to enhance rater training: Does it work? [J]. Language Assessment Quarterly 2: 175-196.
-
4Engelhard, G., Jr. 1994. Examining rater errors in the assessment of written composition with a manyfaceted Rasch model [J]. Journal of Educational Measurement 31, 2: 93-112.
-
5Gyagenda, I. S. & G. Jr. Engelhard. 1998. Applying the Rasch model to explore rater influences on the assessed quality of students' writing ability [P]. Paper presented at the Annual Meeting of the American Educational Research Association, San Diego.
-
6Hedge, J. W. & M. J. Kavanagh. 1988. Improving the accuracy of performance evaluations: Comparison of three methods of performance appraiser training [J]. Journal of Applied Psychology 73 : 68-73.
-
7Johnson, V. E. & J. H. Albert. 1999. Ordinal Data Modeling [M]. New York: Springer-Vedag.
-
8Kondo-Brown, K. 2002. A facets analysis of rater bias in measuring Japanese second language writing performance [J]. Language Testing 19, 1: 3-31.
-
9Kumar, D. D. 2005. Performance appraisal: The importance of rater training [J]. Journal of the Kuala Lumpur Royal Malaysia Police College 4: 1-17.
-
10LeBel, T. J., S. P. Kilgus, A. M, Briesch & S. Chafouleas. Forthcoming. The impact of training on the accuracy of teacher-completed direct behavior ratings [J]. Journal of Positive Behavior Interventions.
共引文献35
-
1李莉文,徐建.大学英语口语考试评分信度研究——以北外保送生口语考试为例[J].中国ESP研究,2020(2):71-79.
-
2彭康洲.竞教比赛的多层面Rasch模型分析[J].重庆邮电大学学报(社会科学版),2011,23(6):111-116. 被引量:1
-
3张艳莉,彭康洲.TEM8写作考试评分员差异性研究[J].外语电化教学,2012(1):42-46. 被引量:11
-
4张艳莉.信息技术和语言测试研究——语言测试研究动向及启示[J].外语测试与教学,2012(4):31-41. 被引量:1
-
5孙海洋,魏梅.口语测试评分标准的现代测试学分析[J].外语与外语教学,2012(6):66-70. 被引量:10
-
6姚淑超.Rasch模型下学生TEM-8写作测试效度的研究[J].文史博览(理论),2012(11):45-47.
-
7李银玲.作文网上评分“三评法”初探[J].考试研究,2013,9(2):64-70.
-
8徐鹰.不同性别评分人差异的实证研究[J].外语测试与教学,2013(3):16-24. 被引量:1
-
9张洁.语言运用测试的评分效度——以评分员为中心的研究综述[J].外语测试与教学,2013(3):25-33. 被引量:1
-
10王初明,亓鲁霞.读后续写题型研究[J].外语教学与研究,2013,45(5):707-718. 被引量:128
-
1丁广琳.平均数、众数、中位数的应用[J].中学生数理化(八年级数学)(北师大版),2008(11):22-25.
-
2李桂梅.帮你选代表[J].中学生数理化(八年级数学)(北师大版),2007(12):15-16.
-
3陈艳君.多层面Rasch模型在语言评估中的应用研究述评[J].教育测量与评价(理论版),2014(6):9-12. 被引量:3
-
4徐生龙.莫以事小而不为——从行为教育缺失看道德教育空洞[J].湖北教育,2006(1):23-23. 被引量:1
-
5武书敬.分析性英语口语测试评分标准的研究[J].考试研究,2014,10(5):45-53.
-
6郭艳军.我眼中的数据的“集中”和“离散”[J].初中生世界(九年级),2014,0(12):11-14.
-
7田国华.从一节数学课的教学实录中感悟新课改[J].广东教育(教研版),2008(4):112-113.
-
8徐鹰,曾用强.基于概化理论和多层面Rasch模型的计算机化英语听说考试评分研究[J].电化教育研究,2015,36(3):89-95. 被引量:8
-
9顾荣炎.描术统计之二:如何寻找反映一批数据集中趋势的代表——集中量数[J].上海教育,1994,0(5):27-29.
-
10牛生才.浅谈心理健康教育对“问题儿童”的转化对策[J].教育革新,2016,0(8):17-17.