摘要
档案袋评价因能充分发挥促进学生发展和教学改进的功能而受到青睐,但不佳的测评信度和效度限制了其在教学评价中的应用。本文对档案袋评分者信度的特点进行实证研究,4位评分者对152份档案袋进行了2次等级评分,运用多种统计方法计算评分者信度。结果表明,档案袋的评分有较高的关联性、中等偏弱的一致性和一定的稳定性,对档案袋整体水平的评分信度最高。本研究中,评分者个数为3时,对档案袋整体水平评分的概化系数和可靠性系数都在0.80以上。
Portfolio assessment is valued because of its function of promoting student development and teaching improvement, but lower reliability and validity have limited the use of portfolio assessment in teaching assessment. This study carried out an experimental research on the rater reliability of portfolio assessment. Four raters scored 152 portfolios twice. Various statistical methods were used to evaluate the inter-rater reliability. The results showed the scoring has a high relativity,a medium-low consistency and a certain stability. The rater reliability of multi-rater scoring of the overall level of the portfolio is the highest. In this research, generalizability coefficient and dependability coefficient of the scoring of the overall level of the portfolios by the three raters are all above 0. 80.
出处
《应用心理学》
CSSCI
2006年第3期258-263,共6页
Chinese Journal of Applied Psychology
关键词
档案袋评价
评分者信度
概化系数
可靠性系数
Portfolio Assessment, Inter-raterReliability, Generalizability Coefficient, Dependability Coefficient
