基于项目类别的多级评分方式比较及探究

Comparison and Exploration of Multi-level Scoring Methods Based on Item Category

在认知诊断中,不同评分方式对学生知识状态的估计有重要的影响。现有基于项目类别的多级评分方式只被应用于参数方法中,且只按步骤顺序对学生进行评分,未考虑在非参数方法中的应用及按步骤非顺序评分情景。文章通过比较参数方法与非参数方法在基于项目类别Q矩阵下的判准率情况,发现其在非参数方法中同样适用,并在现有评分方式基础上提出一种按步骤非顺序的评分方式,通过模拟研究发现这种.评分方式在不同条件下均优于原有评分方式。

In cognitive diagnosis,different scoring methods have important impacts on the estimation of students’knowledge status.The existing multi-level scoring method based on item category is only applied to the parameter method,and the students are only scored in the order of steps,the application in the non-parametric method and the non-sequential scoring in steps are not considered.This paper compares the parameter method and the non-parametric method based on the criterion rate of a category-level Q-matrix,and finds that it is also applicable in the non-parametric method.Based on the existing scoring method,a step-by-step but non-order scoring method is proposed,and through simulation studies it is found that this scoring method is superior to the original scoring method under different conditions.