期刊文献+

多级评分聚类诊断法的影响因素 被引量:8

The influence factors of grade response cluster diagnostic method
下载PDF
导出
摘要 从测验和被试两个层面探讨了属性数目、属性层级关系、被试知识状态分布、属性层级误设和Q矩阵误设等因素对GRCDM的影响,以进一步考察GRCDM的特性。研究发现:(1)GRCDM对属性数目无依赖,随属性数目的增多判准率反而增高;(2)被试知识状态分布对GRCDM判准率高低无影响;(3)属性层级误设对GRCDM的影响与属性层级类型有关,当属性层级为无结构型和发散型时,"属性层级关系错乱"的判准率降幅最大;(4)Q矩阵误设对GRCDM的影响因层级关系而异,收敛型和发散型受影响较小,无结构型和线型的判准率在属性既冗余又缺失时降幅最大。 Due to the limitation of the Parameter Diagnosis model, in recent years, researchers begin to explore the nonparametric diagnosis method which is simpler and more efficient, such as SVM, the machine learning method based on statistical learning theory which is raised by Vapnik according to the risk minimization principle. SVM not only has simple structure, but can also use small sample which is quite time saving and efficient. Chiu and other fellows raised clustering method of 0-1 grading based on the idea of Sum-Scores. In order to match the practical evaluation, researchers developed clustering method of 0-1 grading into multi- grading, and discussed how sample size, percentage of random errors and attribute hierarchy structure impact on the class accuracy. The result indicates that GRCDM shows quite high class accuracy in both simulation and practice situation, little dependence on the sample size and compactness of attribute hierarchy structure, and is adaptable to small scale evaluation. All those characteristics show the advantage of nonparametric method.Nevertheless, the recent research on the nonparametric method is still superficial, so further efforts are needed to explore influence factor, investigate deep into the advantages and features of GRCDM, and enrich the study of nonparametric method with the help of the existing achievement of parameter method. By analyzing the influence factors of the diagnostic on evaluation class accuracy through three well- designed simulate studies from both test and subject layer, this research studies the five factors including the number of attribute, sample distribute, attribute hierarchy structure, attribute hierarchy structure misspecification and Q-matrix misspecification which cause the influence to the GRCDM, tries to investigate its performance comprehensively, and drives the research of the nonparametric diagnostic method. The result indicates thatGRCDM shows no dependence on the number of attribute and the more attribute the test has, the higher class accuracy this method has. Secondly, the sample distribution shows no influence on the class accuracy of GRCDM, reflecting the advantage that nonparametric method has no requirement of ability distribution. Thirdly, GRCDM has a great sensitivity to the attribute hierarchy structure misspecification, especially when for divergent or unstructured attribute hierarchy structure and the disorder of attribute hierarchy structure will lead to the maximum decreasing. Lastly, the influence on GRCDM caused by Q-matrix misspecification is differentiated by the attribute hierarchy structure, of which divergent and convergent will be influenced less, and the decreasing amplitude of the class accuracy of unstructured and linear attribute hierarchy structure will be maximum when both over and under specification of Q-matrix entries for items. This research is the penetration and extension based on the former research. Through the three simulation studies, some significant conclusions have been got, some of them being peculiar to nonparametric method, and some shared with parameter method. All in all, through this research, we can know more about the features of GRCDM. Knowing the advantage of nonparametric method and the difference from parameter method will provide useful information to both theoretical research and practical application of cognitive diagnostic assessment.
出处 《心理学报》 CSSCI CSCD 北大核心 2016年第7期891-902,共12页 Acta Psychologica Sinica
基金 浙江省高校重大人文社科项目攻关计划(2013QN048)资助
关键词 多级评分聚类诊断法 属性数目 被试能力分布 属性层级误设 Q矩阵误设 grade response cluster diagnostic method attributes number subject's ability distribute attributehierarchy misspecification Q matrix misspecification
  • 相关文献

参考文献17

二级参考文献181

共引文献244

同被引文献44

引证文献8

二级引证文献23

相关作者

内容加载中请稍等...

相关机构

内容加载中请稍等...

相关主题

内容加载中请稍等...

浏览历史

内容加载中请稍等...
;
使用帮助 返回顶部