医药类院校教师教学水平学生评教的多元概化分析

Multivariate Generalization Analysis for Students’Evaluation on Teaching Level of Teachers in Medical Colleges

目的采用多元概化理论评价《医药类院校教师课堂教学水平学生评价量表》信度的同时对各维度条目数优化提出建议,并确定学生评教实践中适宜的学生人数。方法收集整理通过该问卷调查的某医科大学422名学生数据,使用mGENOVA进行多元概化分析。先在G研究中估计各种误差来源的方差分量,然后实施一系列改变条目数和学生数D研究获得不同情况下信度系数以评价量表信度。结果G研究中每个领域均呈现学生嵌套于教师的方差分量最大。D研究中,在领域水平,除了教学组织和教学方法2个领域外,其余领域的概化系数和可靠性指数均大于0.80;在总量表水平,合成概化系数和合成可靠性指数均高于0.85。保证可靠性指数在0.80及以上的前提下,每班至少抽取的学生数为25人;保证概化系数在0.80及以上的前提下,每班至少抽取的学生数为28人。结论基于多元概化分析此量表总体上有很好的信度,若下一步需要修订可考虑在教学组织和教学方法2个领域进行内容调整,在高校学生评教实践中各班抽取28名学生来进行调查最合适。

Objective To evaluate the reliability of the Student Evaluation Scale for the Teaching Level of Teachers in Medical Universities(SESTLTMU)and determine the appropriate number of students in the teaching evaluation based on Multivariate Generalizability Theory(MGT).Methods The data of 422 students from a medical university who were surveyed by this scale were collected and analyzed by using mGENOVA,a special software of multivariate generalizability theory.The variance components of various error sources were estimated in Generalizability Study(G-study),and then several Decision Studies(D-studies)with varying numbers of items and numbers of students were analyzed to obtain reliability coefficients including generalizability coefficient(G)and the indexes of dependability(Ф)in order to evaluate the reliability of the scale.Results In the G-study,the most prominent variation in every domain was introduced by student nested in teacher effect.In the D-study,at the level of domain,the G coefficients and theФcoefficients for three of the five domains were approximately equal to or greater than 0.80,except for the teaching organization domain and teaching method domain(>0.70 but<0.80).For the overall scale,the composite G and compositeФcoefficients were larger than 0.85.Under the premise that theФis 0.80 or above,the minimum number of students selected from each class should be 25.Under the premise that the G is 0.80 or above,the minimum number of students selected from each class should be 28.Conclusions The scale has good reliability as a whole based on the results of MGT.If this scale needs to be revised in the future,it can be considered to adjust the content in the teaching organization domain and the teaching method domain.It is the most appropriate to select 28 students from each class for investigation in the practice of teaching evaluation by university students.