膝关节镜实践技能模拟器考核的效度研究——来自三家三甲医院的多中心研究

Validity evidence for a simulated knee arthroscopic surgery assessment from a multisite study of knee arthroscopy practice skill test in three tertiary care hospitals

目的 膝关节镜技术模拟器考核研究是评价专科医师实践技能的一项考核研究,该文希望通过效度验证,提供证据支持考核用于特定目的后所产出分数的解释。方法 针对自上海交通大学医学院附属瑞金医院、上海交通大学医学院附属第九人民医院、南方医科大学珠江医院考点共44位无或少量膝关节镜手术经验的考生实施了膝关节镜技术模拟器考核,收集考生成绩,采用梅西克效度框架进行效度验证,并收集了44份有效考生反馈问卷。结果 该研究根据梅西克的统一效度理论,对膝关节镜技术模拟器考核进行效度验证,收集了基于反应过程的效度证据,基于内部结构的效度证据,基于和其他变量关系的效度证据,基于测试后果的效度证据四个方面的证据。结论 该研究为膝关节镜技术模拟器考核积累了效度证据,该考核是适合用于评价膝关节镜技术初学者的膝关节镜操作技能的理想评价工具。

Objective To provide feasibility evidence of conducting assessment among orthopedic specialists when performing knee arthroscopic surgery using a knee arthroscopy simulator by validating data generated by the simulation-based assessment.Methods Forty-four examinees with little or no prior experience regarding knee arthroscopic surgery from 3 tertiary care hospitals were included in the study and went through the simulated knee arthroscopic surgery assessment.Test scores were analyzed using the Messick’s Framework of Validity and questionnaires regarding the assessment were collected.Results Validity evidence was collected for response process(rater perception),internal structure(reliability),relations to other variables(interassessment correlations),and consequences(composite score).Conclusion This multisite study presents validity evidence for simulated knee arthroscopic surgery assessment.It is feasible to conduct such simulated knee arthroscopic surgery assessment towards novice orthopedic specialists.