情境模拟教学设计及课程开发评价工具的效度验证

Validity evidence for a scenario-based simulation design and development assessment tool

目的 验证《情境模拟教学设计及课程开发评价工具》用于评价住院医师规范化培训指导医师情境模拟教学设计和课程开发能力的效度证据。方法 由2022年上海市住院医师规范化培训指导医师情境模拟教学能力比赛专家小组共同开发了《情境模拟教学设计及课程开发评价工具》,采用Messick效度验证框架对54份参赛教案的评分进行效度验证。结果 本研究收集了基于反应过程、内部结构、与其他变量的关系和后果的效度证据。结论 《情境模拟教学设计及课程开发评价工具》是一种可靠的评价住院医师规范化培训指导医师情境模拟教学设计和课程开发能力的工具。本研究对教案得分细项进行分析,提示未来情境模拟师资培训的重点方向。

Objective To examine the validity evidence of a scenario-based simulation design and development assessment tool for assessing the competence of resident trainers in scenario-based simulation design and development.Methods A scenario-based simulation design and development assessment tool was jointly developed by an expert group of the 2022 Shanghai scenario-based simulation teaching competition for the trainers of standardized residency training.The scores of 54 competitors' teaching plans were analyzed using Messick's framework.Results Validity evidence was collected for response process,internal structure,relations to other variables,and consequences.Conclusion The scenario-based simulation design and development assessment tool is a reliable instrument for assessing the competence of resident trainers in scenario-based simulation design and development.Analyzing the scores of specific items in the teaching plans provides insights into future focus areas in faculty development for scenariobased simulation programs.