建立临床胜任力评估委员会对麻醉科住院医师Milestone评估客观性的影响

Effect of Clinical Competency Committee establishment on the objectivity of Anesthesiology Milestone Evaluation System ratings among residents

目的 分析临床胜任力评估委员会(简称评估委员会)能否改善住院医师里程碑(Milestone)评估的客观性。方法 采取单中心横断面研究,选取2021年—2022年在北京协和医院麻醉科轮转的住院医师66名。应用自制麻醉科专业核心胜任力Milestone评估系统(简称评估系统),请导师和该院评估委员会进行评分,分析评分与客观考核成绩之间的相关性。结果 在评估系统的23个子项目中,导师与评估委员会给予评分的Kendall相关系数最低为0.60,最高为0.79;配对t检验提示两者存在显著差异。Pearson相关分析提示评估委员会给予的Milestone评分与客观考核成绩均呈显著相关性。与导师评分相比,评估委员会评分与客观成绩的差异更小。结论 评估委员会的建立有利于提高住院医师Milestone评估的客观性。

Objective The aim of this study was to determine whether the Clinical Competency Committee could improve the objectivity of Milestone Evaluation System ratings.Methods In this single-center cross-sectional study,we included 66 anesthesia residents under standardized residency training in the 2021-2022 academic year at Peking Union Medical College Hospital.The mentor of each resident and the Clinical Competency Committee were asked to assess the performance of residents using the Chinese version of Anesthesiology Milestone Evaluation System developed by our hospital.The correlation between the Milestone ratings and the scores of objective examinations were compared and analyzed.Results Among the 23 subcompetencies,the Kendall's W coefficient ranged from 0.60 to 0.79 between the ratings given by the mentors and the Clinical Competency Committee.Paired t test also indicated significant differences between them.The Clinical Competency Committee's ratings were significantly correlated with the scores of objective examinations in the Pearson's correlation analysis.Compared with the mentors'ratings,the differences were significantly smaller between the Clinical Competency Committee's ratings and the scores of objective examinations.Conclusion The establishment of the Clinical Competency Committee can improve the objectivity of Milestone ratings.