中医药临床研究类科技成果评价指标体系研究

Research on Evaluation Index System of Scientific and Technological Achievements in Traditional Chinese Medicine Clinical Research

背景开展好中医药科技成果评价工作对推动中医药创新发展意义重大。既往的中医药科技成果评价常套用笼统的评价方法,造成指标不适用、维度单一等问题,不利于科学、全面地反映成果的多元价值。因此,新时期中医药科技成果评价亟需建立分类、多维度的评价指标体系。目的遵循我国新时期科技评价要求,针对中医药临床研究类科技成果,建立体现中医药规律、突出中医药优势的科学、分类、可靠、全面的评价指标体系。方法本研究开始于2022年11月,完成于2023年5月。基于对相关文献资料的梳理分析,结合专题小组讨论,初步形成指标框架;通过两轮德尔菲专家咨询,确定评价指标和评价要点;采用层次分析法,计算指标权重。结果最终确定的中医药临床研究类科技成果评价指标体系包含门槛指标10条,一级指标4条,二级指标17条,评价要点17条。经检验,两轮德尔菲法实施中专家积极系数均为100%,权威系数分别为0.94和0.93,各级指标Kendall's W一致性检验双侧检验显著性P值均<0.05,表明专家积极程度、权威程度高,专家意见一致性强,咨询结果可靠。结论本研究围绕中医药临床研究类科技成果评价,构建了一套科学、合理、可靠、易操作的指标体系。指标涵盖范围广,权重区分度高,具有一定中医特色,有利于在全面考虑成果多元价值的同时凸显核心优势。同时,配套建设的评价要点一定程度上增强了指标体系的可操作性,可能为相关评价活动提供潜在参考。

Background The effective evaluation of scientific and technological achievements in traditional Chinese medicine(TCM)is of great significance in promoting the innovative development of TCM.Previous evaluations of scientific and technological achievements in TCM often used a generalized evaluation method,leading to problems such as inappropriate indicators and limited dimensions,which is not conducive to reflecting the multiple values of achievements in a scientific and comprehensive way.Consequently,there is an urgent need to establish categorized and multi-dimensional evaluation index system for the evaluation of scientific and technological achievements in TCM in the new period.Objective To establish a scientific,categorized,reliable and comprehensive evaluation index system that reflects the principles of TCM and highlights its unique advantages aiming at the scientific and technological achievements in TCM,in accordance with the contemporary requirements for scientific and technological evaluation in China.Methods This study began in November 2022 and was completed in May 2023.A preliminary index framework was developed through literature review and focus group discussions.Delphi expert consultation was then conducted over two rounds to determine the evaluation indexes and points.The hierarchical analysis method was used to calculate the weight of each index.Results The final evaluation index system of scientific and technological achievements in TCM clinical research comprised 10 threshold indicators,4 primary indicators,17 secondary indicators,and 17 evaluation points.After testing,the positive coefficient of experts in both rounds of Delphi method implementation was 100%,the authority coefficient was 0.94 and 0.93,respectively.The Kendall's W consistency test for each level of indicators yielded two-tailed significance(P<0.05),indicated high levels of expert positivity and authority,strong consistency of expert opinion,and reliable consulting results.Conclusion This study constructs a scientific,reasonable,reliable and easy-to-operate evaluation index system for scientific and technological achievements in TCM clinical research.The indexes cover a wide range with highly differentiated weights and TCM characteristics,which is conducive to highlighting the core strengths while comprehensively considering the multiple value of the results.Additionally,the associated evaluation points,enhancing the operationalization of the index system,may potentially serve as a valuable reference for related evaluation activities.