医学科研项目实施过程评价指标体系的可靠性和真实性评价

Validity and reliability evaluation for the evaluating indicator system of execution process in medical research project

目的评价“医学科研项目实施过程评价指标体系”的可靠性和真实性。方法对某医学科研基金资助的在研项目应用已建立的“实施过程评价指标体系”进行评价,同时开展专家组评价。以专家组评分为“金标准”,比较指标体系评分与专家组评分的异同。结果各二级指标的克朗巴哈α系数均达到0．8。26项三级指标的得分与所属二级指标得分的相关系数均大于0．5。、指标体系评分与专家组评分的相关系数为0．713。对两种评价方法作配对资料的关联性分析,两种评价方法具有关联性,Kappa值和一致率较高。结论实施过程评价指标体系具有较高的可靠性和真实性。

Objective To appraise validity and reliability of the evaluating indicator system of execution process in medical research projects. Methods Some medical research projects in practice were evaluated by the evaluating indicator system and expert group respectively. The evaluating results for expert group were regarded as ＇gold standard＇. Two results evaluated by the evaluating indicator system of execution process and expert group were compared. Resdts The Chronbach＇s acoeffieient of 4 second-class indicators were more than 0.8. The correlation coefficients of 26 third - class indicators and the second - class indicator that every third-class indicator belongs to were all more than 0.5. The correlation coefficient of the grades of the evaluating indicator system and the experts group was 0.713. The evaluating indicator system was associated with the appraisal of experts group. Kappa value and agreement rate were higher. Condusion The validity and reliability of the evaluating indicator system of execution process were good and confirmed.