多系统评价评估问卷量表在口腔医学领域中文系统评价应用中的信度和效度评价

Assessment of reliability and validity of assessment of multiple systematic reviews in Chinese systematic re-views on stomatology

目的评价多系统评价评估问卷(AMSTAR)量表应用于口腔医学领域中文系统评价中的一致性、信度和效度。方法计算机检索中国生物医学文献数据库、维普中文科技期刊数据库和中国期刊全文数据库,截止日期为2011年3月1日。手工检索19种中文口腔医学杂志,检索已发表的口腔医学类系统评价。2名评价者分别用总体质量评估问卷(OQAQ)量表和AMSTAR量表对系统评价进行评价,计算观察者间使用AMSTAR量表的Kappa值,AMSTAR量表重测信度的级内相关系数(ICC)以及AMSTAR和OQAQ量表得分的最大得分百分比的级内相关系数(结构效度)。结果纳入52篇系统评价文献。评价者使用AMSTAR量表的Kappa值为0.81[95%C(I0.73,0.89)],使用OQAQ量表的Kappa值为0.74[95%CI(0.66,0.83)]。重测信度的ICC为0.98[95%CI(0.97,0.99),P=0.000]。内部一致性信度Cronbach’α为0.69[95%CI(0.56,0.80),P=0.000]。AMSTAR和OQAQ量表最大得分百分比的ICC为0.94[95%CI(0.90,0.97),P=0.000]。结论 AMSTAR量表在应用于口腔医学领域系统评价时有很好的一致性、信度和效度。AMSTAR量表可很好的推广至口腔医学领域进行系统评价的方法学质量评价,为医务工作者进行系统评价方法学质量评价时带来了较大的便利。

Objective To measure the agreement, reliability and validity of assessment of multiple systematic re- views （AMSTAR） to assess Chinese systematic reviews on stomatology. Methods A comprehensive electronic search was made through Chinese BioMedical Literature Database, VIP Database for Chinese Technical Periodicals and China National Knowledge Infrastructure electronically on March 1~ 2011 together with handsearch through 19 stomato- logical journals to identify published Chinese systematic reviews on stomatology. Each systematic review was assessed by two reviewers with overview quality assessment questionnaire （OQAQ） and AMSTAR. And reliability （interobserver Kappa of the 11 AMSTAR items）, interclass correlation coefficient （ICC） of the sum scores and construct validity （ICC of the sum scores of AMSTAR compared with those of the OQAQ） were reported. Results A total of 52 sys- tematic reviews on stomatology were eligible. The reviewers agreement of the individual items of AMSTAR was with a mean Kappa of 0.81195%CI （0.73, 0.89）] while the OQAQ was 0.74195%ci （0.66, 0.83）]. The ICC of the total score for AMSTAR was 0.98195%CI （0.97, 0.99）, P=0.000]. Cronbach＇ ct was 0.69195%CI （0.56, 0.80）, P=0.000]. And ICC of the sum scores of AMSTAR compared with those of the OQAQ was 0.94195%CI （0.90, 0.97）, P=0.000]. Conclusion AMSTAR has good agreement, reliability and validity. AMSTAR can be well used in Chinese stomato-logy and can bring dentists much convenience when assess the methodological quality of systematical reviews on stomatology.