Assessing the Quality of the First Batch of Evidence-Based Clinical Practice Guidelines in Traditional Chinese Medicine

Objective: To assess the quality of the first batch of Chinese evidence-based clinical practice guidelines (CPGs) in Traditional Chinese Medicine (TCM) using the Appraisal of Guidelines for Research and Evaluation (AGREE) instrument. Methods: Evidence-based CPGs in TCM supported by the World Health Organization Western Pacific Regional Office (WHO/WPRO) and whose development was organized by the China Academy of Chinese Medical Sciences were identified and manually retrieved. CPGs were assessed using the AGREE instrument, and the data in each CPG were analyzed in terms of the six domains in the AGREE instrument: scope and purpose, stakeholder involvement, rigor of development, clarity and presentation, applicability, and editorial independence. Results: Twenty-eight CPGs were identified, of which 26 were included in the study. The AGREE instrument rated the 26 CPGs in terms of the six domains. The assessment results showed the following average scores: for editorial independence, 84.16%; for rigor of development, 80.95%; for scope and purpose, 79.96%; for clarity and presentation, 70.88%; for stakeholder involvement, 61.28%; for applicability, the average score was only 27.09%. In summary, nine CPGs were rated as "strongly recommended", six as "recommended with provision or alternation", and 11 as "unsure". Conclusion: Most of the first batch of Chinese evidence-based CPGs in TCM had significant shortcomings in applicability. It is suggested that special attention be paid to enhancing the quality of applicability when developing evidence-based CPGs in TCM.

Survey and Practice of Reporting Quality of Randomized Controlled Clinical Trials on Traditional Chinese Medicine

Evidence obtained from randomized controlled trials （RCTs） has been generally accepted as the gold standard in the evaluation of clinical effectiveness. Readers need to understand the trial design, implementation, results, analysis and interpretation, so as to fully Jnderstand the results of RCTs. Thus, the investigators of RCTs have to report these items in a complete, accurate and clear manner. Since 1998, we have conducted several evaluations on the reporting quality of RCTs published in Chinese journals on traditional Chinese medicine （TCM） and results have shown that there is an urgent need for higher quality RCTs on TCM.

Quality Assessment of Clinical Practice Guidelines for Integrative Medicine in China:A Systematic Review

Objective： To assess the quality of integrative medicine clinical practice guidelines（CPGs） published before 2014. Methods： A systematic search of the scientific literature published before 2014 was conducted to select integrative medicine CPGs. Four major Chinese integrated databases and one guideline database were searched： the Chinese Biomedical Literature Database（CBM）, the China National Knowledge Infrastructure（CNKI）, China Science and Technology Journal Database（VIP）, Wanfang Data, and the China Guideline Clearinghouse（CGC）. Four reviewers independently assessed the quality of the included guidelines using the Appraisal of Guidelines for Research and Evaluation（AGREE） Ⅱ Instrument. Overall consensus among the reviewers was assessed using the intra-class correlation coefficient（ICC）. Results： A total of 41 guidelines published from 2003 to 2014 were included. The overall consensus among the reviewers was good [ICC： 0.928; 95% confidence interval（CI）： 0.920 to 0.935]. The scores on the 6 AGREE domains were： 17% for scope and purpose（range： 6% to 32%）, 11% for stakeholder involvement（range： 0 to 24%）, 10% for rigor of development（range： 3% to 22%）, 39% for clarity and presentation（range： 25% to 64%）, 11% for applicability（range： 4% to 24%）, and 1% for editorial independence（range： 0 to 15%）. Conclusions： The quality of integrative medicine CPGs was low, the development of integrative medicine CPGs should be guided by systematic methodology. More emphasis should be placed on multi-disciplinary guideline development groups, quality of evidence, management of funding and conflicts of interest, and guideline updates in the process of developing integrative medicine CPGs in China.