Advancing guideline quality through country-wide and regional quality assessment of CPGs using AGREE: a scoping review.

Publisher: BioMed Central Country of Publication: England NLM ID: 100968545 Publication Model: Electronic Cited Medium: Internet ISSN: 1471-2288 (Electronic) Linking ISSN: 14712288 NLM ISO Abbreviation: BMC Med Res Methodol Subsets: MEDLINE

Original Publication: London : BioMed Central, [2001-

Databases, Factual* ; Practice Guidelines as Topic*/standards

Background and Objective: Clinical practice guidelines (CPGs) are evaluated for quality with the Appraisal of Guidelines for Research and Evaluation (AGREE) tool, and this is increasingly done for different countries and regional groupings. This scoping review aimed to describe, map, and compare these geographical synthesis studies, that assessed CPG quality using the AGREE tool. This allowed a global interpretation of the current landscape of these country-wide or regional synthesis studies, and a closer look at its methodology and results.
Study Design and Methods: A scoping review was conducted searching databases Medline, Embase, Epistemonikos, and grey literature on 5 October 2021 for synthesis studies using the later versions of AGREE (AGREE II, AGREE-REX and AGREE GRS) to evaluate country-wide or regional CPG quality. Country-wide or regional synthesis studies were the units of analysis, and simple descriptive statistics was used to conduct the analysis. AGREE scores were analysed across subgroups into one of the seven Sustainable Development Goal regions, to allow for meaningful interpretation.
Results: Fifty-seven studies fulfilled our eligibility criteria, which had included a total of 2918 CPGs. Regions of the Global North, and Eastern and South-Eastern Asia were most represented. Studies were consistent in reporting and presenting their AGREE domain and overall results, but only 18% (n = 10) reported development methods, and 19% (n = 11) reported use of Grading of Recommendations Assessment, Development, and Evaluation (GRADE). Overall scores for domains Rigor of development and Editorial independence were low, notably in middle-income countries. Editorial Independence scores, especially, were low across all regions with a maximum domain score of 46%. There were no studies from low-income countries.
Conclusion: There is an increasing tendency to appraise country-wide and regionally grouped CPGs, using quality appraisal tools. The AGREE tool, evaluated in this scoping review, was used well and consistently across studies. Findings of low report rates of development of CPGs and of use of GRADE is concerning, as is low domain scores globally for Editorial Independence. Transparent reporting of funding and competing interests, as well as highlighting evidence-to-decision processes, should assist in further improving CPG quality as clinicians are in dire need of high-quality guidelines.
(© 2023. The Author(s).)

Lancet Glob Health. 2021 Jun;9(6):e875-e879. (PMID: 33765437)
Int J Clin Pract. 2017 May;71(5):. (PMID: 28382763)
J Clin Epidemiol. 2022 Nov;151:88-95. (PMID: 35868494)
CMAJ. 2010 Jul 13;182(10):1045-52. (PMID: 20513780)
BMC Res Notes. 2016 Sep 13;9(1):442. (PMID: 27623764)
BMC Cardiovasc Disord. 2017 Jun 13;17(1):153. (PMID: 28610621)
Ann Intern Med. 2012 Apr 3;156(7):525-31. (PMID: 22473437)
J Clin Epidemiol. 2021 Nov;139:222-231. (PMID: 34437947)
J Eval Clin Pract. 2020 Jun;26(3):852-862. (PMID: 31287214)
J Clin Epidemiol. 2021 Dec;140:189-199. (PMID: 34416326)
Int J Qual Health Care. 2003 Feb;15(1):31-45. (PMID: 12630799)
JAMA Intern Med. 2019 Apr 1;179(4):553-560. (PMID: 30776060)
JBI Evid Synth. 2020 Oct;18(10):2119-2126. (PMID: 33038124)
J Clin Epidemiol. 2017 Jun;86:3-10. (PMID: 28412463)
CMAJ. 2014 Feb 18;186(3):E123-42. (PMID: 24344144)
J Clin Epidemiol. 2021 Feb;130:125-134. (PMID: 33130237)
J Clin Epidemiol. 2022 Feb;142:333-370. (PMID: 34785346)
J Clin Epidemiol. 2018 Mar;95:120-127. (PMID: 29288133)
BMJ Open. 2019 Sep 4;9(9):e022392. (PMID: 31488461)
CMAJ. 2010 Jul 13;182(10):E472-8. (PMID: 20513779)
Lancet. 2020 Nov 14;396(10262):1539-1541. (PMID: 33096041)
Implement Sci. 2016 Mar 23;11:43. (PMID: 27005280)
Afr J Emerg Med. 2021 Mar;11(1):79-86. (PMID: 33014698)
Int J Qual Health Care. 2005 Apr;17(2):123-32. (PMID: 15665068)
PLoS One. 2017 Mar 30;12(3):e0174831. (PMID: 28358870)
J Multidiscip Healthc. 2021 Feb 09;14:297-309. (PMID: 33603389)
JAMA Netw Open. 2020 May 1;3(5):e205535. (PMID: 32459354)
J Korean Med Sci. 2016 May;31(5):682-7. (PMID: 27134487)
Implement Sci. 2020 Sep 18;15(1):79. (PMID: 32948216)
BMC Med Res Methodol. 2005 Apr 20;5:13. (PMID: 15840177)
J Clin Epidemiol. 2020 Nov;127:184-190. (PMID: 32621853)
Arch Phys Med Rehabil. 2020 Sep;101(9):1643-1655. (PMID: 32437691)
BMJ Open. 2017 Nov 22;7(11):e018467. (PMID: 29170291)
Ann Intern Med. 2018 Oct 2;169(7):467-473. (PMID: 30178033)
J Clin Epidemiol. 2020 Nov;127:177-183. (PMID: 32853762)
J Clin Epidemiol. 2017 Jan;81:13-21. (PMID: 27565978)
J Clin Epidemiol. 2021 Oct;138:22-31. (PMID: 34217818)
Global Health. 2019 Feb 19;15(1):14. (PMID: 30782176)
Syst Rev. 2016 Dec 5;5(1):210. (PMID: 27919275)
Medwave. 2020 Apr 30;20(3):e7887. (PMID: 32428925)
J Eur Acad Dermatol Venereol. 2016 Mar;30(3):395-403. (PMID: 26466752)
BMC Health Serv Res. 2019 Nov 4;19(1):788. (PMID: 31684938)
J Eval Clin Pract. 2019 Aug;25(4):565-574. (PMID: 29901241)
Int J Technol Assess Health Care. 2003 Winter;19(1):148-57. (PMID: 12701947)

Keywords: AGREE tools; Clinical practice guidelines; Global guidelines; LMICs; Quality appraisal; Regional guidelines; Reviews

Date Created: 20231130 Date Completed: 20231205 Latest Revision: 20240111

20240112

PMC10690993

10.1186/s12874-023-02101-5

38036974