Improving grading of recommendations assessment, development, and evaluation evidence tables part 4: a three-arm noninferiority randomized trial demonstrates improved understanding of content in summary of findings tables with a new format

Rebecca L. Morgan, Juan José Yepes-Nuñez, Joycelyne Ewusie, Lawrence Mbuagbaw, Stephanie Chang, Tejan Baldeh, Susanne Hempel, Mark Helfand, Paul Shekelle, Timothy J. Wilt, Holger J. Schünemann

Research output: Contribution to journalArticlepeer-review

3 Scopus citations

Abstract

Objectives: To evaluate alternative formats of summary of findings (SoF) tables for single comparison with multiple outcomes. Study Design and Setting: We conducted a three-arm randomized controlled noninferiority trial (RCT) in the following systematic review (SR) users: researchers, clinical practice guideline developers, health care providers, policymakers, and knowledge transfer organizations to measure understanding, accessibility, satisfaction, and preference across the current grading of recommendations assessment, development, and evaluation (GRADE) SoF, an alternative GRADE SoF, or an adapted evidence-based practice center (EPC) program SoF table. Results: One Hundred Seventy-Nine participants were randomized, and 129 participants completed the RCT (n = 47 current GRADE, n = 41 alternative GRADE, n = 41 adapted EPC). Understanding the certainty of evidence and treatment effect was comparable across groups. The adapted EPC SoF table was inferior for quantifying risk and RD compared to the alternatives (<35% correct vs. >85% correct). Participants reported increased satisfaction when SoF tables presented number needed to treat (NNT), anticipated absolute effect differences, and narrative syntheses for evidence that could not be meta-analyzed. Participants reported accessibility to information as significantly better in both GRADE SoF tables, when compared with the adapted EPC SoF table. Participants preferred the alternative GRADE SoF table format. Conclusion: The alternative GRADE SoF table is a promising format for SR users preferring a comprehensive presentation of SR results for single comparisons.

Original languageEnglish (US)
Pages (from-to)125-135
Number of pages11
JournalJournal of Clinical Epidemiology
Volume154
DOIs
StatePublished - Feb 2023

Bibliographical note

Funding Information:
We would like to acknowledge Alonso Carrasco-Labra, Carlos Cuello-Garcia, Yngve Falck-Ytter, M. Hassan Murad, Reem Mustafa, Nancy Santesso, Wojtek Wiercioch, and Yuan Zhang for reviewing and proving suggestions during the development of the alternative GRADE SoF table.

Publisher Copyright:
© 2022 Elsevier Inc.

Keywords

  • Evidence summaries
  • GRADE
  • Guideline development
  • Randomized controlled noninferiority trial
  • Summary of findings table
  • Systematic reviews

PubMed: MeSH publication types

  • Randomized Controlled Trial
  • Journal Article

Fingerprint

Dive into the research topics of 'Improving grading of recommendations assessment, development, and evaluation evidence tables part 4: a three-arm noninferiority randomized trial demonstrates improved understanding of content in summary of findings tables with a new format'. Together they form a unique fingerprint.

Cite this