Randomized trials published in higher vs. lower impact journals differ in design, conduct, and analysis

Malgorzata M. Bala, Elie A. Akl, Xin Sun, Dirk Bassler, Dominik Mertz, Filip Mejza, Per Olav Vandvik, German Malaga, Bradley C. Johnston, Philipp Dahm, Pablo Alonso-Coello, Natalia Diaz-Granados, Sadeesh K. Srinathan, Basil Hassouneh, Matthias Briel, Jason W. Busse, John J. You, Stephen D. Walter, Douglas G. Altman, Gordon H. Guyatt

Research output: Contribution to journalArticlepeer-review

45 Scopus citations

Abstract

Objective: To compare methodological characteristics of randomized controlled trials (RCTs) published in higher vs. lower impact Core Clinical Journals. Study Design and Setting: We searched MEDLINE for RCTs published in 2007 in Core Clinical Journals. We randomly sampled 1,140 study reports in a 1:1 ratio in higher (five general medicine journals with the highest total citations in 2007) and lower impact journals. Results: Four hundred sixty-nine RCTs proved eligible: 219 in higher and 250 in lower impact journals. RCTs in higher vs. lower impact journals had larger sample sizes (median, 285 vs. 39), were more likely to receive industry funding (53% vs. 28%), declare concealment of allocation (66% vs. 36%), declare blinding of health care providers (53% vs. 41%) and outcome adjudicators (72% vs. 54%), report a patient-important primary outcome (69% vs. 50%), report subgroup analyses (64% vs. 26%), prespecify subgroup hypotheses (42% vs. 20%), and report a test for interaction (54% vs. 27%); P < 0.05 for all differences. Conclusion: RCTs published in higher impact journals were more likely to report methodological safeguards against bias and patient-important outcomes than those published in lower impact journals. However, sufficient limitations remain such that publication in a higher impact journal does not ensure low risk of bias.

Original languageEnglish (US)
Pages (from-to)286-295
Number of pages10
JournalJournal of Clinical Epidemiology
Volume66
Issue number3
DOIs
StatePublished - Mar 2013

Keywords

  • Data interpretation
  • Humans
  • Periodical
  • Randomized controlled trial
  • Research design
  • Systematic review

Fingerprint Dive into the research topics of 'Randomized trials published in higher vs. lower impact journals differ in design, conduct, and analysis'. Together they form a unique fingerprint.

Cite this