Exclusion of studies with no events in both arms in meta-analysis impacted the conclusions

Chang Xu, Ling Li, Lifeng Lin, Haitao Chu, Lehana Thabane, Kang Zou, Xin Sun

Research output: Contribution to journalArticlepeer-review

5 Scopus citations

Abstract

Objectives: Classical meta-analyses routinely treated studies with no events in both arms noninformative and excluded them from analyses. This study assessed whether such studies contain information and have an influence on the conclusions of meta-analyses. Study Design and Setting: We collected meta-analyses of binary outcomes with at least one study having no events in both arms from Cochrane systematic reviews (2003–2018). We used the generalized linear mixed model to reanalyze these meta-analyses by two approaches: one including studies with no events in both arms and one excluding such studies. The magnitude and direction of odds ratio (OR), P value, and width of 95% confidence interval (CI) were compared. A simulation study was conducted to examine the robustness of results. Results: We identified 442 meta-analyses. In comparing paired meta-analyses that included studies with no events in both arms vs. those not, 8 (1.80%) resulted in different directions on OR; 41 (9.28%) altered conclusions on statistical significance. Substantial changes occurred on P value (55.66% increased and 44.12% decreased) and the width of 95% CI (50.68% inflated and 49.32% declined) when excluding studies with no events. Simulation study confirmed these findings. Conclusion: Studies with no events in both arms are not necessarily noninformative. Excluding such studies may alter conclusions.

Original languageEnglish (US)
Pages (from-to)91-99
Number of pages9
JournalJournal of Clinical Epidemiology
Volume123
DOIs
StatePublished - Jul 2020

Bibliographical note

Funding Information:
Funding: The corresponding author (S.X) was supported by the Natural Science Foundation of China (No.71573183), and the first author was supported by Doctoral Scholarship of Sichuan University. Authors? contributions: C.X. conceived and designed the study; X.S. supervised the study; C.X., Lif.L., and H.C. acquired the data. C.X. developed the code, analyzed the data, and draft the manuscript; C.X., X.S., and Lin.L interpreted the results; Lif.L., H.C., and L.T. provided careful comments on the statistical methods; K.Z. sought financial support for the project; all authors contribute to careful edits for the article. All authors approved the final version.

Keywords

  • Generalized linear mixed model
  • Meta-analysis of rare events
  • Statistical inference
  • Zero-events studies

PubMed: MeSH publication types

  • Journal Article

Fingerprint Dive into the research topics of 'Exclusion of studies with no events in both arms in meta-analysis impacted the conclusions'. Together they form a unique fingerprint.

Cite this