Computational Reproducibility in The Wildlife Society's Flagship Journals

Althea A. Archmiller, Andrew D. Johnson, Jane Nolan, Margaret Edwards, Lisa H. Elliott, Jake M. Ferguson, Fabiola Iannarilli, Juliana Vélez, Kelsey Vitense, Douglas H. Johnson, John Fieberg

Research output: Contribution to journalArticle

Abstract

Scientific progress depends upon the accumulation of empirical knowledge via reproducible methodology. Although reproducibility is a main tenet of the scientific method, recent studies have highlighted widespread failures in adherence to this ideal. The goal of this study was to gauge the level of computational reproducibility, or the ability to obtain the same results using the same data and analytic methods as in the original publication, in the field of wildlife science. We randomly selected 80 papers published in the Journal of Wildlife Management and Wildlife Society Bulletin between 1 June 2016 and 1 June 2018. Of those that were suitable for reproducibility review (n = 74), we attempted to obtain study data from online repositories or directly from authors. Forty-two authors did not respond to our requests, and we were further unable to obtain data from authors of 13 other studies. Of the 19 studies for which we were able to obtain data and complete our analysis, we judged that 13 were mostly or fully reproducible. We conclude that the studies with publicly available data or data shared upon request were largely reproducible, but we remain concerned about the difficulty in obtaining data from recently published papers. We recommend increased data-sharing, data organization and documentation, communication, and training to advance computational reproducibility in the wildlife sciences.

Original languageEnglish (US)
Pages (from-to)1012-1017
Number of pages6
JournalJournal of Wildlife Management
Volume84
Issue number5
DOIs
StatePublished - Jul 1 2020

Keywords

  • data sharing
  • meta-analysis
  • open science
  • reproducibility
  • research methods
  • statistical methods

Fingerprint Dive into the research topics of 'Computational Reproducibility in The Wildlife Society's Flagship Journals'. Together they form a unique fingerprint.

  • Cite this

    Archmiller, A. A., Johnson, A. D., Nolan, J., Edwards, M., Elliott, L. H., Ferguson, J. M., Iannarilli, F., Vélez, J., Vitense, K., Johnson, D. H., & Fieberg, J. (2020). Computational Reproducibility in The Wildlife Society's Flagship Journals. Journal of Wildlife Management, 84(5), 1012-1017. https://doi.org/10.1002/jwmg.21855