NCBI Bookshelf. A service of the National Library of Medicine, National Institutes of Health.
Questions about the reproducibility of scientific research have been raised in numerous settings and have gained visibility through several high-profile journal and popular press articles. Quantitative issues contributing to reproducibility challenges have been considered (including improper data measurement and analysis, inadequate statistical expertise, and incomplete data, among others), but there is no clear consensus on how best to approach or to minimize these problems.
A lack of reproducibility of scientific results has created some distrust in scientific findings among the general public, scientists, funding agencies, and industries. While studies fail for a variety of reasons, many factors contribute to the lack of perfect reproducibility, including insufficient training in experimental design, misaligned incentives for publication and the implications for university tenure, intentional manipulation, poor data management and analysis, and inadequate instances of statistical inference.
The workshop summarized in this report was designed not to address the social and experimental challenges but instead to focus on the latter issues of improper data management and analysis, inadequate statistical expertise, incomplete data, and difficulties applying sound statistic inference to the available data. Many efforts have emerged over recent years to draw attention to and improve reproducibility of scientific work. This report uniquely focuses on the statistical perspective of three issues: the extent of reproducibility, the causes of reproducibility failures, and the potential remedies for these failures.
Contents
- The National Academies of SCIENCES • ENGINEERING • MEDICINE
- PLANNING COMMITTEE ON STATISTICAL CHALLENGES IN ASSESSING AND FOSTERING THE REPRODUCIBILITY OF SCIENTIFIC RESULTS
- COMMITTEE ON APPLIED AND THEORETICAL STATISTICS
- BOARD ON MATHEMATICAL SCIENCES AND THEIR APPLICATIONS
- Acknowledgment of Reviewers
- 1. Introduction
- 2. Overview and Case Studies
- 3. Conceptualizing, Measuring, and Studying Reproducibility
- 4. The Way Forward: Using Statistics to Improve Reproducibility
- References
- APPENDIXES
Rapporteur: Michelle Schwalbe.
Suggested citation:
National Academies of Sciences, Engineering, and Medicine. 2016. Statistical Challenges in Assessing and Fostering the Reproducibility of Scientific Results: Summary of a Workshop. Washington, DC: The National Academies Press. doi: 10.17226/21915.
- NLM CatalogRelated NLM Catalog Entries
- Review Translational Metabolomics of Head Injury: Exploring Dysfunctional Cerebral Metabolism with Ex Vivo NMR Spectroscopy-Based Metabolite Quantification.[Brain Neurotrauma: Molecular, ...]Review Translational Metabolomics of Head Injury: Exploring Dysfunctional Cerebral Metabolism with Ex Vivo NMR Spectroscopy-Based Metabolite Quantification.Wolahan SM, Hirt D, Glenn TC. Brain Neurotrauma: Molecular, Neuropsychological, and Rehabilitation Aspects. 2015
- A research roadmap for complementary and alternative medicine - what we need to know by 2020.[Forsch Komplementmed. 2014]A research roadmap for complementary and alternative medicine - what we need to know by 2020.Fischer F, Lewith G, Witt CM, Linde K, von Ammon K, Cardini F, Falkenberg T, Fønnebø V, Johannessen H, Reiter B, et al. Forsch Komplementmed. 2014; 21(2):e1-16. Epub 2014 Mar 24.
- Alcohol research and the alcoholic beverage industry: issues, concerns and conflicts of interest.[Addiction. 2009]Alcohol research and the alcoholic beverage industry: issues, concerns and conflicts of interest.Babor TF. Addiction. 2009 Feb; 104 Suppl 1:34-47.
- Impact Factors and Prediction of Popular Topics in a Journal.[Ultraschall Med. 2016]Impact Factors and Prediction of Popular Topics in a Journal.Nielsen MB, Seitz K. Ultraschall Med. 2016 Aug; 37(4):343-5. Epub 2016 Aug 4.
- Review Updating Systematic Reviews[ 2007]Review Updating Systematic ReviewsShojania KG, Sampson M, Ansari MT, Ji J, Garritty C, Rader T, Moher D. 2007 Sep
- Statistical Challenges in Assessing and Fostering the Reproducibility of Scienti...Statistical Challenges in Assessing and Fostering the Reproducibility of Scientific Results
Your browsing activity is empty.
Activity recording is turned off.
See more...