Reproducibility: A tragedy of errors

No abstract is available for this paper.

• Publication year

  2016

• Venue

  Nature

• Publication date

  2016-02-03

• Fields of study

  Medicine, Psychology

• Identifiers
  DOI 10.1038/530027aPMID 26842041PMCID PMC4831566
• External record

  Open on Semantic Scholar

• Source metadata

  Semantic Scholar, PubMed

• No claims are published for this paper.

• No concepts are published for this paper.

• Unsubstantiated conclusions from improper statistical design and analysis of a randomized controlled trial

  2016cited by this paper
• Best (but oft forgotten) practices: testing for treatment effects in randomized trials by separate analyses of changes from baseline in each group is a misleading approach.

  2015cited by this paper
• Best (but oft-forgotten) practices: designing, analyzing, and reporting cluster randomized controlled trials.

  2015cited by this paper
• Quality Management in Scientific Publishing – the Importance to Critically Scrutinize Scientific Work

  2015cited by this paper
• Errors in statistical analysis and questionable randomization lead to unreliable conclusions.

  2015cited by this paper
• Concerning Sichieri R, Cunha DB: Obes Facts 2014;7:221-232. The Assertion that Controlling for Baseline (Pre-Randomization) Covariates in Randomized Controlled Trials Leads to Bias Is False

  2015cited by this paper
• Letter to the Editor: Exceptional Data in Paper on "The effect of meridian massage on BM, BMI, WC and HC in simple obesity patients: a randomized controlled trial".

  2015cited by this paper
• Exceptional data in paper on “The effect of meridian massage on BM, BMI, WC and HC in simple obesity patients: a randomized controlled tria”

  2015cited by this paper
• Order of Magnitude Misestimation of Weight Effects of Children's Meal Policy Proposals

  2014cited by this paper

• The Engine of Scientific Discovery

  2026cites this paper
• Unlocking the benefits of transparent and reusable science for climate risk management

  2026cites this paper
• Conclusions Are Not Supported by the Published Statistical Analysis. Comment on López-Toledo et al. Flaxseed Improves Glucose and Lipid Metabolism in Mexican Subjects with Type 2 Diabetes: A Parallel Randomized Clinical Trial. Nutrients 2025, 17, 709

  2026cites this paper
• On and off-the-record correction practices: A survey-based study of how chemistry researchers react to errors.

  2025cites this paper
• Reproducing and Improving CheXNet: Deep Learning for Chest X-ray Disease Classification

  2025cites this paper
• Reproducing and Improving CheXNet: Deep Learning for Chest X-ray Disease Classification

  2025cites this paper
• How Do Psychology Journals Handle Postpublication Critique? A Cross-Sectional Study of Policy and Practice

  2025cites this paper
• Physical activity and diet pattern do not mitigate C-reactive protein increases associated with oral contraceptive use

  2025cites this paper
• The Controversy behind the Controversies: Scientific Discourse in the Twenty-First Century

  2025cites this paper
• Accuracy and distribution of baseline categorical variables and p-values in spine randomized controlled trials

  2025cites this paper
• Misleading biases in methods for estimating wolf abundance using spatial models

  2025cites this paper
• Statistical Perspectives on Reproducibility: Definitions and Challenges

  2025cites this paper
• Artificial Intelligence in Detecting Statistical Errors: Implications for Authors, Reviewers, and Editors

  2025cites this paper
• ZnTrack - Data as Code

  2024cites this paper
• Pathways to a Shiny Future: Building the Foundation for Computational Physical Chemistry and Biophysics in 2050

  2024cites this paper
• The research literature is an unsafe workplace

  2024influential citation
• Experimental Designs and Statistical Analyses for Rootstock Trials

  2024cites this paper
• Standardised Versioning of Datasets: a FAIR–compliant Proposal

  2024cites this paper
• Training in the implementation of sex and gender research policies: an evaluation of publicly available online courses

  2024cites this paper
• Debunking revolutionary paradigm shifts: evidence of cumulative scientific progress across science

  2024cites this paper
• Data Drift for Automatic FAIR-compliant Dataset Versioning in Large Repositories

  2024cites this paper
• A Note on "Response to: Methodological Rigor in Reference Chart Development: A Comment on 'Normative Reference Centiles for Sprint Performance in High-Level Youth Soccer Players: The Need To Consider Biological Maturity'".

  2024cites this paper
• Science of science: A multidisciplinary field studying science

  2024cites this paper
• Sex contextualism in laboratory research: Enhancing rigor and precision in the study of sex-related variables.

  2024cites this paper
• A discussion and evaluation of statistical procedures used by JIMB authors when comparing means.

  2024cites this paper
• Metadata integrity in bioinformatics: Bridging the gap between data and knowledge

  2023influential citation
• Philosophy of Open Science

  2023cites this paper
• Considering Sex as a Variable at a Research University: Knowledge, Attitudes, and Practices

  2023cites this paper
• Connecting simple and precise P‐values to complex and ambiguous realities (includes rejoinder to comments on “Divergence vs. decision P‐values”)

  2023cites this paper
• Incorrect analysis in "Effects of the application of a food processing-based classification system in obese women: A randomized controlled pilot study" has resulted in incorrect conclusions of demonstrated effects where no such effects have been demonstrated.

  2023cites this paper
• Sex-Inclusive Biomedicine: Are New Policies Increasing Rigor and Reproducibility?

  2023cites this paper
• Effect of Radioiodine Treatment on Quality of Life in Patients with Subclinical Hyperthyroidism: A Prospective Controlled Study

  2023cites this paper
• Exploring arXiv usage habits among Slovenian scientists

  2023cites this paper
• Why and How to Account for Sex and Gender in Brain and Behavioral Research

  2023cites this paper
• Replication and Reproducibility and the Self-Correction of Science: What Can JID Innovations Do?

  2023cites this paper
• Amending the literature through version control

  2023cites this paper
• Best practices to promote rigor and reproducibility in the era of sex-inclusive research

  2023cites this paper
• Burden of proof: combating inaccurate citation in biomedical literature

  2023cites this paper
• Data Management: The First Step in Reproducible Research

  2023cites this paper
• Are female scientists underrepresented in self-retractions for honest error?

  2023cites this paper
• The future of academic publishing

  2023cites this paper
• Determination of sex differences requires formal test for differences: Comment on “lipoprotein‐subclass particle numbers in children with abdominal obesity”

  2023cites this paper
• Inaccuracy in the Scientific Record and Open Postpublication Critique

  2023cites this paper
• A self-governing, self-regulating system for assessing scientific predictive power

  2022cites this paper
• Protection of the human gene research literature from contract cheating organizations known as research paper mills

  2022cites this paper
• Characteristics of correction practice and its citation in library and information science journals

  2022cites this paper
• Are female scientists underrepresented in self-correcting science for honest error?

  2022cites this paper
• FAIRsoft—a practical implementation of FAIR principles for research software

  2022cites this paper
• A bibliometric study on the publication errors in emergency medicine journals from 2000 to 2020.

  2022cites this paper
• Findings from meta-analysis of soy supplementation and inflammatory biomarkers should be interpreted with caution.

  2022cites this paper
• An observational analysis of the trope “A p-value of < 0.05 was considered statistically significant” and other cut-and-paste statistical methods

  2022cites this paper
• Reproducibility in Computing Research: An Empirical Study

  2022cites this paper
• Patching Science – amending the literature through version control

  2022influential citation
• Comment on ‘Effects of pistachios on anthropometric indices, inflammatory markers, endothelial function and blood pressure in adults: a systematic review and meta-analysis of randomised controlled trials’

  2021cites this paper
• Behind the Façade of Self-Correcting Science

  2021cites this paper
• Reproducibility 2020 : Progress and priorities [ version 1 ; peer review : 2 approved ]

  2021cites this paper
• Systematic review and meta-analyses of studies analysing instructions to authors from 1987 to 2017

  2021cites this paper
• Misinformation: an empirical study with scientists and communicators during the COVID-19 pandemic

  2021cites this paper
• University of Alabama at Birmingham Nathan Shock Center: comparative energetics of aging

  2021cites this paper
• Errors in the implementation, analysis, and reporting of randomization within obesity and nutrition research: a guide to their avoidance

  2021cites this paper
• Scholarly Publishing and Scientific Reproducibility

  2021cites this paper
• Evidence of misuse of nonparametric tests in the presence of heteroscedasticity within obesity research

  2021cites this paper
• The daily self-weighing for obesity management in primary care study: Rationale, design and methodology.

  2021cites this paper
• The thin ret(raction) line: biomedical journal responses to incorrect non-targeting nucleotide sequence reagents in human gene knockdown publications

  2021cites this paper
• Transparency About Values and Assertions of Fact in Natural Resource Management

  2021influential citation
• Code Review: An Important Step Towards Reproducible Research.

  2021cites this paper
• Comment on “Effect of bariatric surgery on circulating FGF‐19: A systematic review and meta‐analysis”

  2021cites this paper
• The impact of using biased performance metrics on software defect prediction research

  2021cites this paper
• Persistent confusion in nutrition and obesity research about the validity of classic nonparametric tests in the presence of heteroscedasticity: evidence of the problem and valid alternatives.

  2021cites this paper
• Open practices in our science and our courtrooms.

  2021cites this paper
• Reasons and implications of retracted articles in Brazil

  2021cites this paper
• Is preprint the future of science? A thirty year journey of online preprint services

  2021cites this paper
• From Model Organisms to Humans, the Opportunity for More Rigor in Methodologic and Statistical Analysis, Design, and Interpretation of Aging and Senescence Research.

  2021cites this paper
• Directing scientists away from potentially biased publications: the role of systematic reviews in health care

  2021cites this paper
• Quotation Accuracy Matters: An Examination of How an Influential Meta-Analysis on Active Learning Has Been Cited

  2021cites this paper
• Benefits and harms of implementing [18F]FDG-PET/CT for diagnosing recurrent breast cancer: a prospective clinical study

  2021cites this paper
• Teaching Metrology and Examinology in Chemistry at the University

  2020cites this paper
• Preprints in Medicine: Useful or Harmful?

  2020cites this paper
• Workflows in AiiDA: Engineering a high-throughput, event-based engine for robust and modular computational workflows

  2020cites this paper
• Comparisons of Within-Group Instead of Between-Group Affect the Conclusions. Comment on: “Changes in Weight and Substrate Oxidation in Overweight Adults Following Isomaltulose Intake during a 12-Week Weight Loss Intervention: A Randomized, Double-Blind, Controlled Trial”. Nutrients 2019, 11(10), 236

  2020cites this paper
• Towards standardization guidelines for in silico approaches in personalized medicine

  2020cites this paper
• Improving open and rigorous science: ten key future research opportunities related to rigor, reproducibility, and transparency in scientific research

  2020cites this paper
• Rhetorical Citizenship and the Science of Science Communication

  2020cites this paper
• Ten simple rules on how to write a standard operating procedure

  2020cites this paper
• How To Be a Better Scientist. By Andrew C. Johnson and John P. Sumpter. Taylor and Francis, 2018. Pp. 248. Price GBP 15.19 ISBN 9781138731295 (paperback), GBP 76.00 ISBN 9781138731219 (hardback), GBP 12.34 ISBN 9781315189079 (ebook).

  2020cites this paper
• AiiDA 1.0, a scalable computational infrastructure for automated reproducible workflows and data provenance

  2020cites this paper
• From insight network to open policy practice: practical experiences

  2020cites this paper
• Editorial: More Covid

  2020cites this paper
• Universal rules of life: metabolic rates, biological times and the equal fitness paradigm

  2020cites this paper
• Commentary: Studying a Possible Placebo Effect of an Imaginary Low-Calorie Diet

  2020cites this paper
• Improving the Reproducibility of LaTeX Documents by Enriching Figures with Embedded Scripts and Data

  2020cites this paper
• Appetite‐Related Responses to Overfeeding and Longitudinal Weight Change in Obesity‐Prone and Obesity‐Resistant Adults

  2020cites this paper
• Murine genetic models of obesity: type I error rates and the power of commonly used analyses as assessed by plasmode-based simulation

  2020cites this paper
• Correcting the scientific record – A broken system?

  2020cites this paper
• On the socio-technical potential for onshore wind in Europe: A response to Enevoldsen et al. (2019), Energy Policy, 132, 1092-1100

  2020cites this paper
• The long life of unicorns

  2020cites this paper
• Initial thoughts on Greene’s the tragedy of commonsense morality

  2020cites this paper
• Retraction Watch: What We’ve Learned and How Metrics Play a Role

  2020cites this paper
• Within-group comparisons led to unsubstantiated conclusions in “Low-phytate wholegrain bread instead of high-phytate wholegrain bread in a total diet context did not improve iron status of healthy Swedish females: a 12-week, randomized, parallel-design intervention Study”

  2020cites this paper
• Contrary to the Conclusions Stated in the Paper, Only Dry Fat-Free Mass Was Different between Groups upon Reanalysis. Comment on: “Intermittent Energy Restriction Attenuates the Loss of Fat-Free Mass in Resistance Trained Individuals. A Randomized Controlled Trial”

  2020cites this paper