Apophenia and anesthesia: how we sometimes change our practice prematurely

Human beings are predisposed to identifying false patterns in statistical noise, a likely survival advantage during our evolutionary development. Moreover, humans seem to prefer “positive” results over “negative” ones. These two cognitive features lay a framework for premature adoption of falsely positive studies. Added to this predisposition is the tendency of journals to “overbid” for exciting or newsworthy manuscripts, incentives in both the academic and publishing industries that value change over truth and scientific rigour, and a growing dependence on complex statistical techniques that some reviewers do not understand. The purpose of this article is to describe the underlying causes of premature adoption and provide recommendations that may improve the quality of published science.

• Publication year

  2021

• Venue

  Canadian Journal of Anesthesia/Journal canadien d'anesthésie

• Publication date

  2021-05-07

• Fields of study

  Medicine, Philosophy

• Identifiers
  DOI 10.1007/s12630-021-02005-2PMID 33963519PMCID 8104920
• External record

  Open on Semantic Scholar

• Source metadata

  Semantic Scholar, PubMed

• No claims are published for this paper.

• No concepts are published for this paper.

• Retraction—Hydroxychloroquine or chloroquine with or without a macrolide for treatment of COVID-19: a multinational registry analysis

  2020cited by this paper
• The Effect of the IPACK Block on Pain After Primary TKA: A Double-Blinded, Prospective, Randomized Trial.

  2020cited by this paper
• Apophenia as the disposition to false positives: A unifying framework for openness and psychoticism.

  2020cited by this paper
• Cardiovascular Disease, Drug Therapy, and Mortality in Covid-19

  2020cited by this paper
• Impact of capnography on patient safety in high- and low-income settings: a scoping review.

  2020cited by this paper
• RETRACTED: Hydroxychloroquine or chloroquine with or without a macrolide for treatment of COVID-19: a multinational registry analysis

  2020cited by this paper
• Perineural Liposomal Bupivacaine Is Not Superior to Nonliposomal Bupivacaine for Peripheral Nerve Block Analgesia.

  2020cited by this paper
• Perioperative Use of Gabapentinoids for the Management of Postoperative Acute Pain: A Systematic Review and Meta-analysis.

  2020cited by this paper
• Retraction: Cardiovascular Disease, Drug Therapy, and Mortality in Covid-19. N Engl J Med. DOI: 10.1056/NEJMoa2007621.

  2020cited by this paper
• Scientists rise up against statistical significance

  2019cited by this paper
• National Institutes of Health-Funded Anesthesiology Research and Anesthesiology Physician-Scientists: Trends, Promises, and Concerns.

  2019cited by this paper
• Triple-low Alerts Do Not Reduce Mortality: A Real-time Randomized Trial

  2019cited by this paper
• Addition of Infiltration Between the Popliteal Artery and the Capsule of the Posterior Knee and Adductor Canal Block to Periarticular Injection Enhances Postoperative Pain Control in Total Knee Arthroplasty: A Randomized Controlled Trial.

  2019cited by this paper
• Early goal-directed therapy in the treatment of severe sepsis and septic shock.

  2018cited by this paper
• Full publication of results initially presented in abstracts.

  2018cited by this paper
• The Proposal to Lower P Value Thresholds to .005.

  2018cited by this paper
• Parachute use to prevent death and major trauma when jumping from aircraft: randomized controlled trial

  2018cited by this paper
• Parachute use to prevent death and major trauma when jumping from aircraft: randomized controlled trial

  2018cited by this paper
• Investigating the Effect of the Multiple Comparisons Problem in Visual Analysis

  2018cited by this paper
• Sample size of surgical randomized controlled trials: a lack of improvement over time.

  2018cited by this paper
• Redefine or justify? Comments on the alpha debate

  2018cited by this paper
• Sample size calculations for randomized clinical trials published in anesthesiology journals: a comparison of 2010 versus 2016

  2018cited by this paper
• Comparison of Registered and Reported Outcomes in Randomized Clinical Trials Published in Anesthesiology Journals

  2017cited by this paper
• Meta-assessment of bias in science

  2017cited by this paper
• Pectoral I Block Does Not Improve Postoperative Analgesia After Breast Cancer Surgery: A Randomized, Double-Blind, Dual-Centered Controlled Trial

  2017cited by this paper
• Redefine statistical significance

  2017cited by this paper
• Cochrane Database of Systematic Reviews Healthcare outcomes assessed with observational study designs compared with those assessed in randomized trials (Review)

  2017cited by this paper
• Redefine Statistical Significance

  2017cited by this paper
• Bayesian statistical inference

  2017cited by this paper
• Poor replication validity of biomedical association studies reported by newspapers

  2017cited by this paper
• Title: Redefine Statistical Significance

  2017cited by this paper
• A two-stage review process for randomized controlled trials: the ultimate solution for publication bias?

  2016cited by this paper
• Perineural Versus Intravenous Dexamethasone as an Adjuvant for Peripheral Nerve Blocks: A Systematic Review and Meta-Analysis

  2016cited by this paper
• Publication bias and the canonization of false facts

  2016cited by this paper
• Why Most Clinical Research Is Not Useful

  2016cited by this paper
• Francis Bacon’s comments on the power of negative observations in his Novum Organum, first published in 1620

  2016cited by this paper
• Pulmonary Artery Catheters for Adult Patients in Intensive Care.

  2016cited by this paper
• The Impact of Anesthesiologists on Coronary Artery Bypass Graft Surgery Outcomes

  2015cited by this paper
• The Impact of Anesthesiologists on Coronary Artery Bypass Graft Surgery Outcomes

  2015cited by this paper
• Discrepancies Between Randomized Controlled Trial Registry Entries and Content of Corresponding Manuscripts Reported in Anesthesiology Journals

  2015cited by this paper
• Book Review: “Blink: the power of thinking without thinking”

  2015cited by this paper
• Do clinicians understand the size of treatment effects? A randomized survey across 8 countries

  2015cited by this paper
• A systematic review and meta-analysis of early goal-directed therapy for septic shock: the ARISE, ProCESS and ProMISe Investigators

  2015cited by this paper
• Data fraud in clinical trials.

  2015cited by this paper
• Healthcare outcomes assessed with observational study designs compared with those assessed in randomized trials.

  2014cited by this paper
• Pectoral Nerves I and II Blocks in Multimodal Analgesia for Breast Cancer Surgery: A Randomized Clinical Trial

  2014cited by this paper
• Antiretroviral interventions for preventing breast milk transmission of HIV.

  2014cited by this paper
• Status of Anesthesiology Resident Research Education in the United States: Structured Education Programs Increase Resident Research Productivity

  2013cited by this paper
• Pulmonary artery catheters for adult patients in intensive care.

  2013cited by this paper
• Paranormal believers are more prone to illusory agency detection than skeptics.

  2013cited by this paper
• A decade of reversal: an analysis of 146 contradicted medical practices.

  2013cited by this paper
• Bayesian Statistical Inference in ANESTHESIOLOGY

  2013cited by this paper
• Statistical literacy of obstetrics-gynecology residents.

  2013cited by this paper
• Publication bias, retrospective bias, and reproducibility of significant results in observational studies.

  2012cited by this paper
• Hospital Stay and Mortality Are Increased in Patients Having a “Triple Low” of Low Blood Pressure, Low Bispectral Index, and Low Minimum Alveolar Concentration of Volatile Anesthesia

  2012cited by this paper
• Perioperative and anaesthetic-related mortality in developed and developing countries: a systematic review and meta-analysis.

  2012cited by this paper
• Do Physicians Understand Cancer Screening Statistics? A National Survey of Primary Care Physicians in the United States

  2012cited by this paper
• Publication Bias in the Anesthesiology Literature

  2012cited by this paper
• Chest-compression-only versus standard cardiopulmonary resuscitation: a meta-analysis

  2011cited by this paper
• Effect of dexamethasone on the duration of interscalene nerve blocks with ropivacaine or bupivacaine.

  2011cited by this paper
• A phase 3, randomized, placebo-controlled trial of DepoFoam® bupivacaine (extended-release bupivacaine local analgesic) in bunionectomy

  2011cited by this paper
• Retracted Science and the Retraction Index

  2011cited by this paper
• Fooled by Randomness: The Hidden Role of Chance in Life and in the Markets

  2010cited by this paper
• Chest-compression-only versus standard cardiopulmonary resuscitation: a meta-analysis.

  2010cited by this paper
• Graphical inference for infovis

  2010cited by this paper
• Intensive versus conventional glucose control in critically ill patients.

  2009cited by this paper
• How Many Scientists Fabricate and Falsify Research? A Systematic Review and Meta-Analysis of Survey Data

  2009cited by this paper
• Comparison of registered and published primary outcomes in randomized controlled trials.

  2009cited by this paper
• The journal impact factor denominator: defining citable (counted) items.

  2009cited by this paper
• Anesthesia awareness and the bispectral index.

  2008cited by this paper
• Effects of extended-release metoprolol succinate in patients undergoing non-cardiac surgery (POISE trial): a randomised controlled trial.

  2008cited by this paper
• Why Current Publication Practices May Distort Science

  2008cited by this paper
• Apophenia, theory of mind and schizotypy: perceiving meaning and intentionality in randomness.

  2008cited by this paper
• Anesthesia awareness and the bispectral index.

  2008cited by this paper
• Medicine residents' understanding of the biostatistics and results in the medical literature.

  2007cited by this paper
• How impact factors changed medical publishing—and science

  2007cited by this paper
• Relative suppression of magical thinking: a transcranial magnetic stimulation study.

  2007cited by this paper
• Persistence of contradicted claims in the literature.

  2007cited by this paper
• Full publication of results initially presented in abstracts.

  2007cited by this paper
• Biases in casino betting: The hot hand and the gambler’s fallacy

  2006cited by this paper
• Epidural Pain Relief Versus Systemic Opioid-Based Pain Relief for Abdominal Aortic Surgery

  2006cited by this paper
• Anesthesiology Physician Scientists in Academic Medicine: A Wake-up Call

  2006cited by this paper
• Contradicted and initially stronger effects in highly cited clinical research.

  2005cited by this paper
• Effect of intravenous corticosteroids on death within 14 days in 10008 adults with clinically significant head injury (MRC CRASH trial): randomised placebo-controlled trial

  2005cited by this paper
• Effect of intravenous corticosteroids on death within 14 days in 10008 adults with clinically significant head injury (MRC CRASH trial): randomised placebo-controlled trial.

  2004cited by this paper
• Bispectral index monitoring to prevent awareness during anaesthesia: the B-Aware randomised controlled trial.

  2004cited by this paper
• Effects of gabapentin on postoperative morphine consumption and pain after abdominal hysterectomy: A randomized, double‐blind trial

  2004cited by this paper
• Sophistry in Medicine: Lessons From the Epidural Space

  2004cited by this paper
• A comparison of albumin and saline for fluid resuscitation in the intensive care unit.

  2004cited by this paper
• The persistence of underpowered studies in psychological research: causes, consequences, and remedies.

  2004cited by this paper
• Intensive insulin therapy in critically ill patients.

  2002cited by this paper
• Journal prestige, publication bias, and other characteristics associated with citation of published studies in peer-reviewed journals.

  2002cited by this paper
• Intensive insulin therapy in critically ill patients.

  2001cited by this paper
• To Err is Human: Building a Safer Health System

  2001cited by this paper
• Use of dopamine in acute renal failure: A meta-analysis

  2001cited by this paper
• Early Goal-Directed Therapy in the Treatment of Severe Sepsis and Septic Shock

  2001cited by this paper
• Error management theory: a new perspective on biases in cross-sex mind reading.

  2000cited by this paper
• COMMITTEE ON QUALITY OF HEALTH CARE IN AMERICA

  2000cited by this paper
• Randomized, controlled trials, observational studies, and the hierarchy of research designs.

  2000cited by this paper
• A comparison of observational studies and randomized, controlled trials.

  2000cited by this paper

• The function of web decorations in orb web spiders

  2024cites this paper
• Sensitivity of endogenous autofluorescence in HeLa cells to the application of external magnetic fields

  2023cites this paper
• Increasing the reproducibility of research will reduce the problem of apophenia (and more)

  2021influential citation
• Use of nitrous oxide in contemporary anesthesia—an ongoing tug of war

  2021cites this paper
• Regional anaesthesia for thoracic surgery: what is the PROSPECT that fascial plane blocks are the answer?

  2021cites this paper
• In Defense of Science.

  2021cites this paper