Why Current Publication Practices May Distort Science

John Ioannidis and colleagues argue that the current system of publication in biomedical research provides a distorted view of the reality of scientific data.

• Publication year

  2008

• Venue

  PLoS Medicine

• Publication date

  2008-10-01

• Fields of study

  Medicine, Philosophy, Political Science

• Identifiers
  DOI 10.1371/journal.pmed.0050201PMID 18844432PMCID 2561077
• External record

  Open on Semantic Scholar

• Source metadata

  Semantic Scholar, PubMed

• No claims are published for this paper.

• No concepts are published for this paper.

• Selective Publication of Antidepressant Trials and Its Influence on Apparent Efficacy

  2009cited by this paper
• Systematic reviews are not biased by results from trials stopped early for benefit.

  2008cited by this paper
• Naturally occurring markets and exogenous laboratory experiments: A case study of the winner's curse

  2008cited by this paper
• Selective publication of antidepressant trials and its influence on apparent efficacy.

  2008cited by this paper
• Why Most Discovered True Associations Are Inflated

  2008cited by this paper
• Life and times of the impact factor: retrospective analysis of trends for seven medical journals (1994-2005) and their Editors’ views

  2007cited by this paper
• Systematic reviewers neglect bias that results from trials stopped early for benefit.

  2007cited by this paper
• Show me the data

  2007cited by this paper
• Almost all articles on cancer prognostic markers report statistically significant results.

  2007cited by this paper
• Selection in Reported Epidemiological Risks: An Empirical Assessment

  2007cited by this paper
• Journal impact factor in the era of expanding literature.

  2006cited by this paper
• Microparadigms: chains of collective reasoning in publications about molecular interactions.

  2006cited by this paper
• Evolution and Translation of Research Findings: From Bench to Where?

  2006cited by this paper
• Concentration of the Most-Cited Papers in the Scientific Literature: Analysis of Journal Ecosystems

  2006cited by this paper
• Origin and funding of the most frequently cited papers in medicine: database analysis

  2006cited by this paper
• Association of industry sponsorship to published outcomes in gastrointestinal clinical research.

  2006cited by this paper
• Journals Should Publish All “Null” Results and Should Sparingly Publish “Positive” Results

  2006cited by this paper
• The journal impact factor: too much of an impact?

  2006cited by this paper
• Scientific Journals: Who Impacts the Impact Factor?

  2006cited by this paper
• Commentary: the power of the unrelenting impact factor--is it a force for good or harm?

  2006cited by this paper
• Expanded Publishing Model for Genetic Association Studies

  2006cited by this paper
• The publication process itself was the major cause of publication bias in genetic epidemiology.

  2006cited by this paper
• Local Literature Bias in Genetic Epidemiology: An Empirical Evaluation of the Chinese Literature

  2005cited by this paper
• Early extreme contradictory estimates may appear in published research: the Proteus phenomenon in molecular genetics research and randomized trials.

  2005cited by this paper
• Contradicted and initially stronger effects in highly cited clinical research.

  2005cited by this paper
• Selective reporting biases in cancer prognostic factor studies.

  2005cited by this paper
• Why Most Published Research Findings Are False

  2005cited by this paper
• A surplus of positive trials: weighing biases and reconsidering equipoise

  2004cited by this paper
• Do the print media “hype” genetic research? A comparison of newspaper stories and peer-reviewed research papers

  2004cited by this paper
• A perspective on judgment and choice: mapping bounded rationality.

  2003cited by this paper
• Herd Behaviour and Cascading in Capital Markets: A Review and Synthesis

  2003cited by this paper
• Translation of highly promising basic science research into clinical applications.

  2003cited by this paper
• Factors associated with failure to publish large randomized trials presented at an oncology meeting.

  2003cited by this paper
• Publication bias in editorial decision making.

  2002cited by this paper
• Publication Bias: The “File-Drawer” Problem in Scientific Inference

  2000cited by this paper
• The role of electronic journals in reducing publication bias.

  1999cited by this paper
• Positive-outcome bias and other limitations in the outcome of research abstracts submitted to a scientific meeting.

  1998cited by this paper
• Learning from the behavior of others : conformity, fads, and informational cascades

  1998cited by this paper
• The Changing Rewards to Science: The Case of Biotechnology

  1998cited by this paper
• Statistical reviewing policies of medical journals

  1998cited by this paper
• Statistical reviewing policies of medical journals: caveat lector?

  1998cited by this paper
• Publication bias: evidence of delayed publication in a cohort study of clinical research projects

  1997cited by this paper
• The economics of science

  1996cited by this paper
• Bidding in Common Value Auctions: How the Commercial Construction Industry Corrects for the Winner's Curse

  1996cited by this paper
• The Winner-Take-All Society

  1995cited by this paper
• Photodynamic therapy-induced alterations in interstitial fluid pressure, volume and water content of an amelanotic melanoma in the hamster.

  1994cited by this paper
• Toward a new economics of science

  1994cited by this paper
• Will publication bias vanish in the age of online journals?

  1992cited by this paper
• On limiting the market for status signals

  1991cited by this paper
• Publication bias in clinical research.

  1991cited by this paper
• What makes basic research economically useful

  1991cited by this paper
• A Note on Restaurant Pricing and Other Examples of Social Influences on Price

  1991cited by this paper
• SCIENCE, TECHNOLOGY AND THE WESTERN MIRACLE

  1990cited by this paper
• Selection Models and the File Drawer Problem

  1988cited by this paper
• Bubbles, Crashes, and Endogenous Expectations in Experimental Spot Asset Markets

  1988cited by this paper
• Anomalies: The Winner's Curse

  1988cited by this paper
• Publication bias and clinical trials.

  1987cited by this paper
• Towards a reduction in publication bias.

  1987cited by this paper
• Information, Returns, and Bidding Behavior in OCS Auctions: 1954-1969

  1987cited by this paper
• Publication bias: the case for an international registry of clinical trials.

  1986cited by this paper
• In Search of the Winner's Curse

  1984cited by this paper
• Publication Productivity among Scientists: A Critical Review

  1983cited by this paper
• Implications of the Auction Mechanism in Baseball's Free Agent Draft*

  1980cited by this paper
• Consequences of Prejudice Against the Null Hypothesis

  1975cited by this paper
• Science, Invention and Economic Growth

  1974cited by this paper
• Book Publishing What It Is, What It Does

  1974cited by this paper
• Productivity Differences Among Scientists: Evidence for Accumulative Advantage

  1974cited by this paper
• Competitive Bidding in High-Risk Situations

  1971cited by this paper
• Some economic aspects of science

  1971cited by this paper
• Science, Faith and Society

  1964cited by this paper
• The Rate and Direction of Inventive Activity: Economic and Social Factors.

  1963influential reference
• The Rate and Direction of Inventive Activity: Economic and Social Factors.

  1962cited by this paper
• The Logic of Scientific Discovery.

  1959cited by this paper
• The Simple Economics of Basic Scientific Research

  1959cited by this paper
• Priorities in scientific discovery: A chapter in the sociology of science.

  1957cited by this paper
• The Instability of Capitalism

  1928cited by this paper

• Are Reproducible Dietary Patterns Consistently Associated With Disease Outcomes or Their Drivers in Italy? A Systematic Review

  2025cites this paper
• High Costs, Long Waits, and Ethical Dilemmas: A Review of Challenges in Academic Publishing

  2025cites this paper
• Science as status: early marketing activities of Newtonian entrepreneurs and the new taste regime of polite society in eighteenth-century England

  2025cites this paper
• Publication bias in the social sciences since 1959: Application of a regression discontinuity framework

  2025cites this paper
• Do robots boost productivity? A quantitative meta‐study

  2025cites this paper
• Lost in citations: Why standard metrics fail archaeology and regional scholarship. A critical analysis of bibliographic indexing and research evaluation.

  2025cites this paper
• Philosophical in Confronting Rejection: language confusion in the correspondence between editor and author

  2025cites this paper
• AgEvidence: a dataset to explore agro-ecological effects of conservation agriculture

  2024cites this paper
• Assessing hypo-arousal during reward anticipation with pupillometry in patients with major depressive disorder: replication and correlations with anhedonia

  2024cites this paper
• A knowledge synthesis of health research reporting standards relevant to epilepsy surgery

  2024cites this paper
• Genetic factors associated with reasons for clinical trial stoppage

  2024cites this paper
• The golden ratio—dispelling the myth

  2024cites this paper
• Assessing Adherence to the PRISMA-DTA Guideline in Diagnostic Test Accuracy Systematic Reviews: A Five-Year Follow-up Analysis.

  2024cites this paper
• Exploring the Interplay Between Climate Change, 24-Hour Movement Behavior, and Health: A Systematic Review.

  2024cites this paper
• What should constitute a control condition in psychedelic drug trials?

  2024cites this paper
• SPIN-PM: A consensus framework to evaluate the presence of spin in studies on prediction models.

  2024cites this paper
• Unveiling systemic oppression in business education: Freire’s contribution to our quest for social change

  2024cites this paper
• Being positive about negatives: why publishing negative results is good for veterinary science.

  2024cites this paper
• Sulle spalle di giganti di sabbia

  2024cites this paper
• Placebo effects in osteoarthritis: implications for treatment and drug development

  2023cites this paper
• Statistical power in network neuroscience.

  2023cites this paper
• The future of academic publishing

  2023cites this paper
• The rise of a mega‐journal in public health publishing

  2023cites this paper
• Power and bias in industrial relations research

  2023cites this paper
• Promotion and caution in research article abstracts: The use of positive, negative and hedge words across disciplines and rankings

  2023cites this paper
• Aging and Economic Preferences: Cumulative Meta-Analyses of Age Differences in Risk, Time, Social, and Effort Preferences

  2023cites this paper
• Presence and consequences of positive words in scientific abstracts

  2023cites this paper
• Statins for chronic liver disease and the need for randomized controlled trials.

  2023cites this paper
• A Simple Rational Expectations Model of the Voltage Effect

  2023cites this paper
• Reducing bias, increasing transparency and calibrating confidence with preregistration

  2023cites this paper
• The Concept of Scaffold-Guided Bone Regeneration for the Treatment of Long Bone Defects: Current Clinical Application and Future Perspective

  2023cites this paper
• Meta‐analysis of social science research: A practitioner's guide

  2023cites this paper
• Reciprocal transplants reveal asymmetric local adaptation of Himalayan Rhododendron approaching elevational range limit

  2023cites this paper
• Selective and (mis)leading economics journals: Meta‐research evidence

  2023cites this paper
• Why Clinical Trials Stop: The Role of Genetics

  2023cites this paper
• Extraordinary Claims in the Literature on High-Intensity Interval Training (HIIT): I. Bonafide Scientific Revolution or a Looming Crisis of Replication and Credibility?

  2023cites this paper
• Are Most Published Criminological Research Findings Wrong? Taking Stock of Criminological Research Using a Bayesian Simulation Approach

  2022cites this paper
• A Re-evaluation of the mechanism of microwave absorption in film – Part 1: Energy conservation

  2022cites this paper
• Current Status and Future Opportunities in Modeling Clinical Characteristics of Multiple Sclerosis

  2022cites this paper
• Replicability in Brain Imaging

  2022cites this paper
• Effects of rural electrification on household welfare: a meta-regression analysis

  2022cites this paper
• Natural Mathematical Derivation of the Gibbs–Duhem Equation Related to ΔG and ∂G/∂ξ

  2022cites this paper
• Tribute to an editor: Neal S. Young As a Medical Editor and Writer.

  2022cites this paper
• Expansion of information in scientific research papers

  2022cites this paper
• Quantifying Bias from Measurable and Unmeasurable Confounders Across Three Domains of Individual Determinants of Political Preferences

  2022cites this paper
• Beyond counting papers – a mission and vision for scientific publication

  2022cites this paper
• All power to the reviewers: British sociology under two-level supervision of the Research Excellence Framework

  2022cites this paper
• Scientific Publishing in Biomedicine: A Brief History of Scientific Journals

  2022cites this paper
• How strong is the evidence to support statins repurposing for the treatment of cirrhosis?

  2022cites this paper
• Reproducibility, Relevance and Reliability as Barriers to Efficient and Credible Biomedical Technology Translation.

  2022cites this paper
• Modeling of interventions for reducing external Enterobacteriaceae contamination of broiler carcasses during processing

  2022cites this paper
• P-Hacking in Experimental Accounting Studies

  2021cites this paper
• Responsible Science Assessment: downplaying indexes, boosting quality.

  2021cites this paper
• Dyslexia treatment studies: A systematic review and suggestions on testing treatment efficacy with small effects and small samples

  2021cites this paper
• Improving the reproducibility of findings by updating research methodology

  2021cites this paper
• Apophenia and anesthesia: how we sometimes change our practice prematurely

  2021cites this paper
• Preprint paper platforms in the academic scholarly communication environment

  2021cites this paper
• A Narrative on The Fabrication of Results in Science

  2021cites this paper
• Scholarly Publishing and Scientific Reproducibility

  2021cites this paper
• Low statistical power and overestimated anthropogenic impacts, exacerbated by publication bias, dominate field studies in global change biology

  2021cites this paper
• Avoiding Regrettable Substitutions: Green Toxicology for Sustainable Chemistry.

  2021cites this paper
• Neither Donor nor Recipient Mitochondrial Haplotypes Are Associated with Unrelated Donor Transplant Outcomes: A Validation Study from the CIBMTR.

  2021cites this paper
• Is rapid scientific publication also high quality? Bibliometric analysis of highly disseminated COVID‐19 research papers

  2021cites this paper
• A theoretical investigation of the quarter-wavelength model-part 2: verification and extension

  2021cites this paper
• Raising the Bar: Improving Methodological Rigour in Cognitive Alcohol Research.

  2021cites this paper
• Directing scientists away from potentially biased publications: the role of systematic reviews in health care

  2021cites this paper
• An umbrella review of effect size, bias, and power across meta‐analyses in emergency medicine

  2021cites this paper
• Towards a credibility revolution in bilingualism research: Open data and materials as stepping stones to more reproducible and replicable research

  2021cites this paper
• Reverse Bayesian Implications of p-Values Reported in Critical Care Randomized Trials

  2021cites this paper
• Valid statistical approaches for clustered data: A Monte Carlo simulation study

  2020cites this paper
• Settings, Quantification, and Statistical Analyses beyondp‐Values for Arabidopsis Ethylene Responses

  2020cites this paper
• Research Evaluation: Mapping the Field Structure

  2020cites this paper
• Heart failure disease management interventions: time for a reappraisal

  2020cites this paper
• Enhanced Recovery After Surgery (ERAS) and Immunonutrition: An Evidence-Based Approach

  2020cites this paper
• Highlighting the racial inequality present within academia: PsyPAG’s response to the Black Lives Matter movement

  2020cites this paper
• 2017 KLEIN LECTURE: THE SCIENCE OF USING SCIENCE: TOWARD AN UNDERSTANDING OF THE THREATS TO SCALABILITY

  2020cites this paper
• How can experiments play a greater role in public policy? Twelve proposals from an economic model of scaling

  2020cites this paper
• A Provisional System to Evaluate Journal Publishers Based on Partnership Practices and Values Shared with Academic Institutions and Libraries

  2020cites this paper
• Open Data in Catalysis: From Today's Big Picture to the Future of Small Data

  2020cites this paper
• Norms, Competition, and Visibility in Contemporary Science: The Legacy of Robert K. Merton

  2020cites this paper
• A Methodological and Reporting Quality Assessment of Systematic Reviews/Meta-Analyses about Chinese Medical Treatment for Gastroesophageal Reflux Disease

  2020cites this paper
• Assessment of Factors Causing Bias in Marketing- Related Publications

  2020cites this paper
• Temporal discounting across adulthood: A systematic review and meta-analysis.

  2020cites this paper
• Ten simple rules for open human health research

  2020cites this paper
• fetishisation of excellence

  2020cites this paper
• Ten Steps Toward a Better Personality Science – How Quality May Be Rewarded More in Research Evaluation

  2020cites this paper
• The importance of using multiple outcome measures in infant research.

  2020cites this paper
• Replicability Crisis and Scientific Reforms: Overlooked Issues and Unmet Challenges

  2020cites this paper
• Designing Studies and Evaluating Research Results: Type M and Type S Errors for Pearson Correlation Coefficient

  2020cites this paper
• Using collaboration networks to identify authorship dependence in meta‐analysis results

  2020cites this paper
• 13. Does Money Change Everything? Priming Experiments in Situations of Strategic Interaction

  2020cites this paper
• Sex, Drugs, and How to Deal with Criticism: The Case of Flibanserin

  2020cites this paper
• Is science a pyramid scheme? The correlation between an author's position in the academic hierarchy and her scientific output per year

  2020cites this paper
• No Organizations for Today’s Einsteins

  2020cites this paper
• Information Retrieval: A Biomedical and Health Perspective

  2020cites this paper
• Dangerous Science Science: Policy and Risk Analysis for Scientists and Engineers

  2020cites this paper
• Methodological and clinical challenges associated with biomarkers for psychiatric disease: A scoping review.

  2020cites this paper
• How Can Experiments Play a Greater Role in Public Policy? 12 Proposals from an Economic Model of Scaling

  2019cites this paper
• Reporting Guidelines for Imaging Research.

  2019cites this paper
• An empirical assessment of transparency and reproducibility-related research practices in the social sciences (2014–2017)

  2019cites this paper