Evaluating the replicability of social science experiments in Nature and Science between 2010 and 2015

No abstract is available for this paper.

• Publication year

  2018

• Venue

  Nature Human Behaviour

• Publication date

  2018-07-11

• Fields of study

  Mathematics, Medicine, Political Science

• Identifiers
  DOI 10.1038/s41562-018-0399-zPMID 31346273
• External record

  Open on Semantic Scholar

• Source metadata

  Semantic Scholar, PubMed

• No claims are published for this paper.

• No concepts are published for this paper.

• Investigating Variation in Replicability: A “Many Labs” Replication Project

  2022cited by this paper
• Reproducibility

  2019cited by this paper
• Why Most Published Research Findings Are False

  2019cited by this paper
• Many Labs 2: Investigating Variation in Replicability Across Sample and Setting

  2018cited by this paper
• The preregistration revolution

  2018cited by this paper
• Many Labs 2: Investigating Variation in Replicability Across Samples and Settings

  2018cited by this paper
• Title: Redefine Statistical Significance

  2017cited by this paper
• Registered Replication Report: Rand, Greene, and Nowak (2012)

  2017cited by this paper
• A Bayesian bird's eye view of ‘Replications of important results in social psychology’

  2017cited by this paper
• Bayesian inference for psychology. Part II: Example applications with JASP

  2017cited by this paper
• A manifesto for reproducible science

  2017cited by this paper
• Redefine statistical significance

  2017cited by this paper
• A Bayesian Perspective on the Reproducibility Project: Psychology

  2016cited by this paper
• oTree - An Open-Source Platform for Laboratory, Online, and Field Experiments

  2016cited by this paper
• Comment on “Estimating the reproducibility of psychological science”

  2016cited by this paper
• Response to Comment on “Estimating the reproducibility of psychological science”

  2016cited by this paper
• Many Labs 3: Evaluating participant pool quality across the academic semester via replication

  2016cited by this paper
• 1,500 scientists lift the lid on reproducibility

  2016cited by this paper
• Evaluating replicability of laboratory experiments in economics

  2016cited by this paper
• What Should Researchers Expect When They Replicate Studies? A Statistical View of Replicability in Psychological Science

  2016cited by this paper
• Promoting an open research culture

  2015cited by this paper
• The Economics of Reproducibility in Preclinical Research

  2015cited by this paper
• Promoting an open research culture : Author guidelines for journals could help to promote transparency , openness , and reproducibility

  2015cited by this paper
• Using prediction markets to estimate the reproducibility of scientific research

  2015cited by this paper
• Estimating the reproducibility of psychological science

  2015cited by this paper
• Inequality and visibility of wealth in experimental social networks

  2015cited by this paper
• Reproducibility

  2014cited by this paper
• Mutational heterogeneity in cancer and the search for new cancer genes

  2014cited by this paper
• Bayesian Cognitive Modeling: A Practical Course

  2014cited by this paper
• Just think: The challenges of the disengaged mind

  2014cited by this paper
• One swallow doesn’t make a summer: new evidence on anchoring effects

  2014cited by this paper
• Small Telescopes

  2014cited by this paper
• Is thinking really aversive? A commentary on Wilson et al.'s “Just think: the challenges of the disengaged mind”

  2014influential reference
• Avoiding overhead aversion in charity

  2014cited by this paper
• Psychology. Replication effort provokes praise--and 'bullying' charges.

  2014cited by this paper
• Cooperating with the future

  2014cited by this paper
• UvA-DARE ( Digital Academic Repository ) Bayesian tests to quantify the result of a replication attempt

  2014cited by this paper
• Mutational heterogeneity in cancer and the search for new cancer genes

  2013cited by this paper
• Intuition and cooperation reconsidered

  2013cited by this paper
• Experimental evidence for the influence of group size on cultural complexity

  2013cited by this paper
• Reading Literary Fiction Improves Theory of Mind

  2013cited by this paper
• Morals and Markets

  2013cited by this paper
• Power failure: why small sample size undermines the reliability of neuroscience

  2013cited by this paper
• How psychological framing affects economic market prices in the lab and field

  2013cited by this paper
• Faculty Opinions recommendation of Power failure: why small sample size undermines the reliability of neuroscience.

  2013cited by this paper
• Memory’s Penumbra: Episodic Memory Decisions Induce Lingering Mnemonic Biases

  2012cited by this paper
• Analytic Thinking Promotes Religious Disbelief

  2012cited by this paper
• Body Cues, Not Facial Expressions, Discriminate Between Intense Positive and Negative Emotions

  2012cited by this paper
• Some Consequences of Having Too Little

  2012cited by this paper
• LOGARITHMIC MARKETS CORING RULES FOR MODULAR COMBINATORIAL INFORMATION AGGREGATION

  2012cited by this paper
• Spontaneous giving and calculated greed

  2012cited by this paper
• Drug development: Raise standards for preclinical cancer research

  2012cited by this paper
• Affirmative Action Policies Promote Women and Do Not Harm Efficiency in the Laboratory

  2012cited by this paper
• Writing About Testing Worries Boosts Exam Performance in the Classroom

  2011cited by this paper
• Retrieval Practice Produces More Learning than Elaborative Studying with Concept Mapping

  2011cited by this paper
• Google Effects on Memory: Cognitive Consequences of Having Information at Our Fingertips

  2011cited by this paper
• Human tears contain a chemosignal

  2011cited by this paper
• Believe it or not: how much can we rely on published data on potential drug targets?

  2011cited by this paper
• False-Positive Psychology

  2011cited by this paper
• Why Testing Improves Memory: Mediator Effectiveness Hypothesis

  2010cited by this paper
• Incidental Haptic Sensations Influence Social Judgments and Decisions

  2010cited by this paper
• The Social Sense: Susceptibility to Others’ Beliefs in Human Infants and Adults

  2010cited by this paper
• Thought for Food: Imagined Consumption Reduces Actual Consumption

  2010cited by this paper
• Washing Away Postdecisional Dissonance

  2010cited by this paper
• Lab Experiments for the Study of Social-Ecological Systems

  2010cited by this paper
• The Promise of Prediction Markets

  2008cited by this paper
• Replication and p Intervals: p Values Predict the Future Only Vaguely, but Confidence Intervals Do Much Better

  2008cited by this paper
• Why Most Discovered True Associations Are Inflated

  2008cited by this paper
• Results from a Dozen Years of Election Futures Markets Research

  2008cited by this paper
• Interpreting the Predictions of Prediction Markets

  2006cited by this paper
• Finite Mixture and Markov Switching Models

  2006cited by this paper
• The Difference Between “Significant” and “Not Significant” is not Itself Statistically Significant

  2006cited by this paper
• Why Most Published Research Findings Are False

  2005cited by this paper
• Markets as an information aggregation mechanism for decision support

  2005cited by this paper
• z-Tree: Zurich toolbox for ready-made economic experiments

  1999cited by this paper
• Bayes factors

  1995cited by this paper
• Could gambling save science? Encouraging an honest consensus

  1995cited by this paper
• Psychology

  1929cited by this paper
• Theory of Probability

  year unknowncited by this paper
• Poverty Impedes Cognitive Function

  year unknowncited by this paper

• Comparing Positive Rates in Traditional Articles and Registered Reports within Sport and Exercise Science: A Stage 1 Registered Report.

  2026cites this paper
• Dishonesty and justifications: Evidence from the second roll of a dice game

  2026cites this paper
• The Computational Reproducibility of Psychology Learning and Teaching Research

  2026cites this paper
• The Certainty Bound: Structural Limits on Scientific Reliability

  2026cites this paper
• Advancing Organizational Science: Construct and Process Theorizing, Layers of Theoretical Explanation, and Implications for Causality and Intervention

  2026cites this paper
• The computational reproducibility of articles published under the Open Data + FAIR policy of IJGIS

  2026cites this paper
• Preaching conservative ideas: The speech-act theory of value conflict

  2026cites this paper
• Using prediction markets and forecasting surveys to predict 28 replication outcomes of classic articles in social psychology and judgement and decision making

  2026cites this paper
• Individual and collective epistemic virtue in science

  2026cites this paper
• LLM-Assisted Replication for Quantitative Social Science

  2026cites this paper
• Critically Engaged Pragmatism: A Scientific Norm and Social, Pragmatist Epistemology for AI Science Evaluation Tools

  2026influential citation
• A multiverse lack of replication for working memory capacity as moderator of the perceptual disfluency effect

  2026cites this paper
• The Story is Not the Science: Execution-Grounded Evaluation of Mechanistic Interpretability Research

  2026cites this paper
• The Moderating Role of Alexithymia in the Effects of Narrative Points of View on Theory of Mind, Transportation, and Identification: An Extreme-Group Design Investigation

  2026cites this paper
• From individual choices to the four-eyes principle: The big robber game revisited among financial professionals and students

  2026cites this paper
• “We do the best we can with the information we have” Science reporting referencing retracted papers in the UK and Finland

  2026cites this paper
• Many AI Analysts, One Dataset: Navigating the Agentic Data Science Multiverse

  2026cites this paper
• Reading the Financial Stars: The Interplay of Chinese Fortune‐Telling, Western Astrology, and Investment Decisions

  2026cites this paper
• Slaying the undead: How long does it take to kill zombie papers?

  2026cites this paper
• The Effects of Body Movement on Perceptions of Violin Performance Among Musically Trained and Untrained Audiences

  2025cites this paper
• In Search of the Lost Interaction: A Theoretical and Methodological Framework for Researching Interactions.

  2025cites this paper
• Support for liberal democracy in times of crisis: Evidence from the COVID-19 pandemic

  2025cites this paper
• Meta-regression to explain shrinkage and heterogeneity in large-scale replication projects

  2025cites this paper
• Replication of experiments and the canonisation of incorrect conclusions

  2025cites this paper
• Can I trust this paper?

  2025cites this paper
• The political consequences of resource scarcity: Targeted spending in a water-stressed democracy. A replication study of Mahadevan and Shenoy (Journal of Public Economics, 2023)

  2025cites this paper
• Editorial commitment to trust and integrity in science: implications for pain and anesthesiology research.

  2025cites this paper
• Replicating a Middle-School Belonging Intervention: Evidence from a Randomized Trial Within a New School District

  2025cites this paper
• Investigating the effects of single-dose intranasal testosterone on economic preferences in a large randomized trial of men

  2025cites this paper
• DeScAI: the convergence of decentralized science and artificial intelligence

  2025cites this paper
• REPRO-Bench: Can Agentic AI Systems Assess the Reproducibility of Social Science Research?

  2025cites this paper
• Editorial commitment to trust and integrity in science: implications for pain and anesthesiology research.

  2025cites this paper
• Replicability: Terminology, Measuring Success, and Strategy

  2025cites this paper
• An adversarial collaboration on the rigidity‐of‐the‐right, symmetry thesis, or rigidity‐of‐extremes: The answer depends on the question

  2025cites this paper
• In Their Own Voice: Educational Perspectives From Intellectually Precocious Youth as Adults

  2025cites this paper
• The Consequences of Narrow Framing for Risk Taking: A Stress Test of Myopic Loss Aversion

  2025cites this paper
• Editorial commitment to trust and integrity in science: implications for pain and anaesthesiology research*

  2025cites this paper
• ChatGPT struggles to recognize reproducible science

  2025cites this paper
• Reality Check: A New Evaluation Ecosystem Is Necessary to Understand AI's Real World Effects

  2025cites this paper
• The subtleties of small truth as a prerequisite for larger theory evaluation

  2025cites this paper
• A global P-Process map to avoid P-value abuse

  2025cites this paper
• Profiling students’ critical thinking and communication skills through research-oriented collaborative inquiry learning

  2025cites this paper
• Editorial commitment to trust and integrity in science: implications for pain and anesthesiology research

  2025cites this paper
• A gravity model for emergency departments

  2025cites this paper
• The Effectiveness of Nudging and Its Ethical Implications

  2025cites this paper
• Opening open science to all: demystifying reproducibility and transparency practices in linguistic research

  2025cites this paper
• Editorial commitment to trust and integrity in science: Implications for pain and anesthesiology research

  2025cites this paper
• Widespread misidentification of scanning electron microscope instruments in the peer-reviewed materials science and engineering literature

  2025cites this paper
• Global p-Values in Multi-Design Studies

  2025cites this paper
• Editorial Commitment to Trust and Integrity in Science: Implications for Pain and Anesthesiology Research.

  2025cites this paper
• Cognitive-digital interaction: the state of the field, weaknesses and solutions.

  2025cites this paper
• Introducing RobustiPy: An efficient next generation multiversal library with model selection, averaging, resampling, and explainable artificial intelligence

  2025cites this paper
• Critical remarks on current practices of data article publishing: Issues, challenges, and recommendations

  2025cites this paper
• Accessibility, Transparency, Inclusivity? The Values of Open Science and the Paradox of Democratization

  2025cites this paper
• Why We Disagree About the Success of Replications

  2025cites this paper
• Editorial Commitment to Trust and Integrity in Science: Implications for Pain and Anesthesiology Research

  2025cites this paper
• Comments on “Single paper meta‐analysis is unavoidable”

  2025cites this paper
• A scoping review on metrics to quantify reproducibility: a multitude of questions leads to a multitude of metrics

  2025cites this paper
• Editorial commitment to trust and integrity in science: Implications for pain and anesthesiology research

  2025cites this paper
• AI Behavioral Science

  2025cites this paper
• Editorial Commitment to Trust and Integrity in Science: Implications for Pain and Anesthesiology Research.

  2025cites this paper
• “I once was blind”: experimental manipulation of religious attitudes via choice blindness

  2025cites this paper
• Subjective financial scarcity today = objective financial scarcity in the future? The impact of subjective financial scarcity on saving for retirement

  2025cites this paper
• Open Science: A Review of Its Effectiveness and Implications for Service Research

  2025cites this paper
• Editorial commitment to trust and integrity in science

  2025cites this paper
• Verbal persuasion in marketing: A multimethod meta-analysis of analytical and narrative processing

  2025cites this paper
• Augmenting Insufficiently Accruing Oncology Clinical Trials Using Generative Models: Validation Study

  2025cites this paper
• Reproducibility and replicability in research: What 452 professors think in Universities across the USA and India

  2025cites this paper
• Fifty years for Plog’s psychographic theory: lessons of replication and validity for tourist behaviour research

  2025cites this paper
• Sample size and its justification in the Journal of Memory and Language

  2025cites this paper
• Are the Internet and AI affecting our memory? What the science says

  2025cites this paper
• Achieving reproducibility in the innovation process

  2025cites this paper
• Measuring the quality of experimental research

  2025cites this paper
• ForenPsy: un Banco Estandarizado de Testimonios Ficticios de Testigos para la Investigación en Psicología Experimental y Judicial

  2025cites this paper
• Public Perceptions of Minority Inclusion and Feelings of Political Efficacy: A Replication, Validation, and Extension

  2025cites this paper
• Descriptor: Fear and Fear Regulation of Chinese and Vietnamese Investors in the Extremely Volatile Markets Dataset (FearCVI)

  2025cites this paper
• Replicating and extending the reliability, criterion validity, and treatment sensitivity of the shortened PANSS for pediatric trials

  2025cites this paper
• Platforms, Politics, and the Crisis of Democracy: Connective Action and the Rise of Illiberalism

  2025cites this paper
• What is empathy for laypeople? - A replication study of Hall, Schwartz, and Duong (2021).

  2025cites this paper
• Open science interventions to improve reproducibility and replicability of research: a scoping review

  2025cites this paper
• Mitigating impacts of food production and consumption on climate change: Applications of behavioral economics

  2025cites this paper
• Teaching Psychology in Era of Digital Intelligence: The Role of Artificial Intelligence in Knowledge-Oriented and Research-Oriented Education

  2025cites this paper
• The relationship between concerns of local issues and water conservation behaviors: insights from Albuquerque, New Mexico, USA

  2025cites this paper
• Reflective thinking predicts disbelief in God across 19 countries

  2025cites this paper
• A Review of the Performance Metrics and Entrepreneurial Practices of Economics and Business Departments in UK Universities: A ‘Gresham’s Law’ Threat?

  2025cites this paper
• Factors impacting effective altruism: revisiting heuristics and biases in charity in a replication and extension registered report of Baron and Szymanska (2011)

  2025cites this paper
• Enhancing the quality and reproducibility of research: Preferred Evaluation of Cognitive and Neuropsychological Studies - The PECANS statement for human studies

  2025cites this paper
• modelbased: An R package to make the most out of your statistical models through marginal means, marginal effects, and model predictions

  2025cites this paper
• The Controversy behind the Controversies: Scientific Discourse in the Twenty-First Century

  2025cites this paper
• Internal replication as a tool for evaluating reproducibility in preclinical experiments

  2025cites this paper
• Exploring Italian consumers’ willingness to pay for sustainable fashion: the roles of eco-consciousness and vintage preference

  2025influential citation
• The first half-century of empirical capital markets research in accounting in pictures

  2025cites this paper
• Reproducibility of published model-based cancer drug cost-effectiveness analyses: a study protocol for a cross-sectional analysis

  2025cites this paper
• Is archaeology a science? Insights and imperatives from 10,000 articles and a year of reproducibility reviews

  2025cites this paper
• A large-scale replication of scenario-based experiments in psychology and management using large language models

  2025cites this paper
• A metric of knowledge as information compression reflects reproducibility predictions for biomedical experiments

  2025cites this paper
• Editorial commitment to trust and integrity in science: implications for pain and anesthesiology research

  2025cites this paper
• Use as directed? A comparison of software tools intended to check rigor and transparency of published work

  2025cites this paper
• Evaluation of the replicability of systematic reviews with meta-analyses of the effects of health interventions

  2025cites this paper
• A Protocol for Structured Robustness Reproductions and Replicability Assessments

  2025cites this paper