Failing the Future: Three Unsuccessful Attempts to Replicate Bem's ‘Retroactive Facilitation of Recall’ Effect

Nine recently reported parapsychological experiments appear to support the existence of precognition. We describe three pre-registered independent attempts to exactly replicate one of these experiments, ‘retroactive facilitation of recall’, which examines whether performance on a memory test can be influenced by a post-test exercise. All three replication attempts failed to produce significant effects (combined n = 150; combined p = .83, one-tailed) and thus do not support the existence of psychic ability.

• Publication year

  2012

• Venue

  PLoS ONE

• Publication date

  2012-03-14

• Fields of study

  Biology, Medicine, Psychology

• Identifiers
  DOI 10.1371/journal.pone.0033423PMID 22432019PMCID 3303812
• External record

  Open on Semantic Scholar

• Source metadata

  Semantic Scholar, PubMed

• No claims are published for this paper.

• No concepts are published for this paper.

• Feeling the future: experimental evidence for anomalous retroactive influences on cognition and affect.

  2011influential reference
• Must psychologists change the way they analyze their data?

  2011cited by this paper
• A Bayes factor meta-analysis of Bem’s ESP claim

  2011cited by this paper
• Journal of Personality and Social Psychology Why Psychologists Must Change the Way They Analyze Their Data : The Case of Psi : Comment on Bem ( 2011 )

  2011cited by this paper
• Fearing the Future of Empirical Psychology: Bem's (2011) Evidence of Psi as a Case Study of Deficiencies in Modal Research Practice

  2011cited by this paper
• Not feeling the future: A failed replication of retroactive facilitation of memory recall.

  2011cited by this paper
• G*Power 3: A flexible statistical power analysis program for the social, behavioral, and biomedical sciences

  2007cited by this paper
• Of two minds: Sceptic-proponent collaboration within parapsychology.

  2006cited by this paper
• Give the Null Hypothesis a Chance Reasons to Remain Doubtful about the Existence of Psi

  2003cited by this paper
• Why Is PSI So Elusive? A Review and Proposed Model

  2001cited by this paper
• Frequency Analysis of English Usage: Lexicon and Grammar. By W. Nelson Francis and Henry Kučera with the assistance of Andrew W. Mackie. Boston: Houghton Mifflin. 1982. x + 561

  1985cited by this paper
• tails you lose

  1965cited by this paper

• Experimentally falsifying ghost criminology: exercising rigor, exorcising residue

  2026cites this paper
• A Tale of Open Science: Emergence of a New Normal

  2025cites this paper
• Concerns About Replicability Across Two Crises in Social Psychology

  2025cites this paper
• The struggle to make transparency mainstream: initial evidence for a slow uptake of open science practices in PhD theses

  2025cites this paper
• Normative scientific conflict is unavoidable and should be welcomed

  2025cites this paper
• International initiatives to enhance awareness and uptake of open research in psychology: a systematic mapping review

  2025cites this paper
• Exact Versus Conceptual Replication: Internet-based Research Investigating the Replicability of Cognitive Effects

  2025cites this paper
• How Statistical Challenges and Misreadings of the Literature Combine to Produce Unreplicable Science: An Example From Psychology

  2024cites this paper
• Are replications mainstream now? A comparison of support for replications expressed in the policies of social psychology journals in 2015 and 2022

  2023cites this paper
• Evaluating Policy Impact: Working Out What Works

  2023cites this paper
• The trustworthiness of the cumulative knowledge in industrial/organizational psychology: The current state of affairs and a path forward.

  2023cites this paper
• Is Social Work Research in Crisis?

  2023cites this paper
• Jung's Psychoid Monism.

  2023cites this paper
• Follow‐up on the U.S. Central Intelligence Agency's (CIA) remote viewing experiments☆

  2023cites this paper
• How replication studies can improve doctoral student education

  2023cites this paper
• On the importance of modeling the invisible world of underlying effect sizes

  2023cites this paper
• A discipline-wide investigation of the replicability of Psychology papers over the past two decades

  2023cites this paper
• Preliminary Evidence for an Association between Journal Submission Requirements and Reproducibility of Published Findings: A Pilot Study

  2022cites this paper
• Ten Years of Psychology's Replicability Crisis:

  2022cites this paper
• Estimating the replicability of technology education research

  2022cites this paper
• Statistical Assumptions and Reproducibility in Psychology: Data Mining Based on Open Science

  2022cites this paper
• The Central Role of Lifelong Learning and Humility in Clinical Psychology

  2022cites this paper
• Robust Bayesian meta‐analysis: Model‐averaging across complementary publication bias adjustment methods

  2022cites this paper
• Remarkably reproducible psychological (memory) phenomena in the classroom: some evidence for generality from small-N research

  2022cites this paper
• A Review of Multisite Replication Projects in Social Psychology: Is It Viable to Sustain Any Confidence in Social Psychology’s Knowledge Base?

  2022cites this paper
• What FiveThirtyEight Can Teach Us about Solving the Replication Crisis

  2022influential citation
• Page Proof Instructions and Queries

  2022influential citation
• Nailing Jelly: The Replication Problem Seems to Be Unsurmountable— Two Failed Replications of the Matrix Experiment

  2022cites this paper
• Neuroanatomy of the Will

  2022cites this paper
• Replication value as a function of citation impact and sample size

  2021cites this paper
• Developing an open science ‘mindset’

  2021cites this paper
• Objectivity for the research worker

  2021cites this paper
• Research culture and open practice in psychology

  2021cites this paper
• “What We Have Here, Is a Failure to [Replicate]”: Ways to Solve a Replication Crisis in Implementation Science

  2021cites this paper
• A STUDY ON RECRUITMENT & SELECTION PROCESS AT DAINIK BHASKAR UDAIPUR

  2020cites this paper
• Promoting scientific integrity through open science in health psychology: results of the Synergy Expert Meeting of the European health psychology society

  2020cites this paper
• Die Replikationskrise in der Psychologie

  2020influential citation
• Why Most Research Findings About Psi Are False: The Replicability Crisis, the Psi Paradox and the Myth of Sisyphus

  2020cites this paper
• A preregistered multi-lab replication of Maier et al. (2014, Exp. 4) testing retroactive avoidance

  2020cites this paper
• Science is not a signal detection problem

  2020cites this paper
• Using retracted journal articles in psychology to understand research misconduct in the social sciences: What is to be done?

  2020cites this paper
• Deciding what to replicate: A decision model for replication study selection under resource and knowledge constraints.

  2020cites this paper
• Effect size reporting and interpretation in social personality research

  2020cites this paper
• Chris French

  2020cites this paper
• Understanding Replication: Trust But Verify

  2019cites this paper
• Page Proof Instructions and Queries

  2019cites this paper
• The Replication Crisis and Open Science in Psychology

  2019cites this paper
• Towards Reproducibility in ANS Performance Enrico Spinielli

  2019cites this paper
• I Saw You in the Crowd: Credibility, Reproducibility, and Meta-Utility

  2019cites this paper
• Can You Repeat That? Exploring the Definition of a Successful Model Replication in Health Economics

  2019cites this paper
• The Pitfalls of Investigating Radicalization on Social Media

  2019cites this paper
• A snapshot look at replication and statistical reporting practices in psychology journals

  2019cites this paper
• How to Obtain Significant Results Intentionally:

  2019cites this paper
• Decline Effect in Parapsychology

  2019cites this paper
• Grassroots Training for Reproducible Science: A Consortium-Based Approach to the Empirical Dissertation

  2019cites this paper
• 3.7 The Replication Crisis in Psychology

  2019cites this paper
• On reproducibility and replicability: Arguing for open science practices and methodological improvements at the South African Journal of Industrial Psychology

  2019cites this paper
• Registered reports: an early example and analysis

  2019cites this paper
• Who Believes in ESP: Cognitive and Motivational Determinants of the Belief in Extra-Sensory Perception

  2019cites this paper
• Assessing the Efficacy of a Training Intervention to Reduce Acceptance of Questionable Research Practices in Psychology Graduate Students

  2019cites this paper
• Evaluating replicability of laboratory experiments in Economics

  2019cites this paper
• Perceived crisis and reforms: Issues, explanations, and remedies.

  2018cites this paper
• Grounds for Ambiguity: Justifiable Bases for Engaging in Questionable Research Practices

  2018cites this paper
• In Defense of the Questionable: Defining the Basis of Research Scientists’ Engagement in Questionable Research Practices

  2018cites this paper
• The Convergent Validity and Nomological Net of Two Methods to Measure Retroactive Influences

  2018influential citation
• Ambiguity : Justifiable Bases for Engaging in Questionable Research Practices

  2018cites this paper
• Modelling science trustworthiness under publish or perish pressure

  2018cites this paper
• Test of reward contingent precall

  2018cites this paper
• The Replication Crisis and Chemistry Education Research

  2018cites this paper
• The Emergence of Structured, Living, and Conscious Matter in the Evolution of the Universe: A Theory of Structural Evolution and Interaction of Matter

  2018cites this paper
• Methoden

  2018cites this paper
• Replication in Criminology and the Social Sciences

  2018cites this paper
• Am I Luckier Than You? Individual Differences in Precognition Performance

  2018cites this paper
• Place of behavior analysis in the changing culture of replication and statistical reporting in psychological science

  2018cites this paper
• EEG anticipation of random high and low arousal faces and sounds

  2018cites this paper
• The experimental evidence for parapsychological phenomena: A review.

  2018cites this paper
• Humanization: The Crash or Reboot of Social Psychology

  2017cites this paper
• Attempting to elicit a precall effect using emotive images and participants with high levels of belief in psi

  2017cites this paper
• Replication in Social Science

  2017cites this paper
• Why Do Irrational Beliefs Mimic Science? The Cultural Evolution of Pseudoscience

  2017cites this paper
• The (Partial but) Real Crisis in Social Psychology

  2017cites this paper
• The Replication Crisis in Psychology

  2017cites this paper
• Pitfalls in Parapsychological Research

  2017cites this paper
• Running Head: FAILURE TO REPLICATE RETROCAUSAL RECALL 1 Failure to Replicate Retrocausal Recall

  2017cites this paper
• Scientific Method, Human Research Ethics, and Biosafety/Biosecurity

  2017cites this paper
• Making Confidential Data Part of Reproducible Research

  2017cites this paper
• Novelty vs. Replicability: Virtues and Vices in the Reward System of Science

  2017cites this paper
• 2 . 1 Virtue 1 : The Priority Rule Incentivizes the Production of Novel Scientific Findings

  2017cites this paper
• Histories of Human Engineering: Tact and Technology

  2017cites this paper
• Novelty versus Replicability: Virtues and Vices in the Reward System of Science

  2017cites this paper
• STIMULUS-RESPONSE COMPATIBILITY EFFECT: AN ATTEMPT TO REPLICATE COOK’S ‘AUTOMATIC IMITATION IN A STRATEGIC CONTEXT’

  2017cites this paper
• Lack of Associations between Female Hormone Levels and Visuospatial Working Memory, Divided Attention and Cognitive Bias across Two Consecutive Menstrual Cycles

  2017cites this paper
• Feeling the future: A meta-analysis of 90 experiments on the anomalous anticipation of random future events

  2016cites this paper
• Time and Consciousness

  2016cites this paper
• Does the conclusion follow from the evidence? Recommendations for improving research

  2016cites this paper
• A COMPLETE GUIDE TO THE BAYES FACTOR TEST

  2016cites this paper
• Reconceptualizing replication as a sequence of different studies: A replication typology

  2016cites this paper
• Guidelines for Reporting Articles on Psychiatry and Heart rate variability (GRAPH): recommendations to advance research communication

  2016cites this paper
• Telepathy, Using the Force, and Other Paranormal Abilities

  2016cites this paper
• There's more than one way to conduct a replication study: Beyond statistical significance.

  2016cites this paper