When more data steer us wrong: replications with the wrong dependent measure perpetuate erroneous conclusions

No abstract is available for this paper.

• Publication year

  2014

• Venue

  Psychonomic Bulletin & Review

• Publication date

  2014-11-11

• Fields of study

  Medicine, Psychology

• Identifiers
  DOI 10.3758/s13423-014-0759-2PMID 25384892
• External record

  Open on Semantic Scholar

• Source metadata

  Semantic Scholar, PubMed

• No claims are published for this paper.

• No concepts are published for this paper.

• Investigating Variation in Replicability: A “Many Labs” Replication Project

  2022cited by this paper
• On the Applied Implications of the “Verbal Overshadowing Effect”

  2015cited by this paper
• Traditional difference-score analyses of reasoning are flawed.

  2014cited by this paper
• An evaluation of lineup presentation, weapon presence, and a distinctive feature using ROC analysis

  2014cited by this paper
• A signal detection theory analysis of racial and ethnic disproportionality in the referral and substantiation processes of the U.S. child welfare services system

  2014cited by this paper
• Registered Replication Report

  2014cited by this paper
• Publication and other reporting biases in cognitive sciences: detection, prevalence, and prevention.

  2014cited by this paper
• The Neural Correlates of Belief Bias: Activation in Inferior Frontal Cortex Reflects Response Rate Differences

  2014cited by this paper
• The neural correlates of belief-bias inhibition: the impact of logic training.

  2014cited by this paper
• Memory bias for negative emotional words in recognition memory is driven by effects of category membership

  2014cited by this paper
• A critical comparison of discrete-state and continuous models of recognition memory: implications for recognition and beyond.

  2013cited by this paper
• What counts as evidence for working memory training? Problems with correlated gains and dichotomization

  2013cited by this paper
• The SDT model of belief bias: complexity, time, and cognitive ability mediate the effects of believability.

  2013cited by this paper
• Eyewitness confidence in simultaneous and sequential lineups: a criterion shift account for sequential mistaken identification overconfidence.

  2013cited by this paper
• Showups versus lineups: An evaluation using ROC analysis

  2012cited by this paper
• Receiver operating characteristic analysis of eyewitness memory: comparing the diagnostic accuracy of simultaneous versus sequential lineups.

  2012cited by this paper
• An Open, Large-Scale, Collaborative Effort to Estimate the Reproducibility of Psychological Science

  2012cited by this paper
• Too good to be true: Publication bias in two prominent studies from experimental psychology

  2012cited by this paper
• The pervasive effects of argument length on inductive reasoning

  2012cited by this paper
• Binary ROCs in perception and recognition memory are curved.

  2012cited by this paper
• The Long Way From α-Error Control to Validity Proper

  2012cited by this paper
• The Field of Eyewitness Memory Should Abandon Probative Value and Embrace Receiver Operating Characteristic Analysis

  2012cited by this paper
• Levels of conflict in reasoning modulate right lateral prefrontal cortex.

  2012cited by this paper
• Open Science Collaboration

  2012cited by this paper
• Seventy-two tests of the sequential lineup superiority effect: A meta-analysis and policy discussion.

  2011cited by this paper
• Reframing child protection: A response to a constant crisis of confidence in child protection ☆

  2011cited by this paper
• Visceral fit: While in a visceral state, associated states of the world seem more likely.

  2011cited by this paper
• Short- and long-term benefits of cognitive training

  2011cited by this paper
• Disproportionality at the “Front End” of the Child Welfare Services System: An Analysis of Rates of Referrals, “Hits,” “Misses,” and “False Alarms”

  2010cited by this paper
• Relations between inductive reasoning and deductive reasoning.

  2010cited by this paper
• Fourth National Incidence Study of Child Abuse and Neglect (NIS-4)

  2010cited by this paper
• Assessing the belief bias effect with ROCs: it's a response bias effect.

  2010cited by this paper
• Scene perception and memory revealed by eye movements and ROC analysis: Does a cultural difference truly exist?

  2010cited by this paper
• Short Article: Scene perception and memory revealed by eye movements and receiver-operating characteristic analyses: Does a cultural difference truly exist?

  2009cited by this paper
• Sources of bias in the Goodman-Kruskal gamma coefficient measure of association: implications for studies of metacognitive processes.

  2009cited by this paper
• Modeling the effects of argument length and validity on inductive and deductive reasoning.

  2009cited by this paper
• The self-regulation of automatic associations and behavioral impulses.

  2008cited by this paper
• Type I error rates and power analyses for single-point sensitivity measures

  2008cited by this paper
• 1/f noise and effort on implicit measures of bias.

  2008influential reference
• The use of a responder analysis to identify differences in patient outcomes following a self‐care intervention to improve cancer pain management

  2007cited by this paper
• “Remembering” emotional words is based on response bias, not recollection

  2007cited by this paper
• The influence of stereotypes on decisions to shoot

  2007cited by this paper
• Scene Perception

  2007cited by this paper
• Across the thin blue line: police officers and racial bias in the decision to shoot.

  2007cited by this paper
• Measures of sensitivity based on a single hit rate and false alarm rate: The accuracy, precision, and robustness of′,Az, andA’

  2006cited by this paper
• Eliminating automatic racial bias: Making race non-diagnostic for responses to criminal suspects

  2005cited by this paper
• Detection theory: A user's guide, 2nd ed.

  2005cited by this paper
• The Consequences of Race for Police Officers' Responses to Criminal Suspects

  2005cited by this paper
• Theremember response: Subject to bias, graded, and not a process-pure indicator of recollection

  2005cited by this paper
• Rapid responding increases belief bias: Evidence for the dual-process theory of reasoning

  2005cited by this paper
• Remember-know: a matter of confidence.

  2004cited by this paper
• Does familiarity change in the revelation effect?

  2003cited by this paper
• Explaining modulation of reasoning by belief.

  2003cited by this paper
• Stereotypes as dominant responses: on the "social facilitation" of prejudice in anticipated public contexts.

  2003cited by this paper
• The Role of Race and Severity of Abuse in Teachers' Recognition or Reporting of Child Abuse

  2003cited by this paper
• Targets of discrimination: Effects of race on responses to weapons holders

  2003cited by this paper
• Best laid plans: Effects of goals on accessibility bias and cognitive control in race-based misperceptions of weapons

  2002cited by this paper
• The police officer's dilemma: using ethnicity to disambiguate potentially threatening individuals.

  2002cited by this paper
• Prejudice and perception: the role of automatic and controlled processes in misperceiving a weapon.

  2001cited by this paper
• From the lab to the police station. A successful application of eyewitness research.

  2000cited by this paper
• Dissociation of mechanisms underlying syllogistic reasoning.

  2000cited by this paper
• Toward unbiased measurement of conscious and unconscious memory processes within the process dissociation framework.

  1995cited by this paper
• Surely You''re Joking Mr

  1992cited by this paper
• Detection Theory: A User's Guide

  1991cited by this paper
• A process dissociation framework: Separating automatic from intentional uses of memory

  1991cited by this paper
• Verbal overshadowing of visual memories: some things are better left unsaid.

  1990cited by this paper
• “Surely you're joking, Mr. Feynman!” Adventures of a curious character

  1986cited by this paper
• Indices of discrimination or diagnostic accuracy: their ROCs and implied models.

  1986cited by this paper
• Form of empirical ROCs in discrimination and diagnostic tasks: implications for theory and measurement of performance.

  1986cited by this paper
• Surely you're joking Mr. Feynman! Adventures of a curious character as told to Ralph Leighton

  1985cited by this paper
• Mental Models: Towards a Cognitive Science of Language, Inference, and Consciousness

  1985cited by this paper
• On the conflict between logic and belief in syllogistic reasoning

  1983cited by this paper
• On Estimating the Diagnosticity of Eyewitness Nonidentifications

  1980cited by this paper
• Measures of association for cross classifications

  1979cited by this paper
• Treatments of bias in detection and recognition models: A review

  1975cited by this paper
• A non-parametric analysis of recognition experiments

  1964cited by this paper
• the front-end

  year unknowncited by this paper

• Pre-replication: Anything Goes, Once

  2025cites this paper
• The perceptual average in ensemble representation: Neither perceptual nor an average

  2025cites this paper
• A test of a “Neo” retrieval-based interference account of verbal overshadowing: effects of suspect description accuracy and post-description delay of suspect identifications on eyewitness recognition performance

  2025cites this paper
• Discourse on measurement

  2025cites this paper
• The Replication Crisis: A Persistent Challenge in Biomedical Research

  2024cites this paper
• Assessing the distortions introduced when calculating d’: A simulation approach

  2024cites this paper
• Long term trends in non‐audit fees and audit quality: New evidence based on going concern opinions and financial restatements

  2024cites this paper
• Zooming in on what counts as core and auxiliary: A case study on recognition models of visual working memory

  2024cites this paper
• Noisy and hierarchical visual memory across timescales

  2024cites this paper
• Replication studies in the Netherlands: Lessons learned and recommendations for funders, publishers and editors, and universities

  2024cites this paper
• Crediting or blaming theories or auxiliary assumptions for empirical victories or defeats

  2024cites this paper
• Reproducible research practices and transparency across linguistics

  2023cites this paper
• Multidimensional Signals and Analytic Flexibility: Estimating Degrees of Freedom in Human-Speech Analyses

  2023cites this paper
• Measuring memory is harder than you think: How to avoid problematic measurement practices in memory research

  2022influential citation
• Perceived danger associated with a property modulates cross category generalization

  2022cites this paper
• Linking computational models of two core tasks of cognitive control.

  2022cites this paper
• Toward a more comprehensive modeling of sequential lineups

  2022cites this paper
• ROC measures of memory accessibility

  2022cites this paper
• Lineup identification in young and older witnesses: does describing the criminal help or hinder?

  2022cites this paper
• Extraction from English RCs and Cross-Linguistic Similarities in the Environments That Facilitate Extraction

  2022cites this paper
• AP-XHPJ220070 1390..1409

  2022cites this paper
• What makes eye movements effective retrieval cue: The contribution of visual and the motor components to memory performance

  2022cites this paper
• Four Internal Inconsistencies in Tversky and Kahneman’s (1992) Cumulative Prospect Theory Article: A Case Study in Ambiguous Theoretical Scope and Ambiguous Parsimony

  2022cites this paper
• You cannot "count" how many items people remember in visual working memory: The importance of signal detection-based measures for understanding change detection performance.

  2022cites this paper
• Are business and management journals anti-replication? An analysis of editorial policies

  2021cites this paper
• Triplet Loss Feature Aggregation for Scalable Hash

  2020cites this paper
• The bright homunculus in our head: Individual differences in intuitive sensitivity to logical validity

  2020cites this paper
• Do sequential lineups impair underlying discriminability?

  2020cites this paper
• The ratio of posterior–anterior medial temporal lobe volumes predicts source memory performance in healthy young adults

  2020cites this paper
• Scalable Hash From Triplet Loss Feature Aggregation For Video De-duplication

  2020cites this paper
• Tutorial: “With sufficient increases in X, more people will engage in the target behavior”

  2020cites this paper
• Why are lineups better than showups? A test of the filler siphoning and enhanced discriminability accounts.

  2020cites this paper
• The effect of lineup size on eyewitness identification.

  2020influential citation
• The forgotten history of signal detection theory.

  2020cites this paper
• Test-retest reliability of the emotional enhancement of memory

  2020cites this paper
• State-trace analysis — Misrepresented and misunderstood: Reply to Ashby (2019)

  2020cites this paper
• A Model Hierarchy for Psychological Science

  2019cites this paper
• Assessing Theoretical Conclusions With Blinded Inference to Investigate a Potential Inference Crisis

  2019cites this paper
• Understanding and improving Chinese adolescent snacking using behaviour change and a mindfulness-based approach

  2019cites this paper
• An Overview of Scientific Reproducibility: Consideration of Relevant Issues for Behavior Science/Analysis

  2019cites this paper
• Disappearing dissociations in experimental psychology: Using state-trace analysis to test for multiple processes

  2019cites this paper
• The grammaticality asymmetry in agreement attraction reflects response bias: Experimental and modeling evidence.

  2019cites this paper
• Improving Methodological Standards in Behavioral Interventions for Cognitive Enhancement

  2019cites this paper
• Approaching gradience in acceptability with the tools of signal detection theory

  2019cites this paper
• Modeling choice paradoxes under risk: From prospect theories to sampling-based accounts.

  2019cites this paper
• Theories of the Wason Selection Task: a Critical Assessment of Boundaries and Benchmarks

  2019cites this paper
• Filler-Siphoning Theory Does Not Predict the Effect of Lineup Fairness on the Ability to Discriminate Innocent From Guilty Suspects: Reply to Smith, Wells, Smalarz, and Lampinen (2018)

  2018cites this paper
• The robustness of false memory for emotional pictures

  2018cites this paper
• The Effects of Verbal Descriptions on Performance in Lineups and Showups

  2018cites this paper
• Characterizing belief bias in syllogistic reasoning: A hierarchical Bayesian meta-analysis of ROC data

  2018cites this paper
• The Road to Uncreative Science Is Paved With Good Intentions: Ideas, Implementations, and Uneasy Balances

  2018cites this paper
• Interaction effects on common measures of sensitivity: choice of measure, type I error, and power

  2018cites this paper
• The Shape of ROC Curves in Shooter Tasks: Implications for Best Practices in Analysis

  2018cites this paper
• Humans and Algorithms for Facial Recognition: The Effects of Candidate List Length and Experience on Performance

  2018cites this paper
• On a problematic procedure to manipulate response biases in recognition experiments: the case of “implied” base rates

  2017influential citation
• 2.29 – Eyewitness Identification☆

  2017cites this paper
• A re-examination of eyewitness memory phenomena using receiver operating characteristic analysis and confidence-accuracy characteristic analysis

  2017cites this paper
• Behavioral and Brain Sciences (forthcoming)

  2017cites this paper
• Neuroscience-based nomenclature (NbN).

  2017cites this paper
• Evidence-based science policy for mental health in a post-truth era.

  2017cites this paper
• ROCs in Eyewitness Identification: Instructions versus Confidence Ratings

  2017cites this paper
• ROC Analysis in Theory and Practice

  2017cites this paper
• Diffusion vs. linear ballistic accumulation: Different models, different conclusions about the slope of the zROC in recognition memory

  2017cites this paper
• The meaning of a claim is its reproducibility

  2017cites this paper
• Memory representations, tree structures, and parameter polysemy: Comment on Cooper, Greve, and Henson (2017).

  2017cites this paper
• The Construct–Behavior Gap in Behavioral Decision Research: A Challenge Beyond Replicability

  2017cites this paper
• The Electrophysiological Signature of Remember–Know Is Confounded with Memory Strength and Cannot Be Interpreted as Evidence for Dual-process Theory of Recognition

  2017cites this paper
• The Role of Site Variance in the American Judicature Society Field Study Comparing Simultaneous and Sequential Lineups

  2017cites this paper
• 1 Eyewitness Identification

  2016cites this paper
• From the Pigeon Lab to the Courtroom

  2016cites this paper
• The Effects of Verbal Descriptions on Eyewitness Memory: Implications for the Real-World ☆

  2016cites this paper
• The unitary zROC slope in amnesics does not reflect the absence of recollection: critical simulations in healthy participants of the zROC slope.

  2016cites this paper
• Implications of “Too Good to Be True” for Replication, Theoretical Claims, and Experimental Design: An Example Using Prominent Studies of Racial Bias

  2016cites this paper
• ROC curve analyses of eyewitness identification decisions: An analysis of the recent debate

  2016cites this paper
• Roc Analyses of Eyewitness Identification Decisions: an Analysis of the Recent Debate

  2016cites this paper
• Towards a motivational alternative to the strength model of self-control

  2016cites this paper
• Healthy ageing and binding features in working memory: measurement issues and potential boundary conditions

  2016cites this paper
• On the Applied Implications of the “Verbal Overshadowing Effect”

  2015cites this paper
• ONE Conducting an Eyewitness Lineup : How the Research Got It Wrong

  2015cites this paper
• The Role of Site Variance in the American Judicature Society Field Study Comparing Simultaneous and Sequential Lineups

  2015cites this paper
• The Role of Executive Functions for Overcoming Misconceptions through Structure-Mapping in Mathematics Classrooms

  2015cites this paper
• The statistical crisis in science

  2014cites this paper