Methods to detect low quality data and its implication for psychological research

No abstract is available for this paper.

• Publication year

  2018

• Venue

  Behavior Research Methods

• Publication date

  2018-03-14

• Fields of study

  Medicine, Computer Science, Psychology

• Identifiers
  DOI 10.3758/s13428-018-1035-6PMID 29542063
• External record

  Open on Semantic Scholar

• Source metadata

  Semantic Scholar, PubMed

• No claims are published for this paper.

• No concepts are published for this paper.

• Standardized Assessment

  2020cited by this paper
• The New Statistics

  2017cited by this paper
• Lie for a Dime

  2017cited by this paper
• Pre-registration in social psychology—A discussion and suggested template

  2016cited by this paper
• Measuring Resilience With the RS–14: A Tale of Two Samples

  2015cited by this paper
• The New Statistics

  2014cited by this paper
• Inside the Turk

  2014cited by this paper
• Separate but equal? A comparison of participants and data gathered via Amazon's MTurk, social media, and face-to-face behavioral testing

  2013cited by this paper
• Calculating and reporting effect sizes to facilitate cumulative science: a practical primer for t-tests and ANOVAs

  2013cited by this paper
• Standardized assessment of reading performance: the New International Reading Speed Texts IReST.

  2012cited by this paper
• Evaluating Online Labor Markets for Experimental Research: Amazon.com's Mechanical Turk

  2012cited by this paper
• Conducting behavioral research on Amazon’s Mechanical Turk

  2011cited by this paper
• Honesty in an Online Labor Market

  2011cited by this paper
• Working the Crowd: Employment and Labor Law in the Crowdsourcing Industry

  2011cited by this paper
• Amazon's Mechanical Turk

  2011cited by this paper
• Analyzing the Amazon Mechanical Turk marketplace

  2010cited by this paper
• Are Your Participants Gaming the System? Screening Mechanical Turk Workers

  2010cited by this paper
• An Analysis of Assessor Behavior in Crowdsourced Preference Judgments

  2010cited by this paper
• Separate But Equal

  2010cited by this paper
• Running experiments on Amazon Mechanical Turk

  2010cited by this paper
• WEIRD languages have misled us, too

  2010cited by this paper
• What are participants doing while filling in an online questionnaire: A paradata collection tool and an empirical study

  2010cited by this paper
• Weird people, yes, but also weird experiments

  2010cited by this paper
• A Review of the Resilience Scale

  2009cited by this paper
• Utility data annotation with Amazon Mechanical Turk

  2008cited by this paper
• Survey non‐response and the duration of unemployment

  2006cited by this paper
• Should we trust web-based studies? A comparative analysis of six preconceptions about internet questionnaires.

  2004cited by this paper
• Generalized eta and omega squared statistics: measures of effect size for some common research designs.

  2003cited by this paper
• Validity of Web-Based Psychological Research

  2000cited by this paper
• Development and psychometric evaluation of the Resilience Scale.

  1993cited by this paper
• Statistical Power Analysis for the Behavioral Sciences (2nd ed.)

  1989cited by this paper
• Last Words: Amazon Mechanical Turk: Gold Mine or Coal Mine?

  year unknowncited by this paper

• How online studies must increase their defences against AI

  2026cites this paper
• Indigenous well-being indicators and social impact assessment: Redefining restoration success for Klamath River dam removal

  2026cites this paper
• Online survey data integrity: lessons learnt from investigating a bot attack on a small-scale educational study

  2026cites this paper
• Assessing Positive Digital Experiences: A Spanish Validation of the Digital Flourishing Scale for Adolescents.

  2026cites this paper
• Learning to Pay Attention: Unsupervised Modeling of Attentive and Inattentive Respondents in Survey Data

  2026cites this paper
• Examining the psychometric properties of the childhood adversity and social stress questionnaire, self-report (CASSQ-SR) in emerging adults with varied autistic traits

  2026cites this paper
• Make your mark on the planet! Observing pro-ecological behaviour through a web application

  2026cites this paper
• Method matters: Diverging patterns in online measures of temporal binding.

  2026cites this paper
• Screen exposure in relation to cool and hot executive functions in preschoolers: parenting processes as mediators and parental growth mindset as moderator

  2026cites this paper
• Impaired Prosodic Processing but Not Hearing Function Is Associated with an Age-Related Reduction in AI Speech Recognition

  2025cites this paper
• Cracks in the JD-R model? The failure of strengths use, job crafting, and home-work spillover to support wellbeing during COVID-19

  2025cites this paper
• Keeping up with generative AI: effects of engagement characteristics, cognitive appraisals, and affective reactions on user adaptation

  2025cites this paper
• It’s more than money: The true costs of spam in online survey research

  2025cites this paper
• Childhood Adversity Is Not Related to Associative Memory for Emotional Stimuli

  2025cites this paper
• Using natural language processing to identify patterns associated with depression, anxiety, and stress symptoms during the COVID-19 pandemic.

  2025cites this paper
• The seven deadly sins: measuring overvaluation of social media with the Plan-net 25 scale

  2025cites this paper
• Social exclusion partially mediates the association of autistic traits and anxiety in young adults

  2025cites this paper
• Addressing Survey Fraud in Online Health Research: A Case Study of Latine Sexual Minority Men.

  2025cites this paper
• Surveying Non-Consensual Drink Spiking Among College and Online Samples

  2025cites this paper
• The association between reported artificial light and reported physical activity at night: the mediating roles of environmental restorativeness and perceived safety

  2025cites this paper
• Yes stormtrooper, these are the droids you are looking for: Identifying and preliminarily evaluating bot and fraud detection strategies in online psychological research.

  2025cites this paper
• Bots, scammers, and fraudulent responders: a year of disrupted data collection

  2025cites this paper
• Survey sabotage: Insights into reducing the risk of fraudulent responses in online surveys

  2025cites this paper
• Perceptions of Multiple Perpetrator Rape in the Courtroom

  2025cites this paper
• A symbol of purity or pedophilia? Legal perceptions of priest-perpetrated child sexual assault

  2025cites this paper
• Using a novel, multi-method approach to evaluate the quality of self-report survey data in organizational readiness research

  2025cites this paper
• Institutional environments, self-efficacy, outcome expectations and country context: serial mediating effects on entrepreneurial intentions and decision-making

  2025cites this paper
• Public attitudes and values regarding a semi‐urban feral ungulate

  2025cites this paper
• Juror perceptions of rape involving Rohypnol

  2025cites this paper
• Elder Abuse During COVID-19 Pandemic in Canada

  2025cites this paper
• The Impact of AI-Powered Ad Customization: Exploring the Impact of Engagement, Psychological Ownership, Responsibility, and Attitude on Behavioral Intentions

  2025cites this paper
• Styles of Digital Parental Mediation: A Multi-Group Person-Centered Approach

  2025cites this paper
• Viva les fans! Exploring social sourcing for research tasks on social networking sites

  2025cites this paper
• The Socio‐Ecological Enablers of Smoking and Vaping in Rural Young Adults: A Mixed‐Methods Study

  2025cites this paper
• Attention Allocation for Dysphoric Information in Adults with Depression Symptoms Using Eye-tracking and Mouse-tracking

  2025cites this paper
• The influence of female victim sexual orientation on legal decision-making in a rape-case

  2025cites this paper
• Social Identification in Times of Crisis: How Need to Belong, Perspective Taking, and Cognitive Closure Relate to Changes in Social Identification

  2024cites this paper
• Evaluating Policy Shifts on Perceived Greenspace Quality: Applying Regression Discontinuity During the COVID-19 Reopening Period

  2024cites this paper
• When Help Hurts: Workplace Instrumental Support and Employee Emotional Exhaustion Within-Person

  2024cites this paper
• Can a Culturally Adapted Autism Training Reduce Stigma Towards Autistic People in South Korea?

  2024cites this paper
• Child and Adolescent Exposure to Sexual Harassment: Relationship to Gender, Contact Sexual Abuse, and Adult Psychological Symptoms

  2024cites this paper
• Data integrity in an online world: Demonstration of multimodal bot screening tools and considerations for preserving data integrity in two online social and behavioral research studies with marginalized populations.

  2024cites this paper
• Childhood emotional maltreatment and romantic relationship satisfaction: the mediating role of early maladaptive schemas

  2024cites this paper
• Characterizing Chinese undergraduate students’ empathizing-systemizing profiles: a person-centered approach

  2024cites this paper
• Exploring Age Differences in Absorption and Enjoyment during Story Listening

  2024cites this paper
• ChatGPT usage in everyday life: A motivation-theoretic mixed-methods study

  2024cites this paper
• Development, Acceptability, and Initial Implementation of an Interactive Text-Messaging Program for Fathers with Low Income

  2024cites this paper
• From adoption to continuance: Stablecoins in cross-border remittances and the role of digital and financial literacy

  2024cites this paper
• REFORMS: Consensus-based Recommendations for Machine-learning-based Science

  2024cites this paper
• Entrepreneurs can create a better tomorrow: The relationship between entrepreneurial grit, nonfinancial success, and societal impact

  2024influential citation
• Two days before Friday versus 2 days from today: How future (vs. present) anchors in deadlines increase goal achievement

  2024cites this paper
• The Burden for High-Quality Online Data Collection Lies With Researchers, Not Recruitment Platforms

  2024cites this paper
• Rationale and Study Checklist for Ethical Rejection of Participants on Crowdsourcing Research Platforms.

  2024cites this paper
• Exploring the Loss Aversion Scale’s psychometric properties in Spain

  2024cites this paper
• Survey and Analysis of User Perceptions of Security Icons

  2024cites this paper
• The Influence of Trait Mindfulness and Self-Regulatory Efficacy on Academic Cheating Intention

  2024influential citation
• Identifying Careless Responding in Web-Based Surveys

  2024cites this paper
• A Nunavut community-directed Inuit youth mental wellness initiative: making I-SPARX fly

  2024cites this paper
• Ultra-Brief Breath Counting (Mindfulness) Training Abolishes Negative Affect–Induced Alcohol Motivation in Hazardous Community Drinkers

  2024cites this paper
• A Cross-Cultural Examination of Blatant and Subtle Dehumanization of Autistic People

  2024cites this paper
• The Pathways Linking Green Spaces to Reduced Climate Change Anxiety

  2024cites this paper
• Re-thinking vulnerability: Research fraud and bureaucratic harm in community-engaged online research

  2024cites this paper
• Measuring the Reliability of a Gamified Stroop Task: Quantitative Experiment

  2024cites this paper
• The significance of the cartographic sign: influences of symbol shape on intuitive judgments

  2024cites this paper
• Detecting inattentive respondents by machine learning: A generic technique that substitutes for the directed questions scale and compensates for its shortcomings

  2024cites this paper
• Are autistic traits associated with a social-emotional memory bias?

  2024cites this paper
• Feeling bad about feeling good? how avengers and observers evaluate the hedonic pleasure of taking revenge

  2024cites this paper
• Development of the Modified Highly Processed Food Withdrawal Scale (mProWS).

  2024cites this paper
• ‘Help me be myself’—How identity-specific support promotes LGBTQ+ employees’ authenticity via basic need satisfaction

  2024cites this paper
• Rumination in dementia and its relationship with depression, anxiety, and attentional biases

  2024cites this paper
• Neighborhood social contact and cohesion mediate the relationship between subjectively perceived artificial light at night and mental wellbeing

  2024cites this paper
• Measuring Attentiveness in Self-Administered Surveys

  2024cites this paper
• A credibility crisis in psychology?

  2023cites this paper
• Early Identification of Cognitive Impairment in Community Environments Through Modeling Subtle Inconsistencies in Questionnaire Responses: Machine Learning Model Development and Validation

  2023cites this paper
• Challenges and Lessons Learned in Managing Web-Based Survey Fraud for the Garnering Effective Outreach and Research in Georgia for Impact Alliance–Community Engagement Alliance Survey Administrations

  2023cites this paper
• Managing and minimizing online survey questionnaire fraud: lessons from the Triple C project

  2023cites this paper
• Weakening the ideological immune system: can debiasing techniques reduce confirmation bias?

  2023cites this paper
• Model-agnostic unsupervised detection of bots in a Likert-type questionnaire

  2023cites this paper
• The Poverty-Related Stress Scale: Development and Validation of a Multidimensional Measure Assessing Poverty-Related Stressors

  2023influential citation
• The Effect of Cooperative Organizational Culture and Gender on Helping Behavior

  2023cites this paper
• Validation of the teaching equity enactment scenario scale in Singapore: a mixed-methods convergent study

  2023cites this paper
• Czy kryzys wiarygodności w psychologii?

  2023cites this paper
• Integrating statistical and visual analytic methods for bot identification of health-related survey data

  2023cites this paper
• Ethical Responsiveness as a Mediator Between Enduring Vulnerabilities and Relationship Quality

  2023cites this paper
• Perturbation-based Active Learning for Question Answering

  2023cites this paper
• Inattentive responding can induce spurious associations between task behaviour and symptom measures

  2023cites this paper
• Do proactive students benefit more from university support for entrepreneurship when it comes to choosing entrepreneurship as a career choice? An examination of Ghanian and Malaysian students

  2023cites this paper
• Beach recreationists perceive a lack of knowledge about shorebirds' needs as a constraint to walking around shorebird flocks

  2023cites this paper
• Who Broke Amazon Mechanical Turk?: An Analysis of Crowdsourcing Data Quality over Time

  2023cites this paper
• Development of an objective measure of knowledge of plastic recycling: The outcomes of plastic recycling knowledge scale (OPRKS)

  2023cites this paper
• Using quality control checks to overcome pitfalls in the collection of primary data via online platforms

  2023cites this paper
• Do mturkers collude in interactive online experiments?

  2023cites this paper
• When 2 become 1: Autistic simultaneity judgements about asynchronous audiovisual speech

  2023cites this paper
• The inaccuracy of data from online surveys: A cautionary analysis

  2023influential citation
• Reduced loneliness mediates the effects of multiple group identifications on well-being.

  2023cites this paper
• Visual display size and shape impact the accuracy of US adults' health‐risk estimates

  2023cites this paper
• Detecting the corruption of online questionnaires by artificial intelligence

  2023influential citation
• The logo ‘visual thickness effect’: When and why it boosts brand personality

  2023cites this paper
• The Whole is Not Different From its Parts

  2023cites this paper
• REFORMS: Reporting Standards for Machine Learning Based Science

  2023cites this paper