Human confidence in artificial intelligence and in themselves: The evolution and impact of confidence on adoption of AI advice

Artificial intelligence (AI) has shown its promise in assisting human decision-making. However, humans ’ inappropriate decision to accept or reject suggestions from AI can lead to severe consequences in high-stakes AI-assisted decision-making scenarios. This problem persists due to insufficient understanding of human trust in AI. Therefore, this research studies how two types of human confidence that affect trust, their confidence in AI and confidence in themselves, evolve and affect humans ’ decisions. A cognitive study and a quantitative model together examine how changing positive and negative experiences affect these confidences and ultimate decisions. Results show that human self-confidence, not their confidence in AI, directs the decision to accept or reject AI suggestions. Furthermore, this work finds that humans often misattribute blame to themselves and enter a vicious cycle of relying on a poorly performing AI. Findings reveal the need and provide insights to effectively calibrate human self-confidence for successful AI-assisted decision-making.

• Publication year

  2022

• Venue

  Computers in Human Behavior

• Publication date

  2022-02-01

• Fields of study

  Computer Science, Psychology

• Identifiers
  DOI 10.1016/j.chb.2021.107018
• External record

  Open on Semantic Scholar

• Source metadata

  Semantic Scholar

• No claims are published for this paper.

• No concepts are published for this paper.

• A cautionary tale about the impact of AI on human design teams

  2021cited by this paper
• Human Trust in Artificial Intelligence: Review of Empirical Research

  2020cited by this paper
• Effect of confidence and explanation on accuracy and trust calibration in AI-assisted decision making

  2020influential reference
• Human–machine partnership with artificial intelligence for chest radiograph diagnosis

  2019cited by this paper
• Understanding the Effect of Accuracy on Trust in Machine Learning Models

  2019cited by this paper
• Beyond Accuracy: The Role of Mental Models in Human-AI Team Performance

  2019cited by this paper
• Computational Modeling of the Dynamics of Human Trust During Human–Machine Interactions

  2019cited by this paper
• Updates in Human-AI Teams: Understanding and Addressing the Performance/Compatibility Tradeoff

  2019cited by this paper
• Artificial intelligence in medicine: current trends and future possibilities.

  2018cited by this paper
• Collaborative Intelligence: Humans and AI Are Joining Forces

  2018cited by this paper
• Building Trust in Artificial Intelligence, Machine Learning, and Robotics

  2018cited by this paper
• Artificial Intelligence in Medicine: 16th Conference on Artificial Intelligence in Medicine, AIME 2017, Vienna, Austria, June 21-24, 2017, Proceedings

  2017cited by this paper
• A Little Anthropomorphism Goes a Long Way

  2017cited by this paper
• Algorithmic Bias in Autonomous Systems

  2017cited by this paper
• Interference effects of choice on confidence: Quantum characteristics of evidence accumulation

  2015cited by this paper
• Algorithm aversion: people erroneously avoid algorithms after seeing them err.

  2015cited by this paper
• Google’s Driverless Cars Run into Problem: Cars with Drivers

  2015cited by this paper
• Reliance, trust and heuristics in judgmental forecasting

  2014cited by this paper
• Trust in Automation

  2013cited by this paper
• Swift trust in global virtual teams: Trusting beliefs and normative actions.

  2013cited by this paper
• Combining human and machine intelligence in large-scale crowdsourcing

  2012cited by this paper
• Automation bias: a systematic review of frequency, effect mediators, and mitigators

  2012cited by this paper
• Making Business Predictions by Combining Human and Machine Intelligence in Prediction Markets

  2011cited by this paper
• A Meta-Analysis of Factors Affecting Trust in Human-Robot Interaction

  2011cited by this paper
• Adaptive Automation for Human Supervision of Multiple Uninhabited Vehicles: Effects on Change Detection, Situation Awareness, and Mental Workload

  2009cited by this paper
• An Integrative Model of Organizational Trust: Past, Present, and Future

  2007cited by this paper
• Measuring trust inside organisations

  2006cited by this paper
• Models of Interpersonal Trust Development: Theoretical Approaches, Empirical Evidence, and Future Directions

  2006cited by this paper
• Trust in Automation: Designing for Appropriate Reliance

  2004cited by this paper
• CONSIDERING SUBJECTIVE TRUST AND MONITORING BEHAVIOR IN ASSESSING AUTOMATION-INDUCED “COMPLACENCY”

  2004cited by this paper
• The role of trust in automation reliance

  2003cited by this paper
• The Perceived Utility of Human and Automated Aids in a Visual Detection Task

  2002cited by this paper
• THE MEANINGS OF TRUST

  2000cited by this paper
• Formal Analysis of Models for the Dynamics of Trust Based on Experiences

  1999cited by this paper
• Not So Different After All: A Cross-Discipline View Of Trust

  1998cited by this paper
• Humans and Automation: Use, Misuse, Disuse, Abuse

  1997cited by this paper
• An Integrative Model Of Organizational Trust

  1995cited by this paper
• Trust, self-confidence, and operators' adaptation to automation

  1994cited by this paper
• Performance Consequences of Automation-Induced 'Complacency'

  1993cited by this paper
• Loss Aversion in Riskless Choice: A Reference-Dependent Model

  1991cited by this paper
• Trust as a Social Reality

  1985cited by this paper
• Computing a Trust Region Step

  1983cited by this paper

• The differential perception of leaders' response to employee-GenAI advice: A multi-level study based on social comparison view

  2026cites this paper
• Integrating Neurocognitive Signals and Machine Learning for Trust Prediction in Human–AI Collaborative Design

  2026cites this paper
• Normative Equivalence in Human-AI Cooperation: Behaviour, Not Identity, Drives Cooperation in Mixed-Agent Groups

  2026cites this paper
• Exploring the Investment Construct for Quantifying AI Utilization.

  2026cites this paper
• The Influence of Prior Perception, Attitude, and Immediate Knowledge of AI on Adolescents’ Preferences for High- and Low-Replaceable Jobs

  2026cites this paper
• Align When They Want, Complement When They Need! Human-Centered Ensembles for Adaptive Human-AI Collaboration

  2026cites this paper
• The Algorithmic Boardroom: AI-Driven Governance and Strategic Decision Making

  2026cites this paper
• Human-AI Interaction: Evaluating LLM Reasoning on Digital Logic Circuit included Graph Problems, in terms of creativity in design and analysis

  2026cites this paper
• Editable XAI: Toward Bidirectional Human-AI Alignment with Co-Editable Explanations of Interpretable Attributes

  2026cites this paper
• Toward agentic AI: User acceptance of a deeply personalized AI super assistant (AISA)

  2026cites this paper
• How does contextual fidelity impact how we think, talk, and act in AI-assisted engineering design?

  2026cites this paper
• Success and failure of human-AI collaboration in clinical reasoning: An experimental study on challenging real-world cases

  2026cites this paper
• Toward Shared Situational Awareness in Human–AI Hybrid Intelligence: A Survey in High-Risk Aviation Environments

  2026cites this paper
• Authorship Drift: How Self-Efficacy and Trust Evolve During LLM-Assisted Writing

  2026influential citation
• When AI Persuades: Adversarial Explanation Attacks on Human Trust in AI-Assisted Decision Making

  2026cites this paper
• Overloaded minds and machines: a cognitive load framework for human-AI symbiosis

  2026cites this paper
• AI-Driven Image Analysis for Enhancing Audits in Food and Beverage Industries Under GMP and SSOP Standards

  2025cites this paper
• The Impact and Feasibility of Self-Confidence Shaping for AI-Assisted Decision-Making

  2025influential citation
• Artificial Intelligence in engineering design: an industry perspective

  2025cites this paper
• Beyond Predictions: A Study of AI Strength and Weakness Transparency Communication on Human-AI Collaboration

  2025cites this paper
• Enhancing Joint Human-AI Inference in Robot Missions: A Confidence-Based Approach

  2025cites this paper
• Exploring the Effects of Chatbot Anthropomorphism and Human Empathy on Human Prosocial Behavior Toward Chatbots

  2025cites this paper
• Investment construct in human autonomy teaming for deep space habitat operations

  2025cites this paper
• The Rise of Artificial Intelligence in the Film Industry - A Study on Story-Writing AI Applications

  2025influential citation
• Deep mechanism design: Learning social and economic policies for human benefit

  2025cites this paper
• The Impact of Digital Transformation on Supply Chain Optimisation in Industrial Engineering: A Systematic Literature Review

  2025cites this paper
• Feeling grounded when watching live streaming shows of highly anthropomorphic interactive virtual influencers: An exploratory study on customer opinions

  2025cites this paper
• Sensitivity to Emotional Exploitation in Reasoning Models: Stereotypical Analysis

  2025cites this paper
• Red Teaming AI Policy: A Taxonomy of Avoision and the EU AI Act

  2025cites this paper
• The impact of different task contexts on emergency responders' trust and usage intention of artificial intelligence.

  2025cites this paper
• Effects of Explanations and Accuracy on Human Performance and Trust in AI-Assisted Anomaly Diagnosis Tasks

  2025influential citation
• Exploring the role of trust in AI-driven decision-making: a systematic literature review

  2025cites this paper
• Passing the Buck to AI: How Individuals’ Decision-Making Patterns Affect Reliance on AI

  2025cites this paper
• FİNANS SEKTÖRÜNDE YAPAY ZEKÂ AVANTAJLARI, ZORLUKLARI VE STRATEJİLERİ ÜZERİNE KAVRAMSAL BİR DEĞERLENDİRME

  2025cites this paper
• Confronting and alleviating AI resistance in the workplace: An integrative review and a process framework

  2025cites this paper
• A new model for calculating human trust behavior during human-AI collaboration in multiple decision-making tasks: A Bayesian approach

  2025cites this paper
• Breaking Barriers or Building Dependency? Exploring Team-LLM Collaboration in AI-infused Classroom Debate

  2025cites this paper
• Navigating AI Convergence in Human–Artificial Intelligence Teams: A Signaling Theory Approach

  2025cites this paper
• Aligning and comparing values of ChatGPT and human as learning facilitators: A value-sensitive design approach

  2025cites this paper
• Is Conversational XAI All You Need? Human-AI Decision Making With a Conversational XAI Assistant

  2025cites this paper
• Guidance Source Matters: How Guidance from AI, Expert, or a Group of Analysts Impacts Visual Data Preparation and Analysis

  2025cites this paper
• Fostering Appropriate Reliance on Large Language Models: The Role of Explanations, Sources, and Inconsistencies

  2025cites this paper
• The Impact of Generative AI on Critical Thinking: Self-Reported Reductions in Cognitive Effort and Confidence Effects From a Survey of Knowledge Workers

  2025cites this paper
• Trust at Your Own Peril: A Mixed Methods Exploration of the Ability of Large Language Models to Generate Expert‐Like Systems Engineering Artifacts and a Characterization of Failure Modes

  2025cites this paper
• Selective Trust: Understanding Human-AI Partnerships in Personal Health Decision-Making Process

  2025cites this paper
• Good Performance Isn't Enough to Trust AI: Lessons from Logistics Experts on their Long-Term Collaboration with an AI Planning System

  2025cites this paper
• Judging Phishing Under Uncertainty: How Do Users Handle Inaccurate Automated Advice?

  2025cites this paper
• As Confidence Aligns: Understanding the Effect of AI Confidence on Human Self-confidence in Human-AI Decision Making

  2025influential citation
• Influence of AI behavior on human moral decisions, agency, and responsibility

  2025cites this paper
• Catch Me if You Search: When Contextual Web Search Results Affect the Detection of Hallucinations

  2025cites this paper
• Effect of Explainable Artificial Intelligence on Trust of Mental Health Professionals in an AI-Based System for Suicide Prevention

  2025cites this paper
• Learning to Lie: Reinforcement Learning Attacks Damage Human-AI Teams and Teams of LLMs

  2025cites this paper
• Building Appropriate Mental Models: What Users Know and Want to Know about an Agentic AI Chatbot

  2025cites this paper
• AI-Augmented Advising: A Comparative Study of GPT-4 and Advisor-based Major Recommendations

  2025cites this paper
• Maritime AI socialisation: Exploring the impact of digital enablers on human-AI collaboration and service and process innovation

  2025cites this paper
• Adopting “blackbox” engineering advice: the influence of imperfect suggestions during AI-assisted decision-making with multiple objectives

  2025cites this paper
• Enhancing individuals’ engagement in marine recreational sport activities: from an institutional perspective

  2025cites this paper
• Modeling the Dynamics of Trust in Digital Pathology Using Explainable AI

  2025cites this paper
• AI literacy in media education: A comparative study of mass communication students in the UAE and Pakistan

  2025cites this paper
• Artificial intelligence in corporate boards: a dual-dimensional framework for integration across autonomy and structural levels

  2025cites this paper
• Pika: Designing a social-support agent to improve drivers' experience in gig work

  2025cites this paper
• The “TOP” drivers of academics’ adoption of ChatGPT in teaching

  2025cites this paper
• The Relational Tradeoff Model: The Effects of Socially Interactive Artificial Intelligence (AI) in Human-AI Relationships

  2025cites this paper
• Human–AI collaboration in knowledge ecosystems: a multidisciplinary review, integrative framework and future directions

  2025cites this paper
• Investigating appropriate reliance on AI-Based decision support systems: the role of expertise, trust, and self-confidence

  2025influential citation
• New venture team trust: Perceptions of new human, AI and AI-augmented teammates during funding activities

  2025cites this paper
• Designing AI for team ideation: How content strategy and participation style affect creative performance through team emergent states

  2025cites this paper
• Impact of EXplainable AI on Trust Evolution with AI Error Severity: Comparing Similar Instances and Saliency Map in a Baggage Screening Task

  2025cites this paper
• Position: Human Factors Reshape Adversarial Analysis in Human-AI Decision-Making Systems

  2025cites this paper
• Chatbots as a Speaking Partner: Improving Student Confidence for Oral Assessments

  2025cites this paper
• The application of digital technologies in external auditing: a double edged sword?

  2025cites this paper
• [Re] Cooperate or Collapse: Emergence of Sustainable Cooperation in a Society of LLM Agents

  2025cites this paper
• Designing Behavior-Aware AI to Improve the Human-AI Team Performance in AI-Assisted Decision Making

  2024cites this paper
• The Impact of AI Technology on the Productivity of Gig Economy Workers

  2024cites this paper
• Reliability Matters: Exploring the Effect of AI Explanations on Misinformation Detection with a Warning

  2024cites this paper
• The impact of AI errors in a human-in-the-loop process

  2024cites this paper
• Human Delegation Behavior in Human-AI Collaboration: The Effect of Contextual Information

  2024cites this paper
• Designing for Appropriate Reliance: The Roles of AI Uncertainty Presentation, Initial User Decision, and User Demographics in AI-Assisted Decision-Making

  2024cites this paper
• Trust in artificial intelligence: Literature review and main path analysis

  2024cites this paper
• The Role of Artificial Intelligence Autonomy in Higher Education: A Uses and Gratification Perspective

  2024cites this paper
• Understanding the Effects of Miscalibrated AI Confidence on User Trust, Reliance, and Decision Efficacy

  2024cites this paper
• How do humans learn about the reliability of automation?

  2024cites this paper
• Determinants of LLM-assisted Decision-Making

  2024cites this paper
• Dark side of algorithmic management on platform worker behaviors: A mixed‐method study

  2024cites this paper
• Human-AI Collaboration Increases Skill Tagging Speed but Degrades Accuracy

  2024cites this paper
• Trust with increasing and decreasing reliability

  2024cites this paper
• Humans in XAI: increased reliance in decision-making under uncertainty by using explanation strategies

  2024cites this paper
• “Are You Really Sure?” Understanding the Effects of Human Self-Confidence Calibration in AI-Assisted Decision Making

  2024cites this paper
• Borderline decisions?: Lack of justification for automatic deception detection at EU borders

  2024cites this paper
• AI for decision support: What are possible futures, social impacts, regulatory options, ethical conundrums and agency constellations?

  2024cites this paper
• Balancing Act: Exploring the Interplay Between Human Judgment and Artificial Intelligence in Problem-solving, Creativity, and Decision-making

  2024cites this paper
• Human-artificial intelligence interaction in gastrointestinal endoscopy

  2024cites this paper
• Understanding Voice Shopping Value Co-Creation: A Sem-Fsqca Method

  2024influential citation
• Explainability does not mitigate the negative impact of incorrect AI advice in a personnel selection task

  2024cites this paper
• Empirically Understanding the Potential Impacts and Process of Social Influence in Human-AI Teams

  2024cites this paper
• "I'm Not Sure, But...": Examining the Impact of Large Language Models' Uncertainty Expression on User Reliance and Trust

  2024cites this paper
• Outperformed by AI: Interacting with Superhuman AI Changes the Way We Perceive Ourselves

  2024cites this paper
• Trust in the machine: How contextual factors and personality traits shape algorithm aversion and collaboration

  2024cites this paper
• Human-AI collaboration by design

  2024cites this paper
• Human-AI interaction: Augmenting decision-making for IT leader's project selection

  2024influential citation