Confidence Calibration in a Multiyear Geopolitical Forecasting Competition

No abstract is available for this paper.

• Publication year

  2017

• Venue

  Management Sciences

• Publication date

  Unknown publication date

• Fields of study

  Computer Science, Economics, Political Science

• Identifiers
  DOI 10.1287/mnsc.2016.2525
• External record

  Open on Semantic Scholar

• Source metadata

  Semantic Scholar

• No claims are published for this paper.

• No concepts are published for this paper.

• Distilling the Wisdom of Crowds: Prediction Markets vs. Prediction Polls

  2017cited by this paper
• Overconfidence over the lifespan

  2017cited by this paper
• Distilling the Wisdom of Crowds: Prediction Markets versus Prediction Polls

  2015cited by this paper
• The psychology of intelligence analysis: drivers of prediction accuracy in world politics.

  2015cited by this paper
• Superforecasting: The Art and Science of Prediction

  2015cited by this paper
• Identifying and Cultivating Superforecasters as a Method of Improving Probabilistic Predictions

  2015influential reference
• A User's Guide to Debiasing

  2014cited by this paper
• Probability aggregation in time-series: Dynamic hierarchical modeling of sparse expert beliefs

  2014cited by this paper
• Psychological Strategies for Winning a Geopolitical Forecasting Tournament

  2014influential reference
• Combining multiple probability predictions using a simple logit model

  2014cited by this paper
• Two Reasons to Make Aggregated Probability Forecasts More Extreme

  2014cited by this paper
• Accuracy of forecasts in strategic intelligence

  2014cited by this paper
• Managerial Miscalibration

  2013cited by this paper
• Signal and Noise: Why So Many Predictions Fail – but Some Don't

  2013cited by this paper
• Overconfidence produces underachievement: Inaccurate self evaluations undermine students’ learning and retention

  2012cited by this paper
• A status-enhancement account of overconfidence.

  2012cited by this paper
• Expert Political Judgment : How Good Is It ? How Can We Know ?

  2012influential reference
• The hypercorrection effect persists over a week, but high-confidence errors return

  2011cited by this paper
• Thinking, Fast and Slow

  2011cited by this paper
• Intelligent management of intelligence agencies: beyond accountability ping-pong.

  2011cited by this paper
• Overconfidence in tournaments: evidence from the field

  2010cited by this paper
• A simple remedy for overprecision in judgment.

  2010cited by this paper
• The Dynamics of Overconfidence: Evidence from Stock Market Forecasters

  2010cited by this paper
• Overconfidence in Forecasts of Own Performance: An Experimental Study

  2009cited by this paper
• The trouble with overconfidence.

  2008cited by this paper
• Overconfidence in interval estimates: What does expertise buy you?

  2008cited by this paper
• Adult age differences in the realism of confidence judgments: overconfidence, format dependence, and cognitive predictors.

  2008cited by this paper
• Perspectives on Probability Judgment Calibration

  2008cited by this paper
• The illusion of knowledge: When more information reduces accuracy and increases confidence

  2007cited by this paper
• Overconfidence and trading volume

  2007cited by this paper
• Expert Political Judgment: How Good Is It? How Can We Know?

  2007influential reference
• Social comparison and confidence: When thinking you’re better than average predicts overconfidence (and when it does not)

  2007cited by this paper
• Not so Above Average After All: When People Believe They are Worse than Average and its Implications for Theories of Bias in Social Comparison

  2007cited by this paper
• Aligning confidence with accuracy: revisiting the role of feedback.

  2007cited by this paper
• Accuracy, error, and bias in predictions for real versus hypothetical events.

  2006cited by this paper
• Intuitions About Combining Opinions: Misappreciation of the Averaging Principle

  2006cited by this paper
• Investor Overconfidence and Trading Volume

  2006cited by this paper
• Skilled or unskilled, but still unaware of it: how perceptions of difficulty drive miscalibration in relative comparisons.

  2006cited by this paper
• Collaborative planning and prediction: Does group discussion affect optimistic biases in time estimation?

  2005cited by this paper
• The recalcitrance of overconfidence and its contribution to decision aid neglect

  2005cited by this paper
• Overconfident: Do You Put Your Money On It?

  2005cited by this paper
• Eyewitness testimony.

  2003cited by this paper
• The Relationship between Overconfidence and the Introduction of Risky Products: Evidence from a Field Study

  2003cited by this paper
• Underestimating Costs in Public Works Projects: Error or Lie?

  2002cited by this paper
• Heuristics and Biases: The Calibration of Expert Judgment: Heuristics and Biases Beyond the Laboratory

  2002cited by this paper
• Comparing objective and subjective learning curves: judgments of learning exhibit increased underconfidence with practice.

  2002cited by this paper
• Principles of forecasting: A handbook for researchers and practitioners

  2002influential reference
• Heuristics and Biases: The Weighing of Evidence and the Determinants of Confidence

  2002cited by this paper
• Heuristics and Biases: Support Theory: A Nonextensional Representation of Subjective Probability

  2002cited by this paper
• Principles of forecasting

  2001cited by this paper
• Training to Improve Calibration and Discrimination: The Effects of Performance and Environmental Feedback.

  2000cited by this paper
• Naive empiricism and dogmatism in confidence research: a critical examination of the hard-easy effect.

  2000influential reference
• Principles of Forecasting : A Handbook for Researchers and Practitioners ,

  2000cited by this paper
• Accounting for the effects of accountability.

  1999cited by this paper
• Lake Wobegon be gone! The "below-average effect" and the egocentric nature of comparative ability judgments.

  1999cited by this paper
• Overconfidence: It Depends on How, What, and Whom You Ask.

  1999influential reference
• Unskilled and unaware of it: how difficulties in recognizing one's own incompetence lead to inflated self-assessments.

  1999cited by this paper
• Cross-Cultural Variations in Probability Judgment Accuracy: Beyond General Knowledge Overconfidence?

  1998cited by this paper
• On the Importance of Random Error in the Study of Probability Judgment. Part II: Applying the Stochastic Judgment Model to Detect Systematic Trends

  1997cited by this paper
• Confidence in judgment.

  1997cited by this paper
• Bias in judgment: Comparing individuals and groups.

  1996cited by this paper
• The False Consensus Effect and Overconfidence: Flaws in Judgment or Flaws in How We Study Judgment?

  1996cited by this paper
• Interaction with Others Increases Decision Confidence but Not Decision Quality: Evidence against Information Collection Views of Interactive Decision Making

  1995cited by this paper
• Coherence, Calibration, and Expertise in Judgmental Probability Forecasting

  1994cited by this paper
• Simultaneous Over- and Underconfidence: The Role of Error in Judgment Processes.

  1994influential reference
• Timid choices and bold forecasts: a cognitive perspective on risk taking

  1993cited by this paper
• The effects of feedback and training on the performance of probability forecasters

  1992cited by this paper
• Probabilistic mental models: a Brunswikian theory of confidence.

  1991cited by this paper
• The process-performance paradox in expert judgment - How can experts know so much and predict so badly?

  1991cited by this paper
• Calibration and probability judgements: Conceptual and methodological issues

  1991cited by this paper
• How to Make Cognitive Illusions Disappear: Beyond “Heuristics and Biases”

  1991cited by this paper
• Judgment in Managerial Decision Making

  1990cited by this paper
• Accuracy and confidence in group judgment

  1989cited by this paper
• Entrepreneurs' perceived chances for success

  1988cited by this paper
• Effects of information load and percentage of shared information on the dissemination of unshared information during group discussion.

  1987cited by this paper
• Facing uncertainty in the game of bridge: A calibration study

  1987cited by this paper
• The Effects of Group Cohesion and Leader Behavior on Subordinate Satisfaction

  1986cited by this paper
• Judgment Under Uncertainty: Heuristics and Biases.

  1984cited by this paper
• External correspondence: Decompositions of the mean probability score

  1982cited by this paper
• Judgment under uncertainty: Debiasing

  1982cited by this paper
• Group decision making and social influence: A social interaction sequence model.

  1981cited by this paper
• Training for calibration.

  1980cited by this paper
• CAN WEATHER FORECASTERS FORMULATE RELIABLE PROBABILITY FORECASTS OF PRECIPITATION AND TEMPERATURES ?

  1977cited by this paper
• Application of signal detection theory to perceptual-motor skills.

  1977cited by this paper
• Decision Making: A Psychological Analysis of Conflict, Choice, and Commitment

  1977cited by this paper
• Calibration of Probabilities: The State of the Art

  1977cited by this paper
• Knowing with Certainty: The Appropriateness of Extreme Confidence.

  1977cited by this paper
• The group as a polarizer of attitudes.

  1969cited by this paper
• Attitudes toward U.S. and Russian Actions: A Double Standard

  1965influential reference
• OVERCONFIDENCE IN CASE-STUDY JUDGMENTS.

  1965influential reference
• VERIFICATION OF FORECASTS EXPRESSED IN TERMS OF PROBABILITY

  1950influential reference

• Rethinking misinformation through plausibility estimation and confidence calibration

  2026cites this paper
• The cognitive mechanisms behind wishful predictions: A diffusion model decomposition.

  2025cites this paper
• Missing Team Dynamics? An Integrative Review of Research on Team Development Over Time

  2025cites this paper
• Influencing Confidence: Testing Ways to Increase or Decrease Confidence in Knowledge

  2025cites this paper
• Group Discussions Improve Competence Calibration: Making Self-Perceived Competence Valuable When Harnessing the Wisdom of Crowds

  2025cites this paper
• Crowd Dynamics in Online Lending: Unveiling Indicators of Collective Insight

  2025cites this paper
• When deciding creates overconfidence

  2025cites this paper
• How does training improve individual forecasts? Modeling differences in compensatory and non-compensatory biases in geopolitical forecasts

  2025cites this paper
• Individual foresight: Concept, operationalization, and correlates

  2025cites this paper
• Does expertise protect against overclaiming false knowledge?

  2024cites this paper
• Metacognition biases information seeking in assessing ambiguous news

  2024cites this paper
• The effect of calibration training on the calibration of intelligence analysts' judgments

  2024cites this paper
• Different methods elicit different belief distributions.

  2024cites this paper
• A Case Study of an Ignored Facet: Metacognitive Experiences

  2024cites this paper
• Narrative Abduction

  2024cites this paper
• FORECAST2023: A Forecast and Reasoning Corpus of Argumentation Structures

  2024cites this paper
• Leveraging Advice-taking and Kernel Density Estimation to Identify A Cluster of Experts and Improve Wisdom of Crowds

  2024cites this paper
• “Are You Really Sure?” Understanding the Effects of Human Self-Confidence Calibration in AI-Assisted Decision Making

  2024cites this paper
• Effects of behavioral bias regarding demand forecasting in a competitive market

  2024cites this paper
• Improving the accuracy of social work judgements: A proof‐of‐concept study of a training programme

  2024cites this paper
• Improving decision making through visual knowledge calibration

  2023cites this paper
• Compromising improves forecasting

  2023cites this paper
• Hidden Indicators of Collective Intelligence in Crowdfunding

  2023influential citation
• Calibration training for improving probabilistic judgments using an interactive app

  2023cites this paper
• Predictable Errors in Monetary Policy Communications and Decisions

  2023cites this paper
• Automated calibration training for forecasters

  2023cites this paper
• Thinking without knowing: Psychological and behavioral consequences of unjustified confidence regarding blackjack strategy

  2023cites this paper
• Who Should I Trust: AI or Myself? Leveraging Human and AI Correctness Likelihood to Promote Appropriate Trust in AI-Assisted Decision-Making

  2023cites this paper
• - 1-Confirmation Bias in the Utilization of Others ’ Opinion Strength

  2022cites this paper
• Election polls are 95% confident but only 60% accurate

  2022cites this paper
• Extremists are more confident

  2022cites this paper
• False dichotomy alert: Improving subjective-probability estimates vs. raising awareness of systemic risk

  2022cites this paper
• Brain Systems Underlying Fundamental Motivations of Human Social Conformity

  2022cites this paper
• Does constructing a belief distribution truly reduce overconfidence?

  2022cites this paper
• A strategy to improve expert technology forecasts

  2021cites this paper
• What do forecasting rationales reveal about thinking patterns of top geopolitical forecasters?

  2021cites this paper
• Forecasting forecaster accuracy: Contributions of past performance and individual differences

  2021cites this paper
• Belief Movement, Uncertainty Reduction, and Rational Updating*

  2021cites this paper
• How well did experts and laypeople forecast the size of the COVID-19 pandemic?

  2021cites this paper
• Do People Prescribe Optimism, Overoptimism, or Neither?

  2021cites this paper
• Forecasting the Accuracy of Forecasters from Properties of Forecasting Rationales

  2021cites this paper
• Worker overconfidence: Field evidence and implications for employee turnover and firm profits

  2020cites this paper
• Leveraging Clickstream Trajectories to Reveal Low-Quality Workers in Crowdsourced Forecasting Platforms

  2020cites this paper
• Quantifying the qualities of language

  2020cites this paper
• Combining prediction intervals in the M4 competition

  2020cites this paper
• Judgment and Decision Making.

  2020cites this paper
• The M4 Forecasting Competition Prediction Intervals

  2019cites this paper
• Does “putting on your thinking cap” reduce myside bias in evaluation of scientific evidence?

  2019cites this paper
• Forecasting tournaments, epistemic humility and attitude depolarization.

  2019cites this paper
• Overprecision increases subsequent surprise

  2019cites this paper
• Confirmation bias in the utilization of others’ opinion strength

  2019cites this paper
• The Value of Performance Weights and Discussion in Aggregated Expert Judgments

  2018cites this paper
• Belief Movement , Uncertainty Reduction , & Rational Updating ∗

  2017cites this paper
• Distilling the Wisdom of Crowds: Prediction Markets vs. Prediction Polls

  2017cites this paper
• Worker Overconfidence: Field Evidence and Implications for Employee Turnover and Returns from Training

  2017cites this paper
• Network Signatures of Success: Emulating Expert and Crowd Assessment in Science, Art, and Technology

  2017cites this paper
• InvestigateDiscussEstimateAggregate for structured expert judgement

  2016influential citation
• Developing expert political judgment: The impact of training and practice on judgmental accuracy in geopolitical forecasting tournaments

  2016cites this paper
• Overconfidence at work: Does overconfidence survive the checks and balances of organizational life?

  2016cites this paper