The Value of Performance Weights and Discussion in Aggregated Expert Judgments

No abstract is available for this paper.

• Publication year

  2018

• Venue

  Risk Analysis

• Publication date

  2018-09-01

• Fields of study

  Medicine, Economics, Political Science

• Identifiers
  DOI 10.1111/risa.12992PMID 29665625
• External record

  Open on Semantic Scholar

• Source metadata

  Semantic Scholar, PubMed

• No claims are published for this paper.

• No concepts are published for this paper.

• Classical meets modern in the IDEA protocol for structured expert judgement

  2018cited by this paper
• Confidence Calibration in a Multiyear Geopolitical Forecasting Competition

  2017cited by this paper
• I nvestigate D iscuss E stimate A ggregate for structured expert judgement

  2017cited by this paper
• Cross validation for the classical model of structured expert judgment

  2017cited by this paper
• There is Data, and then there is Data: Only Experimental Evidence will Determine the Utility of Differential Weighting of Expert Judgment

  2015cited by this paper
• The Wiley Blackwell handbook of judgement and decision making

  2015cited by this paper
• Identifying Expertise to Extract the Wisdom of Crowds

  2015cited by this paper
• Consensus measurement in Delphi studies Review and implications for future quality assurance Technological Forecasting & Social Change

  2015cited by this paper
• Our Knowledge of the World is Often Not Simple: Policymakers Should Not Duck that Fact, But Should Deal with It

  2015influential reference
• Equal Versus Differential Weighting in Combining Forecasts

  2015influential reference
• Overprecision in Judgment

  2015cited by this paper
• Identifying and Cultivating Superforecasters as a Method of Improving Probabilistic Predictions

  2015influential reference
• The psychology of intelligence analysis: drivers of prediction accuracy in world politics.

  2015influential reference
• Trusting Judgements: How to Get the Best out of Experts

  2015cited by this paper
• Decision Making in Groups and Organizations

  2015cited by this paper
• The Aggregation of Expert Judgment: Do Good Things Come to Those Who Weight?

  2015cited by this paper
• Cognitive and Motivational Biases in Decision and Risk Analysis

  2015cited by this paper
• The Aggregation of Expert Judgment: Do Good Things Come to Those Who Weight?

  2015influential reference
• Psychological Strategies for Winning a Geopolitical Forecasting Tournament

  2014cited by this paper
• Out-of-sample validation for structured expert judgment of Asian carp establishment in Lake Erie

  2014cited by this paper
• Two Reasons to Make Aggregated Probability Forecasts More Extreme

  2014cited by this paper
• The effect of the number of seed variables on the performance of Cooke′s classical model

  2014cited by this paper
• Quantifying scientific uncertainty from expert judgement elicitation

  2013cited by this paper
• Consensus measurement in Delphi studies

  2012cited by this paper
• The Intelligence Game: Assessing Delphi Groups and structured question formats

  2012cited by this paper
• The Good Judgment Project: A Large Scale Test of Different Methods of Combining Expert Predictions

  2012cited by this paper
• Redefining expertise and improving ecological judgment

  2011cited by this paper
• How social influence can undermine the wisdom of crowd effect

  2011cited by this paper
• Improving the Delphi process: Lessons from social psychological research

  2011cited by this paper
• Expert Status and Performance

  2011cited by this paper
• Does the Delphi process lead to increased accuracy in group-based judgmental forecasts or does it simply induce consensus amongst judgmental forecasters ?

  2011cited by this paper
• Group-based forecasting?: A social psychological analysis

  2011cited by this paper
• A route to more tractable expert advice

  2010influential reference
• On the performance of social network and likelihood-based expert weighting schemes

  2008cited by this paper
• TU Delft expert judgment data base

  2008influential reference
• Special issue on expert judgment

  2008cited by this paper
• Linguistic Uncertainty in Qualitative Risk Analysis and How to Minimize It

  2008cited by this paper
• Uncertain Judgements: Eliciting Experts' Probabilities

  2006cited by this paper
• Risks and Decisions for Conservation and Environmental Management: Risk ranking

  2005cited by this paper
• Group Judgments: Deliberation, Statistical Means, and Information Markets

  2004cited by this paper
• Heuristics and Biases: The Weighing of Evidence and the Determinants of Confidence

  2002cited by this paper
• Expert Opinions in Forecasting: The Role of the Delphi Technique

  2001cited by this paper
• Choices, Values, and Frames

  2000cited by this paper
• ‘Combining Probability Distributions from Experts in Risk Analysis’

  2000cited by this paper
• Procedures Guide for Structural Expert Judgement in Accident Consequence Modelling

  2000cited by this paper
• The Delphi technique as a forecasting tool: issues and analysis

  1999cited by this paper
• Trust, Emotion, Sex, Politics, and Science: Surveying the Risk‐Assessment Battlefield

  1999cited by this paper
• Primary total hip replacement surgery: a systematic review of outcomes and modelling of cost-effectiveness associated with different prostheses.

  1998cited by this paper
• Consensus development methods, and their use in clinical guideline development.

  1998cited by this paper
• Precision and Accuracy of Judgmental Estimation

  1997cited by this paper
• Discrete subjective probabilities and decision analysis: Elicitation, calibration and combination.

  1994cited by this paper
• Experts in Uncertainty: Opinion and Subjective Probability in Science

  1991influential reference
• An Evaluation of Delphi

  1991cited by this paper
• Critical Values for Spearman’s Rank Order Correlation

  1989influential reference
• Calibration of probabilities: the state of the art to 1980

  1982cited by this paper
• A New Vector Partition of the Probability Score

  1973cited by this paper
• An experimental study of group opinion

  1969cited by this paper
• VERIFICATION OF FORECASTS EXPRESSED IN TERMS OF PROBABILITY

  1950cited by this paper

• Can India Achieve its 2030 Non-Fossil Capacity Target? Insights from Entropy-Weighted Composite Index and Grey Forecasting of Subnational Renewable Transitions

  2026cites this paper
• Fuzzy-Based Decision Support for Strategic Management: Evaluating Electric Vehicle Attractiveness in the Digital Era

  2025cites this paper
• Expert‐Derived Flood Damage Curves for Critical Infrastructure Network Components

  2025cites this paper
• Group discussions improve reliability and validity of rated categories based on qualitative data from systematic review

  2025cites this paper
• Group Discussions Improve Competence Calibration: Making Self-Perceived Competence Valuable When Harnessing the Wisdom of Crowds

  2025cites this paper
• Threat assessment for Pacific sand lance (Ammodytes personatus) in the Salish Sea

  2024cites this paper
• Assessing invasion risks using EICAT-based expert elicitation: application to a conservation translocation

  2024cites this paper
• Improving the accuracy of social work judgements: A proof‐of‐concept study of a training programme

  2024cites this paper
• Eliciting expert judgements to underpin our understanding of faecal indicator organism loss from septic tank systems.

  2024cites this paper
• Measuring the impacts of human and organizational factors on human errors in the Dutch construction industry using structured expert judgement

  2024cites this paper
• Resist and recover: Introducing a spring theory for modeling disaster resilience

  2024cites this paper
• Linking species distribution models with structured expert elicitation for predicting management effectiveness

  2023cites this paper
• Compromising improves forecasting

  2023cites this paper
• Predicting reliability through structured expert elicitation with the repliCATS (Collaborative Assessments for Trustworthy Science) process

  2023cites this paper
• Interactions among the human and organizational factors within the public sector regarding epidemic prevention and control

  2022cites this paper
• Depth‐damage curves for rail rapid transit infrastructure

  2022influential citation
• Modular interface for managing cognitive bias in experts

  2022cites this paper
• Aggregating human judgment probabilistic predictions of the safety, efficacy, and timing of a COVID-19 vaccine

  2022cites this paper
• Editorial: Multivariate Probabilistic Modelling for Risk and Decision Analysis

  2022cites this paper
• Test-time Collective Prediction

  2021cites this paper
• Uncertainty Quantification with Experts: Present Status and Research Needs

  2021cites this paper
• Eliciting group judgements about replicability: a technical implementation of the IDEA Protocol

  2021cites this paper
• What is a Good Calibration Question?

  2021cites this paper
• An In-Depth Perspective on the Classical Model

  2021cites this paper
• Expert Judgement for Geological Hazards in New Zealand

  2021cites this paper
• Developing a reference protocol for structured expert elicitation in health-care decision-making: a mixed-methods study.

  2021cites this paper
• Predicting species and community responses to global change using structured expert judgement: An Australian mountain ecosystems case study

  2021cites this paper
• Mathematically aggregating experts’ predictions of possible futures

  2021cites this paper
• Protective consumption behavior under smog: using a data-driven dynamic Bayesian network

  2021cites this paper
• Strategic marketing initiatives for small co-operative enterprises generated from SWOT-TOWS analysis and evaluated with PROMETHEE-GAIA

  2021cites this paper
• Forecasting forecaster accuracy: Contributions of past performance and individual differences

  2021cites this paper
• Edinburgh Bioengineering horizon scan 2020

  2020cites this paper
• An analysis and evaluation of methods currently used to quantify the likelihood of existential hazards

  2020cites this paper
• PAL-VMEA: A Novel Method for Enhancing Decision-Making Consistency in Maintenance Management

  2020cites this paper
• The Efficacy of the Retirement Pension Provision System: Modeling, and Assessing of the Case of Kazakhstan

  2020cites this paper
• Aggregating predictions from experts: A review of statistical methods, experiments, and applications

  2020influential citation
• Applying expert elicitation of viability and persistence to a lynx species status assessment

  2020cites this paper
• Adoption of a Data‐Driven Bayesian Belief Network Investigating Organizational Factors that Influence Patient Safety

  2020cites this paper
• Predicting species and community responses to global change in Australian mountain ecosystems using structured expert judgement

  2020cites this paper
• Bioengineering horizon scan 2020

  2020cites this paper
• ‘Off-reserve’ management in practice: Contributing to conservation of biodiversity over 30 years of Tasmania’s forest practices system

  2020cites this paper
• Who is an expert for foresight? A review of identification methods

  2020cites this paper
• Dangerous Science Science: Policy and Risk Analysis for Scientists and Engineers

  2020cites this paper
• Untapped potential of collective intelligence in conservation and environmental decision making

  2019cites this paper
• Improving expert forecasts in reliability: Application and evidence for structured elicitation protocols

  2019cites this paper
• Aggregating predictions from experts: a scoping review of statistical methods, experiments, and applications

  2019influential citation
• Cause-related marketing: an exploration of new avenues through conjoint analysis

  2019cites this paper
• Calibrating experts’ probabilistic assessments for improved probabilistic predictions

  2019cites this paper
• IDEA for Uncertainty Quantification

  2018cites this paper