A solution to the single-question crowd wisdom problem

No abstract is available for this paper.

• Publication year

  2017

• Venue

  Nature

• Publication date

  2017-01-26

• Fields of study

  Medicine, Computer Science, Political Science

• Identifiers
  DOI 10.1038/nature21054PMID 28128245
• External record

  Open on Semantic Scholar

• Source metadata

  Semantic Scholar, PubMed

• No claims are published for this paper.

• No concepts are published for this paper.

• Hierarchical Bayesian Modeling for Test Theory Without an Answer Key

  2015cited by this paper
• Intuitive Biases in Choice vs . Estimation : Implications for the Wisdom of Crowds

  2015cited by this paper
• The Recognition Heuristic

  2015cited by this paper
• Identifying Expertise to Extract the Wisdom of Crowds

  2015cited by this paper
• Automatic integration of confidence in the brain valuation signal

  2015cited by this paper
• Psychological Strategies for Winning a Geopolitical Forecasting Tournament

  2014cited by this paper
• Supplementary Information

  2014cited by this paper
• Using cognitive models to combine probability estimates

  2014cited by this paper
• Use (and abuse) of expert elicitation in support of decision making for public policy

  2014cited by this paper
• The Wisdom of the Crowd in Combinatorial Problems

  2012cited by this paper
• Measuring the Prevalence of Questionable Research Practices With Incentives for Truth Telling

  2012cited by this paper
• Cultural consensus theory for multiple consensus truths

  2012cited by this paper
• Inferring Expertise in Knowledge and Prediction Ranking Tasks

  2012cited by this paper
• When Are Two Heads Better than One and Why?

  2012cited by this paper
• Tapping into the Wisdom of the Crowd—with Confidence

  2012cited by this paper
• How social influence can undermine the wisdom of crowd effect

  2011cited by this paper
• A route to more tractable expert advice

  2010cited by this paper
• A crowdsourcing evaluation of the NIH chemical probes.

  2009cited by this paper
• TU Delft expert judgment data base

  2008cited by this paper
• The Promise of Prediction Markets

  2008cited by this paper
• Infotopia: How Many Minds Produce Knowledge

  2006cited by this paper
• Infotopia: How Many Minds Produce Knowledge

  2006cited by this paper
• A Bayesian Truth Serum for Subjective Data

  2004cited by this paper
• Eliminating Public Knowledge Biases in Information-Aggregation Mechanisms

  2004cited by this paper
• Models of ecological rationality: the recognition heuristic.

  2002cited by this paper
• A decision-theoretic generalization of on-line learning and an application to boosting

  1997cited by this paper
• Experts in Uncertainty: Opinion and Subjective Probability in Science

  1991cited by this paper
• Test theory without an answer key

  1988cited by this paper
• Vox Populi

  year unknowncited by this paper

• Optimal linear aggregation of correlated expert judgments

  2026cites this paper
• Silence Routing: When Not Speaking Improves Collective Judgment

  2026cites this paper
• Jailbreaking LLMs via Calibration

  2026cites this paper
• Majority views and confidence information promote informed decisions

  2026cites this paper
• Dependence-Aware Label Aggregation for LLM-as-a-Judge via Ising Models

  2026cites this paper
• A large scale group decision making with expert guidance via discrete conditional variational autoencoder

  2025cites this paper
• Crowd Assessment of the Military Utility of Future Technologies

  2025cites this paper
• The Art of Two-Round Voting

  2025cites this paper
• Crowd Dynamics in Online Lending: Unveiling Indicators of Collective Insight

  2025cites this paper
• SP-Rank: A Dataset for Ranked Preferences with Secondary Information

  2025cites this paper
• Surprisingly Popular Voting with Concentric Rank-Order Models

  2025cites this paper
• Enhancing Collective Intelligence in Large Language Models Through Emotional Integration

  2025cites this paper
• An enhanced memetic algorithm for energy-efficient and low-carbon flexible job shop scheduling problem considering machine restart

  2025cites this paper
• Improved Jaya algorithm for energy-efficient distributed heterogeneous permutation flow shop scheduling

  2025cites this paper
• SelectMix: Enhancing Label Noise Robustness through Targeted Sample Mixing

  2025cites this paper
• Subjective-probability forecasts of existential risk: Initial results from a hybrid persuasion-forecasting tournament

  2025cites this paper
• The meta-aggregation approaches: Correctly choosing how to choose correctly in groups

  2025cites this paper
• Emergent numeracy: How the crowd wisdom of non-rounding survey respondents generates accurate immigration estimates

  2025cites this paper
• Beyond Majority Voting: LLM Aggregation by Leveraging Higher-Order Information

  2025influential citation
• Eliciting subjective real-valued beliefs

  2025cites this paper
• Paper Quality Assessment based on Individual Wisdom Metrics from Open Peer Review

  2025cites this paper
• Swarmter: A Crowd Wisdom based Collective Decision Making System for Decentralized Applications

  2025cites this paper
• Metaheuristics should be tested on large benchmark set with various numbers of function evaluations

  2025cites this paper
• A Social Choice Analysis of Optimism's Retroactive Project Funding

  2025cites this paper
• Optional disclosure and observational learning

  2025cites this paper
• A tale of two birds: cognitive simplicity drives collective route improvements in homing pigeons

  2025cites this paper
• Follow the money, not the majority: A mechanism predicting unresolvable events

  2025influential citation
• Surprisingly popular-based multivariate conceptual knowledge acquisition method

  2025cites this paper
• Participation in strategic foresight: feasibility of using nonexpert methods for megatrend assessment

  2025cites this paper
• An ensemble method utilising multiple thinking styles that boosts the wisdom-of-inner-crowd effect

  2025cites this paper
• A New Ensemble Strategy Based on Surprisingly Popular Algorithm and Classifier Prediction Confidence

  2025cites this paper
• Modeling the Collective Intelligence of Innovatively Integrated Enterprises

  2025cites this paper
• Strong Equilibria in Bayesian Games with Bounded Group Size

  2025cites this paper
• Crowds Improve Human Detection of AI‐Synthesised Faces

  2024cites this paper
• Robust recalibration of aggregate probability forecasts using meta-beliefs

  2024cites this paper
• Artificial intelligence‐based prediction of pathogen emergence and evolution in the world of synthetic biology

  2024cites this paper
• Mechanisms for Belief Elicitation Without Ground Truth

  2024cites this paper
• The Surprising Effectiveness of SP Voting with Partial Preferences

  2024influential citation
• Aggregation of Antagonistic Contingent Preferences: When Is It Possible?

  2024cites this paper
• Algorithmic Robust Forecast Aggregation

  2024cites this paper
• CRISP: A cross-modal integration framework based on the surprisingly popular algorithm for multimodal named entity recognition

  2024cites this paper
• Eliciting Informative Text Evaluations with Large Language Models

  2024cites this paper
• Using Cognitive Models to Improve the Wisdom of the Crowd

  2024cites this paper
• Peer Expectation in Robust Forecast Aggregation: The Possibility/Impossibility

  2024cites this paper
• Measuring probabilistic coherence to identify superior forecasters

  2024cites this paper
• Crowdsourcing the assessment of wine quality: Vivino ratings, professional critics, and the weather

  2024cites this paper
• Where’s Waldo, Ohio? Using Cognitive Models to Improve the Aggregation of Spatial Knowledge

  2024cites this paper
• Adaptive Crowdsourcing Via Self-Supervised Learning

  2024cites this paper
• Crowd-PrefRL: Preference-Based Reward Learning from Crowds

  2024cites this paper
• From CNNs to Transformers in Multimodal Human Action Recognition: A Survey

  2024cites this paper
• Face matching as a majority: Getting the best from a crowd

  2024cites this paper
• Messengers: breaking echo chambers in collective opinion dynamics with homophily

  2024cites this paper
• Leveraging Advice-taking and Kernel Density Estimation to Identify A Cluster of Experts and Improve Wisdom of Crowds

  2024cites this paper
• Evaluating Holistic Privacy Risk Posed by Smart Home Ecosystem: A Capability-Oriented Model Accommodating Epistemic Uncertainty and Wisdom of Crowds

  2024cites this paper
• k-Clustering with Comparison and Distance Oracles

  2024cites this paper
• Two-Stage Adaptive Memetic Algorithm with Surprisingly Popular Mechanism for Energy-Aware Distributed Hybrid Flow Shop Scheduling Problem with Sequence-Dependent Setup Time

  2024cites this paper
• A two-dimensional approach to flexibility degree of XOR numbers with application to group decision making

  2023cites this paper
• Surprisingly Popular-Based Adaptive Memetic Algorithm for Energy-Efficient Distributed Flexible Job Shop Scheduling

  2023influential citation
• Unsupervised classification for uncertain varying responses: The wisdom-in-the-crowd (WICRO) algorithm

  2023cites this paper
• Human and Algorithmic Predictions in Geopolitical Forecasting: Quantifying Uncertainty in Hard-to-Quantify Domains

  2023cites this paper
• Robust Decision Aggregation with Second-order Information

  2023influential citation
• Schools’ air quality monitoring for health and education: Methods and protocols of the SAMHE initiative and project

  2023cites this paper
• Machine learning augmentation reduces prediction error in collective forecasting: development and validation across prediction markets with application to COVID events

  2023cites this paper
• A normative model for Bayesian combination of subjective probability estimates

  2023cites this paper
• A Bayesian Hierarchical Model of Crowd Wisdom Based on Predicting Opinions of Others

  2023cites this paper
• Are ensembles getting better all the time?

  2023cites this paper
• What inclines us towards collective decisions

  2023cites this paper
• Improving geopolitical forecasts with 100 brains and one computer

  2023cites this paper
• Metawisdom of the Crowd: How Choice Within Aided Decision Making Can Make Crowd Wisdom Robust

  2023cites this paper
• Swarm Robots Search for Multiple Targets Based on Historical Optimal Weighting Grey Wolf Optimization

  2023cites this paper
• Frustratingly Easy Truth Discovery for Rank Aggregation 1

  2023cites this paper
• Group efficiency and individual fairness tradeoff in making wise decisions

  2023cites this paper
• Boosting the Wisdom of Crowds Within a Single Judgment Problem: Weighted Averaging Based on Peer Predictions

  2023cites this paper
• Wisdom of Crowds in Quantum Machine Learning

  2023cites this paper
• Can individual subjective confidence in training questions predict group performance in test questions?

  2023cites this paper
• Hidden Indicators of Collective Intelligence in Crowdfunding

  2023cites this paper
• The Wisdom of Strategic Voting

  2023cites this paper
• Testing the Social Function of Metacognition for Common-Pool Resource Use

  2023cites this paper
• Metawisdom of the Crowd: Experimental Evidence of Crowd Accuracy Through Diverse Choices of Decision Aids

  2023cites this paper
• Aggregating diverse evaluations in group decision making: An approach based on wisdom of crowds

  2023cites this paper
• Dominantly Truthful Peer Prediction Mechanisms with a Finite Number of Tasks

  2023cites this paper
• Calibrating "Cheap Signals" in Peer Review without a Prior

  2023influential citation
• On an effective and efficient method for exploiting the wisdom of the inner crowd

  2023cites this paper
• On the Truthfulness of Surprisingly Likely Responses of Large Language Models

  2023cites this paper
• I’m wearing a mask, but are they?: Perceptions of self-other differences in COVID-19 health behaviors

  2022cites this paper
• Predicting the future with humans and AI

  2022cites this paper
• Improving Judgments of Existential Risk: Better Forecasts, Questions, Explanations, Policies

  2022cites this paper
• Content-oriented or persona-oriented? A text analytics of endorsement strategies on public willingness to participate in citizen science

  2022cites this paper
• Can laypeople predict the replicability of social science studies without expert intervention: an exploratory study

  2022cites this paper
• Multi-winner Approval Voting Goes Epistemic

  2022cites this paper
• Surrogate Scoring Rules

  2022cites this paper
• We the swarm—Methodological, theoretical, and societal (r)evolutions in collective decision-making research

  2022cites this paper
• Cultural alignment of machine-vision representations

  2022cites this paper
• Adjudication with Rational Jurors

  2022cites this paper
• The Theoretical Analysis of Crowdsource Logistics Concept

  2022cites this paper
• Collective wisdom in polarized groups

  2022cites this paper
• Evaluating airline service quality through a comprehensive text-mining and multi-criteria decision-making analysis

  2022cites this paper
• Aggregation models in ensemble learning: A large-scale comparison

  2022cites this paper
• Peer Prediction for Learning Agents

  2022cites this paper
• The distribution of initial estimates moderates the effect of social influence on the wisdom of the crowd

  2022cites this paper