Should I stay or should I go? How the human brain manages the trade-off between exploitation and exploration

No abstract is available for this paper.

• Publication year

  2007

• Venue

  Philosophical Transactions of the Royal Society B: Biological Sciences

• Publication date

  2007-05-29

• Fields of study

  Medicine, Computer Science, Psychology

• Identifiers
  DOI 10.1098/rstb.2007.2098PMID 17395573PMCID PMC2430007
• External record

  Open on Semantic Scholar

• Source metadata

  Semantic Scholar, PubMed

• No claims are published for this paper.

• No concepts are published for this paper.

• Collective Motion, Sensor Networks, and Ocean Sampling

  2007cited by this paper
• A tunable algorithm for collective decision-making

  2006cited by this paper
• Cortical substrates for exploratory decisions in humans

  2006influential reference
• Neurons in the orbitofrontal cortex encode economic value

  2006cited by this paper
• Imaging valuation models in human choice.

  2006cited by this paper
• Simple Neural Networks that Optimize Decisions

  2005cited by this paper
• New approaches to investigating the function of mycelial networks

  2005cited by this paper
• Uncertainty, neuromodulation, and attention.

  2005influential reference
• An exploration-exploitation model based on norepinepherine and dopamine activity

  2005cited by this paper
• An integrative theory of locus coeruleus-norepinephrine function: adaptive gain and optimal performance.

  2005influential reference
• Separate Neural Systems Value Immediate and Delayed Monetary Rewards

  2004influential reference
• The neural basis of error detection: conflict monitoring and the error-related negativity.

  2004cited by this paper
• Matching Behavior and the Representation of Value in the Parietal Cortex

  2004cited by this paper
• Computational roles for dopamine in behavioural control

  2004cited by this paper
• Anterior Cingulate Conflict Monitoring and Adjustments in Control

  2004cited by this paper
• A region of mesial prefrontal cortex tracks monetarily rewarding outcomes: characterization with rapid event-related fMRI

  2003cited by this paper
• A computational substrate for incentive salience.

  2003cited by this paper
• The neural basis of human error processing: reinforcement learning, dopamine, and the error-related negativity.

  2002cited by this paper
• An integrative theory of prefrontal cortex function.

  2001cited by this paper
• Conflict monitoring and cognitive control.

  2001cited by this paper
• Abstract reward and punishment representations in the human orbitofrontal cortex

  2001cited by this paper
• Functional imaging of brain responses to pain. A review and meta-analysis (2000).

  2000cited by this paper
• Parsing executive processes: strategic vs. evaluative functions of the anterior cingulate cortex.

  2000cited by this paper
• Taking time seriously. A theory of socioemotional selectivity.

  1999cited by this paper
• The role of locus coeruleus in the regulation of cognitive performance.

  1999influential reference
• Anterior cingulate cortex, error detection, and the online monitoring of performance.

  1998cited by this paper
• Reinforcement Learning: An Introduction

  1998cited by this paper
• A Neural Substrate of Prediction and Reward

  1997cited by this paper
• Conditioned responses of monkey locus coeruleus neurons anticipate acquisition of discriminative behavior in a vigilance task.

  1997cited by this paper
• Event-Related Brain Potentials Following Incorrect Feedback in a Time-Estimation Task: Evidence for a Generic Neural System for Error Detection

  1997cited by this paper
• A framework for mesencephalic dopamine systems based on predictive Hebbian learning

  1996cited by this paper
• Reinforcement Learning: A Survey

  1996cited by this paper
• Costs of a predictible switch between simple cognitive tasks.

  1995cited by this paper
• Locus coeruleus neurons in monkey are selectively activated by attended cues in a vigilance task

  1994cited by this paper
• Switching Costs and the Gittins Index

  1994cited by this paper
• SHIFTING INTENTIONAL SET - EXPLORING THE DYNAMIC CONTROL OF TASKS

  1994cited by this paper
• Learning in embedded systems

  1993cited by this paper
• Handbook of Intelligent Control: Neural, Fuzzy, and Adaptive Approaches

  1992cited by this paper
• THE ROLE OF EXPLORATION IN LEARNING CONTROL

  1992cited by this paper
• Optimizing the use of information: strategic control of activation of responses.

  1992influential reference
• Bandit Problems, Sequential Allocation of Experiments

  1987cited by this paper
• Attention and the detection of signals.

  1980cited by this paper
• Bandit processes and dynamic allocation indices

  1979influential reference
• The role of the locus coeruleus

  1979influential reference
• Choice reaction performance following an error

  1979influential reference
• Autocorrelation of choice-reaction times.

  1979cited by this paper
• Test of optimal sampling by foraging great tits

  1978influential reference
• Specious reward: a behavioral theory of impulsiveness and impulse control.

  1975cited by this paper
• Human Problem Solving.

  1973cited by this paper
• Errors and error correction in choice-response tasks.

  1966influential reference

• SMaRT: Understanding responses to inconsistency using sense motivation and response theory.

  2026cites this paper
• Individual Differences in Dopaminergic Modulation of Exploration-Exploitation Behaviour

  2026cites this paper
• Circadian Modulation of Semantic Exploration in Social Media Language

  2026cites this paper
• An evolutionary-developmental perspective on the relationship between childhood unpredictability and intellectual humility

  2026cites this paper
• An “Aha!” moment precedes the strategic response to a visuomotor rotation

  2026cites this paper
• Creative foraging and the explore-exploit trade-off in knowledge networks.

  2026cites this paper
• Exploring Users’ Dissatisfaction with Video Streaming Service Content Recommendation Algorithms and Their Coping Behaviors

  2026cites this paper
• Simulation-based inference with deep learning suggests speed climbers combine innovation and copying to improve performance.

  2026cites this paper
• The Complex Card Matching Task (CCMT): A PsychoPy-Based Task for Studying the Exploration-Exploitation Trade-Off

  2026cites this paper
• Raccoons optimally forage for information: exploration–exploitation trade-offs in innovation

  2026cites this paper
• The road not taken: selective sampling and persisting inaccurate impressions

  2026cites this paper
• Baseline activity of V1 interneurons connects pupil-linked arousal to engaged behavioral state

  2026cites this paper
• Exploration vs. Exploitation in a Novel Complex Card Matching Task: Evidence from Pupillometry.

  2026cites this paper
• Deep Chain-of-Preference: A Novel Deep Learning Method for Mixed-Grained Recommendation

  2025cites this paper
• Dissociable Effects of Curiosity and Hedonic Valence on Reinforcement Learning

  2025cites this paper
• Life History and Child Development

  2025cites this paper
• Cross-frequency routing in a hippocampo–cortical circuit during probabilistic reversal learning

  2025cites this paper
• Against Radical Epistemic Environmentalism (Or Why Uncritically Deferring to Authority is Still Irrational)

  2025cites this paper
• Expectation violation enhances short-term source memory

  2025cites this paper
• Empowerment Gain and Causal Model Construction: Children and adults are sensitive to controllability and variability in their causal interventions

  2025cites this paper
• Model-based planning in structured foraging environments.

  2025cites this paper
• Switching, fast and slow: Deciphering the dynamics of memory search, its brain connectivity patterns, and its role in creativity

  2025cites this paper
• Success-efficient/failure-safe strategy for hierarchical reinforcement motor learning

  2025cites this paper
• LLMs and Compound AI Systems - Exploring Potential Applications in Real-World Scenarios

  2025cites this paper
• Reward monitoring in the frontopolar cortex of macaques

  2025cites this paper
• Comparing Exploration-Exploitation Strategies of LLMs and Humans: Insights from Standard Multi-armed Bandit Tasks

  2025cites this paper
• Resourceful by design: archetypal strategies in startup resource management

  2025cites this paper
• Economic and physical risk-taking in 7- to 9-year-olds: The link with a novelty-driven exploratory strategy

  2025cites this paper
• Structured human-LLM interaction design reveals exploration and exploitation dynamics in higher education content generation

  2025cites this paper
• When to keep trying and when to let go: Benchmarking optimal quitting.

  2025cites this paper
• No effect of preliminarily simulated cathodal HD-tDCS on the frontopolar cortex in the exploration-exploitation task

  2025cites this paper
• Modeling value integration during decision making under uncertainty with the Florida and Georgia gambling task

  2025cites this paper
• Stochastic choice drives variability in patch foraging decisions across species

  2025cites this paper
• Fluctuations in Sequential Many-Alternative Decisions Reveal Strategies Beyond Immediate Reward Maximisation

  2025cites this paper
• Understanding the interplay of entrepreneurial orientation behaviors – does it hinder or facilitate creating new venture ideas by nascent entrepreneurial teams?

  2025cites this paper
• Human regulatory systems in the age of abundance: A predictive processing perspective

  2025cites this paper
• Comparing Exploration-Exploitation Strategies of LLMs and Humans: Insights from Standard Multi-armed Bandit Experiments

  2025cites this paper
• When to stop social learning from a predecessor in an information-foraging task

  2025cites this paper
• Human-Guided Artificial Intelligence (HGAI), a Framework for Overcoming AI's Blind Spots

  2025cites this paper
• SmartSwitch: Advancing LLM Reasoning by Overcoming Underthinking via Promoting Deeper Thought Exploration

  2025cites this paper
• Perceptual predictions track subjective, over objective, statistical structure

  2025cites this paper
• Pavlovian bias instigates suboptimal choices in humans.

  2025cites this paper
• Temporal–orbitofrontal pathway regulates choices across physical reward and visual novelty

  2025cites this paper
• Continuous theta burst stimulation to the medial posterior cerebellum impairs reversal learning in healthy volunteers

  2025cites this paper
• Spatial navigation strategy in older adults: Preference or ability?

  2025cites this paper
• The evolution of human-type consciousness – a by-product of mammalian innovation mechanism – a preliminary hypothesis

  2025cites this paper
• Gain modulation of probabilistic selection without synaptic relearning

  2025cites this paper
• How cortico-basal ganglia-thalamic subnetworks can shift decision policies to increase reward rate

  2025cites this paper
• The explore-exploit trade-off in sports and exercise: a primer on empirical and computational approaches.

  2025cites this paper
• Decision-making trades off learned and perceived information

  2025cites this paper
• Different exploration strategies along the autism spectrum: diverging effects of autism diagnosis and autism traits

  2025cites this paper
• "Flexible Trade-Off": Social Participation Change Model among Middle-Aged and Older Stroke Survivors: A Grounded Theory Study.

  2025cites this paper
• The neural basis for uncertainty processing in hierarchical decision making

  2025cites this paper
• Dopamine drives a positive reward bias on human reinforcement learning

  2025cites this paper
• Interaction-Driven Browsing: A Human-in-the-Loop Conceptual Framework Informed by Human Web Browsing for Browser-Using Agents

  2025cites this paper
• How the brain's amygdala reacts when making decisions to avoid losses.

  2025cites this paper
• Novelty as a drive of human exploration in complex stochastic environments

  2025cites this paper
• Dynamical alignment: a principle for adaptive neural computation

  2025cites this paper
• A review on exploration–exploitation trade-off in psychiatric disorders

  2025influential citation
• Accelerated experimental design using a human-AI teaming framework

  2025cites this paper
• Learn from your competitor or cooperator? A hyperscanning functional near-infrared spectroscopy study of gender-specific neural dynamics during interactive learning.

  2025cites this paper
• Exploring rodent prosociality: A conceptual framework

  2025cites this paper
• Identification of conserved frontal neurophysiological markers of cognitive flexibility in humans and rats

  2025cites this paper
• Individual differences in policy precision: Links to suicidal risk and network dynamics

  2025cites this paper
• Gearshift Fellowship: A Next-Generation Neurocomputational Game Platform to Model and Train Human-AI Adaptability

  2025cites this paper
• Stock Boundary Behavior

  2025cites this paper
• Higher-order and distributed synergistic functional interactions encode information gain in goal-directed learning

  2025cites this paper
• Rate and noise in human amygdala drive increased exploration in aversive learning

  2025cites this paper
• Impact of virtual landmarks on children’s navigation preferences

  2025cites this paper
• Individual Differences in Policy Precision: Links to Suicidal Ideation and Network Dynamics

  2025cites this paper
• Prospective and retrospective representations of saccadic movements in primate prefrontal cortex.

  2025cites this paper
• Gaze dynamics during natural scene memorization and recognition

  2025cites this paper
• Grounding computational cognitive models.

  2025cites this paper
• Building a developmental science of redemption

  2025cites this paper
• DEEP: A model of gaming preferences informed by the hierarchical nature of goal-oriented cognition

  2025cites this paper
• Home cage-based insights into motor learning and strategy adaptation in a Huntington disease mouse model

  2025cites this paper
• Chimpanzees adapt their exploration to key properties of the environment

  2025cites this paper
• Turning Task-Adjusted Temporary Newcomers into Permanent Employees: An Identity Perspective

  2025cites this paper
• Self-guided transitions and creative idea search: adaptively choosing flexibility versus persistence in divergent and convergent thinking tasks

  2025cites this paper
• Observational learning of exploration-exploitation strategies in bandit tasks.

  2025influential citation
• Preferences, goals and implications for paternalism

  2025cites this paper
• EESB-FDO: enhancing the fitness-dependent optimizer through a modified boundary handling mechanism

  2025cites this paper
• How the dynamic interplay of cortico-basal ganglia-thalamic pathways shapes the time course of deliberation and commitment

  2025cites this paper
• Differential functional connectivity between hippocampus and prefrontal cortex is associated with heterogeneity in open field exploration

  2025cites this paper
• Gaze reinstatement during working memory for natural scenes

  2025cites this paper
• Contextual influences on risk-taking in children and adults

  2025cites this paper
• Catecholamine Precursor Modulation of Human Exploration: Evidence From a Large Gender-Balanced Sample

  2025cites this paper
• Origins and consequences of cognitive fatigue.

  2025cites this paper
• Structured navigation emerges from self-guided spatial learning in freely moving common marmosets

  2025cites this paper
• Trade-off between search costs and accuracy in oculomotor and manual search tasks.

  2025cites this paper
• Test-retest reliability of computational parameters versus manifest behavior for decisional flexibility in psychosis.

  2025influential citation
• Individual differences in sequential decision-making

  2025cites this paper
• Cooperative Dilemmas in Rational Debate

  2025cites this paper
• Distributional dual-process model predicts strategic shifts in decision-making under uncertainty

  2025cites this paper
• Human Rationality.

  2025cites this paper
• Questions Should Have Answers

  2025cites this paper
• Oscillations of the Wandering Mind: Neural Evidence for Distinct Exploration/Exploitation Strategies in Younger and Older Adults

  2025cites this paper
• Exploration is associated with socioeconomic disparities in learning and academic achievement in adolescence

  2025cites this paper
• Many roads to minimizing regret: A comparison of Wang et al (2024) and OpAL* models of adaptive striatal dopamine

  2025cites this paper
• Vagus nerve stimulation during training fails to improve learning in healthy rats

  2024cites this paper