Goals and Habits in the Brain

An enduring and richly elaborated dichotomy in cognitive neuroscience is that of reflective versus reflexive decision making and choice. Other literatures refer to the two ends of what is likely to be a spectrum with terms such as goal-directed versus habitual, model-based versus model-free or prospective versus retrospective. One of the most rigorous traditions of experimental work in the field started with studies in rodents and graduated via human versions and enrichments of those experiments to a current state in which new paradigms are probing and challenging the very heart of the distinction. We review four generations of work in this tradition and provide pointers to the forefront of the field’s fifth generation.

• Publication year

  2013

• Venue

  Neuron

• Publication date

  2013-10-16

• Fields of study

  Medicine, Psychology

• Identifiers
  DOI 10.1016/j.neuron.2013.09.007PMID 24139036PMCID 3807793
• External record

  Open on Semantic Scholar

• Source metadata

  Semantic Scholar, PubMed

• No claims are published for this paper.

• No concepts are published for this paper.

• Heuristics And Biases The Psychology Of Intuitive Judgment

  2014cited by this paper
• Retrospective revaluation in sequential decision making: a tale of two systems.

  2014cited by this paper
• The Mixed Instrumental Controller: Using Value of Information to Combine Habitual Choice and Mental Simulation

  2013influential reference
• The Curse of Planning : Dissecting Multiple Reinforcement-Learning Systems by Taxing the Central Executive

  2013cited by this paper
• Hierarchical and binary associations compete for behavioral control during instrumental biconditional discrimination.

  2013cited by this paper
• arned Repulsion into Motivational ‘ ‘ Wanting ’ ’

  2013cited by this paper
• Evidence for Model-based Computations in the Human Amygdala during Pavlovian Conditioning

  2013cited by this paper
• The Curse of Planning

  2013cited by this paper
• Hippocampal place cell sequences depict future paths to remembered goals

  2013influential reference
• Disruption of Dorsolateral Prefrontal Cortex Decreases Model-Based in Favor of Model-free Control in Humans

  2013cited by this paper
• Using optogenetics to study habits.

  2013cited by this paper
• The ubiquity of model-based reinforcement learning.

  2012influential reference
• Bonsai Trees in Your Head: How the Pavlovian System Sculpts Goal-Directed Choices by Pruning Decision Trees

  2012cited by this paper
• Mapping value based planning and extensively trained choice in the human brain

  2012cited by this paper
• The future of memory: remembering, imagining, and the brain.

  2012cited by this paper
• Dopamine Enhances Model-Based over Model-Free Choice Behavior

  2012cited by this paper
• Goal-directed decision making as probabilistic inference: a computational framework and potential neural correlates.

  2012cited by this paper
• How to set the switches on this thing.

  2012cited by this paper
• Corticostriatal Connectivity Underlies Individual Differences in the Balance between Habitual and Goal-Directed Action Control

  2012cited by this paper
• Goal-oriented searching mediated by ventral hippocampus early in trial-and-error learning

  2012cited by this paper
• How much of reinforcement learning is working memory, not reinforcement learning? A behavioral, computational, and neurogenetic analysis

  2012cited by this paper
• Hierarchical reinforcement learning and decision making.

  2012cited by this paper
• Dopamine Receptor Blockade Attenuates the General Incentive Motivational Effects of Noncontingently Delivered Rewards and Reward-Paired Cues Without Affecting Their Ability to Bias Action Selection

  2012cited by this paper
• Action-Specific Value Signals in Reward-Related Regions of the Human Brain

  2012cited by this paper
• Mechanisms of hierarchical reinforcement learning in corticostriatal circuits 1: computational analysis.

  2012cited by this paper
• Using hippocampal-striatal loops for spatial navigation and goal-directed decision-making

  2012cited by this paper
• Signals in Human Striatum Are Appropriate for Policy Update Rather than Value Prediction

  2011cited by this paper
• Cortico‐basal ganglia mechanisms for overcoming innate, habitual and motivational behaviors

  2011cited by this paper
• Double Dissociation of Stimulus-Value and Action-Value Learning in Humans with Orbitofrontal or Anterior Cingulate Cortex Damage

  2011cited by this paper
• Neural Correlates of Forward Planning in a Spatial Decision Task in Humans

  2011influential reference
• Model-based influences on humans’ choices and striatal prediction errors

  2011cited by this paper
• An In Vivo Assay of Synaptic Function Mediating Human Cognition

  2011cited by this paper
• Speed/Accuracy Trade-Off between the Habitual and the Goal-Directed Processes

  2011cited by this paper
• Ventral Striatum and Orbitofrontal Cortex Are Both Required for Model-Based, But Not Model-Free, Reinforcement Learning

  2011cited by this paper
• Disruption in the Balance Between Goal-Directed Behavior and Habit Learning in Obsessive-Compulsive Disorder

  2011cited by this paper
• The Neural Basis of Following Advice

  2011cited by this paper
• Neural Correlates of Instrumental Contingency Learning: Differential Effects of Action–Reward Conjunction and Disjunction

  2011cited by this paper
• Dopaminergic Genes Predict Individual Differences in Susceptibility to Confirmation Bias

  2011cited by this paper
• Inverted-U-shaped dopamine actions on human working memory and cognitive control.

  2011cited by this paper
• Dopaminergic control of the striatum for high-level cognition.

  2011cited by this paper
• The Neurology of Value

  2011cited by this paper
• Habitual versus Goal-directed Action Control in Parkinson Disease

  2011cited by this paper
• Thinking, Fast and Slow

  2011cited by this paper
• Human and Rodent Homologies in Action Control: Corticostriatal Determinants of Goal-Directed and Habitual Action

  2010cited by this paper
• The Reward Circuit: Linking Primate Anatomy and Human Imaging

  2010cited by this paper
• Evidence for Model-Based Action Planning in a Sequential Finger Movement Task

  2010cited by this paper
• States versus rewards: dissociable neural prediction error signals underlying model-based and model-free reinforcement learning.

  2010influential reference
• Differential dynamics of activity changes in dorsolateral and dorsomedial striatal loops during learning.

  2010cited by this paper
• 2009 Special Issue: Goal-directed control and its antipodes

  2009cited by this paper
• Dynamic reorganization of striatal circuits during the acquisition and consolidation of a skill

  2009cited by this paper
• Disruption of endogenous opioid activity during instrumental learning enhances habit acquisition.

  2009cited by this paper
• A specific role for posterior dorsolateral striatum in human habit learning

  2009cited by this paper
• Reinforcement learning, conditioning, and the brain: Successes and challenges

  2009cited by this paper
• Instructional control of reinforcement learning: a behavioral and neurocomputational investigation.

  2009influential reference
• Parallel and interactive learning processes within the basal ganglia: relevance for the understanding of addiction.

  2009cited by this paper
• Reinforcement learning in the brain

  2009cited by this paper
• Faculty Opinions recommendation of Review. Neural mechanisms underlying the vulnerability to develop compulsive drug-seeking habits and addiction.

  2008cited by this paper
• The neural bases of obsessive–compulsive disorder in children and adults

  2008cited by this paper
• Habits, rituals, and the evaluative brain.

  2008influential reference
• Spatial Cognition and the Brain

  2008cited by this paper
• Neural mechanisms underlying the vulnerability to develop compulsive drug-seeking habits and addiction

  2008cited by this paper
• A framework for studying the neurobiology of value-based decision making

  2008cited by this paper
• Sample-based learning and search with permanent and transient memories

  2008cited by this paper
• Decision theory, reinforcement learning, and the brain

  2008cited by this paper
• Calculating Consequences: Brain Systems That Encode the Causal Effects of Actions

  2008cited by this paper
• Bidirectional modulation of goal-directed actions by prefrontal cortical dopamine.

  2007cited by this paper
• Determining the Neural Substrates of Goal-Directed Learning in the Human Brain

  2007cited by this paper
• Patients with hippocampal amnesia cannot imagine new experiences

  2007cited by this paper
• Neural Ensembles in CA3 Transiently Encode Paths Forward of the Animal at a Decision Point

  2007influential reference
• Hippocampal Contributions to Control: The Third Way

  2007cited by this paper
• Remembering the past to imagine the future: the prospective brain

  2007cited by this paper
• Tonic dopamine: opportunity costs and the control of response vigor

  2007cited by this paper
• Hippocampal theta sequences

  2007cited by this paper
• Anterior Prefrontal Function and the Limits of Human Decision-Making

  2007cited by this paper
• Heterarchical reinforcement-learning model for integration of multiple cortico-striatal loops: fMRI examination in stimulus-action-reward association learning

  2006cited by this paper
• The misbehavior of value and the discipline of the will

  2006cited by this paper
• The role of the basal ganglia in habit formation

  2006cited by this paper
• Neurons in the orbitofrontal cortex encode economic value

  2006cited by this paper
• Temporal encoding of place sequences by hippocampal cell assemblies.

  2006cited by this paper
• The Role of the Ventromedial Prefrontal Cortex in Abstract State-Based Inference during Decision Making in Humans

  2006cited by this paper
• Making Working Memory Work: A Computational Model of Learning in the Prefrontal Cortex and Basal Ganglia

  2006cited by this paper
• Reverse replay of behavioural sequences in hippocampal place cells during the awake state

  2006cited by this paper
• Cortical substrates for exploratory decisions in humans

  2006influential reference
• Neural bases of food-seeking: affect, arousal and reward in corticostriatolimbic circuits.

  2005influential reference
• Lesion to the Nigrostriatal Dopamine System Disrupts Stimulus-Response Habit Formation

  2005cited by this paper
• The role of the dorsomedial striatum in instrumental conditioning

  2005cited by this paper
• Lesions of Medial Prefrontal Cortex Disrupt the Acquisition But Not the Expression of Goal-Directed Learning

  2005cited by this paper
• Dynamic Dopamine Modulation in the Basal Ganglia: A Neurocomputational Account of Cognitive Deficits in Medicated and Nonmedicated Parkinsonism

  2005cited by this paper
• Double Dissociation of Basolateral and Central Amygdala Lesions on the General and Outcome-Specific Forms of Pavlovian-Instrumental Transfer

  2005cited by this paper
• Actions , Policies , Values , and the Basal Ganglia

  2005cited by this paper
• Associative Learning, and Expectancies

  2005cited by this paper
• Uncertainty-based competition between prefrontal and dorsolateral striatal systems for behavioral control

  2005influential reference
• 2005 Special issue: Hippocampal replay contributes to within session learning in a temporal difference reinforcement learning model

  2005cited by this paper
• Differential projections of the infralimbic and prelimbic cortex in the rat

  2004cited by this paper
• Human orbitofrontal cortex mediates extinction learning while accessing conditioned representations of value

  2004cited by this paper
• Relations between Pavlovian-instrumental transfer and reinforcer devaluation.

  2004influential reference
• A Neural Correlate of Reward-Based Behavioral Learning in Caudate Nucleus: A Functional Magnetic Resonance Imaging Study of a Stochastic Decision Task

  2004influential reference
• Reward representations and reward-related learning in the human brain: insights from neuroimaging.

  2004cited by this paper
• By Carrot or by Stick: Cognitive Reinforcement Learning in Parkinsonism

  2004cited by this paper
• The orbitofrontal cortex: Neuronal activity in the behaving monkey

  2004cited by this paper

• Probing the causal contribution of premotor and parietal cortex in habit formation and expression.

  2026cites this paper
• Dopamine ramps as a normative consequence of dual-process control

  2026cites this paper
• Efficient Learning of Predictive Maps for Flexible Planning

  2026cites this paper
• Joint Training Across Multiple Activation Sparsity Regimes

  2026cites this paper
• Novel devaluation methods to explore habits in humans

  2026cites this paper
• Invasive brain-computer interface applications: Decoding and modulation of memory

  2026cites this paper
• Fentanyl reinforcement history has sex-specific effects on multi-step decision-making.

  2026cites this paper
• The Physiology Of the WEight Reduced State (POWERS) study: design and rationale for assessment of food intake, physical activity and other behavioral constructs.

  2026cites this paper
• Evolution of behavioral flexibility and the forming and breaking of habits

  2026cites this paper
• Adaptive integration of model-based and model-free strategies in human reinforcement learning of reachable space

  2026cites this paper
• Hedonic Foraging: From Reward to Action

  2026cites this paper
• Body-Reservoir Governance in Repeated Games: Embodied Decision-Making, Dynamic Sentinel Adaptation, and Complexity-Regularized Optimization

  2026influential citation
• Comparative effects of inactivation and dopamine receptor agents in the dorsolateral and dorsomedial striatum on performance of action sequences in rats

  2026cites this paper
• Distributed activity in the human posterior putamen distinguishes goal-directed from habitual control

  2025cites this paper
• Critical intelligence: computing defensive behaviour.

  2025cites this paper
• Direct and indirect striatal projecting neurons exert strategy-dependent effects on decision-making

  2025cites this paper
• Studying human habit formation through motor sequence learning

  2025cites this paper
• Children's sensitivity to automatic behavior relates to pedagogical reasoning and Theory of Mind

  2025cites this paper
• Prediction of U.S. daily mask wearing and social distancing using psychologically valid agents during three waves of COVID-19

  2025cites this paper
• Structuring the environment nudges participants toward hierarchical over shortest path planning.

  2025cites this paper
• Shared sensitivity to data distribution during learning in humans and transformer networks.

  2025cites this paper
• Model-based planning is unaffected by ketamine, antidepressant and internet delivered cognitive behavioural therapy treatments in depression

  2025cites this paper
• Higher-order and distributed synergistic functional interactions encode information gain in goal-directed learning

  2025cites this paper
• Biased Competition between Action Representations.

  2025cites this paper
• Human goal-directed behavior is resistant to interventions on the action-outcome contingency

  2025cites this paper
• Interaction between Model-based and Model-free Mechanisms in Motor Learning

  2025cites this paper
• Atypical contributions of reward decisions to momentary mood in individuals with methamphetamine use disorder

  2025cites this paper
• Children leverage predictive representations for flexible, value-guided choice.

  2025cites this paper
• The role of psychological distress in understanding the relationship between habitual decision-making and addictive behaviors.

  2025cites this paper
• Agentic AI Needs a Systems Theory

  2025cites this paper
• Increasing the smoking cessation success rate by enhancing improvement of self-control through sleep-amplified memory consolidation: protocol of a randomized controlled, functional magnetic resonance study

  2025cites this paper
• Reinforcement Learning and Decision Making in Anorexia Nervosa

  2025cites this paper
• Evolving learning state reactivation and value encoding neural dynamics in multi-step planning

  2025cites this paper
• Are the principles of Pavlovian conditioning in insects conserved with those in mammals?

  2025cites this paper
• Exploring System 1 and 2 communication for latent reasoning in LLMs

  2025cites this paper
• Teaching Mathematics in Early Childhood Classrooms: From Beginning to End

  2025cites this paper
• Avoidance habit learning in adolescents and young women with anorexia nervosa: an fMRI study

  2025cites this paper
• Improving the adaptive and continuous learning capabilities of artificial neural networks: Lessons from multi-neuromodulatory dynamics

  2025cites this paper
• Habitizing Diffusion Planning for Efficient and Effective Decision Making

  2025cites this paper
• Reward signals in the motor cortex: from biology to neurotechnology

  2025cites this paper
• Single-unit activity in the anterior claustrum during memory retrieval after trace fear conditioning

  2025cites this paper
• The distinct functions of working memory and intelligence in model-based and model-free reinforcement learning

  2025cites this paper
• Decision-making between biases and strategies

  2025cites this paper
• Assessing the validity evidence for habit measures based on time pressure

  2025cites this paper
• Environmental dynamics shape human learning: change points versus random walks

  2025cites this paper
• NMDA receptor ablation in medial prefrontal cortex disrupts value updating and reward history integration

  2025cites this paper
• Frontostriatal dynamics of cognitive control

  2025cites this paper
• Addressing Altered Anticipation as a Transdiagnostic Target through Computational Psychiatry.

  2025cites this paper
• Prefrontal meta-control incorporating mental simulation enhances the adaptivity of reinforcement learning agents in dynamic environments

  2025cites this paper
• Erasing “bad memories”: reversing aberrant synaptic plasticity as therapy for neurological and psychiatric disorders

  2025cites this paper
• Reinforcement learning at the interface of artificial intelligence and cognitive science.

  2025cites this paper
• Trust in AI is dynamically updated based on users' expectations

  2025cites this paper
• A New Methodological Approach Integrating Motion Capture and Pressure-Sensitive Gait Data to Assess Functional Mobility in Parkinson’s Disease: A Two-Phase Study

  2025cites this paper
• Time Alters Distinct Memories Driven by Sensory Prediction Errors and Task Errors in Sensorimotor Adaptation

  2025cites this paper
• Cognitive computational model reveals repetition bias in a sequential decision-making task

  2025cites this paper
• Differences in resting state functional connectivity in striatal and frontal networks associated with task-behaviour elicited by gamified two-stage decision task.

  2025cites this paper
• Dissociable habits of response preparation versus response initiation

  2025cites this paper
• Dorsal-Ventral Reinforcement Learning Network Connectivity and Incentive-Driven Changes in Exploration

  2025cites this paper
• Consolidation of a recurrent choice pattern into a fixed action schema requires the orbitofrontal cortex

  2025cites this paper
• Similar failures of consideration arise in human and machine planning.

  2025cites this paper
• Striatal cell-type specific stability and reorganization underlying agency and habit

  2025cites this paper
• Experience-Dependent Neuroplasticity in the Hippocampus of Bilingual Young Adults

  2025cites this paper
• Brain-Like Processing Pathways Form in Models With Heterogeneous Experts

  2025cites this paper
• Motivational control of habits: A preregistered fMRI study

  2025cites this paper
• Active inference and cognitive control: Balancing deliberation and habits through precision optimization.

  2025cites this paper
• Touchscreen Response Precision Is Sensitive to the Explore/Exploit Trade-off

  2025cites this paper
• Misalignment or misuse? The AGI alignment tradeoff

  2025cites this paper
• Fentanyl reinforcement history has sex-specific effects on multi-step decision-making

  2025cites this paper
• Are ambient smart environments sufficient for developing good habits?

  2025cites this paper
• Looking deeper into the algorithms underlying human planning.

  2025cites this paper
• Cost-benefit tradeoff mediates the transition from rule-based to memory-based processing during practice

  2025cites this paper
• Behavioral inflexibility through overtraining is mediated by reduced mGluR1/5 signaling capacity in the dorsolateral striatum

  2025cites this paper
• Striatal pathways oppositely shift cortical activity along the decision axis

  2025cites this paper
• Learning from outcomes shapes reliance on moral rules versus cost–benefit reasoning

  2025cites this paper
• Can cognitive discovery be incentivized with money?

  2025cites this paper
• Model-based and model-free valuation signals in the human brain vary markedly in their relationship to individual differences in behavioral control

  2025cites this paper
• Impaired arbitration between reward-related decision-making strategies in Alcohol Users compared to Alcohol Non-Users: a computational modeling study

  2025cites this paper
• Maturation of striatal dopamine supports the development of habitual behavior through adolescence

  2025cites this paper
• Exploring the link between anticipatory outcome encoding in the brain and goal-directed behavior during outcome devaluation

  2025cites this paper
• Signatures of Perseveration and Heuristic-Based Directed Exploration in Two-Step Sequential Decision Task Behaviour

  2025cites this paper
• Study Protocol for ‘PsilOCD: A Pharmacological Challenge Study Evaluating the Effects of the 5-HT2A Agonist Psilocybin on the Neurocognitive and Clinical Correlates of Compulsivity’

  2025cites this paper
• Proactive and reactive construction of memory-based preferences

  2025cites this paper
• Neural Mechanisms of Organism-Dependent Affordances: The XPLR-XPLT Movement Spectrum

  2025cites this paper
• Interacting corticobasal ganglia-thalamocortical loops shape behavioral control through cognitive maps and shortcuts.

  2025cites this paper
• When models matter: Environmental demand guides the arbitration between model-based and model-free control

  2025cites this paper
• Thalamic regulation of reinforcement learning strategies across prefrontal-striatal networks

  2025cites this paper
• Reasoning on a Spectrum: Aligning LLMs to System 1 and System 2 Thinking

  2025cites this paper
• Pavlovian bias instigates suboptimal choices in humans.

  2025cites this paper
• Could the Contraceptive Pill Pose a Risk to Brain Development in Young Girls?

  2025cites this paper
• Cognitive Foundations for Reasoning and Their Manifestation in LLMs

  2025cites this paper
• Forward Planning in a Population‐Based Alcohol Use Disorder Sample

  2025cites this paper
• Aberrant neural computation of social controllability in nicotine-dependent humans

  2024cites this paper
• Adaptive planning depth in human problem-solving

  2024cites this paper
• Model-free decision-making underlies motor errors in rapid sequential movements under threat

  2024cites this paper
• The consequences of AI training on human decision-making

  2024cites this paper
• Disorders of compulsivity: Deficits in arbitrating learning strategies

  2024cites this paper
• Use of the non-paretic arm reflects a habitual behaviour in chronic stroke

  2024cites this paper
• Framing affects postdecision preferences through self-preference inferences (and probably not dissonance).

  2024cites this paper
• Bad habits–good goals? Meta-analysis and translation of the habit construct to alcoholism

  2024cites this paper
• Single-Trial Representations of Decision-Related Variables by Decomposed Frontal Corticostriatal Ensemble Activity

  2024cites this paper