Action Dominates Valence in Anticipatory Representations in the Human Striatum and Dopaminergic Midbrain

The acquisition of reward and the avoidance of punishment could logically be contingent on either emitting or withholding particular actions. However, the separate pathways in the striatum for go and no-go appear to violate this independence, instead coupling affect and effect. Respect for this interdependence has biased many studies of reward and punishment, so potential action–outcome valence interactions during anticipatory phases remain unexplored. In a functional magnetic resonance imaging study with healthy human volunteers, we manipulated subjects' requirement to emit or withhold an action independent from subsequent receipt of reward or avoidance of punishment. During anticipation, in the striatum and a lateral region within the substantia nigra/ventral tegmental area (SN/VTA), action representations dominated over valence representations. Moreover, we did not observe any representation associated with different state values through accumulation of outcomes, challenging a conventional and dominant association between these areas and state value representations. In contrast, a more medial sector of the SN/VTA responded preferentially to valence, with opposite signs depending on whether action was anticipated to be emitted or withheld. This dominant influence of action requires an enriched notion of opponency between reward and punishment.

• Publication year

  2011

• Venue

  Journal of Neuroscience

• Publication date

  2011-05-25

• Fields of study

  Medicine, Psychology

• Identifiers
  DOI 10.1523/JNEUROSCI.6376-10.2011PMID 21613500PMCID PMC3109549
• External record

  Open on Semantic Scholar

• Source metadata

  Semantic Scholar, PubMed

• No claims are published for this paper.

• No concepts are published for this paper.

• Serotonin and Dopamine: Unifying Affective, Activational, and Decision Functions

  2011cited by this paper
• Requirement of dopamine signaling in the amygdala and striatum for learning and maintenance of a conditioned avoidance response.

  2011cited by this paper
• Two-factor theory, the actor-critic model, and conditioned avoidance

  2010cited by this paper
• The Reward Circuit: Linking Primate Anatomy and Human Imaging

  2010influential reference
• Region of interest analysis using an SPM toolbox

  2010influential reference
• Contextual Novelty Changes Reward Representations in the Striatum

  2010cited by this paper
• Opponency Revisited: Competition and Cooperation Between Dopamine and Serotonin

  2010cited by this paper
• Reconciling the Role of Serotonin in Behavioral Inhibition and Aversion: Acute Tryptophan Depletion Abolishes Punishment-Induced Inhibition in Humans

  2009cited by this paper
• Phasic excitation of dopamine neurons in ventral VTA by noxious stimuli

  2009cited by this paper
• Functional imaging of the human dopaminergic midbrain.

  2009influential reference
• Evaluation of 14 nonlinear deformation algorithms applied to human brain MRI registration

  2009cited by this paper
• Serotonin in affective control.

  2009cited by this paper
• Two types of dopamine neuron distinctly convey positive and negative motivational signals

  2009cited by this paper
• Valence and salience contribute to nucleus accumbens activation

  2008cited by this paper
• A temporal difference account of avoidance learning

  2008cited by this paper
• Mesolimbic Dopamine in Desire and Dread: Enabling Motivation to Be Generated by Localized Glutamate Disruptions in Nucleus Accumbens

  2008cited by this paper
• Unique properties of mesoprefrontal neurons within a dual mesocorticolimbic dopamine system.

  2008cited by this paper
• BOLD Responses Reflecting Dopaminergic Signals in the Human Ventral Tegmental Area

  2008cited by this paper
• The role of the striatum in aversive learning and aversive prediction errors

  2008cited by this paper
• Tonic dopamine: opportunity costs and the control of response vigor

  2007influential reference
• Different neural systems adjust motor behavior in response to reward and punishment

  2007cited by this paper
• Cortical and Subcortical Contributions to Stop Signal Response Inhibition: Role of the Subthalamic Nucleus

  2006influential reference
• Absolute coding of stimulus novelty in the human substantia nigra/VTA.

  2006cited by this paper
• Cortical substrates for exploratory decisions in humans

  2006cited by this paper
• Optimal EPI parameters for reduction of susceptibility-induced BOLD sensitivity losses: A whole-brain analysis at 3 T and 1.5 T

  2006cited by this paper
• Distributed Neural Representation of Expected Value

  2005influential reference
• Pavlovian conditioning: a functional perspective.

  2005cited by this paper
• Midbrain dopamine neurons encode a quantitative reward prediction error signal.

  2005cited by this paper
• Beyond the reward hypothesis: alternative functions of nucleus accumbens dopamine.

  2005cited by this paper
• Opponent appetitive-aversive neural processes underlie predictive learning of pain relief

  2005cited by this paper
• Human striatal responses to monetary reward depend on saliency.

  2004cited by this paper
• Temporal difference models describe higher-order learning in humans

  2004influential reference
• By Carrot or by Stick: Cognitive Reinforcement Learning in Parkinsonism

  2004cited by this paper
• Increased extracellular dopamine in nucleus accumbens in response to unconditioned and conditioned aversive stimuli: studies using 1 min microdialysis in rats.

  2004cited by this paper
• Motivation-dependent responses in the human caudate nucleus.

  2004cited by this paper
• Dissociable Roles of Ventral and Dorsal Striatum in Instrumental Conditioning

  2004cited by this paper
• Reward representations and reward-related learning in the human brain: insights from neuroimaging.

  2004cited by this paper
• Modulation of caudate activity by action contingency.

  2004influential reference
• Instrumental responding for rewards is associated with enhanced neuronal response in subcortical reward systems

  2004cited by this paper
• Temporal difference models and reward-related learning in the human brain.

  2003cited by this paper
• Dorsal striatum responses to reward and punishment: Effects of valence and magnitude manipulations

  2003cited by this paper
• Right inferior prefrontal cortex mediates response inhibition while mesial prefrontal cortex is responsible for error detection

  2003cited by this paper
• Human Striatal Response to Salient Nonrewarding Stimuli

  2003cited by this paper
• Temporal prediction errors in a passive learning task activate human striatum.

  2003influential reference
• Inhibition of subliminally primed responses is mediated by the caudate and thalamus: evidence from functional MRI and Huntington's disease.

  2003cited by this paper
• Limbic-striatal memory systems and drug addiction.

  2002cited by this paper
• Neural responses during anticipation of a primary taste reward.

  2002cited by this paper
• Research report Motivational views of reinforcement: implications for understanding the behavioral functions of nucleus accumbens dopamine

  2002cited by this paper
• Opponent interactions between serotonin and dopamine

  2002cited by this paper
• Synapse Formation between Central Neurons Requires Postsynaptic Expression of the MEN1 Tumor Suppressor Gene

  2001cited by this paper
• Motivated Reinforcement Learning

  2001cited by this paper
• Anticipation of Increasing Monetary Reward Selectively Recruits Nucleus Accumbens

  2001influential reference
• Selective responding of nucleus accumbens core and shell dopamine to aversively conditioned contextual and discrete stimuli.

  2001cited by this paper
• NudC Associates with Lis1 and the Dynein Motor at the Leading Pole of Neurons

  2001cited by this paper
• A Computational Model of Learned Avoidance Behavior in a One-Way Avoidance Experiment

  2001cited by this paper
• Tracking the hemodynamic responses to reward and punishment in the striatum.

  2000influential reference
• Striatonigrostriatal Pathways in Primates Form an Ascending Spiral from the Shell to the Dorsolateral Striatum

  2000cited by this paper
• Is the short-latency dopamine response too short to signal reward error?

  1999cited by this paper
• Reinforcement Learning: An Introduction

  1998cited by this paper
• Escape, Avoidance, and Imitation: A Neural Network Approach

  1997cited by this paper
• A Neural Substrate of Prediction and Reward

  1997cited by this paper
• A framework for mesencephalic dopamine systems based on predictive Hebbian learning

  1996cited by this paper
• A neurochemical and behavioral investigation of the involvement of nucleus accumbens dopamine in instrumental avoidance.

  1993cited by this paper
• The neostriatal mosaic: multiple levels of compartmental organization.

  1992cited by this paper
• The neostriatal mosaic: multiple levels of compartmental organization.

  1992cited by this paper
• 5-HT and mechanisms of defence

  1991cited by this paper
• Précis of The neuropsychology of anxiety: An enquiry into the functions of the septo-hippocampal system

  1982cited by this paper
• A neural theory of punishment and avoidance, I: Qualitative theory

  1972cited by this paper
• Adipsia and aphagia after 6-hydroxydopamine induced degeneration of the nigro-striatal dopamine system.

  1971cited by this paper
• On the dual nature of learning—a re-interpretation of "conditioning" and "problem-solving."

  1947cited by this paper

• Incentive valence differentially engages open- and closed-loop basal ganglia circuits during movement initiation

  2025cites this paper
• Modelling Pavlovian biases in depressed and healthy young adults.

  2025cites this paper
• Dopamine drives a positive reward bias on human reinforcement learning

  2025cites this paper
• Prospective reward in dual task induces a bias towards action at the cost of less accurate Task 2 performance

  2025cites this paper
• The Role of Pavlovian Bias in Smoking Cessation Success and Neurocognitive Alterations During Nicotine Withdrawal

  2025cites this paper
• Intertemporal Pavlovian biases and links with mental health in the general population

  2025cites this paper
• Cardiac-sympathetic state predicts action restraint, gated by demonstrated agency

  2025cites this paper
• Synaptic histamine shapes the neurocomputational dynamics of human learning

  2025cites this paper
• Neural Processing of Immediate versus Delayed Feedback in Action-Feedback and Stimulus-Feedback Associations

  2025cites this paper
• The Interplay Between Experimental Heat Pain and Noninvasive Stimulation of the Medial Prefrontal Cortex on Reinforcement Learning With Manipulated Outcome Contingencies

  2025cites this paper
• Exploring the link between a prior for active avoidance and apathy, anhedonia, and depression - a network analysis.

  2025cites this paper
• Pavlovian impatience: The anticipation of immediate rewards increases approach behaviour

  2024influential citation
• Adolescents flexibly adapt action selection based on controllability inferences

  2024cites this paper
• Prefrontal signals precede striatal signals for biased credit assignment in motivational learning biases

  2024cites this paper
• Emotional cues reduce Pavlovian interference in feedback-based go and nogo learning

  2024influential citation
• Craving money? Evidence from the laboratory and the field

  2024cites this paper
• The selective serotonin reuptake inhibitor sertraline alters learning from aversive reinforcements in patients with depression: evidence from a randomized controlled trial.

  2024cites this paper
• Dissociation of novel open loop from ventral putamen to motor areas from classic closed loop in humans II: task-based function

  2024cites this paper
• Transcranial direct-current stimulation enhances Pavlovian tendencies during intermittent loss of control

  2023cites this paper
• Anhedonia and sensitivity to punishment in schizophrenia, depression and opiate use disorder.

  2023cites this paper
• Functional Magnetic Resonance Imaging Signatures of Pavlovian and Instrumental Valuation Systems during a Modified Orthogonalized Go/No-go Task

  2023cites this paper
• Changing the incentive structure of social media platforms to halt the spread of misinformation

  2023cites this paper
• EXAMINING MECHANISMS OF CHILDHOOD COGNITIVE CONTROL

  2023cites this paper
• Neural correlates of overvaluation and the effort to save possessions in a novel decision task: An exploratory fMRI study

  2023cites this paper
• Anticipating social feedback involves basal forebrain and mesolimbic functional connectivity

  2023cites this paper
• Goal-directed recruitment of Pavlovian biases through selective visual attention

  2023cites this paper
• Oscillation/Coincidence-Detection Models of Reward-Related Timing in Corticostriatal Circuits

  2022cites this paper
• Independent effects of emotional arousal and reward anticipation on episodic memory formation.

  2022cites this paper
• Limited evidence for enhanced working memory performance and effort allocation in the face of loss versus gain incentives: A preregistered (non) replication.

  2022cites this paper
• The effects of induced positive and negative affect on Pavlovian-instrumental interactions

  2022influential citation
• Association of the OPRM1 A118G polymorphism and Pavlovian-to-instrumental transfer: Clinical relevance for alcohol dependence

  2021cites this paper
• The impact of social anxiety on feedback-based go and nogo learning

  2021cites this paper
• Gambling on an empty stomach: Hunger modulates preferences for learned but not described risks

  2021cites this paper
• Hunger improves reinforcement-driven but not planned action

  2021cites this paper
• Schizophrenia Patients Show Largely Similar Salience Signaling Compared to Healthy Controls in an Observational Task Environment

  2021cites this paper
• Neural underpinnings of valence-action interactions triggered by cues and targets in a rewarded approach/avoidance task.

  2021cites this paper
• Cortical dopamine reduces the impact of motivational biases governing automated behaviour

  2021cites this paper
• Modeling Variation in Empathic Sensitivity Using Go/No-Go Social Reinforcement Learning

  2021cites this paper
• The Prostate Cancer Therapy Enzalutamide Compared with Abiraterone Acetate/Prednisone Impacts Motivation for Exploration, Spatial Learning and Alters Dopaminergic Transmission in Aged Castrated Mice

  2021cites this paper
• Role of dopamine and gray matter density in aging effects and individual differences of functional connectomes

  2021cites this paper
• An empirical evaluation of active inference in multi-armed bandits

  2021cites this paper
• Not context monitoring but inhibition plays a privileged role in childhood cognitive control

  2021cites this paper
• Motivational learning biases are differentially modulated by genetic determinants of striatal and prefrontal dopamine function

  2021cites this paper
• Neurodevelopment of the incentive network facilitates motivated behaviour from adolescence to adulthood

  2021cites this paper
• Investigating the effect of losses and gains on effortful engagement during an incentivized Go/NoGo task through anticipatory cortical oscillatory changes.

  2021cites this paper
• Expecting the good: Symbolic valence signals provoke action biases and undermine goal-directed behavior.

  2020cites this paper
• The Role of the Striatum in Learning to Orthogonalize Action and Valence: A Combined PET and 7 T MRI Aging Study.

  2020influential citation
• Medial frontal cortex activity predicts information sampling in economic choice

  2020cites this paper
• Using pharmacological manipulations to study the role of dopamine in human reward functioning: A review of studies in healthy adults.

  2020cites this paper
• Effects of dopamine on reinforcement learning in Parkinson’s disease depend on motor phenotype

  2020cites this paper
• Dopamine Related Genes Differentially Affect Declarative Long-Term Memory in Healthy Humans

  2020cites this paper
• Pavlovian bias in Parkinson’s disease: an objective marker of impulsivity that modulates with deep brain stimulation

  2020cites this paper
• A model of mood as integrated advantage.

  2020cites this paper
• Striatal BOLD and midfrontal theta power express motivation for action

  2020influential citation
• Brain-behaviour correlates of habitual motivation in chronic back pain

  2020cites this paper
• Proactive engagement of cognitive control modulates implicit approach-avoidance bias

  2020cites this paper
• Brain activity and connectivity differences in reward value discrimination during effort computation in schizophrenia

  2020cites this paper
• Enhanced Go and NoGo Learning in Individuals With Obesity

  2020cites this paper
• Effects of carrying a pathogenic variant in the tyrosine hydroxylase gene on motivated action and valuation: A pilot study in family members with tyrosine hydroxylase deficiency

  2020cites this paper
• Asymmetric coupling of action and outcome valence in active and observational feedback learning

  2020cites this paper
• Neural signatures of arbitration between Pavlovian and instrumental action selection

  2020cites this paper
• Help of neutral countries in the return to life of the Women deportees from Ravensbrück camp. The Spanish Women case

  2019cites this paper
• Pavlovian-to-instrumental transfer after human threat conditioning

  2019cites this paper
• Neural correlates of reward-related response tendencies in an equiprobable Go/NoGo task

  2019cites this paper
• Deep brain stimulation of the nucleus accumbens releases aversive inhibition of behaviour in obsessive-compulsive disorder

  2019cites this paper
• Approach and avoidance movements modulate value-driven attentional capture.

  2019cites this paper
• Pavlovian-instrumental interactions in active avoidance: The bark of neutral trials.

  2019cites this paper
• A computational account of threat-related attentional bias

  2019cites this paper
• Biasing Actions by Incentive Valence in an Approach/Avoidance Task

  2019influential citation
• Dopamine, decision-making, and aging : neural and behavioural correlates

  2019cites this paper
• The promise of neurobiological research in anorexia nervosa.

  2019cites this paper
• Neural correlates of reward-directed action and inhibition of action.

  2019cites this paper
• Signals of anticipation of reward and of mean reward rates in the human brain

  2019cites this paper
• Reward and avoidance learning in the context of aversive environments and possible implications for depressive symptoms

  2019cites this paper
• Behavioural evidence for parallel outcome sensitive and outcome insensitive Pavlovian learning systems in humans

  2019cites this paper
• Using reinforcement learning models in social neuroscience: frameworks, pitfalls and suggestions of best practices

  2019influential citation
• Adolescents exhibit reduced Pavlovian biases on instrumental learning

  2019cites this paper
• The anticipation and outcome phases of reward and loss processing: A neuroimaging meta‐analysis of the monetary incentive delay task

  2018cites this paper
• Financial gain‐ and loss‐related BOLD signals in the human ventral tegmental area and substantia nigra pars compacta

  2018cites this paper
• Seeing through rose-colored glasses: How optimistic expectancies guide visual attention

  2018cites this paper
• Dopaminergic basis for signaling belief updates, but not surprise, and the link to paranoia

  2018cites this paper
• Parsing cultural impacts on regret and risk in Iran, China and the United Kingdom

  2018cites this paper
• Learning Contextual Reward Expectations for Value Adaptation

  2018cites this paper
• The Cue-Approach Task as a General Mechanism for Long-Term Non-Reinforced Behavioral Change

  2018cites this paper
• Where expectation meets attention: the dynamic interplay between optimism bias and attention bias

  2018cites this paper
• Understanding the human subcortex using ultra-high field MRI and computational cognitive models

  2018cites this paper
• Using Expectancy Theory to quantitatively dissociate the neural representation of motivation from its influential factors in the human brain: An fMRI study

  2018cites this paper
• Interactions between incentive valence and action information in a cued approach–avoidance task

  2018cites this paper
• Motivational sensitivity of outcome-response priming: Experimental research and theoretical models

  2018cites this paper
• Dorsal striatal dopamine D1 receptor availability predicts an instrumental bias in action learning

  2018cites this paper
• Change, stability, and instability in the Pavlovian guidance of behaviour from adolescence to young adulthood

  2018cites this paper
• Neural activity and fundamental learning, motivated by monetary loss and reward, are intact in mild to moderate major depressive disorder

  2018influential citation
• Importance of Temporal Analyzes for the Exploration of the Posturographic Correlates of Emotional Processing

  2018cites this paper
• Pavlovian influences on learning differ between rats and mice in a counter-balanced Go/NoGo judgement bias task

  2017cites this paper
• Engaging and Exploring: Cortical Circuits for Adaptive Foraging Decisions.

  2017cites this paper
• Vigour in active avoidance

  2017cites this paper
• Behavioral / Cognitive Frontal Theta Overrides Pavlovian Learning Biases

  2017cites this paper
• Learning and Choice in Mood Disorders: Searching for the Computational Parameters of Anhedonia

  2017influential citation
• Opponent Brain Systems for Reward and Punishment Learning: Causal Evidence From Drug and Lesion Studies in Humans

  2017cites this paper
• Opposing effects of reward and punishment on human vigor

  2017cites this paper