Dopamine neurons can represent context-dependent prediction error.

No abstract is available for this paper.

• Publication year

  2004

• Venue

  Neuron

• Publication date

  2004-01-22

• Fields of study

  Biology, Medicine, Psychology

• Identifiers
  DOI 10.1016/S0896-6273(03)00869-9PMID 14741107
• External record

  Open on Semantic Scholar

• Source metadata

  Semantic Scholar, PubMed

• No claims are published for this paper.

• No concepts are published for this paper.

• Reward-predicting activity of dopamine and caudate neurons--a possible mechanism of motivational control of saccadic eye movement.

  2004cited by this paper
• Coding of cognitive magnitude: compressed scaling of numerical information in the primate prefrontal cortex.

  2003cited by this paper
• Correlated Coding of Motivation and Outcome of Decision by Dopamine Neurons

  2003cited by this paper
• Discrete Coding of Reward Probability and Uncertainty by Dopamine Neurons

  2003influential reference
• Neuronal Correlates of Goal-Based Motor Selection in the Prefrontal Cortex

  2003cited by this paper
• A neural correlate of response bias in monkey caudate nucleus

  2002cited by this paper
• Reward-dependent spatial selectivity of anticipatory activity in monkey caudate neurons.

  2002cited by this paper
• Neural correlates of decisions.

  2002cited by this paper
• Influence of reward expectation on visuospatial processing in macaque lateral prefrontal cortex.

  2002cited by this paper
• Metalearning and neuromodulation

  2002cited by this paper
• Visual and Anticipatory Bias in Three Cortical Eye Fields of the Monkey during an Adaptive Decision-Making Task

  2002cited by this paper
• Anterior Cingulate: Single Neuronal Signals Related to Degree of Reward Expectancy

  2002cited by this paper
• A neural correlate of oculomotor sequences in supplementary eye field.

  2002cited by this paper
• Monitoring and control of action by the frontal lobes.

  2002cited by this paper
• Feature-based anticipation of cues that predict reward in monkey caudate nucleus.

  2002cited by this paper
• Modulation of saccadic eye movements by predicted reward outcome

  2001cited by this paper
• Motivated Reinforcement Learning

  2001cited by this paper
• Sequential organization of multiple movements: involvement of cortical motor areas.

  2001cited by this paper
• Anticipatory responses of dopamine neurons and cortical neurons reproduced by internal model

  2001cited by this paper
• Dopamine responses comply with basic assumptions of formal learning theory

  2001cited by this paper
• A cellular mechanism of reward-related learning

  2001cited by this paper
• Temporal Difference Model Reproduces Anticipatory Neural Activity

  2001cited by this paper
• Parallel Cortico-Basal Ganglia Mechanisms for Acquisition and Execution of Visuomotor SequencesA Computational Approach

  2001cited by this paper
• Anterior cingulate activity during routine and non-routine sequential behaviors in macaques

  2000cited by this paper
• Performance monitoring by the supplementary eye field

  2000cited by this paper
• Neural correlates of decision variables in parietal cortex

  1999cited by this paper
• Effect of expected reward magnitude on the response of neurons in the dorsolateral prefrontal cortex of the macaque.

  1999cited by this paper
• Role for cingulate motor area cells in voluntary movement selection based on reward.

  1998cited by this paper
• Dopamine neurons report an error in the temporal prediction of reward during learning

  1998cited by this paper
• Expectation of reward modulates cognitive signals in the basal ganglia

  1998cited by this paper
• A Computational Model of How the Basal Ganglia Produce Sequences

  1998cited by this paper
• Predictive reward signal of dopamine neurons.

  1998cited by this paper
• Learning of sequential movements by neural network model with dopamine-like reinforcement signal

  1998cited by this paper
• Reinforcement learning

  1998influential reference
• Neuronal activity in medial frontal cortex during learning of sequential procedures.

  1998cited by this paper
• A Neural Substrate of Prediction and Reward

  1997influential reference
• Antisaccade performance predicted by neuronal activity in the supplementary eye field

  1997cited by this paper
• Role for cells in the presupplementary motor area in updating motor plans.

  1996cited by this paper
• Reward expectancy in primate prefrental neurons

  1996cited by this paper
• A framework for mesencephalic dopamine systems based on predictive Hebbian learning

  1996cited by this paper
• Neuropharmacology of timing and time perception.

  1996cited by this paper
• Reward-related signals carried by dopamine neurons.

  1995cited by this paper
• Models of Information Processing in the Basal Ganglia.

  1995influential reference
• Bee foraging in uncertain environments using predictive hebbian learning

  1995cited by this paper
• TD-Gammon, a Self-Teaching Backgammon Program, Achieves Master-Level Play

  1994cited by this paper
• Importance of unpredictability for reward responses in primate dopamine neurons.

  1994cited by this paper
• The basal ganglia and adaptive motor control.

  1994cited by this paper
• Multiple striatal representation in primate substantia nigra

  1994cited by this paper
• A Model of How the Basal Ganglia Generate and Use Neural Signals That Predict Reinforcement

  1994cited by this paper
• Modeling the Roles of Basal Ganglia in Timing and Sequencing Saccadic Eye Movements

  1994cited by this paper
• Responses of monkey dopamine neurons during learning of behavioral reactions.

  1992cited by this paper
• Dyna, an integrated architecture for learning, planning, and reacting

  1990cited by this paper
• Dopamine neurons of the monkey midbrain: contingencies of responses to active touch during self-initiated arm movements.

  1990cited by this paper
• Responses of nigrostriatal dopamine neurons to high-intensity somatosensory stimulation in the anesthetized monkey.

  1987cited by this paper
• Toward a modern theory of adaptive networks: expectation and prediction.

  1981cited by this paper
• Implantation of magnetic search coils for measurement of eye position: an improved method.

  1980cited by this paper
• A theory of Pavlovian conditioning : Variations in the effectiveness of reinforcement and nonreinforcement

  1972cited by this paper
• A METHOD OF MEASURING EYE MOVEMENT USING A SCLERAL SEARCH COIL IN A MAGNETIC FIELD.

  1963cited by this paper
• ON CELLULAR

  year unknowncited by this paper

• Dopamine Dynamics in the Nucleus Accumbens Reflect Confidence in Detecting the Occurrence and Non-Occurrence of Visual Signals in Perceptual Decision-Making

  2025cites this paper
• Stimulus-Dependent Dopamine Dynamics from Locus Coeruleus Axons

  2025cites this paper
• Generative Adversarial Implicit Successor Representation

  2024cites this paper
• Dopamine-independent effect of rewards on choices through hidden-state inference

  2024cites this paper
• Cerebellar climbing fibers signal flexible, rapidly adapting reward predictions

  2024cites this paper
• Dopamine neurons encode trial-by-trial subjective reward value in an auction-like task

  2024cites this paper
• Predictive Motor Control Based on a Generative Adversarial Network

  2023cites this paper
• A Basal Ganglia Model for understanding Working Memory Functions in Healthy and Parkinson’s Conditions

  2023cites this paper
• Dopamine neurons encode trial-by-trial subjective reward value in an auction-like task

  2023cites this paper
• A stable, distributed code for cue value in mouse cortex during reward learning

  2023cites this paper
• Dopamine-independent state inference mediates expert reward guided decision making

  2023cites this paper
• Working memory-based and -free reward prediction in a dual dopamine system in the basal ganglia

  2023cites this paper
• Dual credit assignment processes underlie dopamine signals in a complex spatial environment

  2023cites this paper
• Temporal regularities shape perceptual decisions and striatal dopamine signals

  2023cites this paper
• Slow‐rising and fast‐falling dopaminergic dynamics jointly adjust negative prediction error in the ventral striatum

  2023cites this paper
• Accompanying augmentation of dopaminergic slow 2 rise and phasic decay at a false-alarm behavior with 3 larger reward expectations 4 Abbreviated title : DA Dip Amplitude Quantifies Unfulfilled Expectations

  2022cites this paper
• Context-independent scaling of neural responses to task difficulty in the multiple-demand network

  2022cites this paper
• Importance of prefrontal meta control in human-like reinforcement learning

  2022cites this paper
• Learning and Expression of Dopaminergic Reward Prediction Error via Plastic Representations of Time

  2022cites this paper
• Understanding Emotions: Origins and Roles of the Amygdala

  2021cites this paper
• Dopamine reports reward prediction errors, but does not update policy, during inference-guided choice

  2021cites this paper
• Neuronal mechanisms of novelty seeking

  2021cites this paper
• A primate temporal cortex–zona incerta pathway for novelty seeking

  2021cites this paper
• Environment-based object values learned by local network in the striatum tail

  2021cites this paper
• Intrinsic Motivation in Creative Activity

  2021cites this paper
• A Dynamic Affective Core to bind the Contents, Context, and Value of Conscious Experience

  2021influential citation
• THE EFFECTS OF ESCALATED COCAINE INTAKE ON DECISION-MAKING DYNAMICS

  2021cites this paper
• Meta-learning, social cognition and consciousness in brains and machines

  2021cites this paper
• Task-Level Value Affects Trial-Level Reward Processing

  2021cites this paper
• Slow-rising and fast-falling dopaminergic dynamics jointly adjust negative prediction error in the ventral striatum

  2021cites this paper
• A quantitative reward prediction error signal in the ventral pallidum

  2020cites this paper
• PET and SPECT Imaging of the Central Dopamine System in Humans

  2020cites this paper
• What is dopamine doing in model-based reinforcement learning?

  2020cites this paper
• A quantitative reward prediction error signal in the ventral pallidum

  2020cites this paper
• Prior Reward Conditioning Dampens Hippocampal and Striatal Responses during an Associative Memory Task

  2020cites this paper
• Prefrontal solution to the bias-variance tradeoff during reinforcement learning

  2020cites this paper
• Plasticité cérébrale : régénération ? réparation ? réorganisation ? ou compensation ? Que savons-nous aujourd’hui ?

  2020cites this paper
• Teaching Experience

  2020cites this paper
• Private and Public Sources of Economic Information

  2019cites this paper
• Recent advances in understanding the role of phasic dopamine activity

  2019cites this paper
• Expectations of Macroeconomic Cycles

  2019cites this paper
• Inferring the trial-by-trial structure of pitch reinforcement learning in songbirds

  2019cites this paper
• Rare Rewards Amplify Dopamine Learning Responses

  2019cites this paper
• A neural network for information seeking

  2019cites this paper
• Believing in dopamine

  2019cites this paper
• The cost of obtaining rewards enhances the reward prediction error signal of midbrain dopamine neurons

  2019cites this paper
• The effects of reward devaluation on cue-evoked modulation of sucrose seeking and neuronal ensemble plasticity in nucleus accumbens

  2019cites this paper
• Individual Neurons in the Cingulate Cortex Encode Action Monitoring, Not Selection, during Adaptive Decision-Making

  2019cites this paper
• Ventral Tegmental Dopamine Neurons Participate in Reward Identity Predictions.

  2019cites this paper
• Consumer Expectations

  2019cites this paper
• The power of price compels you: Behavioral economic insights into dopamine-based valuation of rewarding and aversively motivated behavior.

  2019cites this paper
• Entorhinal and ventromedial prefrontal cortices abstract and generalize the structure of reinforcement learning problems

  2019cites this paper
• Multiple associative structures created by reinforcement and incidental statistical learning mechanisms

  2019cites this paper
• Models and Methods for Reinforcement Learning

  2018cites this paper
• Dopamine Transients in the Ventral Tegmental Area Attenuate Aversive Prediction Error

  2018cites this paper
• Characterization of glutamatergic VTA neural population responses to aversive and rewarding conditioning in freely-moving mice

  2018cites this paper
• Prediction Error Minimization as a Framework for Social Cognition Research

  2018cites this paper
• Model-based predictions for dopamine.

  2018cites this paper
• The neural correlates of decision-making: review and research agenda

  2018cites this paper
• Dopamine receptors in the rat entopeduncular nucleus

  2018cites this paper
• Previously rewarding environments enhance incidental memory formation

  2018cites this paper
• Amygdala activity for the modulation of goal-directed behavior in emotional contexts

  2018cites this paper
• The biological and behavioral computations that influence dopamine responses

  2018cites this paper
• Parallel basal ganglia circuits for decision making

  2018cites this paper
• Does the Dopaminergic Error Signal Act Like a Cached-Value Prediction Error?

  2018cites this paper
• Model‐free and model‐based reward prediction errors in EEG

  2018cites this paper
• Electrophysiological Correlates of Reward Processing in Dopamine Neurons

  2017cites this paper
• Altered reward expectancy in individuals with recent methamphetamine dependence

  2017cites this paper
• Phasic Activation of Ventral Tegmental, but not Substantia Nigra, Dopamine Neurons Promotes Model-Based Pavlovian Reward Learning

  2017cites this paper
• Prediction error minimization: Implications for Embodied Cognition and the Extended Mind Hypothesis.

  2017cites this paper
• Dopamine Encodes Retros pective Temporal Information in a Context-Independent Manner Graphical

  2017cites this paper
• Dopamine Encodes Retrospective Temporal Information in a Context-Independent Manner.

  2017cites this paper
• The Dopamine Prediction Error: Contributions to Associative Models of Reward Learning

  2017influential citation
• Learning and action in uncertain environments

  2017cites this paper
• Learning representations with neuromodulators

  2017cites this paper
• Distinct Functions of the Primate Putamen Direct and Indirect Pathways in Adaptive Outcome-Based Action Selection

  2017influential citation
• Evaluation of the hypothesis that phasic dopamine constitutes a cached-value signal

  2017cites this paper
• Reorganization of the Connectivity between Elementary Functions – A Model Relating Conscious States to Neural Connections

  2017cites this paper
• An ordinal generative model of Bayesian inference for human decision-making in continuous reward environments

  2017cites this paper
• Emergence of visually-evoked reward expectation signals in dopamine neurons via the superior colliculus in V1 lesioned monkeys

  2017cites this paper
• Midbrain Dopamine Neurons Signal Belief in Choice Accuracy during a Perceptual Decision.

  2017cites this paper
• Rethinking dopamine as generalized prediction error

  2017cites this paper
• Investigating the Contributions of Hippocampal Memory and Reward Valuation Systems to Cost-Benefit Decision Making

  2017cites this paper
• Dopamine reward prediction error signal codes the temporal evaluation of a perceptual decision report

  2017cites this paper
• Roles of centromedian parafascicular nuclei of thalamus and cholinergic interneurons in the dorsal striatum in associative learning of environmental events

  2017cites this paper
• Opposing effects of acute and chronic d-amphetamine on decision-making in rats.

  2017cites this paper
• Reward and value coding by dopamine neurons in non-human primates

  2017cites this paper
• Dopaminergic Modulation of Synaptic Integration and Firing Patterns in the Rat Entopeduncular Nucleus

  2017cites this paper
• Mere Exposure: Preference Change for Novel Drinks Reflected in Human Ventral Tegmental Area

  2017cites this paper
• Prior expectations shape subjective perceptual confidence

  2016cites this paper
• Neural representation of social, monetary and chocolate reinforcer processing

  2016cites this paper
• Dopamine Neuron-Specific Optogenetic Stimulation in Rhesus Macaques

  2016cites this paper
• Predictions Shape Confidence in Right Inferior Frontal Gyrus

  2016cites this paper
• Glutamate neurons are intermixed with midbrain dopamine neurons in nonhuman primates and humans

  2016cites this paper
• Physiological state gates acquisition and expression of mesolimbic reward prediction signals

  2016cites this paper
• Learning to be Ready: Dopamine and Associative Computations

  2016cites this paper
• The influence of drugs of abuse on reward-based decision-making

  2016cites this paper
• Reward functions of the basal ganglia

  2016cites this paper
• Safety out of control: dopamine and defence

  2016cites this paper
• Evolution: Big Bawls, Small Balls

  2015cites this paper