Chapter 15 – Value Learning through Reinforcement: The Basics of Dopamine and Reinforcement Learning

No abstract is available for this paper.

• Publication year

  2013

• Venue

  Unknown venue

• Publication date

  2013-09-01

• Fields of study

  Psychology

• Identifiers
  DOI 10.1016/B978-0-12-416008-8.00015-2
• External record

  Open on Semantic Scholar

• Source metadata

  Semantic Scholar

• No claims are published for this paper.

• No concepts are published for this paper.

• Serotonin Selectively Modulates Reward Value in Human Decision-Making

  2012cited by this paper
• GABA neurons of the VTA drive conditioned place aversion.

  2012cited by this paper
• Optogenetic Mimicry of the Transient Activation of Dopamine Neurons by Natural Reward Is Sufficient for Operant Reinforcement

  2012cited by this paper
• Optogenetic Interrogation of Dopaminergic Modulation of the Multiple Phases of Reward-Seeking Behavior

  2011cited by this paper
• Understanding dopamine and reinforcement learning: The dopamine reward prediction error hypothesis

  2011cited by this paper
• Model-based influences on humans’ choices and striatal prediction errors

  2011influential reference
• Neuron-type specific signals for reward and punishment in the ventral tegmental area

  2011cited by this paper
• The Reward Circuit: Linking Primate Anatomy and Human Imaging

  2010cited by this paper
• Selective impairment of prediction error signaling in human dorsolateral but not ventral striatum in Parkinson's disease patients: evidence from a model-based fMRI study

  2010cited by this paper
• Reward Prediction Error Coding in Dorsal Striatal Neurons

  2010cited by this paper
• Testing the Reward Prediction Error Hypothesis with an Axiomatic Model

  2010cited by this paper
• Behavioral functions of dopamine neurons

  2009cited by this paper
• Validation of Decision-Making Models and Analysis of Decision Variables in the Rat Basal Ganglia

  2009cited by this paper
• Two types of dopamine neuron distinctly convey positive and negative motivational signals

  2009cited by this paper
• Netter's Atlas of Neuroscience

  2009cited by this paper
• Functional imaging of the human dopaminergic midbrain.

  2009cited by this paper
• Phasic Firing in Dopaminergic Neurons Is Sufficient for Behavioral Conditioning

  2009cited by this paper
• Reward-learning and the novelty-seeking personality: a between- and within-subjects study of the effects of dopamine agonists on young Parkinson's patients.

  2009cited by this paper
• Reinforcement learning in the brain

  2009cited by this paper
• Dopaminergic Drugs Modulate Learning Rates and Perseveration in Parkinson's Patients in a Dynamic Foraging Task

  2009cited by this paper
• Solving the credit assignment problem: explicit and implicit learning of action sequences with probabilistic outcomes

  2008cited by this paper
• Sensitivity of the nucleus accumbens to violations in expectation of reward

  2007cited by this paper
• Associative learning mediates dynamic shifts in dopamine signaling in the nucleus accumbens

  2007cited by this paper
• Linking nucleus accumbens dopamine and blood oxygenation

  2007cited by this paper
• Dopamine neurons encode the better option in rats deciding between differently delayed or sized rewards

  2007cited by this paper
• Tonic dopamine: opportunity costs and the control of response vigor

  2007cited by this paper
• Multiple dopamine functions at different time courses.

  2007cited by this paper
• Statistics of midbrain dopamine neuron spike trains in the awake primate.

  2007cited by this paper
• Prediction error as a linear function of reward probability is coded in human nucleus accumbens

  2006cited by this paper
• Reversal learning in Parkinson's disease depends on medication status and outcome valence.

  2006cited by this paper
• Dopamine-dependent prediction errors underpin reward-seeking behaviour in humans

  2006cited by this paper
• Reward Value Coding Distinct From Risk Attitude-Related Uncertainty Coding in Human Reward Systems

  2006cited by this paper
• Midbrain dopamine neurons encode decisions for future action

  2006cited by this paper
• Do Firms Maximize? Evidence from Professional Football

  2006cited by this paper
• Midbrain dopamine neurons encode a quantitative reward prediction error signal.

  2005influential reference
• Adaptive Coding of Reward Value by Dopamine Neurons

  2005cited by this paper
• Human Neural Learning Depends on Reward Prediction Errors in the Blocking Paradigm

  2005cited by this paper
• Electrical Synapses between Dopaminergic Neurons of the Substantia Nigra Pars Compacta

  2005cited by this paper
• Dynamic response-by-response models of matching behavior in rhesus monkeys.

  2005influential reference
• A possible role of midbrain dopamine neurons in short- and long-term adaptation of saccades to position-reward mapping.

  2004cited by this paper
• Reward-predicting activity of dopamine and caudate neurons--a possible mechanism of motivational control of saccadic eye movement.

  2004cited by this paper
• Matching Behavior and the Representation of Value in the Parietal Cortex

  2004influential reference
• Temporal difference models describe higher-order learning in humans

  2004cited by this paper
• By Carrot or by Stick: Cognitive Reinforcement Learning in Parkinsonism

  2004cited by this paper
• Dopamine neurons can represent context-dependent prediction error.

  2004cited by this paper
• Addiction as a Computational Process Gone Awry

  2004cited by this paper
• Temporal prediction errors in a passive learning task activate human striatum.

  2003influential reference
• Correlated Coding of Motivation and Outcome of Decision by Dopamine Neurons

  2003cited by this paper
• Discrete Coding of Reward Probability and Uncertainty by Dopamine Neurons

  2003influential reference
• Temporal difference models and reward-related learning in the human brain.

  2003influential reference
• Coding of Predicted Reward Omission by Dopamine Neurons in a Conditioned Inhibition Paradigm

  2003cited by this paper
• Dopamine-dependent plasticity of corticostriatal synapses

  2002cited by this paper
• Dopamine responses comply with basic assumptions of formal learning theory

  2001influential reference
• Addiction and the brain: The neurobiology of compulsion and its persistence

  2001cited by this paper
• Reinforcement Learning: An Introduction

  1998cited by this paper
• Dopamine neurons report an error in the temporal prediction of reward during learning

  1998cited by this paper
• The Neurobiology of Addiction

  1997cited by this paper
• A Neural Substrate of Prediction and Reward

  1997influential reference
• A framework for mesencephalic dopamine systems based on predictive Hebbian learning

  1996cited by this paper
• 5-hydroxydopamine-labeled dopaminergic axons: three-dimensional reconstructions of axons, synapses and postsynaptic targets in rat neostriatum.

  1994cited by this paper
• Importance of unpredictability for reward responses in primate dopamine neurons.

  1994cited by this paper
• A Model of How the Basal Ganglia Generate and Use Neural Signals That Predict Reinforcement

  1994cited by this paper
• Responses of monkey dopamine neurons to reward and conditioned stimuli during successive steps of learning a delayed response task

  1993cited by this paper
• Functional architecture of basal ganglia circuits: neural substrates of parallel processing.

  1990cited by this paper
• Primate models of movement disorders of basal ganglia origin.

  1990cited by this paper
• 1-Methyl-4-phenyl-1,2,3,6-tetrahydropyridine-induced parkinsonian syndrome in Macaca fascicularis: which midbrain dopaminergic neurons are lost?

  1988cited by this paper
• Learning to predict by the methods of temporal differences

  1988cited by this paper
• Responses of midbrain dopamine neurons to behavioral trigger stimuli in the monkey.

  1986cited by this paper
• Tyrosine hydroxylase-immunoreactive boutons in synaptic contact with identified striatonigral neurons, with particular reference to dendritic spines.

  1984cited by this paper
• Intracellular and extracellular electrophysiology of nigral dopaminergic neurons--3. Evidence for electrotonic coupling.

  1983cited by this paper
• Neuroleptics and operant behavior: The anhedonia hypothesis

  1982cited by this paper
• From motivation to action: functional interface between the limbic system and the motor system.

  1980cited by this paper
• Parametric analysis of brain stimulation reward in the rat: I. The transient process and the memory-containing process.

  1974cited by this paper
• A theory of Pavlovian conditioning : Variations in the effectiveness of reinforcement and nonreinforcement

  1972cited by this paper
• Predictability, surprise, attention, and conditioning

  1967cited by this paper
• A quantitative study on the nigro-neostriatal dopamine neuron system in the rat.

  1966cited by this paper
• A mathematical model for simple learning.

  1951cited by this paper
• Supporting Online Material Materials and Methods Som Text Figs. S1 to S9 References Movie S1 Human Substantia Nigra Neurons Encode Unexpected Financial Rewards

  year unknowncited by this paper
• Animal Intelligence: Experimental Studies

  year unknowncited by this paper

• How can the double bias of mistakes block organizational intelligence? Gender and position analysis

  2025cites this paper
• Electrical brain activations in preadolescents during a probabilistic reward-learning task reflect cognitive processes and behavior strategies

  2025cites this paper
• Dynamic noise estimation: A generalized method for modeling noise fluctuations in decision-making

  2024cites this paper
• Electrical brain activations in young children during a probabilistic reward-learning task are associated with behavioral strategy

  2023cites this paper
• Signed and Unsigned Effects of Prediction Error on Memory: Is it a Matter of Choice?

  2023cites this paper
• Fast rule switching and slow rule updating in a perceptual categorization task

  2022cites this paper
• Neuroprotection in late life attention-deficit/hyperactivity disorder: A review of pharmacotherapy and phenotype across the lifespan

  2022cites this paper
• Interplay between rule learning and rule switching in a perceptual categorization task

  2022cites this paper
• Choice perseverance underlies pursuing a hard-to-get target in an avatar choice task

  2022cites this paper
• The dopamine circuit as a reward-taxis navigation system

  2021cites this paper
• Decision-making: from neuroscience to neuroeconomics—an overview

  2021cites this paper
• Null effects of levodopa on reward- and error-based motor adaptation, savings, and anterograde interference.

  2021cites this paper
• The role of dopamine in reward-based motor adaptation, savings, and interference

  2020cites this paper
• Learning when effort matters: Neural dynamics underlying updating and adaptation to changes in performance efficacy

  2020cites this paper
• Neural systems underlying the learning of cognitive effort costs

  2020cites this paper
• How decisions and the desire for coherency shape subjective preferences over time

  2019cites this paper
• Ten simple rules for the computational modeling of behavioral data

  2019cites this paper
• Learning task-state representations

  2019cites this paper
• Aberrant reward prediction error during Pavlovian appetitive learning in alexithymia

  2019cites this paper
• Prefrontal cortex as a meta-reinforcement learning system

  2018cites this paper
• Alexithymia and the Reduced Ability to Represent the Value of Aversively Motivated Actions

  2018cites this paper
• The neural correlates of decision-making: review and research agenda

  2018cites this paper
• Toward a computational cognitive neuropsychology of Wisconsin card sorts: a showcase study in Parkinson’s disease

  2018cites this paper
• The Emerging Standard Neurobiological Model of Decision Making

  2018cites this paper
• Social learning through prediction error in the brain

  2017cites this paper
• Neural Circuit Mechanisms of Value-Based Decision-Making and Reinforcement Learning

  2017cites this paper
• Reinforcement Learning and Episodic Memory in Humans and Animals: An Integrative Framework

  2017cites this paper
• Towards More Human Like Reinforcement Learning

  2017cites this paper
• Asynchronous Advantage Actor-Critic with Adam Optimization and a Layer Normalized Recurrent Network

  2017cites this paper
• Neural representations of social and non-social uncertainty in human decision making

  2015cites this paper
• Reinforcement learning in depression: A review of computational research.

  2015cites this paper