A neurocomputational account of reward and novelty processing and effects of psychostimulants in attention deficit hyperactivity disorder

Novelty seeking is characteristic of ADHD, but how this influences reward-related decision-making is unknown. Sethi et al. show that stimulant medication selectively attenuates ADHD participants’ tendency to repeatedly select non-optimal novel options, and reduces substantia nigra novelty signalling. Stimulant medication increases learning rates and enhances performance in ADHD participants compared to effects in controls.

• Publication year

  2018

• Venue

  Brain : a journal of neurology

• Publication date

  2018-03-13

• Fields of study

  Medicine, Psychology

• Identifiers
  DOI 10.1093/brain/awy048PMID 29547978PMCID 5917772
• External record

  Open on Semantic Scholar

• Source metadata

  Semantic Scholar, PubMed

• No claims are published for this paper.

• No concepts are published for this paper.

• Magnetization transfer imaging identifies basal ganglia abnormalities in adult ADHD that are invisible to conventional T1 weighted voxel-based morphometry

  2017cited by this paper
• Alterations in brain neurotrophic and glial factors following early age chronic methylphenidate and cocaine administration.

  2015cited by this paper
• Attenuated Tonic and Enhanced Phasic Release of Dopamine in Attention Deficit Hyperactivity Disorder

  2015cited by this paper
• Probabilistic reward learning in adults with Attention Deficit Hyperactivity Disorder--an electrophysiological study.

  2015cited by this paper
• Sex differences in adolescent methylphenidate sensitization: effects on glial cell-derived neurotrophic factor and brain-derived neurotrophic factor.

  2014cited by this paper
• Dopamine modulates novelty seeking behavior during decision making.

  2014cited by this paper
• Internalizing and externalizing behavior in adult ADHD

  2014influential reference
• Amphetamine-Induced Dopamine Release and Neurocognitive Function in Treatment-Naive Adults with ADHD

  2014cited by this paper
• Long-Term Stimulant Treatment Affects Brain Dopamine Transporter Level in Patients with Attention Deficit Hyperactive Disorder

  2013cited by this paper
• A Causal Link Between Prediction Errors, Dopamine Neurons and Learning

  2013cited by this paper
• Changes in plasma Brain-derived neurotrophic factor (BDNF) levels induced by methylphenidate in children with Attention deficit-hyperactivity disorder (ADHD).

  2013cited by this paper
• K-ATP channels in dopamine substantia nigra neurons control bursting and novelty-induced exploration

  2012cited by this paper
• Methylphenidate-Elicited Dopamine Increases in Ventral Striatum Are Associated with Long-Term Symptom Improvement in Adults with Attention Deficit Hyperactivity Disorder

  2012cited by this paper
• The roles of dopamine and noradrenaline in the pathophysiology and treatment of attention-deficit/hyperactivity disorder.

  2011cited by this paper
• Predictive Reward Signal of Dopamine Neurons

  2011cited by this paper
• Comparative review

  2011cited by this paper
• Novelty seeking behaviour in Parkinson's disease.

  2011influential reference
• Influence of Phasic and Tonic Dopamine Release on Receptor Activation

  2010cited by this paper
• Motivation Deficit in ADHD is Associated with Dysfunction of the Dopamine Reward Pathway

  2010cited by this paper
• Identifying the neurobiology of altered reinforcement sensitivity in ADHD: a review and research agenda.

  2010influential reference
• Non-specific effects of methylphenidate (Ritalin) on cognitive ability and decision-making of ADHD and healthy adults

  2010cited by this paper
• Evaluating dopamine reward pathway in ADHD: clinical implications.

  2009cited by this paper
• Dopaminergic Drugs Modulate Learning Rates and Perseveration in Parkinson's Patients in a Dynamic Foraging Task

  2009influential reference
• Midbrain Dopamine Neurons

  2009cited by this paper
• Cognitive and emotional processing in high novelty seeking associated with the L-DRD4 genotype.

  2009cited by this paper
• Prevalence and correlates of adult attention-deficit hyperactivity disorder: meta-analysis

  2009cited by this paper
• Improved segmentation of deep brain grey matter structures using magnetization transfer (MT) parameter maps

  2009cited by this paper
• Methylphenidate-induced dendritic spine formation and ΔFosB expression in nucleus accumbens

  2009cited by this paper
• Age of methylphenidate treatment initiation in children with ADHD and later substance abuse: prospective follow-up into adulthood.

  2008cited by this paper
• Striatal Activity Underlies Novelty-Based Choice in Humans

  2008influential reference
• Exploring personality through test construction: Development of the multidimensional personality questionnaire

  2008cited by this paper
• Single dose of a dopamine agonist impairs reinforcement learning in humans: Behavioral evidence from a laboratory-based measure of reward responsiveness

  2008cited by this paper
• Substantia nigra/ventral tegmental reward prediction error disruption in psychosis

  2008cited by this paper
• Methylphenidate amplifies long-term plasticity in the hippocampus via noradrenergic mechanisms.

  2008cited by this paper
• Midbrain Dopamine Receptor Availability Is Inversely Associated with Novelty-Seeking Traits in Humans

  2008influential reference
• Association of the dopamine D4 receptor (DRD4) gene and approach-related personality traits: meta-analysis and new data.

  2008cited by this paper
• Depressed dopamine activity in caudate and preliminary evidence of limbic involvement in adults with attention-deficit/hyperactivity disorder.

  2007cited by this paper
• Behavioral dopamine signals.

  2007cited by this paper
• Testing Computational Models of Dopamine and Noradrenaline Dysfunction in Attention Deficit/Hyperactivity Disorder

  2007cited by this paper
• Infrequent, but not frequent, reinforcers produce more variable responding and deficient sustained attention in young children with attention-deficit/hyperactivity disorder (ADHD).

  2006cited by this paper
• Absolute coding of stimulus novelty in the human substantia nigra/VTA.

  2006cited by this paper
• Dopamine-dependent prediction errors underpin reward-seeking behaviour in humans

  2006influential reference
• Dopamine, Learning, and Impulsivity: ABiological Account of Attention-Deficit/Hyperactivity Disorder

  2005influential reference
• Midbrain dopamine neurons encode a quantitative reward prediction error signal.

  2005cited by this paper
• Temperament and character profiles and the dopamine D4 receptor gene in ADHD.

  2005influential reference
• Temporal difference models and reward-related learning in the human brain.

  2003influential reference
• Optimized EPI for fMRI studies of the orbitofrontal cortex

  2003cited by this paper
• Temporal prediction errors in a passive learning task activate human striatum.

  2003influential reference
• Conners' Adult ADHD Rating Scales (CAARS).

  2003cited by this paper
• Imaging Human Mesolimbic Dopamine Transmission with Positron Emission Tomography. Part II: Amphetamine-Induced Dopamine Release in the Functional Subdivisions of the Striatum

  2003cited by this paper
• Does stimulant therapy of attention‐deficit/hyperactivity disorder beget later substance abuse?

  2003cited by this paper
• Methylphenidate‐Evoked Potentiation of Extracellular Dopamine in the Brain of Adolescents with Premature Birth

  2002cited by this paper
• Dopamine: generalization and bonuses

  2002influential reference
• A meta-analysis of the association between DRD4 polymorphism and novelty seeking

  2002cited by this paper
• Methylphenidate elevates resting dopamine which lowers the impulse-triggered release of dopamine: a hypothesis.

  2002cited by this paper
• Psychostimulant actions on dopamine and limbic system function: Relevance to the pathophysiology and treatment of ADHD.

  2001cited by this paper
• Therapeutic Doses of Oral Methylphenidate Significantly Increase Extracellular Dopamine in the Human Brain

  2001cited by this paper
• Meta-analysis of the association between the 7-repeat allele of the dopamine D(4) receptor gene and attention deficit hyperactivity disorder.

  2001cited by this paper
• Dopamine responses comply with basic assumptions of formal learning theory

  2001cited by this paper
• Identification of a polymorphism in the promoter region of DRD4associated with the human novelty seeking personality trait

  2000cited by this paper
• Further evidence from haplotype analysis for linkage of the dopamine D4 receptor gene and attention-deficit hyperactivity disorder.

  2000cited by this paper
• A haplotype relative risk study of the dopamine D4 receptor (DRD4) exon III repeat polymorphism and attention deficit hyperactivity disorder (ADHD).

  2000cited by this paper
• Methyiphenidate vs. amphetamine: Comparative review

  2000cited by this paper
• Dopamine D4 gene 7-repeat allele and attention deficit hyperactivity disorder.

  1999cited by this paper
• Evidence that the dopamine D4 receptor is a susceptibility gene in attention deficit hyperactivity disorder

  1999cited by this paper
• Association between the dopamine D4 receptor (DRD4) exon III polymorphism and measures of Novelty Seeking in a German population

  1999cited by this paper
• Association between novelty seeking and dopamine receptor D4 (DRD4) exon III polymorphism in Japanese subjects.

  1999cited by this paper
• Association between novelty seeking and the type 4 dopamine receptor gene in a large Finnish cohort sample.

  1999cited by this paper
• Dopamine neurons report an error in the temporal prediction of reward during learning

  1998cited by this paper
• Dopamine DRD4 receptor polymorphism and attention deficit hyperactivity disorder

  1998cited by this paper
• Evidence that the dopamine D4 receptor is a susceptibility gene in attention deficit hyperactivity disorder

  1998cited by this paper
• Dopamine transporter occupancies in the human brain induced by therapeutic doses of oral methylphenidate.

  1998cited by this paper
• Predictive reward signal of dopamine neurons.

  1998cited by this paper
• Experimental analysis of childhood psychopathology: A laboratory matching analysis of the behavior of children diagnosed with Attention-Deficit Hyperactivity Disorder (ADHD)

  1997cited by this paper
• Adult attention deficit hyperactivity disorder: psychological test profiles in a clinical population.

  1997influential reference
• A Neural Substrate of Prediction and Reward

  1997cited by this paper
• Burst activity of ventral tegmental dopamine neurons is elicited by sensory stimuli in the awake cat.

  1997cited by this paper
• Dopamine D4 receptor gene polymorphism is associated with attention deficit hyperactivity disorder.

  1996cited by this paper
• A framework for mesencephalic dopamine systems based on predictive Hebbian learning

  1996cited by this paper
• Dopamine D4 receptor (D4DR) exon III polymorphism associated with the human personality trait of Novelty Seeking

  1996cited by this paper
• State-Trait Anxiety Inventoryによるペインクリニック外来患者の不安の評価

  1994cited by this paper
• Novelty seeking, risk taking, and related constructs as predictors of adolescent substance use: an application of Cloninger's theory.

  1994cited by this paper
• Responses of monkey dopamine neurons during learning of behavioral reactions.

  1992cited by this paper
• The Tridimensional Personality Questionnaire: U.S. Normative Data

  1991cited by this paper
• Response of dopaminergic neurons in cat to auditory stimuli presented across the sleep-waking cycle.

  1983cited by this paper

• Distinct neurobiological alterations during hedonic experience of rewards in attention deficit hyperactivity disorder and autism spectrum disorder: Multimodal evidence from neuroimaging meta-analyses.

  2026cites this paper
• Maternal immune activation in mice recapitulates features of attention-deficit/hyperactivity disorder (ADHD) in susceptible offspring.

  2026cites this paper
• Neuroimaging findings in sleep disorders: A review article

  2025cites this paper
• Identification of TNR as a Potential Hippocampal Biomarker of Novelty Seeking Behavior with Integrated Quantitative Proteomics and Systems Genetics Approaches

  2025cites this paper
• Incremental Validity of Cognitive Impulsivity, Emotional Impulsivity, and Sensation Seeking in the Predictions of ADHD Inattention and Hyperactivity/Impulsivity Symptoms in Adults

  2025cites this paper
• Investigating Learning, Decision-Making, and Mental Health in Pregnancy: Insights From a UK Cohort Study

  2025cites this paper
• Successful Evidence-Based Parenting Programs are Associated With Brain Changes and Improved Reward Processing in Boys With Conduct Problems.

  2025cites this paper
• The Impact of Social Media & Technology on Child and Adolescent Mental Health

  2025cites this paper
• Regional brain structure at the intersection of novelty-seeking trait and anxiety.

  2025cites this paper
• Listening habits and subjective effects of background music in young adults with and without ADHD

  2025cites this paper
• Perceptual Novelty Drives Early Exploration in a Bottom‐Up Manner

  2025cites this paper
• Characterizing heterogeneity in emotional and behavioral problems: Latent class analysis with 507,188 children and adolescents and associations with mobile gaming addiction behavior

  2025cites this paper
• Moving away from male-dominated, deficit models, to improve the educational outcomes and wellbeing of women: The effect of ADHD symptoms and sex on the needs of autonomy, competence, and relatedness

  2024cites this paper
• Contingency-based flexibility mechanisms through a reinforcement learning model in adults with Attention-Deficit/Hyperactivity Disorder and Obsessive-Compulsive Disorder

  2024cites this paper
• Effects of game-based digital therapeutics on attention deficit hyperactivity disorder in children and adolescents as assessed by parents or teachers: a systematic review and meta-analysis

  2023cites this paper
• Salience and hedonic experience as predictors of central stimulant treatment response in ADHD - A resting state fMRI study.

  2023cites this paper
• Motor System-Dependent Effects of Amygdala and Ventral Striatum Lesions on Explore–Exploit Behaviors

  2023cites this paper
• The Computational Psychiatry of Antisocial Behaviour and Psychopathy.

  2022cites this paper
• Biological Predictors of Treatment Response in Adult Attention Deficit Hyperactivity Disorder (ADHD): A Systematic Review

  2022influential citation
• Striatal dopamine dissociates methylphenidate effects on value-based versus surprise-based reversal learning

  2021cites this paper
• Computational modeling of behavioral tasks: An illustration on a classic reinforcement learning paradigm

  2021cites this paper
• Chronic Administrations of Guanfacine on Mesocortical Catecholaminergic and Thalamocortical Glutamatergic Transmissions

  2021cites this paper
• Cognitive characterization of adult attention deficit hyperactivity disorder by domains: a systematic review

  2021cites this paper
• Understanding sensory regulation in typical and atypical development: the case of sensory seeking

  2021cites this paper
• Shifting uncertainty intolerance: methylphenidate and attention-deficit hyperactivity disorder

  2021cites this paper
• What is the Effect of Stimulus Complexity on Attention to Repeating and Changing Information in Autism?

  2020cites this paper
• The neurobehavioral mechanisms of motivational control in attention-deficit/hyperactivity disorder.

  2020cites this paper
• Het nemen van beslissingen door volwassenen met ADHD: een systematisch literatuuronderzoek

  2020cites this paper
• Attention-deficit/hyperactivity disorder and the explore/exploit trade-off

  2020cites this paper
• Low self-control and aggression exert serial mediation between inattention/hyperactivity problems and severity of internet gaming disorder features longitudinally among adolescents

  2020cites this paper
• Using Mobile Electroencephalography and Actigraphy to Diagnose Attention-Deficit/Hyperactivity Disorder: Case-Control Comparison Study

  2020cites this paper
• Unravelling the effects of methylphenidate on the dopaminergic and noradrenergic functional circuits

  2020cites this paper
• Subcortical Substrates of Explore-Exploit Decisions in Primates.

  2019cites this paper
• Acute Atomoxetine Selectively Modulates Encoding of Reward Value in Ventral Medial Prefrontal Cortex.

  2019cites this paper