Environmental statistics and the trade-off between model-based and TD learning in humans

No abstract is available for this paper.

• Publication year

  2011

• Venue

  Neural Information Processing Systems

• Publication date

  2011-12-12

• Fields of study

  Computer Science, Environmental Science, Psychology

• Identifiers

  No identifiers available.

• External record

  Open on Semantic Scholar

• Source metadata

  Semantic Scholar

• No claims are published for this paper.

• No concepts are published for this paper.

• Model-based influences on humans’ choices and striatal prediction errors

  2011cited by this paper
• Speed/Accuracy Trade-Off between the Habitual and the Goal-Directed Processes

  2011cited by this paper
• 2009 Special Issue: Goal-directed control and its antipodes

  2009cited by this paper
• Multiple Forms of Value Learning and the Function of Dopamine

  2009cited by this paper
• Hippocampal Contributions to Control: The Third Way

  2007cited by this paper
• Brain mechanism of reward prediction under predictable and unpredictable environmental dynamics

  2006cited by this paper
• Uncertainty-based competition between prefrontal and dorsolateral striatal systems for behavioral control

  2005cited by this paper
• 2005 Special issue: Hippocampal replay contributes to within session learning in a temporal difference reinforcement learning model

  2005cited by this paper
• Dynamic response-by-response models of matching behavior in rhesus monkeys.

  2005cited by this paper
• Decision making, impulse control and loss of willpower to resist drugs: a neurocognitive perspective

  2005cited by this paper
• Dissociable Roles of Ventral and Dorsal Striatum in Instrumental Conditioning

  2004cited by this paper
• Category number impacts rule-based but not information-integration category learning: further evidence for dissociable category-learning systems.

  2004cited by this paper
• Temporal difference models describe higher-order learning in humans

  2004cited by this paper
• Dissociating explicit and procedural-learning based systems of perceptual category learning.

  2004cited by this paper
• A New Approach to Linear Filtering and Prediction Problems

  2002cited by this paper
• Interactive memory systems in the human brain

  2001cited by this paper
• What are the computations of the cerebellum, the basal ganglia and the cerebral cortex?

  1999cited by this paper
• Goal-directed instrumental action: contingency and incentive learning and their cortical substrates.

  1998cited by this paper
• Finite-Sample Convergence Rates for Q-Learning and Indirect Algorithms

  1998cited by this paper
• The interaction of cognitive and stimulus-response processes in the control of behaviour.

  1997cited by this paper
• Probabilistic classification learning in amnesia.

  1994cited by this paper
• Task information and performance in probabilistic inference tasks

  1978cited by this paper
• Feedback and task predictability as determinants of performance in multiple cue probability learning tasks

  1976cited by this paper

• Credit Assignment: Challenges and Opportunities in Developing Human-like Learning Agents

  2024cites this paper
• Humans rationally balance detailed and temporally abstract world models

  2024influential citation
• Transfer of Learned Opponent Models in Zero Sum Games

  2022cites this paper
• Uncertainty alters the balance between incremental learning and episodic memory

  2022cites this paper
• UC Merced Proceedings of the Annual Meeting of the Cognitive Science Society

  2021cites this paper
• Task Complexity and Performance in Individuals and Groups Without Communication

  2021cites this paper
• Effects of Decision Complexity in Goal-seeking Gridworlds: A Comparison of Instance-Based Learning and Reinforcement Learning Agents

  2020cites this paper
• “What is the significance of feedback and reinforcement learning mechanisms in aiding dynamic decision making?” – proposing a revised hybrid reinforcement learning initiated instance-based model of dynamic decision making

  2020cites this paper
• Mixing memory and desire: How memory reactivation supports deliberative decision-making.

  2020cites this paper
• Towards Continual Reinforcement Learning: A Review and Perspectives

  2020cites this paper
• The computation of strategic learning in repeated social competitive interactions: Learning sophistication, reward attractor points and strategic asymmetry

  2018cites this paper
• Flexibility to contingency changes distinguishes habitual and goal-directed strategies in 4 humans 5 6 7

  2017cites this paper
• Stress enhances model-free reinforcement learning only after negative outcome

  2017cites this paper
• Flexibility to contingency changes distinguishes habitual and goal-directed strategies in humans

  2017influential citation
• Dynamic Decision Making: Learning Processes and New Research Directions

  2017cites this paper
• Reminders of past choices bias decisions for reward in humans

  2017cites this paper
• Reinforcement Learning and Causal Models

  2017cites this paper
• The successor representation in human reinforcement learning

  2016cites this paper
• Running head : Reinforcement Learning Trade-offs When does model-based control pay off ?

  2016cites this paper
• When Does Model-Based Control Pay Off?

  2016cites this paper
• Action control in uncertain environments

  2015cites this paper
• Reinforcement learning, efficient coding, and the statistics of natural tasks

  2015cites this paper
• The Oxford Handbook of Computational and Mathematical Psychology

  2015cites this paper
• Multiple Systems for Value Learning

  2014cites this paper
• Beyond simple model-free reinforcement learning in human decision making

  2014cites this paper
• Retrospective revaluation in sequential decision making: a tale of two systems.

  2014cites this paper
• Cognitive Control Predicts Use of Model-based Reinforcement Learning

  2014cites this paper
• Action-value comparisons in the dorsolateral prefrontal cortex control choice between goal-directed actions

  2014cites this paper
• Habits as action sequences: hierarchical action control and changes in outcome value

  2014cites this paper
• The Mixed Instrumental Controller: Using Value of Information to Combine Habitual Choice and Mental Simulation

  2013cites this paper
• Cortical and Hippocampal Correlates of Deliberation during Model-Based Decisions for Rewards in Humans

  2013influential citation
• Action selection in multi-effector decision making

  2013cites this paper
• Human learning in non-Markovian decision making

  2013cites this paper
• The ubiquity of model-based reinforcement learning.

  2012cites this paper
• A Distributed Q-Learning Approach for Variable Attention to Multiple Critics

  2012cites this paper
• Journal of Experimental Psychology : General Retrospective Revaluation in Sequential Decision Making : A Tale of Two Systems

  2012cites this paper
• Humans adapt their foraging strategies and computations to environment complexity

  year unknowncites this paper