From recurrent choice to skill learning: a reinforcement-learning model.

No abstract is available for this paper.

• Publication year

  2006

• Venue

  Journal of experimental psychology. General

• Publication date

  2006-05-01

• Fields of study

  Medicine, Psychology

• Identifiers
  DOI 10.1037/0096-3445.135.2.184PMID 16719650
• External record

  Open on Semantic Scholar

• Source metadata

  Semantic Scholar, PubMed

• No claims are published for this paper.

• No concepts are published for this paper.

• The effect of delay and of intervening events on reinforcement value

  2013influential reference
• SNIF-ACT: A Cognitive Model of User Navigation on the World Wide Web

  2007cited by this paper
• Making Working Memory Work: A Computational Model of Learning in the Prefrontal Cortex and Basal Ganglia

  2006cited by this paper
• The soft constraints hypothesis: a rational analysis approach to resource allocation for interactive behavior.

  2006cited by this paper
• Behavioral and Brain Functions

  2005influential reference
• Human Symbol Manipulation Within an Integrated Cognitive Architecture

  2005cited by this paper
• Behavioral and Brain Functions

  2005cited by this paper
• Integrating Reinforcement Learning with Soar

  2005cited by this paper
• Choice

  2005cited by this paper
• On adaptation, maximization, and reinforcement learning among cognitive strategies.

  2005cited by this paper
• An integrated theory of the mind.

  2004influential reference
• The neural basis of error detection: conflict monitoring and the error-related negativity.

  2004cited by this paper
• Learning Real-time Over-the-shoulder Instructions in a Dynamic Task

  2004cited by this paper
• Independent Coding of Reward Magnitude and Valence in the Human Brain

  2004cited by this paper
• An Adaptive Approach to Human Decision Making : Learning Theory , Decision Theory , and Human Performance

  2004influential reference
• Macro-architecture of basal ganglia loops with the cerebral cortex: use of rabies virus to reveal multisynaptic circuits.

  2004cited by this paper
• Proceedings of the 26th annual conference of the cognitive science society

  2004cited by this paper
• The Science of Self-Control

  2004cited by this paper
• Proceedings of the sixth international conference on cognitive modeling

  2004cited by this paper
• SNIF-ACT: A Model of Information Foraging on the World Wide Web

  2003cited by this paper
• Discrete Coding of Reward Probability and Uncertainty by Dopamine Neurons

  2003cited by this paper
• Dorsal striatum responses to reward and punishment: Effects of valence and magnitude manipulations

  2003cited by this paper
• Small feedback‐based decisions and their limited correspondence to description‐based decisions

  2003influential reference
• Activity in human ventral striatum locked to errors of reward prediction

  2002cited by this paper
• Making trade-offs: a probabilistic and context-sensitive model of choice behavior.

  2002influential reference
• Traps in the route to models of memory and decision

  2002influential reference
• Concurrent-chain performance in transition: Effects of terminal-link duration and individual reinforcers

  2002cited by this paper
• Multiple Model-Based Reinforcement Learning

  2002cited by this paper
• The neural basis of human error processing: reinforcement learning, dopamine, and the error-related negativity.

  2002cited by this paper
• Hyperbolic value addition and general models of animal choice.

  2001cited by this paper
• Functional imaging of neural responses to expectancy and experience of monetary gains and losses.

  2001cited by this paper
• Interactive memory systems in the human brain

  2001cited by this paper
• An Economist's Perspective on Probability Matching

  2000cited by this paper
• A Computational Model of Information Processing in the Frontal Cortex and Basal Ganglia

  2000influential reference
• Glutamate infused posttraining into the hippocampus or caudate-putamen differentially strengthens place and response learning.

  1999cited by this paper
• Striatal activation during acquisition of a cognitive skill.

  1999cited by this paper
• The effect of adding a constant to all payoffs: experimental investigation, and implications for reinforcement learning models

  1999influential reference
• A Dynamic Route Finder for the Cognitive Map

  1998cited by this paper
• Model-Based Average Reward Reinforcement Learning

  1998cited by this paper
• Reinforcement Learning: An Introduction

  1998influential reference
• A Computational Role for Dopamine Delivery in Human Decision-Making

  1998cited by this paper
• Rational models of cognition

  1998cited by this paper
• The Atomic Components of Thought

  1998cited by this paper
• Planning Ability After Frontal and Temporal Lobe Lesions in Humans: The Effects of Selection Equivocation and Working Memory Load

  1997influential reference
• Learning the temporal dynamics of behavior.

  1997cited by this paper
• A computational theory of executive cognitive processes and multiple-task performance: Part 1. Basic mechanisms.

  1997cited by this paper
• A computational theory of executive cognitive processes and multiple-task performance: Part 2. Accounts of psychological refractory-period phenomena.

  1997cited by this paper
• A Neural Substrate of Prediction and Reward

  1997cited by this paper
• Inactivation of hippocampus or caudate nucleus with lidocaine differentially affects expression of place and response learning.

  1996cited by this paper
• A framework for mesencephalic dopamine systems based on predictive Hebbian learning

  1996cited by this paper
• A Neostriatal Habit Learning System in Humans

  1996cited by this paper
• Reward-related signals carried by dopamine neurons.

  1995cited by this paper
• Distributed modular architectures linking basal ganglia, cerebellum, and cerebral cortex: their role in planning and controlling action.

  1995cited by this paper
• Learning from delayed rewards

  1995cited by this paper
• Importance of unpredictability for reward responses in primate dopamine neurons.

  1994cited by this paper
• Information Processing in Modular Circuits Linking Basal Ganglia and Cerebral Cortex

  1994cited by this paper
• Mathematical Principles of Reinforcement: Based on the Correlation of Behaviour with Incentives in Short-Term Memory

  1994influential reference
• A Model of How the Basal Ganglia Generate and Use Neural Signals That Predict Reinforcement

  1994cited by this paper
• Responses of monkey dopamine neurons to reward and conditioned stimuli during successive steps of learning a delayed response task

  1993cited by this paper
• Decision field theory: a dynamic-cognitive approach to decision making in an uncertain environment.

  1993influential reference
• The process of recurrent choice.

  1993cited by this paper
• Journal of behavioral decision making: "The need for contextual and technical knowledge in judgmental forecasting", 5 (1992) 39-52

  1992cited by this paper
• Preferences, prices, and ratings in risky decision making.

  1992cited by this paper
• Responses of monkey dopamine neurons during learning of behavioral reactions.

  1992cited by this paper
• Negative Time Preference

  1991cited by this paper
• Unified Theories of Cognition

  1991cited by this paper
• Basal ganglia-thalamocortical circuits: parallel substrates for motor, oculomotor, "prefrontal" and "limbic" functions.

  1990cited by this paper
• Memory for Reward in Probabilistic Choice: Markovian and Non-Markovian Properties

  1990cited by this paper
• Reinforcement, choice and response strength

  1990cited by this paper
• From conditioning to category learning: an adaptive network model.

  1988influential reference
• An adjusting procedure for studying delayed reinforcement.

  1987influential reference
• Production system models of learning and development

  1987cited by this paper
• Learning and relearning in Boltzmann machines

  1986cited by this paper
• Parallel distributed processing: explorations in the microstructure of cognition, vol. 1: foundations

  1986cited by this paper
• Discrimination of operator schemata in problem solving: Learning from examples

  1985cited by this paper
• A Learning Algorithm for Boltzmann Machines

  1985cited by this paper
• Tests of an equivalence rule for fixed and variable reinforcer delays.

  1984influential reference
• Preference reversal and delayed reinforcement

  1981influential reference
• Toward a modern theory of adaptive networks: expectation and prediction.

  1981influential reference
• The Hippocampus as a Cognitive Map

  1980cited by this paper
• Visual information processing.

  1977cited by this paper
• University of California publications in psychology

  1976cited by this paper
• Production Systems: Models of Control Structures

  1973cited by this paper
• A theory of Pavlovian conditioning : Variations in the effectiveness of reinforcement and nonreinforcement

  1972cited by this paper
• Classical conditioning II: Current research and theory.

  1972cited by this paper
• Substitutability and similarity in binary choices

  1969cited by this paper
• Intransitivity of preferences.

  1969cited by this paper
• Contingent gains and losses in a risk-taking situation

  1965influential reference
• Studies in mathematical psychology

  1964cited by this paper
• Gain, cost, and event probability as determiners of choice behavior

  1964influential reference
• The William James Lectures

  1963cited by this paper
• Relative and absolute strength of response as a function of frequency of reinforcement.

  1961cited by this paper
• Stochastic Models for Learning

  1956cited by this paper
• Behavior of Organisms

  1942cited by this paper
• The concept of the habit-family hierarchy, and maze learning. Part I.

  1934cited by this paper
• The order of eliminating blinds in maze learning by the rat.

  1932cited by this paper
• The goal-gradient hypothesis and maze learning.

  1932cited by this paper
• ScholarWorks@UMass Amherst

  year unknowncited by this paper
• Degrees of hunger, reward and non-reward, and maze learning in rats, and Introduction and removal of reward, and maze performance in rats

  year unknowninfluential reference

• Reinforcement learning at the interface of artificial intelligence and cognitive science.

  2025cites this paper
• The Computational Evolution of Cognitive Architectures

  2025cites this paper
• An ACT-R model of resource-rational performance in a pragmatic reference game

  2025cites this paper
• Credit Assignment: Challenges and Opportunities in Developing Human-like Learning Agents

  2024cites this paper
• Hidden Markov Model to Optimize Coordination Relationship for Learning Behaviour

  2024cites this paper
• Big data thinking of top executives and corporate innovation: based on machine learning

  2024cites this paper
• Hidden Markov model to provide coordination relationship for learning behavior development in the era of industrial reform

  2024cites this paper
• Intrinsic motivation in cognitive architecture: intellectual curiosity originated from pattern discovery

  2024cites this paper
• Dynamic Strategy Selection under Bounded Rationality in Constrained Optimization Problems

  2023cites this paper
• Building Human-Like Artificial Agents: A General Cognitive Algorithm for Emulating Human Decision-Making in Dynamic Environments

  2023cites this paper
• Reinforcement Learning-Based Attack Graph Analysis for Wastewater Treatment Plant

  2023cites this paper
• A Partially Observable Markov-Decision-Process-Based Blackboard Architecture for Cognitive Agents in Partially Observable Environments

  2022cites this paper
• Integrated Clinical Environment Security Analysis Using Reinforcement Learning

  2022cites this paper
• The Role of Information in Knowledge-How

  2021cites this paper
• ACT-Rによる内発的動機づけのモデル化:パターンマッチングに基づく知的好奇心のメカニズム

  2021cites this paper
• Using Cognitive Models to Train Warm Start Reinforcement Learning Agents for Human-Computer Interactions

  2021cites this paper
• Reinforcement Learning for Production-Based Cognitive Models

  2021cites this paper
• Cognitive Models in Cybersecurity: Learning From Expert Analysts and Predicting Attacker Behavior

  2020cites this paper
• Production-based Cognitive Models as a Test Suite for Reinforcement Learning Algorithms

  2020cites this paper
• Cognitive Modeling of Automation Adaptation in a Time Critical Task

  2020cites this paper
• Skilled Bandits: Learning to Choose in a Reactive World

  2020cites this paper
• Effects of Decision Complexity in Goal-seeking Gridworlds: A Comparison of Instance-Based Learning and Reinforcement Learning Agents

  2020cites this paper
• Temporal and state abstractions for efficient learning, transfer and composition in humans

  2020cites this paper
• Cognitive Modeling of Intrinsic Motivation for Long-Term Interaction

  2019cites this paper
• Hyperbolic Discounting and Learning over Multiple Horizons

  2019cites this paper
• Contributions of the basal ganglia to action sequence learning and performance.

  2019cites this paper
• End-User Security & Privacy Behaviour on Social Media: Exploring Posture, Proficiency & Practice

  2019cites this paper
• Simulations in Cyber-Security: A Review of Cognitive Modeling of Network Attackers, Defenders, and Users

  2018cites this paper
• Towards a physio-cognitive model of the exploration exploitation trade-off.

  2018cites this paper
• A Natural Language Approach to Human-Robot Interaction

  2018cites this paper
• Some Metatheoretical Reflections on Adaptive Decision Making and the Strategy Selection Problem

  2018cites this paper
• Integrating Fast and Frugal Heuristics with a Model of Memory-based Cue Generation: Memory-based Cue Generation

  2018cites this paper
• The Influence of Emotional State on Learning From Reward and Punishment in Borderline Personality Disorder.

  2018cites this paper
• A case study of crisis management readiness in cross-national contexts: Applying team cognition theories to crisis response teams

  2017cites this paper
• Learning to exploit a hidden predictor in skill acquisition: Tight linkage to conscious awareness

  2017cites this paper
• Modeling Search Behaviors during the Acquisition of Expertise in a Sequential Decision-Making Task

  2017cites this paper
• Incidental Learning and Explicit Knowledge A dissertation submitted in partial satisfaction of the requirements for the degree Doctor of Philosophy in Psychology by

  2017cites this paper
• Computational cognitive modeling of the temporal dynamics of fatigue from sleep loss

  2017cites this paper
• The Cognitive Science Approach to Learning and Memory

  2017cites this paper
• Empirical basis for the development of adaptative interfaces : behavioral and neurophysiological evidences of decision-making and expertise development in a sequencial choice scenario.

  2017cites this paper
• Significance of Skill Reinforcement in Undergraduate Teaching: A Medical College Experience

  2016cites this paper
• Know Your Enemy: Applying Cognitive Modeling in Security Domain

  2016cites this paper
• How do occupants decide their interactions with the building? From qualitative data to a psychological framework of human-building-interaction

  2016cites this paper
• Critic learning in multi agent credit assignment problem

  2016cites this paper
• Balancing Structural and Temporal Constraints in Multitasking Contexts

  2016cites this paper
• Analyses des classes et des transitions latentes : des outils pour documenter le parcours de développement des compétences.

  2015cites this paper
• Decision and choice: Luce's choice axiom

  2015cites this paper
• Motor learning during reaching movements : model acquisition and recalibration

  2015cites this paper
• Cognitive modelling of complex problem solving behaviour

  2014cites this paper
• Model-Based Identification of EEG Markers for Learning Opportunities in an Associative Learning Task with Delayed Feedback

  2014influential citation
• Navigating complex decision spaces: Problems and paradigms in sequential choice.

  2014influential citation
• Change one can believe in: Adding learning to computational models of self-regulation

  2014cites this paper
• Methods for engineering symbolic human behaviour models for activity recognition

  2014cites this paper
• An Integrated Model of Associative and Reinforcement Learning

  2014cites this paper
• Can motor sequence learning be enhanced by monetary rewards

  2014cites this paper
• Lesions of the nucleus accumbens core modulate development of matching behavior

  2014cites this paper
• Choice Architecture for Human-Computer Interaction

  2014cites this paper
• The Goal Circuit Model: A Hierarchical Multi-Route Model of the Acquisition and Control of Routine Sequential Action in Humans

  2014cites this paper
• Neural Correlates of Temporal Credit Assignment in the Parietal Lobe

  2014cites this paper
• Expertness framework in multi-agent systems and its application in credit assignment problem

  2014cites this paper
• Bumblebees’ Bombus impatiens (Cresson) Learning: An Ecological Context

  2014cites this paper
• A Process Model of Trust in Automation

  2014cites this paper
• Learning to Efficiently Pursue Communication Goals on the Web with the GOSMR Architecture

  2013cites this paper
• A Primer for Agent-Based Simulation and Modeling in Transportation Applications

  2013cites this paper
• ACT-R/E

  2013cites this paper
• Goal-Proximity Decision-Making

  2013cites this paper
• Large-scale personal assistant technology deployment: the siri experience

  2013cites this paper
• Personal Rapid Transit and Its Development

  2013cites this paper
• PHEVs and BEVs in Coupled Power and Transportation Systems

  2013cites this paper
• Queueing network-adaptive control of thought rational (QN-ACTR): An integrated cognitive architecture for modelling complex cognitive and multi-task performance

  2013cites this paper
• Bridging across cognitive training and brain plasticity: a neurally inspired computational model of interactive skill learning.

  2013cites this paper
• Organizational Learning Curves: An Overview

  2013cites this paper
• Modeling Strategic Dynamics Under Alternative Information Conditions

  2013cites this paper
• Reinforcement learning in information searching

  2013cites this paper
• Credit Assignment during Movement Reinforcement Learning

  2013cites this paper
• Natural Language Technology in Mobile Devices: Two Grounding Frameworks

  2013cites this paper
• Modeling how thinking about the past and future impacts network traffic with the gosmr architecture

  2013cites this paper
• A Primer for Agent-Based Simulation and Modeling in Transportation Applications

  2013cites this paper
• Melioration as rational choice: sequential decision making in uncertain environments.

  2013cites this paper
• ACT-RΦ: A cognitive architecture with physiology and affect

  2013cites this paper
• Queueing Network Modeling of Human Performance in Complex Cognitive Multi-task Scenarios.

  2013cites this paper
• Electrophysiological Responses to Feedback during the Application of Abstract Rules

  2013cites this paper
• Deconstructing and reconstructing cognitive performance in sleep deprivation.

  2013cites this paper
• When, What, and How Much to Reward in Reinforcement Learning-Based Models of Cognition

  2012cites this paper
• Including cognitive biases and distance-based rewards in a connectionist model of complex problem solving

  2012cites this paper
• Machine Learning Algorithms in Bipedal Robot Control

  2012cites this paper
• Co-adaptivity in Unsupervised Adaptive Brain-Computer Interfacing: a Simulation Approach

  2012cites this paper
• Learning to Improve Agent Behaviours in GOAL

  2012cites this paper
• Organizational Learning as Credit Assignment: A Model and Two Experiments

  2012cites this paper
• Spoken Language Understanding for Natural Interaction: The Siri Experience

  2012cites this paper
• Toward a situation model in a cognitive architecture

  2012cites this paper
• Choices and Decisions of Computer Users

  2012cites this paper
• Analisis Pengaruh Motivasi terhadap Kepuasan Kerja dan Kinerja Pegawai di PT Sang Hyang Seri (Persero) Regional III Malang

  2012cites this paper
• Combining cognitive modeling and EEG to predict user behavior in a search task

  2012cites this paper
• Hierarchical Functional Category Learning for Efficient Value Function Approximation in Object-Based Environments

  2011cites this paper
• Patient Handoffs between Emergency Department and Inpatient Physicians: A Qualitative Study to Inform Standardization of Practice and Organization Theory

  2011cites this paper
• Formal Approaches in Categorization: Adaptive clustering models of categorization

  2011cites this paper
• Metadata of the chapter that will be visualized online

  2011cites this paper
• Hospital handoffs as multifunctional situated routines: implications for researchers and administrators.

  2011cites this paper
• A cognitive modeling account of simultaneous learning and fatigue effects

  2011influential citation