The rat approximates an ideal detector of changes in rates of reward: implications for the law of effect.

No abstract is available for this paper.

• Publication year

  2001

• Venue

  Journal of experimental psychology. Animal behavior processes

• Publication date

  2001-10-01

• Fields of study

  Medicine, Psychology

• Identifiers
  DOI 10.1037//0097-7403.27.4.354PMID 11676086
• External record

  Open on Semantic Scholar

• Source metadata

  Semantic Scholar, PubMed

• No claims are published for this paper.

• No concepts are published for this paper.

• Time, rate, and conditioning.

  2000cited by this paper
• Self-stimulating rats combine subjective reward magnitude and subjective reward rate multiplicatively.

  1998cited by this paper
• A Neural Substrate of Prediction and Reward

  1997cited by this paper
• A framework for mesencephalic dopamine systems based on predictive Hebbian learning

  1996cited by this paper
• Dynamics of time matching: Arousal makes better seem worse

  1995cited by this paper
• Kinetics of matching.

  1994cited by this paper
• Context, time, and memory retrieval in the interference paradigms of Pavlovian learning.

  1993cited by this paper
• The Integration of Reinforcements over Time

  1984cited by this paper
• Optimization and the matching law as accounts of instrumental behavior.

  1981cited by this paper
• A Markov model description of changeover probabilities on concurrent variable-interval schedules.

  1979cited by this paper
• On Herrnstein's equation and related forms.

  1977cited by this paper
• Classical Conditioning of a Complex Skeletal Response

  1971cited by this paper
• Effects of symmetrical and asymmetrical changeover delays on concurrent performances.

  1971cited by this paper
• Auto-maintenance in the pigeon: sustained pecking despite contingent non-reinforcement.

  1969cited by this paper
• Auto-shaping of the pigeon's key-peck.

  1968cited by this paper
• Relative and absolute strength of response as a function of frequency of reinforcement.

  1961cited by this paper
• One-trial discrimination reversal in the white rat.

  1954cited by this paper
• Improvement in successive discrimination reversals.

  1950cited by this paper

• Neural variability in the medial prefrontal cortex contributes to efficient adaptive behavior

  2025cites this paper
• Reconceptualized Associative Learning

  2025cites this paper
• Further examining how animals weigh conflicting information about reward sources over time

  2025cites this paper
• Further assessment of a model of changeover behavior: Implications for the matching law

  2025influential citation
• Emotional tears: What they are and how they work

  2025cites this paper
• Recasting adaptation as strategy inference

  2025cites this paper
• A model of changeover behavior in two‐alternative choice

  2025influential citation
• Creating a Dot-Counting Single-Subject Design Tutorial

  2024cites this paper
• Some Worries About the Probability Account of the Feelings of (Un)Certainty

  2024cites this paper
• Hebbian learning can explain rhythmic neural entrainment to statistical regularities.

  2024cites this paper
• Dopamine-independent effect of rewards on choices through hidden-state inference

  2024cites this paper
• Hyperbolae.

  2024cites this paper
• Distinct value computations support rapid sequential decisions

  2023cites this paper
• Is Detecting Discontinuity Difficult? Evidence from the Visual Trend Classification of Scatterplots

  2023cites this paper
• Dopamine-independent state inference mediates expert reward guided decision making

  2023cites this paper
• Undermatching Is a Consequence of Policy Compression

  2022cites this paper
• The nervous system as a solution for implementing closed negative feedback control loops.

  2022cites this paper
• Mesolimbic dopamine release conveys causal associations

  2022cites this paper
• Rodents monitor their error in self-generated duration on a single trial basis

  2022cites this paper
• Matching Behaviours and Rewards.

  2021cites this paper
• Computational models of adaptive behavior and prefrontal cortex

  2021cites this paper
• Dynamic decision making and value computations in medial frontal cortex.

  2021cites this paper
• The anterior cingulate cortex directs exploration of alternative strategies.

  2021cites this paper
• Dopamine reports reward prediction errors, but does not update policy, during inference-guided choice

  2021cites this paper
• Human behavioral response to fluctuating automation reliability.

  2021cites this paper
• Visuospatial information foraging describes search behavior in learning latent environmental features

  2021cites this paper
• Resurgence and repeated within-session progressive-interval thinning of alternative reinforcement.

  2021cites this paper
• Separable influences of reward on visual processing and choice

  2020cites this paper
• Discovery of a putative blood-based protein signature associated with response to ALK tyrosine kinase inhibition

  2020cites this paper
• Prefrontal Cortex Predicts State Switches during Reversal Learning.

  2020cites this paper
• Punishment and its putative fallout: A reappraisal.

  2020cites this paper
• Believing in dopamine

  2019cites this paper
• Number and time in acquisition, extinction and recovery.

  2019cites this paper
• Changepoint detection versus reinforcement learning: Separable neural substrates approximate different forms of Bayesian inference

  2019cites this paper
• A Free-Operant Reward-Tracking Paradigm to Study Neural Mechanisms and Neurochemical Modulation of Adaptive Behavior in Rats

  2019cites this paper
• Re-exposure to reinforcement in context a during treatment in context b reduces ABC renewal.

  2019cites this paper
• The macaque anterior cingulate cortex translates counterfactual choice value into actual behavioral change

  2019cites this paper
• Discriminative control of saccade latencies.

  2019cites this paper
• Deviation from the matching law reflects an optimal strategy involving learning over multiple timescales

  2019cites this paper
• Multi-Pattern Visual Statistical Learning in Monolinguals and Bilinguals

  2019cites this paper
• Resurgence as Choice in Context: Treatment duration and on/off alternative reinforcement.

  2019cites this paper
• Neural evidence for Bayesian trial-by-trial adaptation on the N400 during semantic priming.

  2019cites this paper
• Behavioral momentum and resistance to extinction across repeated extinction tests.

  2019cites this paper
• Applying the matching law as micro-foundation of social phenomena.

  2018cites this paper
• Contributions of Lateral and Orbital Frontal Regions to Abstract Rule Acquisition and Reversal in Monkeys

  2018cites this paper
• Saccadic latencies depend on functional relations with the environment

  2018cites this paper
• Multiscale behavior analysis and molar behaviorism: An overview.

  2018cites this paper
• The dual systems in temporal cognition: A spatial analogy

  2018cites this paper
• Forget-me-some: General versus special purpose models in a hierarchical probabilistic task

  2018cites this paper
• Control of saccadic latency in a dynamic environment: allocation of saccades in time follows the matching law.

  2018cites this paper
• The macaque anterior cingulate cortex translates counterfactual choice value into actual behavioral change

  2018cites this paper
• An Analysis of Decision Under Risk in Rats

  2018cites this paper
• An effect of serotonergic stimulation on learning rates for rewards apparent after long intertrial intervals

  2018cites this paper
• Brain networks for confidence weighting and hierarchical inference during probabilistic learning

  2017cites this paper
• Theoretical implications of quantitative properties of interval timing and probability estimation in mouse and rat.

  2017cites this paper
• Learning fast and slow: deviations from the matching law can reflect an optimal strategy under uncertainty

  2017cites this paper
• Moving Beyond Reinforcement and Response Strength

  2017cites this paper
• Complementary contributions of basolateral amygdala and orbitofrontal cortex to value learning under uncertainty

  2017cites this paper
• Cognitive Dimension of Operant Learning

  2017cites this paper
• Spontaneous integration of temporal information: implications for representational/computational capacity of animals

  2017cites this paper
• The Coding Question.

  2017cites this paper
• Resurgence as Choice.

  2017cites this paper
• Chance, long tails, and inference in a non-Gaussian, Bayesian theory of vocal learning in songbirds

  2017cites this paper
• Extension of Behavioral Momentum Theory to Conditions with Changing Reinforcer Rates

  2017influential citation
• The Long and the Short of Serotonergic Stimulation: Optogenetic activation of dorsal raphe serotonergic neurons changes the learning rate for rewards

  2017cites this paper
• Shaping Brain and Behaviour: Investigating the Properties and Electrophysiological Correlates of Reinforcement

  2017cites this paper
• Consciousness operationalized, a debate realigned.

  2017cites this paper
• The Effect of Scopolamine on Matching Behavior and the Estimation of Relative Reward Magnitude

  2017cites this paper
• How the brain might work: statistics flowing in redundant population codes

  2017cites this paper
• Metaplasticity as a Neural Substrate for Adaptive Learning and Choice under Uncertainty.

  2017cites this paper
• Contributions of different prefrontal cortical regions to abstract rule acquisition and reversal in monkeys

  2017cites this paper
• The Biological Basis of Economic Choice

  2017cites this paper
• Experience with dynamic reinforcement rates decreases resistance to extinction.

  2016cites this paper
• Mice Can Use Second-Order, Contrast-Modulated Stimuli to Guide Visual Perception

  2016cites this paper
• Sampling over Nonuniform Distributions: A Neural Efficiency Account of the Primacy Effect in Statistical Learning

  2016cites this paper
• Control by reinforcers across time and space: A review of recent choice research.

  2016cites this paper
• Environmental dynamics modulate covariation of choice and timing.

  2016cites this paper
• A microstructural analysis distinguishes motor and motivational influences over voluntary running in animals chronically exposed to methylmercury and nimodipine.

  2016cites this paper
• Mind as Theory Engine: Causation, Explanation and Time

  2016cites this paper
• The matching law and melioration learning

  2016cites this paper
• Adaptive learning and decision-making under uncertainty by metaplastic synapses guided by a surprise detection system

  2016cites this paper
• Anchors aweigh: The impact of overlearning on entrenchment effects in statistical learning.

  2016cites this paper
• Learning to learn about uncertain feedback

  2016cites this paper
• Learning Enhances Sensory Processing in Mouse V1 before Improving Behavior

  2016cites this paper
• The influence of bilingualism on statistical word learning.

  2016cites this paper
• Perceptual Learning During Evidence on an Oculomotor Decision Variable The Relative Influences of Priors and Sensory

  2015cites this paper
• Neuroscience of Value-Guided Choice

  2015cites this paper
• Chapter 7 Foundations of the Formal Number Concept : How Preverbal Mechanisms Contribute to the Development of Cardinal Knowledge

  2015cites this paper
• Automated adaptive inference of phenomenological dynamical models

  2015cites this paper
• Robust speech perception: recognize the familiar, generalize to the similar, and adapt to the novel.

  2015cites this paper
• Foundations of the Formal Number Concept: How Preverbal Mechanisms Contribute to the Development of Cardinal Knowledge

  2015cites this paper
• Extinction and spontaneous recovery of spatial behavior in pigeons.

  2015cites this paper
• The Temporal Patterning of Spontaneous High-Rate Behavior: An Evaluation of Bout Partitioning Methods for Behavior Under Neurotoxicant Challenge

  2015cites this paper
• Apprendre à apprendre dans un environnement incertain, et dynamique des réseaux corticaux pour la flexibilité comportementale

  2015influential citation
• Reinforcement learning and counterfactual reasoning explain adaptive behavior in a changing environment

  2015cites this paper
• Dynamics of pre- and post-choice behaviour: rats approximate optimal strategy in a discrete-trial decision task

  2015cites this paper
• Behavioral momentum and accumulation of mass in multiple schedules.

  2015cites this paper
• Reconsidering Food Reward, Brain Stimulation, and Dopamine: Incentives Act Forward.

  2015cites this paper
• Common Principles Underlying Models of Sequential Effects

  2014cites this paper
• Spatial Generalization in Operant Learning: Lessons from Professional Basketball

  2014cites this paper