Models of trace decay, eligibility for reinforcement, and delay of reinforcement gradients, from exponential to hyperboloid.

No abstract is available for this paper.

• Publication year

  2011

• Venue

  Behavioural Processes

• Publication date

  2011-05-01

• Fields of study

  Medicine, Chemistry, Psychology

• Identifiers
  DOI 10.1016/j.beproc.2010.12.016PMID 21215304
• External record

  Open on Semantic Scholar

• Source metadata

  Semantic Scholar, PubMed

• No claims are published for this paper.

• No concepts are published for this paper.

• A decision model for steady-state choice in concurrent chains.

  2010cited by this paper
• Testing the Applicability of a Multiplicative Hyperbolic Model of Inter-Temporal and Risky Choice in Human Volunteers

  2010cited by this paper
• Delayed reinforcement of operant behavior.

  2010cited by this paper
• The effects of real versus hypothetical reward on delay and probability discounting

  2010cited by this paper
• Distributed versus exclusive preference in discrete-trial choice.

  2010cited by this paper
• Time versus response indices affect conclusions about preference pulses.

  2010cited by this paper
• Effects of lesions of the nucleus accumbens core on inter-temporal choice: further observations with an adjusting-delay procedure.

  2009cited by this paper
• The comparative study of mental time travel.

  2009cited by this paper
• Rapid acquisition of preference in concurrent schedules: effects of d-amphetamine on sensitivity to reinforcement amount.

  2009cited by this paper
• Do pigeons (Columba livia) study for a test?

  2009cited by this paper
• Behavioral and Brain Functions

  2009cited by this paper
• An additive-utility model of delay discounting.

  2009cited by this paper
• The spontaneously hypertensive rat model of ADHD--the importance of selecting the appropriate reference strain.

  2009cited by this paper
• Impulsive choice in a rodent model of attention-deficit/hyperactivity disorder.

  2008cited by this paper
• Relative reinforcer rates and magnitudes do not control concurrent choice independently.

  2008cited by this paper
• Effects of quinolinic acid-induced lesions of the nucleus accumbens core on inter-temporal choice: a quantitative analysis

  2007cited by this paper
• Interval bisection in spontaneously hypertensive rats.

  2007cited by this paper
• Temporal generalization accounts for response resurgence in the peak procedure.

  2007cited by this paper
• Response induction during the acquisition and maintenance of lever pressing with delayed reinforcement.

  2007cited by this paper
• Choice and timing in concurrent chains: effects of initial-link duration.

  2006cited by this paper
• Notes on discounting.

  2006cited by this paper
• gradus ad parnassum: ascending strength gradients or descending memory traces?

  2005cited by this paper
• OF THE EXPERIMENTAL ANALYSIS OF BEHAVIOR CHOICE BEHAVIOR OF RATS IN A CONCURRENT-CHAINS SCHEDULE : AMOUNT AND DELAY OF REINFORCEMENT

  2005cited by this paper
• OF THE EXPERIMENTAL ANALYSIS OF BEHAVIOR 1 INCENTIVE THEORY : II . MODELS FOR CHOICE

  2005cited by this paper
• Within-subject testing of the signaled-reinforcement effect on operant responding as measured by response rate and resistance to change.

  2005cited by this paper
• Earning and obtaining reinforcers under concurrent interval scheduling.

  2005cited by this paper
• OF THE EXPERIMENTAL ANALYSIS OF BEHAVIOR INCENTIVE THEORY . : IV . MAGNITUDE OF REWARD

  2005cited by this paper
• Amount-dependent temporal discounting?

  2004cited by this paper
• Matching: its acquisition and generalization.

  2004cited by this paper
• Quantitative analyses of methamphetamine's effects on self-control choices: implications for elucidating behavioral mechanisms of drug action.

  2004cited by this paper
• Discounting of delayed food rewards in pigeons and rats: is there a magnitude effect?

  2004cited by this paper
• A discounting framework for choice with delayed and probabilistic rewards.

  2004cited by this paper
• Reinforcement learning with replacing eligibility traces

  2004cited by this paper
• Understanding Behaviorism: Behavior, Culture, and Evolution

  2003cited by this paper
• The spontaneously hypertensive-rat as an animal model of ADHD: evidence for impulsive and non-impulsive subpopulations.

  2003cited by this paper
• Every reinforcer counts: reinforcer magnitude and local preference.

  2003cited by this paper
• Evolution of Reinforcement Learning in Uncertain Environments: A Simple Explanation for Complex Foraging Behaviors

  2002cited by this paper
• Numerical Subtraction in the Pigeon: Evidence for a Linear Subjective Number Scale

  2001cited by this paper
• Modeling games from the 20th century.

  2001cited by this paper
• Writing and overwriting short-term memory

  2001cited by this paper
• Hyperbolic value addition and general models of animal choice.

  2001cited by this paper
• Synthesizing concurrent interval performances.

  2000cited by this paper
• Theory and method in the quantitative analysis of ”impulsive choice” behaviour: implications for psychopharmacology

  1999cited by this paper
• The War Between Mentalism and Behaviorism: On the Accessibility of Mental Processes

  1999cited by this paper
• Psychoph ysica l methods, or how to measure a threshold , and w hy

  1999cited by this paper
• Associative competition in operant conditioning: blocking the response-reinforcer association

  1999cited by this paper
• The mechanics of reinforcement

  1998cited by this paper
• Toward a Statistical Theory of Learning.

  1994cited by this paper
• A Turning Point in Mathematical Learning Theory

  1994cited by this paper
• A turning point in mathematical learning theory.

  1994cited by this paper
• Mathematical Principles of Reinforcement: Based on the Correlation of Behaviour with Incentives in Short-Term Memory

  1994cited by this paper
• Acquisition of lever-press responding in rats with delayed reinforcement: A comparison of three procedures.

  1992cited by this paper
• Diminishing marginal value as delay discounting.

  1992cited by this paper
• Preference for conditioned reinforcement.

  1991cited by this paper
• Time-Derivative Models of Pavlovian Reinforcement

  1990cited by this paper
• Unification of models for choice between delayed reinforcers.

  1990cited by this paper
• Responding of pigeons under variable-interval schedules of signaled-delayed reinforcement: effects of delay-signal duration.

  1990cited by this paper
• Time horizons of pigeons on a two-armed bandit

  1989cited by this paper
• Responding of pigeons under variable-interval schedules of unsignaled, briefly signaled, and completely signaled delays to reinforcement.

  1988cited by this paper
• Choice for conditioned reinforcers in the signaled absence of primary reinforcement.

  1984cited by this paper
• Signal functions in delayed reinforcement.

  1984cited by this paper
• The role of marking when reward is delayed.

  1983cited by this paper
• A comparison of signaled and unsignaled delay of reinforcement.

  1981cited by this paper
• Preference for signaled versus unsignaled reinforcement delay in concurrent-chain schedules.

  1981cited by this paper
• Matching, undermatching, and overmatching in studies of choice.

  1979cited by this paper
• Learning when reward is delayed: a marking hypothesis.

  1979cited by this paper
• Overshadowing the instrumental conditioning of a lever-press response by a more valid predictor of the reinforcer.

  1978cited by this paper
• Positive and negative conditioned suppression in the pigeon: Effects of the locus and modality of the CS☆

  1976cited by this paper
• CHOICE AND RESPONSE CONTINGENCIES1

  1975cited by this paper
• Observing stimulus sources that signal food or no food.

  1973cited by this paper
• The matching law.

  1972cited by this paper
• Positive conditioned suppression: effects of CS duration.

  1971cited by this paper
• On the tautology of the matching law.

  1971cited by this paper
• Stimulus Sampling Theory

  1967cited by this paper

• Using rodent data to elucidate dopaminergic mechanisms of ADHD: Implications for human personality

  2024cites this paper
• Hyperbolae.

  2024cites this paper
• Theory of reinforcement schedules.

  2023cites this paper
• Prolegomena to any future philosophy of behavior analysis as a science.

  2023cites this paper
• Moles and Molecules.

  2021cites this paper
• Effects of effort training on effort-based impulsive choice.

  2021cites this paper
• Single-case experimental designs: Characteristics, changes, and challenges.

  2020cites this paper
• Tactical contingencies in the experimental analysis of reinforcement and operant classes.

  2020cites this paper
• Baseline-dependency: How genotype and signaled delays influence amphetamine's effects on delay discounting.

  2020cites this paper
• Reducing impulsive choice VII: effects of duration of delay-exposure training

  2020cites this paper
• Changing Delay Discounting and Impulsive Choice: Implications for Addictions, Prevention, and Human Health

  2019cites this paper
• Timberlake's Theories Dissolve Anomalies.

  2019cites this paper
• Bidding for delayed rewards: Accumulation as delay discounting, delay discounting as regulation, demand functions as corollary.

  2019cites this paper
• Past and Future Preference Reversals Are Predicted by Delay Discounting in Smokers and Non-Smokers

  2019cites this paper
• IN SEARCH OF A DEFINITION OF REINFORCER VALUE: SOME SUCCESSES AND FAILURES OF THE MULTIPLICATIVE HYPERBOLIC MODEL.

  2019cites this paper
• Perturbations in The Arrow of Time: Computational and Procedural Dissociations of Timing and Non-Timing Processes

  2018cites this paper
• Delay Gradients for Spout-Licking and Magazine-Entering Induced by a Periodic Food Schedule

  2018cites this paper
• Changing Nonhuman Impulsive Choice

  2018cites this paper
• Suing for Peace in the War Against Mentalism

  2018cites this paper
• Dissecting drug effects in preclinical models of impulsive choice: emphasis on glutamatergic compounds

  2018cites this paper
• Effects of sucrose concentration on choice in an adjusting-magnitude schedule.

  2018cites this paper
• Experimental Reductions of Delay Discounting and Impulsive Choice: A Systematic Review and Meta-Analysis

  2018cites this paper
• Delay Gradients for Spout-Licking and Magazine-Entering Induced by a Periodic Food Schedule

  2018cites this paper
• A framework for understanding and advancing intertemporal choice research using rodent models.

  2017cites this paper
• Delay discounting as impaired valuation: Delayed rewards in an animal obesity model.

  2017cites this paper
• Some properties of an adjusting-magnitude schedule of reinforcement: Implications for models of choice.

  2017cites this paper
• Pre-asymptotic response rates as a function of the delay-of-reinforcement gradient summation for Catania's Operant Reserve: A reply to Berg & McDowell (2011).

  2017cites this paper
• Fraud detection in banking using deep reinforcement learning

  2017cites this paper
• Impulsive Choice, Alcohol Self-administration, and Pre-exposure to Reward Delay

  2016cites this paper
• Chronic cocaine exposure in adolescence: Effects on spatial discrimination reversal, delay discounting, and performance on fixed-ratio schedules in mice.

  2016cites this paper
• The role of muscarinic cholinergic signaling in cost-benefit decision making

  2016cites this paper
• Determinants of choice, and vulnerability and recovery in addiction.

  2016cites this paper
• Responses compete and collaborate, shaping each others' distributions: Commentary on Boakes, Patterson, Kendig, and Harris (2015).

  2015cites this paper
• The arithmetic of discounting.

  2015cites this paper
• Models of ADHD: Five ways smaller sooner is better.

  2015cites this paper
• The logistics of choice.

  2015cites this paper
• Autoshaped choice in artificial neural networks: implications for behavioral economics and neuroeconomics.

  2015cites this paper
• A quantitative analysis of the behavior maintained by delayed reinforcers.

  2015cites this paper
• The Balloon Analogue Risk Task and Behavioral Correlates in Pigeons

  2015cites this paper
• How do genotype, stimulus conditions, and acute dopaminergic administration interact to influence the temporal allocation of credit?

  2015cites this paper
• Impulsive choice, alcohol consumption, and pre-exposure to delayed rewards: II. Potential mechanisms.

  2015cites this paper
• Delay-specific stimuli and genotype interact to determine temporal discounting in a rapid-acquisition procedure.

  2015cites this paper
• Misbehavior in a Neural Network Model

  2015cites this paper
• Impulsivity affects suboptimal gambling-like choice by pigeons.

  2014cites this paper
• Effect of streptozotocin-induced diabetes on performance on a progressive ratio schedule

  2014cites this paper
• Advanced Reinforcement Learning

  2014cites this paper
• CONTRIBUTION OF NUCLEUS ACCUMBENS CORE TO IMPULSIVE CHOICE: ROLE OF DOPAMINE AND GLUTAMATE SYSTEMS

  2014cites this paper
• Finding time.

  2014cites this paper
• Role of ionotropic glutamate receptors in delay and probability discounting in the rat

  2014cites this paper
• The Role of Ethanol and Neuroanatomical Regions in Sensitivity to Delay and Sensitivity to Magnitude of Reward

  2014cites this paper
• Impulsive Choice Predicts Poor Working Memory in Male Rats

  2014influential citation
• Do the adjusting-delay and increasing-delay tasks measure the same construct: delay discounting?

  2014cites this paper
• A behavioral neuroenergetics theory of ADHD.

  2013cites this paper
• Adjunctive behaviors are operants

  2013cites this paper
• A quantitative analysis of the effects of qualitatively different reinforcers on fixed ratio responding in inbred strains of mice.

  2013influential citation
• Effects of acute administration of nicotinic and muscarinic cholinergic agonists and antagonists on performance in different cost–benefit decision making tasks in rats

  2012cites this paper
• Rats (Rattus norvegicus) and pigeons (Columbia livia) are sensitive to the distance to food, but only rats request more food when distance increases.

  2012cites this paper
• Comparing pleasure and pain: the fundamental mathematical equivalence of reward gain and shock reduction under variable interval schedules.

  2012cites this paper
• Brain activation to cues predicting inescapable delay in adolescent Attention Deficit/Hyperactivity Disorder: an fMRI pilot study.

  2012cites this paper
• Characterizing operant hyperactivity in the Spontaneously Hypertensive Rat

  2012cites this paper
• An investigation of the neural mechanisms of interval timing behaviour

  2012cites this paper
• Nucleus accumbens and delay discounting in rats: evidence from a new quantitative protocol for analysing inter-temporal choice

  2011influential citation