A Convergent Online Single Time Scale Actor Critic Algorithm

No abstract is available for this paper.

• Publication year

  2009

• Venue

  Journal of machine learning research

• Publication date

  2009-09-16

• Fields of study

  Mathematics, Computer Science

• Identifiers
  DOI 10.5555/1756006.1756017
• External record

  Open on Semantic Scholar

• Source metadata

  Semantic Scholar

• No claims are published for this paper.

• No concepts are published for this paper.

• Reinforcement learning

  2019influential reference
• Natural actor-critic algorithms

  2009cited by this paper
• Neuro-Dynamic Programming

  2009influential reference
• Reinforcement Learning Through Modulation of Spike-Timing-Dependent Synaptic Plasticity

  2007cited by this paper
• Incremental Natural Actor-Critic Algorithms

  2007influential reference
• Stochastic learning and optimization - A sensitivity-based approach

  2007cited by this paper
• Reinforcement Learning, Spike-Time-Dependent Plasticity, and the BCM Rule

  2007cited by this paper
• of nonlinear systems

  2006cited by this paper
• Convergence rate and averaging of nonlinear two-time-scale stochastic approximation algorithms

  2006cited by this paper
• Actions , Policies , Values , and the Basal Ganglia

  2005cited by this paper
• Natural Actor-Critic

  2003cited by this paper
• Getting formal with dopamine and reward.

  2002influential reference
• Economic inequality and burden-sharing in the provision of local environmental quality

  2002cited by this paper
• Variance Reduction Techniques for Gradient Estimates in Reinforcement Learning

  2001cited by this paper
• Infinite-Horizon Policy-Gradient Estimation

  2001cited by this paper
• Markov Chains: Gibbs Fields, Monte Carlo Simulation, and Queues

  2000cited by this paper
• Actor-Critic - Type Learning Algorithms for Markov Decision Processes

  1999cited by this paper
• Actor-Critic Algorithms

  1999cited by this paper
• Simulation-based optimization of Markov reward processes

  1998cited by this paper
• Reinforcement learning

  1998influential reference
• Introduction to Reinforcement Learning

  1998influential reference
• An Analysis of Temporal-Difference Learning with Function Approximation

  1998influential reference
• Perturbation realization, potentials, and sensitivity analysis of Markov processes

  1997cited by this paper
• Stochastic approximation with two time scales

  1997cited by this paper
• Analytical Mean Squared Error Curves for Temporal Difference Learning

  1996cited by this paper
• Temporal Difference Learning and TD-Gammon

  1995influential reference
• Dynamic Programming and Optimal Control, Two Volume Set

  1995influential reference
• On the Generation of Markov Decision Processes

  1995cited by this paper
• Discrete Stochastic Processes

  1995influential reference
• Markov Decision Processes: Discrete Stochastic Dynamic Programming

  1994influential reference
• Stochastic approximation algorithms and applications

  1973influential reference

• Optimal Sample Complexity for Single Time-Scale Actor-Critic with Momentum

  2026cites this paper
• Finite-Time Global Optimality Convergence in Deep Neural Actor-Critic Methods for Decentralized Multi-Agent Reinforcement Learning

  2025cites this paper
• Finite Time Analysis of Constrained Natural Critic-Actor Algorithm with Improved Sample Complexity

  2025cites this paper
• Bi-Level Policy Optimization with Nyström Hypergradients

  2025cites this paper
• On the Convergence of Single-Timescale Actor-Critic

  2024cites this paper
• Global Optimality of Single-Timescale Actor-Critic under Continuous State-Action Space: A Study on Linear Quadratic Regulator

  2024cites this paper
• SpaceRL-KG: Searching paths automatically combining embedding-based rewards with Reinforcement Learning in Knowledge Graphs

  2024cites this paper
• Two-Timescale Critic-Actor for Average Reward MDPs with Function Approximation

  2024cites this paper
• A System-theoretic Note on Model-Based Actor-Critic

  2024cites this paper
• Finite-Time Analysis of Three-Timescale Constrained Actor-Critic and Constrained Natural Actor-Critic Algorithms

  2023cites this paper
• On the normative advantages of dopamine and striatal opponency for learning and choice

  2022cites this paper
• A Small Gain Analysis of Single Timescale Actor Critic

  2022cites this paper
• Provably Efficient Convergence of Primal-Dual Actor-Critic with Nonlinear Function Approximation

  2022cites this paper
• Finite-time analysis of single-timescale actor-critic

  2022cites this paper
• Deterministic policy gradient: Convergence analysis

  2022cites this paper
• Stochastic cubic-regularized policy gradient method

  2022cites this paper
• Global Convergence of Two-timescale Actor-Critic for Solving Linear Quadratic Regulator

  2022cites this paper
• Analysis of Stochastic Processes through Replay Buffers

  2022cites this paper
• Sim and Real: Better Together

  2021cites this paper
• Bringing Fairness to Actor-Critic Reinforcement Learning for Network Utility Optimization

  2021cites this paper
• Research on Motion Planning Based on Flocking Control and Reinforcement Learning for Multi-Robot Systems

  2021cites this paper
• On Finite-Time Convergence of Actor-Critic Algorithm

  2021cites this paper
• Single-Timescale Actor-Critic Provably Finds Globally Optimal Policy

  2020influential citation
• A Finite Time Analysis of Two Time-Scale Actor Critic Methods

  2020cites this paper
• Sample Complexity of Policy Gradient Finding Second-Order Stationary Points

  2020cites this paper
• Average-reward model-free reinforcement learning: a systematic review and literature mapping

  2020influential citation
• Parameter Critic: a Model Free Variance Reduction Method Through Imperishable Samples

  2020cites this paper
• Actor-Critic Provably Finds Nash Equilibria of Linear-Quadratic Mean-Field Games

  2019cites this paper
• On the sample complexity of actor-critic method for reinforcement learning with function approximation

  2019influential citation
• Global Convergence of Policy Gradient Methods to (Almost) Locally Optimal Policies

  2019influential citation
• Neural Policy Gradient Methods: Global Optimality and Rates of Convergence

  2019cites this paper
• Convergence and Iteration Complexity of Policy Gradient Method for Infinite-horizon Reinforcement Learning

  2019cites this paper
• Natural Actor-Critic Converges Globally for Hierarchical Linear Quadratic Regulator

  2019cites this paper
• Fully Decentralized Multi-Agent Reinforcement Learning with Networked Agents

  2018cites this paper
• A Finite Sample Analysis of the Actor-Critic Algorithm

  2018cites this paper
• Convergent Reinforcement Learning with Function Approximation: A Bilevel Optimization Perspective

  2018cites this paper
• GANs Trained by a Two Time-Scale Update Rule Converge to a Local Nash Equilibrium

  2017cites this paper
• GANs Trained by a Two Time-Scale Update Rule Converge to a Nash Equilibrium

  2017influential citation
• Tunable and generic problem instance generation for multi-objective reinforcement learning

  2014cites this paper
• On the Sample Complexity of Actor-Critic for Reinforcement Learning

  year unknowncites this paper