Optimal Stabilization Using Lyapunov Measures

Numerical solutions for the optimal feedback stabilization of discrete time dynamical systems is the focus of this technical note. Set-theoretic notion of almost everywhere stability introduced by the Lyapunov measure, weaker than conventional Lyapunov function-based stabilization methods, is used for optimal stabilization. The linear Perron-Frobenius transfer operator is used to pose the optimal stabilization problem as an infinite dimensional linear program. Set-oriented numerical methods are used to obtain the finite dimensional approximation of the linear program. We provide conditions for the existence of stabilizing feedback controls and show the optimal stabilizing feedback control can be obtained as a solution of a finite dimensional linear program. The approach is demonstrated on stabilization of period two orbit in a controlled standard map.

• Publication year

  2014

• Venue

  IEEE Transactions on Automatic Control

• Publication date

  2014-05-01

• Fields of study

  Mathematics, Computer Science, Engineering

• Identifiers
  DOI 10.1109/TAC.2013.2289707arXiv 1408.6917
• External record

  Open on Semantic Scholar

• Source metadata

  Semantic Scholar

• No claims are published for this paper.

• No concepts are published for this paper.

• Recurrence in Ergodic Theory and Combinatorial Number Theory

  2014cited by this paper
• Stability in the almost everywhere sense: A linear transfer operator approach

  2010cited by this paper
• Optimal stabilization using Lyapunov measure

  2008cited by this paper
• Society for Industrial and Applied Mathematics(SIAM)

  2008cited by this paper
• Lyapunov Measure for Almost Everywhere Stability

  2008cited by this paper
• Convex Programs for Temporal Verification of Nonlinear Dynamical Systems

  2007cited by this paper
• Nonlinear stabilization via control-Lyapunov measure

  2007cited by this paper
• Converse theorem for almost everywhere stability using Lyapunov measure

  2007cited by this paper
• Linear Programming Approach to Deterministic Long Run Average Problems of Optimal Control

  2006cited by this paper
• On the implementation of an interior-point filter line-search algorithm for large-scale nonlinear programming

  2006cited by this paper
• A set oriented approach to optimal feedback stabilization

  2005cited by this paper
• Nonlinear optimal control: Numerical approximations via moments and LMI-relaxations

  2005cited by this paper
• Covering Pareto Sets by Multilevel Subdivision Techniques

  2005cited by this paper
• Nonlinear optimal control: approximations via moments and LMI-relaxations

  2005cited by this paper
• Error estimation and adaptive discretization for the discrete stochastic Hamilton–Jacobi–Bellman equation

  2004cited by this paper
• Controllability for a class of area-preserving twist maps

  2004cited by this paper
• A set oriented approach to global optimal control

  2004cited by this paper
• Almost Global Stochastic Stability

  2004cited by this paper
• Convex dynamic programming for hybrid systems

  2002cited by this paper
• A dual to Lyapunov's stability theorem

  2001cited by this paper
• Solution of Fixed Final State Optimal Control Problems via Simple Cell Mapping

  2000cited by this paper
• ESAIM: Control, Optimisation and Calculus of Variations

  2000cited by this paper
• Algorithms for optimization and stabilization of controlled Markov chains

  1999cited by this paper
• On the Approximation of Complicated Dynamical Behavior

  1999cited by this paper
• Chaos, Fractals, and Noise: Stochastic Aspects of Dynamics

  1998cited by this paper
• Approximation Schemes for Infinite Linear Programs

  1998cited by this paper
• Primal-Dual Interior-Point Methods

  1997cited by this paper
• Optimal Control and Viscosity Solutions of Hamilton-Jacobi-Bellman Equations

  1997influential reference
• Book Review: Discrete-time Markov control processes: Basic optimality criteria

  1997cited by this paper
• Uniting local and global controllers

  1997cited by this paper
• THE LINEAR PROGRAMMING APPROACH TO DETERMINISTIC OPTIMAL CONTROL PROBLEMS

  1996cited by this paper
• Stochastic stability versus localization in one-dimensional chaotic dynamical systems

  1996cited by this paper
• Chaos, Fractals, and Noise

  1994cited by this paper
• Convex duality and nonlinear optimal control

  1993cited by this paper
• Linear programming in infinite-dimensional spaces : theory and applications

  1987cited by this paper

• Kernel-Based LMI Approaches to Solving the Hamilton-Jacobi-Bellman Equation and Nonlinear Optimal Control

  2026cites this paper
• Lyapunov-based reinforcement learning for distributed control with stability guarantee

  2024cites this paper
• Data-driven optimal control via linear transfer operators: A convex approach

  2023cites this paper
• Optimal Design of Control-Lyapunov Functions by Semi-Infinite Stochastic Programming

  2023cites this paper
• Real Power Modulation Strategies for Transient Stability Control

  2022cites this paper
• Data-Driven Optimal Control via Linear Transfer Operators: A Convex Approach

  2022cites this paper
• Convex Optimal Control Synthesis Under Safety Constraints

  2021cites this paper
• Stabilization of Nonlinear Discrete-Time Systems to Target Measures Using Stochastic Feedback Laws

  2021cites this paper
• A Convex Approach to Data-Driven Optimal Control via Perron–Frobenius and Koopman Operators

  2020cites this paper
• Data-Driven Control with Learned Dynamics

  2020cites this paper
• AA274A: Principles of Robot Autonomy I Course Notes

  2020cites this paper
• Self-Organization of Multi-Agent Systems Using Markov Chain Models

  2020cites this paper
• Koopman Operator Methods for Global Phase Space Exploration of Equivariant Dynamical Systems

  2020cites this paper
• Data Driven Online Learning of Power System Dynamics

  2020cites this paper
• Introduction to the Koopman Operator in Dynamical Systems and Control Theory

  2020cites this paper
• A convex data-driven approach for nonlinear control synthesis

  2020cites this paper
• Data-driven modeling and control of dynamical systems using Koopman and Perron-Frobenius operators

  2020cites this paper
• Model‐based reinforcement learning for nonlinear optimal control with practical asymptotic stability guarantees

  2020cites this paper
• Deep Learning of Koopman Representation for Control

  2020cites this paper
• On Information Transfer in Dynamical Systems with applications in Control of Non-equilibrium Dynamics

  2019cites this paper
• Data-Driven Nonlinear Stabilization Using Koopman Operator

  2019cites this paper
• Data-Driven Approximations of Dynamical Systems Operators for Control

  2019cites this paper
• On Computation of Koopman Operator from Sparse Data

  2019cites this paper
• Optimal Quadratic Regulation of Nonlinear System Using Koopman Operator

  2019cites this paper
• Online Learning of Dynamical Systems: An Operator Theoretic Approach

  2019cites this paper
• Information Transfer in Dynamical Systems and Optimal Placement of Actuators and Sensors for Control of Non-equilibrium Dynamics

  2019cites this paper
• AA274A: Principles of Robot Autonomy I Course Notes

  2019cites this paper
• Optimal Transport Over Deterministic Discrete-Time Nonlinear Systems Using Stochastic Feedback Laws

  2018cites this paper
• Data-Driven Optimal Control Using Transfer Operators

  2018cites this paper
• Feedback Stabilization Using Koopman Operator

  2018cites this paper
• On Robust Computation of Koopman Operator and Prediction in Random Dynamical Systems

  2018cites this paper
• Data-Driven Optimal Control Using Perron-Frobenius Operator

  2018influential citation
• Optimal motion planning using navigation measure

  2018influential citation
• Koopman operator-based model reduction for switched-system control of PDEs

  2017cites this paper
• Data-Driven Approximation of Transfer Operators: Naturally Structured Dynamic Mode Decomposition

  2017cites this paper
• Transfer operator-based approach for optimal stabilization of stochastic systems

  2017cites this paper
• Optimal transport over nonlinear systems via infinitesimal generators on graphs

  2016cites this paper
• Optimal perturbations for nonlinear systems using graph-based optimal transport

  2016cites this paper
• Moment-sum-of-squares hierarchies for set approximation and optimal control

  2016cites this paper
• Controller design and value function approximation for nonlinear dynamical systems

  2015cites this paper
• Computation of the Lyapunov measure for almost everywhere stochastic stability

  2015cites this paper
• Constructing Markov matrices for real-time transient contaminant transport analysis for indoor environments

  2015cites this paper
• Stochastic stability analysis of discrete-time system using Lyapunov measure

  2015cites this paper