Existence of Markov Controls and Characterization of Optimal Markov Controls

No abstract is available for this paper.

• Publication year

  1998

• Venue

  Siam Journal on Control and Optimization

• Publication date

  1998-03-01

• Fields of study

  Mathematics

• Identifiers
  DOI 10.1137/S0363012995295516
• External record

  Open on Semantic Scholar

• Source metadata

  Semantic Scholar

• No claims are published for this paper.

• No concepts are published for this paper.

• A class of singular control problems

  1987cited by this paper

• Linear Programming Approach to Optimal Control Problems with Unbounded State Constraint

  2025cites this paper
• Bridging Discrete and Continuous RL: Stable Deterministic Policy Gradient with Martingale Characterization

  2025influential citation
• Mean Field Game with Reflected Jump Diffusion Dynamics: A Linear Programming Approach

  2025cites this paper
• Optimal Policy Characterization for a Class of Multi-Dimensional Ergodic Singular Stochastic Control Problems

  2025cites this paper
• A Graphon Mean Field Convex Duality Approach to Shaping the Terminal Probability Distribution of a Network of Nonlinear Multi-Agent Systems

  2025cites this paper
• Accuracy of Discretely Sampled Stochastic Policies in Continuous-time Reinforcement Learning

  2025influential citation
• Continuous-time mean field games: a primal-dual characterization

  2025influential citation
• Moment-SOS hierarchy and exit location of stochastic processes

  2024influential citation
• Existence of Optimal Stationary Singular Controls and Mean Field Game Equilibria

  2024cites this paper
• On the maximum principle for relaxed control problems of nonlinear stochastic systems

  2024cites this paper
• Distributionally Constrained Convex Duality Optimal Control (DC-CDOC) Subject to Different Forms of Constraining the Terminal State of Nonlinear Stochastic Systems

  2024cites this paper
• Finite element approximations for stochastic control problems with unbounded state space

  2024influential citation
• Controlled Martingale Problems And Their Markov Mimics

  2023cites this paper
• Superposition Principle for the Fokker–Planck–Kolmogorov Equations with Unbounded Coefficients

  2022cites this paper
• Energy transition under scenario uncertainty: a mean-field game approach

  2022cites this paper
• Linear programming fictitious play algorithm for mean field games with optimal stopping and absorption

  2022cites this paper
• A Numerical Approach for Stochastic Switched Polynomial Optimal Control and Approximating Control Lyapunov Functions

  2022cites this paper
• MF-OMO: An Optimization Formulation of Mean-Field Games

  2022cites this paper
• Existence of optimal controls for stochastic Volterra equations

  2022cites this paper
• Energy transition under scenario uncertainty: a mean-field game of stopping with common noise

  2022cites this paper
• Stochastic Optimal Control via Local Occupation Measures

  2022cites this paper
• Continuous-Time and Sampled-Data Optimal Control of Linear Stochastic Reaction Networks

  2022cites this paper
• Compactification in optimal control of McKean‐Vlasov stochastic differential equations

  2021cites this paper
• LP Based Bounds for Cesàro and Abel Limits of the Optimal Values in Non-ergodic Stochastic Systems

  2021cites this paper
• O C ] 6 D ec 2 02 1 Optimal and H ∞ Control of Stochastic Reaction Networks

  2021cites this paper
• Optimal and $H_\infty$ Control of Stochastic Reaction Networks

  2021cites this paper
• Moment-SOS hierarchy and exit time of stochastic processes

  2021influential citation
• University of Birmingham Linear programming approach to optimal impulse control problems with functional constraints

  2020cites this paper
• On the Ambrosio–Figalli–Trevisan Superposition Principle for Probability Solutions to Fokker–Planck–Kolmogorov Equations

  2020cites this paper
• Control and optimal stopping Mean Field Games: a linear programming approach

  2020cites this paper
• LP Based Upper and Lower Bounds for Cesàro and Abel Limits of the Optimal Values in Problems of Control of Stochastic Discrete Time Systems

  2020cites this paper
• A dynamic analytic method for risk-aware controlled martingale problems

  2020cites this paper
• Gradient Flows for Regularized Stochastic Control Problems

  2020influential citation
• Reinforcement Learning in Continuous Time and Space: A Stochastic Control Approach

  2020cites this paper
• Superposition and mimicking theorems for conditional McKean–Vlasov equations

  2020cites this paper
• Exercises in Stochastic Analysis

  2020cites this paper
• $p$-Safe Analysis of Stochastic Hybrid Processes

  2020cites this paper
• Representation Formulas for Limit Values of Long Run Stochastic Optimal Controls

  2020cites this paper
• Linear programming approach to optimal impulse control problems with functional constraints

  2019cites this paper
• On the Ambrosio–Figalli–Trevisan Superposition Principle for Probability Solutions to Fokker–Planck–Kolmogorov Equations

  2019cites this paper
• LP Formulations of Discrete Time Long-Run Average Optimal Control Problems: The NonErgodic Case

  2018cites this paper
• Exploration versus exploitation in reinforcement learning: a stochastic control approach

  2018cites this paper
• BASED OPTIMALITY CONDITIONS AND APPROXIMATE SOLUTION OF A DETERMINISTIC INFINITE HORIZON DISCOUNTED OPTIMAL CONTROL PROBLEM IN DISCRETE TIME

  2018cites this paper
• O C ] 7 M ay 2 01 8 Linear Programming Formulation of Long Run Average Optimal Control Problem

  2018cites this paper
• Probabilistic compactification methods for stochastic optimal control and mean field games

  2018cites this paper
• Risk Aware Minimum Principle for Optimal Control of Stochastic Differential Equations

  2018cites this paper
• Denseness of adapted processes among causal couplings

  2018cites this paper
• Linear Programming Formulation of Long-Run Average Optimal Control Problem

  2018cites this paper
• Linear Programming Formulation of Long-Run Average Optimal Control Problem

  2018cites this paper
• Optimal choices: mean field games with controlled jumps and optimality in a stochastic volatility model

  2018cites this paper
• Dense sets of joint distributions appearing in filtration enlargements, stochastic control, and causal optimal transport

  2018cites this paper
• Bounding the stationary distributions of the chemical master equation via mathematical programming.

  2017cites this paper
• Linear Programming Formulations of Singular Stochastic Control Problems: Time-Homogeneous Problems

  2017cites this paper
• Optimal Control for Nonlinear Hybrid Systems via Convex Relaxations

  2017cites this paper
• Mean field games with controlled jump–diffusion dynamics: Existence results and an illiquid interbank market model

  2017influential citation
• Linear programming based optimality conditions and approximate solution of a deterministic infinite horizon discounted optimal control problem in discrete time

  2017cites this paper
• Non-explosivity of Stochastically Modeled Reaction Networks that are Complex Balanced

  2017cites this paper
• Probability CONTROLLED EQUILIBRIUM SELECTION IN STOCHASTICALLY PERTURBED DYNAMICS By

  2017cites this paper
• Convergence of Finite Element Methods for Singular Stochastic Control

  2017cites this paper
• Linear programming formulations of deterministic infinite horizon optimal control problems in discrete time

  2017cites this paper
• Infection Time in Multistable Gene Networks. A Backward Stochastic Variational Inequality with Nonconvex Switch-Dependent Reflection Approach

  2016cites this paper
• Limit Theory for Controlled McKean-Vlasov Dynamics

  2016influential citation
• Infection Time in Multistable Gene Networks. A Backward Stochastic Variational Inequality with Nonconvex Switch-Dependent Reflection Approach

  2016cites this paper
• Safety Verification of Piecewise-Deterministic Markov Processes

  2016cites this paper
• Topics in life and disability insurance

  2015cites this paper
• Stochastic Differential Mean Field Game Theory

  2015cites this paper
• Well-posedness of Multidimensional Diffusion Processes with Weakly Differentiable Coefficients

  2015influential citation
• Asymptotic Lower Bounds for Optimal Tracking: a Linear Programming Approach

  2015influential citation
• On the LP formulation in measure spaces of optimal control problems for jump-diffusions

  2015influential citation
• Controlled equilibrium selection in stochastically perturbed dynamics

  2015cites this paper
• Safety Analysis of Stochastic Dynamical Systems

  2015cites this paper
• Two-Armed Restless Bandits with Imperfect Information: Stochastic Control and Indexability

  2015cites this paper
• Impulsive Control for Continuous-Time Markov Decision Processes: A Linear Programming Approach

  2014cites this paper
• A partial history of the early development of continuous-time nonlinear stochastic systems theory

  2014influential citation
• Risk aggregation and stochastic claims reserving in disability insurance

  2014influential citation
• On Average Control Generating Families for Singularly Perturbed Optimal Control Problems with Long Run Average Optimality Criteria

  2014cites this paper
• Mean field games via controlled martingale problems: Existence of Markovian equilibria

  2014influential citation
• Impulsive Control for Continuous-Time Markov Decision Processes: A Linear Programming Approach

  2014influential citation
• Discussion of dynamic programming and linear programming approaches to stochastic control and optimal stopping in continuous time

  2014cites this paper
• MIMICKING FINITE DIMENSIONAL MARGINALS OF A CONTROLLED DIFFUSION WITH JUMPS

  2014cites this paper
• Existence of Asymptotic Values for Nonexpansive Stochastic Control Systems

  2014cites this paper
• Averaging and Linear Programming in Some Singularly Perturbed Problems of Optimal Control

  2014cites this paper
• On Average Control Generating Families for Singularly Perturbed Optimal Control Problems with Long Run Average Optimality Criteria

  2014cites this paper
• System Modeling and Optimization - 26th IFIP TC 7 Conference, CSMO 2013, Klagenfurt, Austria, September 9-13, 2013, Revised Selected Papers

  2014influential citation
• Averaging and Linear Programming in Some Singularly Perturbed Problems of Optimal Control

  2013cites this paper
• On sets of occupational measures generated by a deterministic control system on an infinite time horizon

  2013cites this paper
• An LP approach to dynamic programming principles for stochastic control problems with state constraints

  2013cites this paper
• Long-Term Optimal Investment Strategies in the Presence of Adjustment Costs

  2013influential citation
• Impulse Control of Standard Brownian Motion: Long-Term Average Criterion

  2013cites this paper
• Stochastic modelling in disability insurance

  2013cites this paper
• On the valuation of barrier and American options in local volatility models with jumps

  2013cites this paper
• Mesures d'occupation et relaxations semi-définies pour la commande optimale

  2013cites this paper
• Quelques sujets en contrôle déterministe et stochastique : méthodes de type LP, PDMP associés aux réseaux de gènes, contrôlabilité

  2013cites this paper
• Discussion of dynamic programming and linear programming approaches to stochastic control and optimal stopping in continuous time

  2013cites this paper
• Existence of Asymptotic Values for Nonexpansive Stochastic Control Systems

  2013cites this paper
• Use of approximations of Hamilton-Jacobi-Bellman inequality for solving periodic optimization problems

  2013cites this paper
• Time homogeneous diffusion with drift and killing to meet a given marginal

  2013cites this paper
• Approximate solution of the HJB inequality related to the infinite horizon optimal control problem with discounting

  2012cites this paper
• Méthodes numériques pour les processus markoviens déterministes par morceaux

  2012cites this paper
• Asymptotically optimal dynamic pricing for network revenue management

  2012cites this paper