Risk sensitive control of Markov processes in countable state space

No abstract is available for this paper.

• Publication year

  1996

• Venue

  Systems & Control Letters

• Publication date

  1996-11-11

• Fields of study

  Mathematics, Engineering

• Identifiers
  DOI 10.1016/S0167-6911(96)00051-5
• External record

  Open on Semantic Scholar

• Source metadata

  Semantic Scholar

• No claims are published for this paper.

• No concepts are published for this paper.

• Risk sensitive control of finite state machines on an infinite horizon. I

  1997cited by this paper
• Risk Sensitive Markov Decision Processes

  1997cited by this paper
• A weak convergence approach to the theory of large deviations

  1997cited by this paper
• Connections between stochastic control and dynamic games

  1996cited by this paper
• Risk-Sensitive Control on an Infinite Time Horizon

  1995cited by this paper
• Risk-Sensitive Control and Dynamic Games for Partially Observed Discrete-Time Nonlinear Systems

  1994cited by this paper
• Robust and Risk-Sensitive Output Feedback Control for Finite State Machines and Hidden Markov Models

  1994cited by this paper
• The equivalence between infinite-horizon optimal control of stochastic systems with exponential-of-integral performance index and stochastic differential games

  1994cited by this paper
• Risk-sensitive optimal control of hidden Markov models: a case study

  1994cited by this paper
• Discrete-time controlled Markov processes with average cost criterion: a survey

  1993cited by this paper
• Asymptotic analysis of nonlinear stochastic risk-sensitive control and differential games

  1992cited by this paper
• Remarks on the existence of solutions to the average cost optimality equation in Markov decision processes

  1991cited by this paper
• Risk-Sensitive Optimal Control

  1990cited by this paper
• Adaptive Markov Control Processes

  1989cited by this paper
• Necessary conditions for the optimality equation in average-reward Markov decision processes

  1989cited by this paper
• Adaptive Markov Control Processes

  1989cited by this paper
• Discounted MDP's: distribution functions and exponential utility maximization

  1987influential reference
• ON DECISION AND CONTROL

  1985cited by this paper
• Optimal control of partially observable stochastic systems with an exponential-of-integral performance index

  1985cited by this paper
• Optimal stochastic linear systems with exponential performance criteria and their relation to deterministic differential games

  1973cited by this paper
• Risk-sensitive Control and Diierential Games in Innnite Dimensions 1

  year unknowncited by this paper

• Risk-Sensitive Exponential Actor Critic

  2026cites this paper
• Optimal Risk Efficient Quantum Control For Risk Sensitive Quantum Systems

  2025cites this paper
• Risk-Sensitive Variational Actor-Critic: A Model-Based Approach

  2025cites this paper
• Reinforcement learning adaptive risk-sensitive fault-tolerant IGC method for a class of STT missile

  2024cites this paper
• Risk Sensitivity in Markov Games and Multi-Agent Reinforcement Learning: A Systematic Review

  2024influential citation
• Discrete-time hybrid control with risk-sensitive discounted costs

  2024influential citation
• Nonzero-sum Discrete-time Stochastic Games with Risk-sensitive Ergodic Cost Criterion

  2024influential citation
• Markov decision processes with risk-sensitive criteria: an overview

  2023cites this paper
• Risk-sensitive Markov Decision Process and Learning under General Utility Functions

  2023cites this paper
• Contractive approximations in average Markov decision chains driven by a risk-seeking controller

  2023cites this paper
• Non-stationary Risk-sensitive Reinforcement Learning: Near-optimal Dynamic Regret, Adaptive Detection, and Separation Design

  2022cites this paper
• Ergodic risk-sensitive control - A survey

  2022cites this paper
• Partially observable discrete-time discounted Markov games with general utility

  2022cites this paper
• Portfolio management under drawdown constraint in discrete-time financial markets

  2022cites this paper
• Cascaded Gaps: Towards Logarithmic Regret for Risk-Sensitive Reinforcement Learning

  2022cites this paper
• Cascaded Gaps: Towards Gap-Dependent Regret for Risk-Sensitive Reinforcement Learning

  2022cites this paper
• Risk-sensitive semi-Markov decision problems with discounted cost and general utilities

  2021cites this paper
• Provably Efficient Actor-Critic for Risk-Sensitive and Robust Adversarial RL: A Linear-Quadratic Case

  2021influential citation
• Risk-Sensitive Reinforcement Learning with Function Approximation: A Debiasing Approach

  2021cites this paper
• Zero-sum semi-Markov games with a probability criterion

  2021cites this paper
• Exponential Bellman Equation and Improved Regret Bounds for Risk-Sensitive Reinforcement Learning

  2021cites this paper
• Ergodic risk-sensitive control of Markov processes on countable state space revisited

  2021cites this paper
• Controlling Tracking Performance for System Health Management - A Markov Decision Process Formulation

  2020cites this paper
• A Discounted Approach in Communicating Average Markov Decision Chains Under Risk-Aversion

  2020cites this paper
• Risk-Sensitive Reinforcement Learning: Near-Optimal Risk-Sample Tradeoff in Regret

  2020cites this paper
• Distributed Stabilization of State Interdependent Markov Jump LinearSystem-of-Systems with Partial Information

  2020cites this paper
• Distributed Stabilization of Two Interdependent Markov Jump Linear Systems With Partial Information

  2020cites this paper
• Risk-sensitive control of branching processes

  2019cites this paper
• Exit time risk-sensitive control for systems of cooperative agents

  2019cites this paper
• Multivariate Utility Optimization with an Application to Risk-Sensitive Partially Observable Markov Decision Processes

  2018cites this paper
• Discrete-time Risk-sensitive Mean-field Games

  2018cites this paper
• Risk-Sensitive Reinforcement Learning: A Constrained Optimization Viewpoint

  2018cites this paper
• J an 2 01 5 A VARIATIONAL FORMULA FOR RISK-SENSITIVE REWARD

  2018cites this paper
• Risk Sensitive Multiple Goal Stochastic Optimization, with application to Risk Sensitive Partially Observed Markov Decision Processes

  2018cites this paper
• Exit time risk-sensitive control for systems of cooperative agents

  2018cites this paper
• Verification of Markov Decision Processes with Risk-Sensitive Measures

  2018cites this paper
• Risk-Sensitive Partially Observable Markov Decision Processes as Fully Observable Multivariate Utility Optimization problems

  2018cites this paper
• Vanishing discount approximations in controlled Markov chains with risk-sensitive average criterion

  2017cites this paper
• Local Poisson Equations Associated with Discrete-Time Markov Control Processes

  2017cites this paper
• Linear and dynamic programming approaches to degenerate risk-sensitive reward processes

  2017cites this paper
• Nonzero-Sum Risk-Sensitive Stochastic Games on a Countable State Space

  2016cites this paper
• Controlled Semi-Markov Chains with Risk-Sensitive Average Cost Criterion

  2016cites this paper
• A poisson equation for the risk-sensitive average cost in semi-markov chains

  2016cites this paper
• Controlled Semi-Markov Chains with Risk-Sensitive Average Cost Criterion

  2016cites this paper
• Nonzero-Sum Risk Sensitive Stochastic Games for Continuous Time Markov Chains

  2016cites this paper
• Nonlinear Perron-Frobenius theory and mean-payoff zero-sum stochastic games

  2016cites this paper
• Zero-sum Risk-Sensitive Stochastic Games

  2016cites this paper
• A poisson equation for the risk-sensitive average cost in semi-markov chains

  2016cites this paper
• Zero-sum risk-sensitive stochastic games for continuous time Markov chains

  2016cites this paper
• A Variational Formula for Risk-Sensitive Reward

  2015cites this paper
• Risk-Sensitive Ergodic Control of Continuous Time Markov Processes With Denumerable State Space

  2015cites this paper
• Risk-sensitive Markov Decision Processes

  2015cites this paper
• A new approach to risk sensitivity

  2015cites this paper
• Continuity of the optimal average cost in Markov decision chains with small risk-sensitivity

  2015cites this paper
• Continuity of the optimal average cost in Markov decision chains with small risk-sensitivity

  2015cites this paper
• Long run risk sensitive portfolio with general factors

  2015influential citation
• Topics in Online Markov Decision Processes

  2015cites this paper
• Risk-sensitive control of continuous time Markov chains

  2014cites this paper
• Online Markov Decision Processes With Kullback–Leibler Control Cost

  2014cites this paper
• Computational Methods for Risk-Averse Undiscounted Transient Markov Models

  2014cites this paper
• Risk-sensitive Markov Control Processes with Strictly Convex Risk Maps

  2014cites this paper
• On Average Risk-sensitive Markov Control Processes

  2014cites this paper
• A unified framework for risk-sensitive Markov control processes

  2014cites this paper
• Risk-Sensitive Multiagent Decision-Theoretic Planning Based on MDP and One-Switch Utility Functions

  2014cites this paper
• Zero-sum risk-sensitive stochastic games on a countable state space

  2014cites this paper
• Abstract dynamic programming

  2013cites this paper
• APPENDIX A: Notation and Mathematical Conventions

  2013cites this paper
• Risk-Sensitive Reinforcement Learning

  2013cites this paper
• Ecuaciones de optimalidad para el criterio del costo promedio sensible al riesgo en procesos de decisión markovianos sobre un espacio finito

  2013cites this paper
• Load allocation for optimal risk management in systems with incipient failure modes

  2013cites this paper
• Risk-Sensitive Control of Pure Jump Process on Countable Space with Near Monotone Cost

  2013cites this paper
• Ecuaciones de Optimalidad Para el Criterio del Costo Promedio Sensible al Riesgo en Procesos de Decisi on Markovianos Sobre un Espacio Finito

  2013cites this paper
• Risk-Sensitive Control of Pure Jump Process on Countable Space with Near Monotone Cost

  2013cites this paper
• Markov Modeling of Component Fault Growth Over A Derived Domain of Feasible Output Control Effort Modifications

  2012cites this paper
• Online Markov decision processes with Kullback-Leibler control cost

  2012cites this paper
• Zero-Sum Risk-Sensitive Stochastic Differential Games

  2012cites this paper
• Safe Exploration in Markov Decision Processes

  2012cites this paper
• A risk sensitive performance index for control problems with a view to Markov jump systems

  2012cites this paper
• An optimality system for finite average Markov decision chains under risk-aversion

  2012influential citation
• Delay optimal multichannel opportunistic access

  2011cites this paper
• Discounted Approximations for Risk-Sensitive Average Criteria in Markov Decision Chains with Finite State Space

  2011cites this paper
• Target-sensitive control of Markov and semi-Markov processes

  2011cites this paper
• Risk-Sensitive Markov Control Processes

  2011cites this paper
• Dissipativity and risk-sensitivity in control problems

  2011cites this paper
• Optimality equations and inequalities in a class of risk-sensitive average cost Markov decision chains

  2010cites this paper
• Topics in Modeling Uncertainty with Learning

  2010cites this paper
• Sequential decision making in general state space models

  2009cites this paper
• The Risk-Sensitive Poisson Equation for a Communicating Markov Chain on a Denumerable State Space

  2009cites this paper
• Solutions of the average cost optimality equation for finite Markov decision chains: risk-sensitive and risk-neutral criteria

  2009influential citation
• Necessary and sufficient conditions for a solution to the risk-sensitive Poisson equation on a finite state space

  2009cites this paper
• Contractive approximations for the Varadhan's function on a finite Markov chain@@@Contractive approximations for the Varadhan's function on a finite Markov chain

  2007cites this paper
• Average optimality for risk-sensitive control with general state space

  2007influential citation
• A note on risk-sensitive control of invariant models

  2007cites this paper
• Infinite Horizon Risk Sensitive Control of Discrete Time Markov Processes under Minorization Property

  2007cites this paper
• Average optimality for risk-sensitive control with general state space

  2007cites this paper
• Risk-Sensitive , Minimax , and MixedRisk-Neutral / Minimax Control ofMarkov Decision

  2007cites this paper
• A System of Poisson Equations for a Nonconstant Varadhan Functional on a Finite State Space

  2006cites this paper
• Remarks on Risk Neutral and Risk Sensitive Portfolio Optimization

  2006cites this paper
• A Simulation-Based Algorithm for Ergodic Control of Markov Chains Conditioned on Rare Events

  2006influential citation
• Decision-theoretic planning under risk-sensitive planning objectives

  2005cites this paper