Finite-Memory Suboptimal Design for Partially Observed Markov Decision Processes

No abstract is available for this paper.

• Publication year

  1994

• Venue

  Operational Research

• Publication date

  1994-06-01

• Fields of study

  Mathematics, Computer Science

• Identifiers
  DOI 10.1287/opre.42.3.439
• External record

  Open on Semantic Scholar

• Source metadata

  Semantic Scholar

• No claims are published for this paper.

• No concepts are published for this paper.

• Computationally Feasible Bounds for Partially Observed Markov Decision Processes

  1991cited by this paper
• A survey of solution techniques for the partially observed Markov decision process

  1991cited by this paper
• Algorithms for partially observable markov decision processes

  1989cited by this paper
• Solution Procedures for Partially Observed Markov Decision Processes

  1989cited by this paper
• Dynamic Programming: Deterministic and Stochastic Models

  1987cited by this paper
• A New Optimality Criterion for Nonhomogeneous Markov Decision Processes

  1987cited by this paper
• Real Applications of Markov Decision Processes

  1985cited by this paper
• The Contraction Mapping Approach to the Perron-Frobenius Theory: Why Hilbert's Metric?

  1982cited by this paper
• The Optimal Control of Partially Observable Markov Processes over the Infinite Horizon: Discounted Costs

  1978cited by this paper
• Discounting, Ergodicity and Convergence for Markov Decision Processes

  1977cited by this paper
• Finite memory estimation and control of finite probabilistic systems

  1977cited by this paper
• The Optimal Control of Partially Observable Markov Processes over a Finite Horizon

  1973cited by this paper
• Introduction to Probabilistic Automata

  1971cited by this paper
• Introduction to probabilistic automata (Computer science and applied mathematics)

  1971cited by this paper
• The optimal control of par-tially observable Markov processes

  1971cited by this paper
• Letter to the Editor - A Test for Suboptimal Actions in Markovian Decision Problems

  1967cited by this paper
• CONTRACTION MAPPINGS IN THE THEORY UNDERLYING DYNAMIC PROGRAMMING

  1967cited by this paper
• Sufficient statistics in the optimum control of stochastic systems

  1965cited by this paper
• OPTIMUM POLICIES FOR PARTIALLY OBSERVABLE MARKOV SYSTEMS

  1965cited by this paper
• Dynamic Programming

  1957cited by this paper

• Sub-optimality bounds for certainty equivalent policies in partially observed systems

  2026cites this paper
• Finite Memory Belief Approximation for Optimal Control in Partially Observable Markov Decision Processes

  2026cites this paper
• Near Optimal Approximations and Finite Memory Policies for POMPDs with Continuous Spaces

  2025cites this paper
• Periodic agent-state based Q-learning for POMDPs

  2024cites this paper
• Agent-state based policies in POMDPs: Beyond belief-state MDPs

  2024cites this paper
• Refined Bounds on Near Optimality Finite Window Policies in POMDPs and Their Reinforcement Learning

  2024cites this paper
• Retail Investment under Hidden Business Cycle

  2024cites this paper
• The optimal probability of the risk for finite horizon partially observable Markov decision processes

  2023cites this paper
• Another Look at Partially Observed Optimal Stochastic Control: Existence, Ergodicity, and Approximations Without Belief-Reduction

  2023influential citation
• Active flow control for bluff body drag reduction using reinforcement learning with partial measurements

  2023influential citation
• Class Notes for ASU Course CSE 691; Spring 2023 Topics in Reinforcement Learning

  2023cites this paper
• Near Optimality of Finite Memory Policies for POMPDs with Continuous Spaces

  2022cites this paper
• Convergence of Finite Memory Q-Learning for POMDPs and Near Optimality of Learned Policies under Filter Stability

  2021cites this paper
• Information State Embedding in Partially Observable Cooperative Multi-Agent Reinforcement Learning

  2020cites this paper
• Asymptotic Optimality of Finite Model Approximations for Partially Observed Markov Decision Processes With Discounted Cost

  2020cites this paper
• Structural Estimation of Partially Observable Markov Decision Processes

  2020cites this paper
• Near Optimality of Finite Memory Feedback Policies in Partially Observed Markov Decision Processes

  2020cites this paper
• Dynamic Discrete Choice Estimation with Partially Observable States and Hidden Dynamics

  2020cites this paper
• Approximations for Partially Observed Markov Decision Processes

  2018cites this paper
• Stochastic Observability and Filter Stability Under Several Criteria

  2018influential citation
• Reinforcement Learning and Optimal Control

  2018cites this paper
• Finite Model Approximations for Partially Observed Markov Decision Processes with Discounted Cost

  2017cites this paper
• Methodological Issues in Analyzing Market Dynamics

  2016cites this paper
• A Framework for Dynamic Oligopoly in Concentrated Industries

  2016cites this paper
• Value of information for a leader–follower partially observed Markov game

  2015cites this paper
• Value of information for a leader–follower partially observed Markov game

  2015cites this paper
• A leader–follower partially observed, multiobjective Markov game

  2015cites this paper
• A leader-follower partially observed Markov game

  2015influential citation
• Markovian-based framework for cooperative channel selection in cognitive radio networks

  2014cites this paper
• Partially Observed, Multi-objective Markov Games

  2014cites this paper
• Adaptive sensing strategies for opportunistic spectrum access

  2013cites this paper
• State observation accuracy and finite-memory policy performance

  2013cites this paper
• Identifying dynamic tuberculosis case-finding policies for HIV/TB coepidemics

  2013cites this paper
• Optimization for stochastic, partially observed systems using a sampling-based approach to learn switched policies

  2011cites this paper
• Event-Based Optimization for POMDPs and Its Application in Portfolio Management

  2011cites this paper
• Traffic Light Control by Multiagent Reinforcement Learning Systems

  2010cites this paper
• Partially Observable Markov Decision Processes: A Geometric Technique and Analysis

  2010cites this paper
• Estimating the price of privacy in liver transplantation

  2008cites this paper
• Stochastic inventory control with partial demand observability

  2008cites this paper
• Reinforcement Learning of Traffic Light Controllers under Partial Observability

  2007cites this paper
• Processos de Decisão de Markov: um tutorial

  2007cites this paper
• A Multiple Representation Approach to Learning Dynamical Systems

  2007cites this paper
• Research in Industrial Projects for Students 1 Project Proposal : The Disambiguation Problem Industrial Partner : Lawrence Livermore National Laboratory Industrial

  2006cites this paper
• A Genetic Algorithm Heuristic for Finite Horizon Partially Observed Markov Decision Problems

  2003cites this paper
• Finite State and Action MDPS

  2003cites this paper
• Adaptive Inventory Control for Nonstationary Demand and Partial Information

  2002cites this paper
• Algorithms for partially observable markov decision processes

  2001cites this paper
• Value-Function Approximations for Partially Observable Markov Decision Processes

  2000cites this paper
• Adaptive Inventory Control for Non-Stationary Demand with Partial Information

  1999cites this paper
• A simple suboptimal algorithm for system maintenanceunder partial observability

  1999cites this paper
• Mathematics of operations research

  1998cites this paper
• A Model Approximation Scheme for Planning in Partially Observable Stochastic Domains

  1997cites this paper
• Planning in Stochastic Domains: Problem Characteristics and Approximation

  1996cites this paper
• Flexible Policy Construction by Information Refinement

  1996cites this paper
• Algorithms for Sequential Decision Making

  1996influential citation
• Instance-Based Utile Distinctions for Reinforcement Learning with Hidden State

  1995cites this paper