Generalization of White's Method of Successive Approximations to Periodic Markovian Decision Processes

No abstract is available for this paper.

• Publication year

  1972

• Venue

  Operational Research

• Publication date

  1972-04-01

• Fields of study

  Mathematics, Computer Science

• Identifiers
  DOI 10.1287/opre.20.2.318
• External record

  Open on Semantic Scholar

• Source metadata

  Semantic Scholar

• No claims are published for this paper.

• No concepts are published for this paper.

• On Finding the Maximal Gain for Markov Decision Processes

  1969cited by this paper
• Letter to the Editor - A Test for Suboptimal Actions in Markovian Decision Problems

  1967cited by this paper
• A MODIFIED DYNAMIC PROGRAMMING METHOD FOR MARKOVIAN DECISION PROBLEMS

  1966cited by this paper
• Discounted Markov Programming in a Periodic Process

  1965cited by this paper
• On the Iterative Method of Dynamic Programming on a Finite Space Discrete Time Markov Process

  1965cited by this paper
• Dynamic programming, Markov chains, and the method of successive approximations

  1963cited by this paper
• Dynamic Programming and Markov Processes

  1960cited by this paper

• Learning from the aggregated optimum: Managing port wine inventory in the face of climate risks

  2024cites this paper
• Going faster to see further: graphics processing unit-accelerated value iteration and simulation for perishable inventory control using JAX

  2023cites this paper
• Optimal Water Allocation Under Climate Change, Based on Stochastic Dynamic Programming Model Approach in Ribb Reservoir, Amhara, Ethiopia

  2022cites this paper
• Optimal operation of a grid‐connected battery energy storage system over its lifetime

  2021cites this paper
• Application of artificial neural network for optimal operation of a multi-purpose multi-reservoir system, II: optimal solution and performance evaluation

  2020cites this paper
• Stochastic modeling and optimization in electric vehicle networks

  2019cites this paper
• Optimal Charging at an Electric Vehicle Battery Swap Station

  2018cites this paper
• Stochastic optimal operation of reservoirs based on copula functions

  2018cites this paper
• Stochastic dynamic programming for hydropower reservoir operations with multiple local optima

  2018cites this paper
• Alpine Hydropower in the Decline of the Nuclear Era: Trade-Off between Revenue and Production in the Swiss Alps

  2018cites this paper
• Submitted to Production and Operations Management Optimal Battery Purchasing and Charging at an Electric Vehicle Battery Swap Station

  2018cites this paper
• Approximate Dynamic Programming Methods for Residential Water Heating

  2015influential citation
• Hydropower scheduling: Correlated price and inflow as stochastic variables in policy generation

  2015cites this paper
• Thinking platforms for smarter urban water systems: fusing technical and socio-economic models and tools

  2014cites this paper
• A two stage Bayesian stochastic optimization model for cascaded hydropower systems considering varying uncertainty of flow forecasts

  2014cites this paper
• Dynamic Energy Control for Energy Efficiency Improvement of Sustainable Manufacturing Systems Using Markov Decision Process

  2013cites this paper
• Source to tap urban water cycle modelling

  2013cites this paper
• Developments in Stochastic Dynamic Programming for Reservoir Operation Optimization

  2013cites this paper
• Stochastic and Robust Control of Water Resource Systems: Concepts, Methods and Applications

  2012cites this paper
• Water reservoir control under economic, social and environmental constraints

  2008cites this paper
• Receding horizon control for water resources management

  2008cites this paper
• Integration, participation and optimal control in water resources planning and management

  2008cites this paper
• An alternative approach to the operation of multinational reservoir systems: Application to the Amistad & Falcon system (Lower Rio Grande/Río Bravo)

  2007cites this paper
• Chapter 12 Off-line non-learning-based policies

  2007cites this paper
• Blood platelet production: Optimization by dynamic programming and simulation

  2007cites this paper
• Blood Platelet Production: a multi-type perishable inventory problem

  2004cites this paper
• A First Course in Stochastic Models

  2003cites this paper
• A DECISION SUPPORT TOOL FOR THE MANAGEMENT OF MULTI‐RESERVOIR SYSTEMS 1

  2002cites this paper
• A parametric rule for planning and management of multiple‐reservoir systems

  1997cites this paper
• The Value of Hydrologic Information in Stochastic Dynamic Programming Models of a Multireservoir System

  1995cites this paper
• Design and Control of Water Systems under Unsteady Conditions

  1994cites this paper
• A Survey of Applications of Markov Decision Processes

  1993cites this paper
• Comparison of two approaches for implementing multireservoir operating policies derived using stochastic dynamic programming

  1993cites this paper
• Numerical Solution of Continuous-State Dynamic Programs Using Linear and Spline Interpolation

  1993cites this paper
• Aggregation‐Disaggregation Approach to multireservoir operation

  1992cites this paper
• Stochastic dynamic programming for reservoir optimal control: Dense discretization and inflow correlation assumption made possible by parallel computing

  1991cites this paper
• Optimal hydropower system configuration based on operational analysis

  1990cites this paper
• Extended linear quadratic Gaussian control: Further extensions

  1989cites this paper
• A methodology for computation reduction for specially structured large scale Markov decision problems

  1988cites this paper
• Optimization of the Firm Hydro Energy Capability for Hydroelectric Systems

  1988cites this paper
• Effects of Reclamation Plans on Water Shortages and Flood Protection

  1988cites this paper
• Politicas de operacion de presas

  1987cites this paper
• A New Method for the Real-Time Operation of Reservoir Systems

  1987cites this paper
• Optimal real-time forecasting and control of reservoir hydrosystems using remote and on-site sensors

  1986cites this paper
• Optimization of Real‐Time Reservoir Operations With Markov Decision Processes

  1986cites this paper
• Aggregation and disaggregation in Markov decision models for inventory control

  1985cites this paper
• Reservoir Management and Operations Models: A State‐of‐the‐Art Review

  1985cites this paper
• Successive Approximation Methods for Solving Nested Functional Equations in Markov Decision Problems

  1984cites this paper
• Optimal Operation of Multipurpose Pool of Elk City Lake

  1984cites this paper
• The numerical exploitation of periodicity in Markov decision processes

  1983influential citation
• Real time adaptive closed loop control of reservoirs with the High Aswan Dam as a case study

  1983cites this paper
• Agricultural vs. hydropower tradeoffs in the operation of the High Aswan Dam

  1982cites this paper
• Application of stochastic dynamic programming in optimizing the regulation of hydropower reservoirs

  1982cites this paper
• Stochastic state variable dynamic programing for reservoir systems analysis

  1981cites this paper
• Stochastic optimization of a water supply system

  1979cites this paper
• Computation techniques for large scale undiscounted markov decision processes

  1979cites this paper
• Geometric convergence of value-iteration in multichain Markov decision problems

  1979cites this paper
• Contraction mappings underlying undiscounted Markov decision problems—II

  1978cites this paper
• DISCOUNTED AND UNDISCOUNTED VALUE-ITERATION IN MARKOV DECISION PROBLEMS: A SURVEY

  1977cites this paper
• Modeling the regulation of lake superior under uncertainty of future water supplies

  1974cites this paper
• CONVERGENCE OF BENEFIT DIFFERENCES

  1974cites this paper
• Discussion on "Stochastic Dynamic Programming for Optimum Reservoir Operation" by William S. Butcher

  1971cites this paper