On Incomplete Learning and Certainty-Equivalence Control

We consider a dynamic learning problem where a decision maker sequentially selects a control and observes a response variable that depends on chosen control and an unknown sensitivity parameter. Af...

• Publication year

  2018

• Venue

  Operational Research

• Publication date

  2018-07-26

• Fields of study

  Mathematics, Computer Science, Economics

• Identifiers
  DOI 10.1287/OPRE.2017.1713
• External record

  Open on Semantic Scholar

• Source metadata

  Semantic Scholar

• No claims are published for this paper.

• No concepts are published for this paper.

• Dynamic Pricing and Demand Learning with Limited Price Experimentation

  2017cited by this paper
• Chasing Demand: Learning and Earning in a Changing Environment

  2017cited by this paper
• On the (Surprising) Sufficiency of Linear Models for Dynamic Pricing with Demand Learning

  2015cited by this paper
• Dynamic Pricing with an Unknown Demand Model: Asymptotically Optimal Semi-Myopic Policies

  2014influential reference
• Simultaneously Learning and Optimizing Using Controlled Variance Pricing

  2014influential reference
• Dynamic Pricing with Multiple Products and Partially Specified Demand Distribution

  2014influential reference
• Dynamic Pricing and Learning with Finite Inventories

  2013cited by this paper
• Dynamic Pricing Under a General Parametric Choice Model

  2012cited by this paper
• Bayesian Dynamic Pricing Policies: Learning and Earning Under a Binary Prior Distribution

  2012cited by this paper
• Reinforcement Learning: A Tutorial Survey and Recent Advances

  2009influential reference
• Improved Rates for the Stochastic Continuum-Armed Bandit Problem

  2007cited by this paper
• Stochastic approximation: invited paper

  2003cited by this paper
• Pricing and learning with uncertain demand

  2003cited by this paper
• Finite-time Analysis of the Multiarmed Bandit Problem

  2002influential reference
• Optimal learning and experimentation in bandit problems

  2000cited by this paper
• Incomplete learning from endogenous data in dynamic allocation

  1999cited by this paper
• Reinforcement Learning: An Introduction

  1998cited by this paper
• Reinforcement Learning: A Survey

  1996cited by this paper
• Asymptotic Properties of Nonlinear Least Squares Estimates in Stochastic Regression Models

  1994cited by this paper
• Model predictive control: Theory and practice - A survey

  1989cited by this paper
• Model predictive control: Theory and practice

  1988cited by this paper
• Asymptotically efficient adaptive allocation rules

  1985cited by this paper
• Price dispersion and incomplete learning in the long run

  1984cited by this paper
• Iterated least squares in multiperiod control

  1982influential reference
• Identification and adaptive control of Markov chains

  1982cited by this paper
• Least Squares Estimates in Stochastic Regression Models with Applications to Identification and Control of Dynamic Systems

  1982cited by this paper
• Consistency and asymptotic efficiency of slope estimates in stochastic approximation schemes

  1981cited by this paper
• Asymptotic Theory of Nonlinear Least Squares Estimation

  1981cited by this paper
• Adaptive Design and Stochastic Approximation

  1979cited by this paper
• Adaptive control of Markov chains, I: Finite parameter set

  1979cited by this paper
• Some Experimental Results on the Statistical Properties of Least Squares Estimates in Control Problems

  1976influential reference
• A two-armed bandit theory of market pricing

  1974cited by this paper
• THE MULTI-PERIOD CONTROL PROBLEM UNDER UNCERTAINTY

  1972influential reference
• Stochastic Approximation

  1969cited by this paper
• Asymptotic Properties of Non-Linear Least Squares Estimators

  1969cited by this paper
• An Algorithm for Least-Squares Estimation of Nonlinear Parameters

  1963cited by this paper
• New Results in Linear Filtering and Prediction Theory

  1961influential reference
• Stochastic Estimation of the Maximum of a Regression Function

  1952cited by this paper
• Some aspects of the sequential design of experiments

  1952cited by this paper
• ON THE LIKELIHOOD THAT ONE UNKNOWN PROBABILITY EXCEEDS ANOTHER IN VIEW OF THE EVIDENCE OF TWO SAMPLES

  1933cited by this paper
• Asymptotically Efficient Adaptive Allocation Rules

  year unknowncited by this paper

• Bandit Social Learning with Exploration Episodes

  2026cites this paper
• Pricing Experimental Design: Causal Effect, Expected Revenue and Tail Risk

  2025cites this paper
• Data-Driven Dynamic Pricing: Sticky Fairness Concerns and the Exploitation-Exploration Trade-Off

  2025cites this paper
• Toward Optimal Statistical Inference in Noisy Linear Quadratic Reinforcement Learning over a Finite Horizon

  2025cites this paper
• Procurement, Dynamic Pricing, and Early Exit Decisions for Products with Short Life Cycles

  2025cites this paper
• Dynamic Pricing with Fairness Constraints

  2025cites this paper
• Revenue Maximization Under Sequential Price Competition Via The Estimation Of s-Concave Demand Functions

  2025cites this paper
• Greedy Algorithm for Structured Bandits: A Sharp Characterization of Asymptotic Success / Failure

  2025cites this paper
• Collaborative Learning and Decision Making on Pricing and Recommendation: A Simple Framework for Planning

  2025cites this paper
• Selling Quality-Differentiated Products in a Markovian Market with Unknown Transition Probabilities

  2024cites this paper
• To Interfere or Not To Interfere: Information Revelation and Price-Setting Incentives in a Multiagent Learning Environment

  2024cites this paper
• Optimal Scheduling of Entropy Regularizer for Continuous-Time Linear-Quadratic Reinforcement Learning

  2024cites this paper
• Feature Misspecification in Sequential Learning Problems

  2024cites this paper
• Nonparametric multi-product dynamic pricing with demand learning via simultaneous price perturbation

  2024cites this paper
• Data-Driven Asset Selling

  2024cites this paper
• Temporal Fairness in Learning and Earning: Price Protection Guarantee and Phase Transitions

  2023cites this paper
• Bandit Social Learning: Exploration under Myopic Behavior

  2023cites this paper
• Information entropy-based adaptive parameter assignment method for dual control neural networks

  2023cites this paper
• PRINCIPRO: Data-Driven Algorithms for Joint Pricing and Inventory Control under Price Protection

  2023cites this paper
• Ranking and pricing under a cascade model of consumer review browsing

  2023cites this paper
• Multinomial Thompson sampling for rating scales and prior considerations for calibrating uncertainty

  2023cites this paper
• Bandit Social Learning under Myopic Behavior

  2023cites this paper
• Optimal Policies for Dynamic Pricing and Inventory Control with Nonparametric Censored Demands

  2023cites this paper
• Optimal scheduling of entropy regulariser for continuous-time linear-quadratic reinforcement learning

  2022cites this paper
• Dynamic Learning and Decision Making via Basis Weight Vectors

  2022cites this paper
• Learning to Sell a Focal‐Ancillary Combination

  2022cites this paper
• Learning to Price Supply Chain Contracts against a Learning Retailer

  2022cites this paper
• Dynamic Learning and Decision-Making by the Aid of Basis Weight Frontiers1

  2021cites this paper
• Exploration-exploitation trade-off for continuous-time episodic reinforcement learning with linear-convex models

  2021influential citation
• Diffusion Approximations for a Class of Sequential Experimentation Problems

  2021cites this paper
• Fairness-aware Online Price Discrimination with Nonparametric Demand Models

  2021cites this paper
• Differential Privacy in Personalized Pricing with Nonparametric Demand Models

  2021cites this paper
• Earning and Learning with Varying Cost

  2021cites this paper
• Dynamic Learning and Market Making in Spread Betting Markets with Informed Bettors

  2021cites this paper
• On Dynamic Pricing with Covariates

  2021cites this paper
• A Bayesian learning model for estimating unknown demand parameter in revenue management

  2020cites this paper
• Technical note: Finite‐time regret analysis of Kiefer‐Wolfowitz stochastic approximation algorithm and nonparametric multi‐product dynamic pricing with unknown demand

  2020cites this paper
• A New Methodology for the Study of Dynamic Decision-Making with a Continuous Unknown Parameter

  2020cites this paper
• Dynamic Pricing with Demand Learning and Reference Effects

  2020cites this paper
• Optimal Bayesian Price Fine-Tuning

  2019cites this paper
• Dynamic Pricing with External Information and Inventory Constraint

  2019cites this paper
• Diffusion Approximations for a Class of Sequential Testing Problems

  2019cites this paper
• A Primal-dual Learning Algorithm for Personalized Dynamic Pricing with an Inventory Constraint

  2018cites this paper
• Exploiting the Natural Exploration In Contextual Bandits

  2017cites this paper
• Avoiding the Exploration-Exploitation Tradeoff in Contextual Bandits

  2017cites this paper
• Mostly Exploration-Free Algorithms for Contextual Bandits

  2017cites this paper