Showing 1–1 of 1 results for author: Chaloulos, G
-
Stochastic control up to a hitting time: optimality and rolling-horizon implementation
Authors:
Debasish Chatterjee,
Eugenio Cinquemani,
Giorgos Chaloulos,
John Lygeros
Abstract:
We present a dynamic programming-based solution to a stochastic optimal control problem up to a hitting time for a discrete-time Markov control process. Firstly, we determine an optimal control policy to steer the process toward a compact target set while simultaneously minimizing an expected discounted cost. We then provide a rolling-horizon strategy for approximating the optimal policy, togeth…
▽ More
We present a dynamic programming-based solution to a stochastic optimal control problem up to a hitting time for a discrete-time Markov control process. Firstly, we determine an optimal control policy to steer the process toward a compact target set while simultaneously minimizing an expected discounted cost. We then provide a rolling-horizon strategy for approximating the optimal policy, together with quantitative characterization of its sub-optimality with respect to the optimal policy. Finally, we address related issues of asymptotic discount-optimality of the value-iteration policy. Both the state and action spaces are assumed to be Polish.
△ Less
Submitted 28 September, 2009; v1 submitted 18 June, 2008;
originally announced June 2008.
