-
Minimal Constraint Violation Probability in Model Predictive Control for Linear Systems
Authors:
Michael Fink,
Tim Brüdigam,
Dirk Wollherr,
Marion Leibold
Abstract:
Handling uncertainty in model predictive control comes with various challenges, especially when considering state constraints under uncertainty. Most methods focus on either the conservative approach of robustly accounting for uncertainty or allowing a small probability of constraint violation. In this work, we propose a linear model predictive control approach that minimizes the probability that…
▽ More
Handling uncertainty in model predictive control comes with various challenges, especially when considering state constraints under uncertainty. Most methods focus on either the conservative approach of robustly accounting for uncertainty or allowing a small probability of constraint violation. In this work, we propose a linear model predictive control approach that minimizes the probability that linear state constraints are violated in the presence of additive uncertainty. This is achieved by first determining a set of inputs that minimize the probability of constraint violation. Then, this resulting set is used to define admissible inputs for the optimal control problem. Recursive feasibility is guaranteed and input-to-state stability is proved under assumptions. Numerical results illustrate the benefits of the proposed model predictive control approach.
△ Less
Submitted 16 February, 2024;
originally announced February 2024.
-
Online Constraint Tightening in Stochastic Model Predictive Control: A Regression Approach
Authors:
Alexandre Capone,
Tim Brüdigam,
Sandra Hirche
Abstract:
Solving chance-constrained stochastic optimal control problems is a significant challenge in control. This is because no analytical solutions exist for up to a handful of special cases. A common and computationally efficient approach for tackling chance-constrained stochastic optimal control problems consists of reformulating the chance constraints as hard constraints with a constraint-tightening…
▽ More
Solving chance-constrained stochastic optimal control problems is a significant challenge in control. This is because no analytical solutions exist for up to a handful of special cases. A common and computationally efficient approach for tackling chance-constrained stochastic optimal control problems consists of reformulating the chance constraints as hard constraints with a constraint-tightening parameter. However, in such approaches, the choice of constraint-tightening parameter remains challenging, and guarantees can mostly be obtained assuming that the process noise distribution is known a priori. Moreover, the chance constraints are often not tightly satisfied, leading to unnecessarily high costs. This work proposes a data-driven approach for learning the constraint-tightening parameters online during control. To this end, we reformulate the choice of constraint-tightening parameter for the closed-loop as a binary regression problem. We then leverage a highly expressive \gls{gp} model for binary regression to approximate the smallest constraint-tightening parameters that satisfy the chance constraints. By tuning the algorithm parameters appropriately, we show that the resulting constraint-tightening parameters satisfy the chance constraints up to an arbitrarily small margin with high probability. Our approach yields constraint-tightening parameters that tightly satisfy the chance constraints in numerical experiments, resulting in a lower average cost than three other state-of-the-art approaches.
△ Less
Submitted 4 October, 2023;
originally announced October 2023.
-
Offline Uncertainty Sampling in Data-driven Stochastic MPC
Authors:
Johannes Teutsch,
Sebastian Kerz,
Tim Brüdigam,
Dirk Wollherr,
Marion Leibold
Abstract:
In this work, we exploit an offline-sampling based strategy for the constrained data-driven predictive control of an unknown linear system subject to random measurement noise. The strategy uses only past measured, potentially noisy data in a non-parametric system representation and does not require any prior model identification. The approximation of chance constraints using uncertainty sampling l…
▽ More
In this work, we exploit an offline-sampling based strategy for the constrained data-driven predictive control of an unknown linear system subject to random measurement noise. The strategy uses only past measured, potentially noisy data in a non-parametric system representation and does not require any prior model identification. The approximation of chance constraints using uncertainty sampling leads to efficient constraint tightening. Under mild assumptions, robust recursive feasibility and closed-loop constraint satisfaction is shown. In a simulation example, we provide evidence for the improved control performance of the proposed control scheme in comparison to a purely robust data-driven predictive control approach.
△ Less
Submitted 6 April, 2023;
originally announced April 2023.
-
Safe Stochastic Model Predictive Control
Authors:
Tim Brüdigam,
Robert Jacumet,
Dirk Wollherr,
Marion Leibold
Abstract:
Combining efficient and safe control for safety-critical systems is challenging. Robust methods may be overly conservative, whereas probabilistic controllers require a trade-off between efficiency and safety. In this work, we propose a safety algorithm that is compatible with any stochastic Model Predictive Control method for linear systems with additive uncertainty and polytopic constraints. This…
▽ More
Combining efficient and safe control for safety-critical systems is challenging. Robust methods may be overly conservative, whereas probabilistic controllers require a trade-off between efficiency and safety. In this work, we propose a safety algorithm that is compatible with any stochastic Model Predictive Control method for linear systems with additive uncertainty and polytopic constraints. This safety algorithm allows to use the optimistic control inputs of stochastic Model Predictive Control as long as a safe backup planner can ensure safety with respect to satisfying hard constraints subject to bounded uncertainty. Besides ensuring safe behavior, the proposed stochastic Model Predictive Control algorithm guarantees recursive feasibility and input-to-state stability of the system origin. The benefits of the safe stochastic Model Predictive Control algorithm are demonstrated in a numerical simulation, highlighting the advantages compared to purely robust or stochastic predictive controllers.
△ Less
Submitted 15 September, 2022; v1 submitted 13 April, 2022;
originally announced April 2022.
-
Data-driven tube-based stochastic predictive control
Authors:
Sebastian Kerz,
Johannes Teutsch,
Tim Brüdigam,
Dirk Wollherr,
Marion Leibold
Abstract:
A powerful result from behavioral systems theory known as the fundamental lemma allows for predictive control akin to Model Predictive Control (MPC) for linear time invariant (LTI) systems with unknown dynamics purely from data. While most of data-driven predictive control literature focuses on robustness with respect to measurement noise, only few works consider exploiting probabilistic informati…
▽ More
A powerful result from behavioral systems theory known as the fundamental lemma allows for predictive control akin to Model Predictive Control (MPC) for linear time invariant (LTI) systems with unknown dynamics purely from data. While most of data-driven predictive control literature focuses on robustness with respect to measurement noise, only few works consider exploiting probabilistic information of disturbances for performance-oriented control as in stochastic MPC. In this work, we propose a novel data-driven stochastic predictive control scheme for chance-constrained LTI systems subject to measurement noise and additive stochastic disturbances. In order to render the otherwise stochastic and intractable optimal control problem deterministic, our approach leverages ideas from tube-based MPC by decomposing the state into a deterministic nominal state driven by inputs and a stochastic error state affected by disturbances. By tightening constraints probabilistically with respect to the additive disturbance and robustly with respect to the measurement noise, satisfaction of original chance-constraints is guaranteed. The resulting data-driven receding horizon optimal control problem is lightweight and recursively feasible, and renders the closed loop input-to-state stable with respect to both additive disturbances and measurement noise. We demonstrate the effectiveness of the proposed approach in a simulation example.
△ Less
Submitted 27 March, 2023; v1 submitted 8 December, 2021;
originally announced December 2021.
-
Model Predictive Control with Models of Different Granularity and a Non-uniformly Spaced Prediction Horizon
Authors:
Tim Brüdigam,
Daniel Prader,
Dirk Wollherr,
Marion Leibold
Abstract:
Horizon length and model accuracy are defining factors when designing a Model Predictive Controller. While long horizons and detailed models have a positive effect on control performance, computational complexity increases. As predictions become less precise over the horizon length, it is worth investigating a combination of different models and varying time step size. Here, we propose a Model Pre…
▽ More
Horizon length and model accuracy are defining factors when designing a Model Predictive Controller. While long horizons and detailed models have a positive effect on control performance, computational complexity increases. As predictions become less precise over the horizon length, it is worth investigating a combination of different models and varying time step size. Here, we propose a Model Predictive Control scheme that splits the prediction horizon into two segments. A detailed model is used for the short-term prediction horizon and a simplified model with an increased sampling time is employed for the long-term horizon. This approach combines the advantage of a long prediction horizon with a reduction of computational effort due to a simplified model and less decision variables. The presented Model Predictive Control is recursively feasible. A simulation study demonstrates the effectiveness of the proposed method: employing a long prediction horizon with advantages regarding computational complexity.
△ Less
Submitted 18 August, 2021;
originally announced August 2021.
-
Multistage Stochastic Model Predictive Control for Urban Automated Driving
Authors:
Tommaso Benciolini,
Tim Brüdigam,
Marion Leibold
Abstract:
Trajectory planning in urban automated driving is challenging because of the high uncertainty resulting from the unknown future motion of other traffic participants. Robust approaches guarantee safety, but tend to result in overly conservative motion planning. Hence, we propose to use Stochastic Model Predictive Control for vehicle control in urban driving, allowing to efficiently plan the vehicle…
▽ More
Trajectory planning in urban automated driving is challenging because of the high uncertainty resulting from the unknown future motion of other traffic participants. Robust approaches guarantee safety, but tend to result in overly conservative motion planning. Hence, we propose to use Stochastic Model Predictive Control for vehicle control in urban driving, allowing to efficiently plan the vehicle trajectory, while maintaining the risk probability sufficiently low. For motion optimization, we propose to use a two-stage hierarchical structure that plans the trajectory and the maneuver separately. A high-level layer takes advantage of a long prediction horizon and of an abstract model to plan the optimal maneuver, and a lower level is in charge of executing the selected maneuver by properly planning the vehicle's trajectory. Numerical simulations are included, showing the potential of our proposal.
△ Less
Submitted 27 November, 2021; v1 submitted 1 July, 2021;
originally announced July 2021.
-
Collision Avoidance with Stochastic Model Predictive Control for Systems with a Twofold Uncertainty Structure
Authors:
Tim Brüdigam,
Jie Zhan,
Dirk Wollherr,
Marion Leibold
Abstract:
Model Predictive Control (MPC) has shown to be a successful method for many applications that require control. Especially in the presence of prediction uncertainty, various types of MPC offer robust or efficient control system behavior. For modeling, uncertainty is most often approximated in such a way that established MPC approaches are applicable for specific uncertainty types. However, for a nu…
▽ More
Model Predictive Control (MPC) has shown to be a successful method for many applications that require control. Especially in the presence of prediction uncertainty, various types of MPC offer robust or efficient control system behavior. For modeling, uncertainty is most often approximated in such a way that established MPC approaches are applicable for specific uncertainty types. However, for a number of applications, especially automated vehicles, uncertainty in predicting the future behavior of other agents is more suitably modeled by a twofold description: a high-level task uncertainty and a low-level execution uncertainty of individual tasks. In this work, we present an MPC framework that is capable of dealing with this twofold uncertainty. A scenario MPC approach considers the possibility of other agents performing one of multiple tasks, with an arbitrary probability distribution, while an analytic stochastic MPC method handles execution uncertainty within a specific task, based on a Gaussian distribution. Combining both approaches allows to efficiently handle the twofold uncertainty structure of many applications. Application of the proposed MPC method is demonstrated in an automated vehicle simulation study.
△ Less
Submitted 15 June, 2021;
originally announced June 2021.
-
(Stochastic) Model Predictive Control -- a Simulation Example
Authors:
Tim Brüdigam
Abstract:
This brief introduction to Model Predictive Control specifically addresses stochastic Model Predictive Control, where probabilistic constraints are considered. A simple linear system subject to uncertainty serves as an example. The Matlab code for this stochastic Model Predictive Control example is available online.
This brief introduction to Model Predictive Control specifically addresses stochastic Model Predictive Control, where probabilistic constraints are considered. A simple linear system subject to uncertainty serves as an example. The Matlab code for this stochastic Model Predictive Control example is available online.
△ Less
Submitted 21 July, 2023; v1 submitted 28 January, 2021;
originally announced January 2021.
-
Stochastic Model Predictive Control with a Safety Guarantee for Automated Driving: Extended Version
Authors:
Tim Brüdigam,
Michael Olbrich,
Dirk Wollherr,
Marion Leibold
Abstract:
Automated vehicles require efficient and safe planning to maneuver in uncertain environments. Largely this uncertainty is caused by other traffic participants, e.g., surrounding vehicles. Future motion of surrounding vehicles is often difficult to predict. Whereas robust control approaches achieve safe, yet conservative motion planning for automated vehicles, Stochastic Model Predictive Control (S…
▽ More
Automated vehicles require efficient and safe planning to maneuver in uncertain environments. Largely this uncertainty is caused by other traffic participants, e.g., surrounding vehicles. Future motion of surrounding vehicles is often difficult to predict. Whereas robust control approaches achieve safe, yet conservative motion planning for automated vehicles, Stochastic Model Predictive Control (SMPC) provides efficient planning in the presence of uncertainty. Probabilistic constraints are applied to ensure that the maximal risk remains below a predefined level. However, safety cannot be ensured as probabilistic constraints may be violated, which is not acceptable for automated vehicles. Here, we propose an efficient trajectory planning framework with safety guarantees for automated vehicles. SMPC is applied to obtain efficient vehicle trajectories for a finite horizon. Based on the first optimized SMPC input, a guaranteed safe backup trajectory is planned using reachable sets. This backup is used to overwrite the SMPC input if necessary for safety. Recursive feasibility of the safe SMPC algorithm is proved. Highway simulations show the effectiveness of the proposed method regarding performance and safety.
△ Less
Submitted 8 June, 2022; v1 submitted 20 September, 2020;
originally announced September 2020.
-
Grid-Based Stochastic Model Predictive Control for Trajectory Planning in Uncertain Environments
Authors:
Tim Brüdigam,
Fulvio di Luzio,
Lucia Pallottino,
Dirk Wollherr,
Marion Leibold
Abstract:
Stochastic Model Predictive Control has proved to be an efficient method to plan trajectories in uncertain environments, e.g., for autonomous vehicles. Chance constraints ensure that the probability of collision is bounded by a predefined risk parameter. However, considering chance constraints in an optimization problem can be challenging and computationally demanding. In this paper, we present a…
▽ More
Stochastic Model Predictive Control has proved to be an efficient method to plan trajectories in uncertain environments, e.g., for autonomous vehicles. Chance constraints ensure that the probability of collision is bounded by a predefined risk parameter. However, considering chance constraints in an optimization problem can be challenging and computationally demanding. In this paper, we present a grid-based Stochastic Model Predictive Control approach. This approach allows to determine a simple deterministic reformulation of the chance constraints and reduces the computational effort, while considering the stochastic nature of the environment. Within the proposed method, we first divide the environment into a grid and, for each predicted step, assign each cell a probability value, which represents the probability that this cell will be occupied by surrounding vehicles. Then, the probabilistic grid is transformed into a binary grid of admissible and inadmissible cells by applying a threshold, representing a risk parameter. Only cells with an occupancy probability lower than the threshold are admissible for the controlled vehicle. Given the admissible cells, a convex hull is generated, which can then be used for trajectory planning. Simulations of an autonomous driving highway scenario show the benefits of the proposed grid-based Stochastic Model Predictive Control method.
△ Less
Submitted 14 May, 2021; v1 submitted 24 July, 2020;
originally announced July 2020.
-
Minimization of Constraint Violation Probability in Model Predictive Control
Authors:
Tim Brüdigam,
Victor Gaßmann,
Dirk Wollherr,
Marion Leibold
Abstract:
While Robust Model Predictive Control considers the worst-case system uncertainty, Stochastic Model Predictive Control, using chance constraints, provides less conservative solutions by allowing a certain constraint violation probability depending on a predefined risk parameter. However, for safety-critical systems it is not only important to bound the constraint violation probability but to reduc…
▽ More
While Robust Model Predictive Control considers the worst-case system uncertainty, Stochastic Model Predictive Control, using chance constraints, provides less conservative solutions by allowing a certain constraint violation probability depending on a predefined risk parameter. However, for safety-critical systems it is not only important to bound the constraint violation probability but to reduce this probability as much as possible. Therefore, an approach is necessary that minimizes the constraint violation probability while ensuring that the Model Predictive Control optimization problem remains feasible. We propose a novel Model Predictive Control scheme that yields a solution with minimal constraint violation probability for a norm constraint in an environment with uncertainty. After minimal constraint violation is guaranteed the solution is then also optimized with respect to other control objectives. Further, it is possible to account for changes over time of the support of the uncertainty. We first present a general method and then provide an approach for uncertainties with symmetric, unimodal probability density function. Recursive feasibility and convergence of the method are proved. A simulation example demonstrates the effectiveness of the proposed method.
△ Less
Submitted 15 June, 2021; v1 submitted 3 June, 2020;
originally announced June 2020.
-
Combined Robust and Stochastic Model Predictive Control for Models of Different Granularity
Authors:
Tim Brüdigam,
Johannes Teutsch,
Dirk Wollherr,
Marion Leibold
Abstract:
Long prediction horizons in Model Predictive Control (MPC) often prove to be efficient, however, this comes with increased computational cost. Recently, a Robust Model Predictive Control (RMPC) method has been proposed which exploits models of different granularity. The prediction over the control horizon is split into short-term predictions with a detailed model using MPC and long-term prediction…
▽ More
Long prediction horizons in Model Predictive Control (MPC) often prove to be efficient, however, this comes with increased computational cost. Recently, a Robust Model Predictive Control (RMPC) method has been proposed which exploits models of different granularity. The prediction over the control horizon is split into short-term predictions with a detailed model using MPC and long-term predictions with a coarse model using RMPC. In many applications robustness is required for the short-term future, but in the long-term future, subject to major uncertainty and potential modeling difficulties, robust planning can lead to highly conservative solutions. We therefore propose combining RMPC on a detailed model for short-term predictions and Stochastic MPC (SMPC), with chance constraints, on a simplified model for long-term predictions. This yields decreased computational effort due to a simple model for long-term predictions, and less conservative solutions, as robustness is only required for short-term predictions. The effectiveness of the method is shown in a mobile robot collision avoidance simulation.
△ Less
Submitted 14 May, 2021; v1 submitted 14 March, 2020;
originally announced March 2020.