Showing 1–50 of 59 results for author: Köhler, J

Model predictive control for tracking using artificial references: Fundamentals, recent results and practical implementation

Authors: Pablo Krupa, Johannes Köhler, Antonio Ferramosca, Ignacio Alvarado, Melanie N. Zeilinger, Teodoro Alamo, Daniel Limon

Abstract: This paper provides a comprehensive tutorial on a family of Model Predictive Control (MPC) formulations, known as MPC for tracking, which are characterized by including an artificial reference as part of the decision variables in the optimization problem. These formulations have several benefits with respect to the classical MPC formulations, including guaranteed recursive feasibility under online… ▽ More This paper provides a comprehensive tutorial on a family of Model Predictive Control (MPC) formulations, known as MPC for tracking, which are characterized by including an artificial reference as part of the decision variables in the optimization problem. These formulations have several benefits with respect to the classical MPC formulations, including guaranteed recursive feasibility under online reference changes, as well as asymptotic stability and an increased domain of attraction. This tutorial paper introduces the concept of using an artificial reference in MPC, presenting the benefits and theoretical guarantees obtained by its use. We then provide a survey of the main advances and extensions of the original linear MPC for tracking, including its non-linear extension. Additionally, we discuss its application to learning-based MPC, and discuss optimization aspects related to its implementation. △ Less

Submitted 10 June, 2024; originally announced June 2024.

Comments: (15 pages, 1 figure)

Adaptive tracking MPC for nonlinear systems via online linear system identification

Authors: Tatiana Strelnikova, Johannes Köhler, Julian Berberich

Abstract: This paper presents an adaptive tracking model predictive control (MPC) scheme to control unknown nonlinear systems based on an adaptively estimated linear model. The model is determined based on linear system identification using a moving window of past measurements, and it serves as a local approximation of the underlying nonlinear dynamics. We prove that the presented scheme ensures practical e… ▽ More This paper presents an adaptive tracking model predictive control (MPC) scheme to control unknown nonlinear systems based on an adaptively estimated linear model. The model is determined based on linear system identification using a moving window of past measurements, and it serves as a local approximation of the underlying nonlinear dynamics. We prove that the presented scheme ensures practical exponential stability of the (unknown) optimal reachable equilibrium for a given output setpoint. Finally, we apply the proposed scheme in simulation and compare it to an alternative direct data-driven MPC scheme based on the Fundamental Lemma. △ Less

Submitted 16 May, 2024; originally announced May 2024.

Perfecting Periodic Trajectory Tracking: Model Predictive Control with a Periodic Observer ($Π$-MPC)

Authors: Luis Pabon, Johannes Köhler, John Irvin Alora, Patrick Benito Eberhard, Andrea Carron, Melanie N. Zeilinger, Marco Pavone

Abstract: In Model Predictive Control (MPC), discrepancies between the actual system and the predictive model can lead to substantial tracking errors and significantly degrade performance and reliability. While such discrepancies can be alleviated with more complex models, this often complicates controller design and implementation. By leveraging the fact that many trajectories of interest are periodic, we… ▽ More In Model Predictive Control (MPC), discrepancies between the actual system and the predictive model can lead to substantial tracking errors and significantly degrade performance and reliability. While such discrepancies can be alleviated with more complex models, this often complicates controller design and implementation. By leveraging the fact that many trajectories of interest are periodic, we show that perfect tracking is possible when incorporating a simple observer that estimates and compensates for periodic disturbances. We present the design of the observer and the accompanying tracking MPC scheme, proving that their combination achieves zero tracking error asymptotically, regardless of the complexity of the unmodelled dynamics. We validate the effectiveness of our method, demonstrating asymptotically perfect tracking on a high-dimensional soft robot with nearly 10,000 states and a fivefold reduction in tracking errors compared to a baseline MPC on small-scale autonomous race car experiments. △ Less

Submitted 1 April, 2024; originally announced April 2024.

Comments: 8 pages, 3 figures, Submitted to the 2024 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2024)

Adaptive Economic Model Predictive Control for linear systems with performance guarantees

Authors: Maximilian Degner, Raffaele Soloperto, Melanie N. Zeilinger, John Lygeros, Johannes Köhler

Abstract: We present a model predictive control (MPC) formulation to directly optimize economic criteria for linear constrained systems subject to disturbances and uncertain model parameters. The proposed formulation combines a certainty equivalent economic MPC with a simple least-squares parameter adaptation. For the resulting adaptive economic MPC scheme, we derive strong asymptotic and transient performa… ▽ More We present a model predictive control (MPC) formulation to directly optimize economic criteria for linear constrained systems subject to disturbances and uncertain model parameters. The proposed formulation combines a certainty equivalent economic MPC with a simple least-squares parameter adaptation. For the resulting adaptive economic MPC scheme, we derive strong asymptotic and transient performance guarantees. We provide a numerical example involving building temperature control and demonstrate performance benefits of online parameter adaptation. △ Less

Submitted 27 March, 2024; originally announced March 2024.

Comments: 8 pages, 3 figures, submitted to IEEE CDC 2024

Safe Guaranteed Exploration for Non-linear Systems

Authors: Manish Prajapat, Johannes Köhler, Matteo Turchetta, Andreas Krause, Melanie N. Zeilinger

Abstract: Safely exploring environments with a-priori unknown constraints is a fundamental challenge that restricts the autonomy of robots. While safety is paramount, guarantees on sufficient exploration are also crucial for ensuring autonomous task completion. To address these challenges, we propose a novel safe guaranteed exploration framework using optimal control, which achieves first-of-its-kind result… ▽ More Safely exploring environments with a-priori unknown constraints is a fundamental challenge that restricts the autonomy of robots. While safety is paramount, guarantees on sufficient exploration are also crucial for ensuring autonomous task completion. To address these challenges, we propose a novel safe guaranteed exploration framework using optimal control, which achieves first-of-its-kind results: guaranteed exploration for non-linear systems with finite time sample complexity bounds, while being provably safe with arbitrarily high probability. The framework is general and applicable to many real-world scenarios with complex non-linear dynamics and unknown domains. Based on this framework we propose an efficient algorithm, SageMPC, SAfe Guaranteed Exploration using Model Predictive Control. SageMPC improves efficiency by incorporating three techniques: i) exploiting a Lipschitz bound, ii) goal-directed exploration, and iii) receding horizon style re-planning, all while maintaining the desired sample complexity, safety and exploration guarantees of the framework. Lastly, we demonstrate safe efficient exploration in challenging unknown environments using SageMPC with a car model. △ Less

Submitted 9 February, 2024; originally announced February 2024.

Fast System Level Synthesis: Robust Model Predictive Control using Riccati Recursions

Authors: Antoine P. Leeman, Johannes Köhler, Florian Messerer, Amon Lahr, Moritz Diehl, Melanie N. Zeilinger

Abstract: System Level Synthesis (SLS) enables improved robust MPC formulations by allowing for joint optimization of the nominal trajectory and controller. This paper introduces a tailored algorithm for solving the corresponding disturbance feedback optimization problem. The proposed algorithm builds on a recently proposed joint optimization scheme and iterates between optimizing the controller and the nom… ▽ More System Level Synthesis (SLS) enables improved robust MPC formulations by allowing for joint optimization of the nominal trajectory and controller. This paper introduces a tailored algorithm for solving the corresponding disturbance feedback optimization problem. The proposed algorithm builds on a recently proposed joint optimization scheme and iterates between optimizing the controller and the nominal trajectory while converging q-linearly to an optimal solution. We show that the controller optimization can be solved through Riccati recursions leading to a horizon-length, state, and input scalability of $\mathcal{O}(N^2 ( n_x^3 + n_u ^3 ) )$ for each iterate. On a numerical example, the proposed algorithm exhibits computational speedups of order $10$ to $10^3$ compared to general-purpose commercial solvers. △ Less

Submitted 24 January, 2024; originally announced January 2024.

Comments: Submitted to IFAC Conference on Nonlinear Model Predictive Control (NMPC) 2024

MHE under parametric uncertainty -- Robust state estimation without informative data

Authors: Simon Muntwiler, Johannes Köhler, Melanie N. Zeilinger

Abstract: In this paper, we study state estimation for general nonlinear systems with unknown parameters and persistent process and measurement noise. In particular, we are interested in stability properties of the state estimate in the absence of persistency of excitation (PE). With a simple academic example, we show that existing moving horizon estimation (MHE) approaches as well as classical adaptive obs… ▽ More In this paper, we study state estimation for general nonlinear systems with unknown parameters and persistent process and measurement noise. In particular, we are interested in stability properties of the state estimate in the absence of persistency of excitation (PE). With a simple academic example, we show that existing moving horizon estimation (MHE) approaches as well as classical adaptive observers can result in diverging state estimates in the absence of PE, even if the noise is small. We propose a novel MHE formulation involving a regularization based on a constant prior estimate of the unknown system parameters. Only assuming the existence of a stable estimator, we prove that the proposed MHE results in practically robustly stable state estimates even in the absence of PE. We discuss the relation of the proposed MHE formulation to state-of-the-art results from MHE, adaptive estimation, and functional estimation. The properties of the proposed MHE approach are illustrated with a numerical example of a car with unknown tire friction parameters. △ Less

Submitted 21 December, 2023; originally announced December 2023.

Comments: 13 pages, 5 figures

Nonlinear Functional Estimation: Functional Detectability and Full Information Estimation

Authors: Simon Muntwiler, Johannes Köhler, Melanie N. Zeilinger

Abstract: We consider the design of functional estimators, i.e., approaches to compute an estimate of a nonlinear function of the state of a general nonlinear dynamical system subject to process noise based on noisy output measurements. To this end, we introduce a novel functional detectability notion in the form of incremental input/output-to-output stability ($δ$-IOOS). We show that $δ$-IOOS is a necessar… ▽ More We consider the design of functional estimators, i.e., approaches to compute an estimate of a nonlinear function of the state of a general nonlinear dynamical system subject to process noise based on noisy output measurements. To this end, we introduce a novel functional detectability notion in the form of incremental input/output-to-output stability ($δ$-IOOS). We show that $δ$-IOOS is a necessary condition for the existence of a functional estimator satisfying an input-to-output type stability property. Additionally, we prove that a system is functional detectable if and only if it admits a corresponding $δ$-IOOS Lyapunov function. Furthermore, $δ$-IOOS is shown to be a sufficient condition for the design of a stable functional estimator by introducing the design of a full information estimation (FIE) approach for functional estimation. Together, we present a unified framework to study functional estimation with a detectability condition, which is necessary and sufficient for the existence of a stable functional estimator, and a corresponding functional estimator design. The practical need for and applicability of the proposed functional estimator design is illustrated with a numerical example of a power system. △ Less

Submitted 3 May, 2024; v1 submitted 21 December, 2023; originally announced December 2023.

Comments: 15 pages, 3 figures

Automatic nonlinear MPC approximation with closed-loop guarantees

Authors: Abdullah Tokmak, Christian Fiedler, Melanie N. Zeilinger, Sebastian Trimpe, Johannes Köhler

Abstract: Safety guarantees are vital in many control applications, such as robotics. Model predictive control (MPC) provides a constructive framework for controlling safety-critical systems, but is limited by its computational complexity. We address this problem by presenting a novel algorithm that automatically computes an explicit approximation to nonlinear MPC schemes while retaining closed-loop guarant… ▽ More Safety guarantees are vital in many control applications, such as robotics. Model predictive control (MPC) provides a constructive framework for controlling safety-critical systems, but is limited by its computational complexity. We address this problem by presenting a novel algorithm that automatically computes an explicit approximation to nonlinear MPC schemes while retaining closed-loop guarantees. Specifically, the problem can be reduced to a function approximation problem, which we then tackle by proposing ALKIA-X, the Adaptive and Localized Kernel Interpolation Algorithm with eXtrapolated reproducing kernel Hilbert space norm. ALKIA-X is a non-iterative algorithm that ensures numerically well-conditioned computations, a fast-to-evaluate approximating function, and the guaranteed satisfaction of any desired bound on the approximation error. Hence, ALKIA-X automatically computes an explicit function that approximates the MPC, yielding a controller suitable for safety-critical systems and high sampling rates. We apply ALKIA-X to approximate two nonlinear MPC schemes, demonstrating reduced computational demand and applicability to realistic problems. △ Less

Submitted 11 April, 2024; v1 submitted 15 December, 2023; originally announced December 2023.

Comments: Submitted to IEEE Transactions on Automatic Control. Compared to the previously uploaded version, this version contains an additional numerical example

Towards non-stochastic targeted exploration

Authors: Janani Venkatasubramanian, Johannes Köhler, Mark Cannon, Frank Allgöwer

Abstract: We present a novel targeted exploration strategy for linear time-invariant systems without stochastic assumptions on the noise, i.e., without requiring independence or zero mean, allowing for deterministic model misspecifications. This work utilizes classical data-dependent uncertainty bounds on the least-squares parameter estimates in the presence of energy-bounded noise. We provide a sufficient… ▽ More We present a novel targeted exploration strategy for linear time-invariant systems without stochastic assumptions on the noise, i.e., without requiring independence or zero mean, allowing for deterministic model misspecifications. This work utilizes classical data-dependent uncertainty bounds on the least-squares parameter estimates in the presence of energy-bounded noise. We provide a sufficient condition on the exploration data that ensures a desired error bound on the estimated parameter. Using common approximations, we derive a semidefinite program to compute the optimal sinusoidal input excitation. Finally, we highlight the differences and commonalities between the developed non-stochastic targeted exploration strategy and conventional exploration strategies based on classical identification bounds through a numerical example. △ Less

Submitted 10 December, 2023; originally announced December 2023.

Comments: submitted to IFAC Symposium on System Identification, 2024

Homothetic tube model predictive control with multi-step predictors

Authors: Danilo Saccani, Giancarlo Ferrari-Trecate, Melanie N. Zeilinger, Johannes Köhler

Abstract: We present a robust model predictive control (MPC) framework for linear systems facing bounded parametric uncertainty and bounded disturbances. Our approach deviates from standard MPC formulations by integrating multi-step predictors, which provide reduced error bounds. These bounds, derived from multi-step predictors, are utilized in a homothetic tube formulation to mitigate conservatism. Lastly,… ▽ More We present a robust model predictive control (MPC) framework for linear systems facing bounded parametric uncertainty and bounded disturbances. Our approach deviates from standard MPC formulations by integrating multi-step predictors, which provide reduced error bounds. These bounds, derived from multi-step predictors, are utilized in a homothetic tube formulation to mitigate conservatism. Lastly, a multi-rate formulation is adopted to handle the incompatibilities of multi-step predictors. We provide a theoretical analysis, guaranteeing robust recursive feasibility, constraint satisfaction, and (practical) stability of the desired setpoint. We use a simulation example to compare it to existing literature and demonstrate advantages in terms of conservatism and computational complexity. △ Less

Submitted 20 November, 2023; v1 submitted 12 September, 2023; originally announced September 2023.

Comments: Extended version of accepted paper in IEEE Control Systems Letters, 2023. Contains additional details regarding the numerical example and LMI derivation

Robust Nonlinear Reduced-Order Model Predictive Control

Authors: John Irvin Alora, Luis A. Pabon, Johannes Köhler, Mattia Cenedese, Ed Schmerling, Melanie N. Zeilinger, George Haller, Marco Pavone

Abstract: Real-world systems are often characterized by high-dimensional nonlinear dynamics, making them challenging to control in real time. While reduced-order models (ROMs) are frequently employed in model-based control schemes, dimensionality reduction introduces model uncertainty which can potentially compromise the stability and safety of the original high-dimensional system. In this work, we propose… ▽ More Real-world systems are often characterized by high-dimensional nonlinear dynamics, making them challenging to control in real time. While reduced-order models (ROMs) are frequently employed in model-based control schemes, dimensionality reduction introduces model uncertainty which can potentially compromise the stability and safety of the original high-dimensional system. In this work, we propose a novel reduced-order model predictive control (ROMPC) scheme to solve constrained optimal control problems for nonlinear, high-dimensional systems. To address the challenges of using ROMs in predictive control schemes, we derive an error bounding system that dynamically accounts for model reduction error. Using these bounds, we design a robust MPC scheme that ensures robust constraint satisfaction, recursive feasibility, and asymptotic stability. We demonstrate the effectiveness of our proposed method in simulations on a high-dimensional soft robot with nearly 10,000 states. △ Less

Submitted 11 September, 2023; originally announced September 2023.

Comments: 9 pages, 3 figures, To be presented at Conference for Decision and Control 2023

Analysis and design of model predictive control frameworks for dynamic operation -- An overview

Authors: Johannes Köhler, Matthas A. Müller, Frank Allgöwer

Abstract: This article provides an overview of model predictive control (MPC) frameworks for dynamic operation of nonlinear constrained systems. Dynamic operation is often an integral part of the control objective, ranging from tracking of reference signals to the general economic operation of a plant under online changing time-varying operating conditions. We focus on the particular challenges that arise w… ▽ More This article provides an overview of model predictive control (MPC) frameworks for dynamic operation of nonlinear constrained systems. Dynamic operation is often an integral part of the control objective, ranging from tracking of reference signals to the general economic operation of a plant under online changing time-varying operating conditions. We focus on the particular challenges that arise when dealing with such more general control goals and present methods that have emerged in the literature to address these issues. The goal of this article is to present an overview of the state-of-the-art techniques, providing a diverse toolkit to apply and further develop MPC formulations that can handle the challenges intrinsic to dynamic operation. We also critically assess the applicability of the different research directions, discussing limitations and opportunities for further research. △ Less

Submitted 9 January, 2024; v1 submitted 6 July, 2023; originally announced July 2023.

Comments: This is the accepted version of the paper in Annual Reviews in Control, 2024

Journal ref: Annual Reviews in Control (2024)

Approximate non-linear model predictive control with safety-augmented neural networks

Authors: Henrik Hose, Johannes Köhler, Melanie N. Zeilinger, Sebastian Trimpe

Abstract: Model predictive control (MPC) achieves stability and constraint satisfaction for general nonlinear systems, but requires computationally expensive online optimization. This paper studies approximations of such MPC controllers via neural networks (NNs) to achieve fast online evaluation. We propose safety augmentation that yields deterministic guarantees for convergence and constraint satisfaction… ▽ More Model predictive control (MPC) achieves stability and constraint satisfaction for general nonlinear systems, but requires computationally expensive online optimization. This paper studies approximations of such MPC controllers via neural networks (NNs) to achieve fast online evaluation. We propose safety augmentation that yields deterministic guarantees for convergence and constraint satisfaction despite approximation inaccuracies. We approximate the entire input sequence of the MPC with NNs, which allows us to verify online if it is a feasible solution to the MPC problem. We replace the NN solution by a safe candidate based on standard MPC techniques whenever it is infeasible or has worse cost. Our method requires a single evaluation of the NN and forward integration of the input sequence online, which is fast to compute on resource-constrained systems. The proposed control framework is illustrated on three non-linear MPC benchmarks of different complexity, demonstrating computational speedups orders of magnitudes higher than online optimization. In the examples, we achieve deterministic safety through the safety-augmented NNs, where naive NN implementation fails. △ Less

Submitted 19 April, 2023; originally announced April 2023.

On stochastic MPC formulations with closed-loop guarantees: Analysis and a unifying framework

Authors: Johannes Köhler, Ferdinand Geuss, Melanie N. Zeilinger

Abstract: We investigate model predictive control (MPC) formulations for linear systems subject to i.i.d. stochastic disturbances with bounded support and chance constraints. Existing stochastic MPC formulations with closed-loop guarantees can be broadly classified in two separate frameworks: i) using robust techniques; ii) feasibility preserving algorithms. We investigate two particular MPC formulations re… ▽ More We investigate model predictive control (MPC) formulations for linear systems subject to i.i.d. stochastic disturbances with bounded support and chance constraints. Existing stochastic MPC formulations with closed-loop guarantees can be broadly classified in two separate frameworks: i) using robust techniques; ii) feasibility preserving algorithms. We investigate two particular MPC formulations representative for these two frameworks called robust-stochastic MPC and indirect feedback stochastic MPC. We provide a qualitative analysis, highlighting intrinsic limitations of both approaches in different edge cases. Then, we derive a unifying stochastic MPC framework that naturally includes these two formulations as limit cases. This qualitative analysis is complemented with numerical results, showcasing the advantages and limitations of each method. △ Less

Submitted 7 August, 2023; v1 submitted 31 March, 2023; originally announced April 2023.

Comments: Extended version of the paper to be presented in Proc. Conference on Decision and Control (CDC), 2023. Appendix contains additionally the theoretical proof and details regarding the computation of the constraint tightening

Active Learning-based Model Predictive Coverage Control

Authors: Rahel Rickenbach, Johannes Köhler, Anna Scampicchio, Melanie N. Zeilinger, Andrea Carron

Abstract: The problem of coverage control, i.e., of coordinating multiple agents to optimally cover an area, arises in various applications. However, coverage applications face two major challenges: (1) dealing with nonlinear dynamics while respecting system and safety critical constraints, and (2) performing the task in an initially unknown environment. We solve the coverage problem by using a hierarchical… ▽ More The problem of coverage control, i.e., of coordinating multiple agents to optimally cover an area, arises in various applications. However, coverage applications face two major challenges: (1) dealing with nonlinear dynamics while respecting system and safety critical constraints, and (2) performing the task in an initially unknown environment. We solve the coverage problem by using a hierarchical framework, in which references are calculated at a central server and passed to the agents' local model predictive control (MPC) tracking schemes. Furthermore, to ensure that the environment is actively explored by the agents a probabilistic exploration-exploitation trade-off is deployed. In addition, we derive a control framework that avoids the hierarchical structure by integrating the reference optimization in the MPC formulation. Active learning is then performed drawing inspiration from Upper Confidence Bound (UCB) approaches. For all developed control architectures, we guarantee closed-loop constraint satisfaction and convergence to an optimal configuration. Furthermore, all methods are tested and compared on hardware using a miniature car platform. △ Less

Submitted 29 March, 2024; v1 submitted 17 March, 2023; originally announced March 2023.

Comments: Extended version of accepted paper in IEEE Transactions on Automatic Control, 2024

Sequential learning and control: Targeted exploration for robust performance

Authors: Janani Venkatasubramanian, Johannes Köhler, Julian Berberich, Frank Allgöwer

Abstract: We present a novel dual control strategy for uncertain linear systems based on targeted harmonic exploration and gain-scheduling with performance and excitation guarantees. In the proposed sequential approach, robust control is implemented after exploration with the main feature that the exploration is optimized with respect to the robust control performance. Specifically, we leverage recent resul… ▽ More We present a novel dual control strategy for uncertain linear systems based on targeted harmonic exploration and gain-scheduling with performance and excitation guarantees. In the proposed sequential approach, robust control is implemented after exploration with the main feature that the exploration is optimized with respect to the robust control performance. Specifically, we leverage recent results on finite excitation using spectral lines to determine a high probability lower bound on the resultant finite excitation of the exploration data. This provides an a priori upper bound on the remaining model uncertainty after exploration, which can further be leveraged in a gain-scheduling controller design that guarantees robust performance. This leads to a semidefinite program-based design which computes an exploration strategy with finite excitation bounds and minimal energy, and a gain-scheduled controller with probabilistic performance bounds that can be implemented after exploration. The effectiveness of our approach and its benefits over common random exploration strategies are demonstrated with an example of a system which is 'hard to learn'. △ Less

Submitted 12 October, 2023; v1 submitted 19 January, 2023; originally announced January 2023.

Comments: submitted to IEEE Transactions on Automatic Control (TAC)

Robust Nonlinear Optimal Control via System Level Synthesis

Authors: Antoine P. Leeman, Johannes Köhler, Andrea Zanelli, Samir Bennani, Melanie N. Zeilinger

Abstract: This paper addresses the problem of finite horizon constrained robust optimal control for nonlinear systems subject to norm-bounded disturbances. To this end, the underlying uncertain nonlinear system is decomposed based on a first-order Taylor series expansion into a nominal system and an error (deviation) described as an uncertain linear time-varying system. This decomposition allows us to lever… ▽ More This paper addresses the problem of finite horizon constrained robust optimal control for nonlinear systems subject to norm-bounded disturbances. To this end, the underlying uncertain nonlinear system is decomposed based on a first-order Taylor series expansion into a nominal system and an error (deviation) described as an uncertain linear time-varying system. This decomposition allows us to leverage System Level Synthesis to jointly optimize an affine error feedback, a nominal nonlinear trajectory, and, most importantly, a dynamic linearization error over-bound used to ensure robust constraint satisfaction for the nonlinear system. The proposed approach thereby results in less conservative planning compared with state-of-the-art techniques. We demonstrate the benefits of the proposed approach to control the rotational motion of a rigid body subject to state and input constraints. △ Less

Submitted 14 February, 2024; v1 submitted 12 January, 2023; originally announced January 2023.

Comments: submitted to IEEE Transactions on Automatic Control (TAC)

Predictive safety filter using system level synthesis

Authors: Antoine P. Leeman, Johannes Köhler, Samir Benanni, Melanie N. Zeilinger

Abstract: Safety filters provide modular techniques to augment potentially unsafe control inputs (e.g. from learning-based controllers or humans) with safety guarantees in the form of constraint satisfaction. In this paper, we present an improved model predictive safety filter (MPSF) formulation, which incorporates system level synthesis techniques in the design. The resulting SL-MPSF scheme ensures safety… ▽ More Safety filters provide modular techniques to augment potentially unsafe control inputs (e.g. from learning-based controllers or humans) with safety guarantees in the form of constraint satisfaction. In this paper, we present an improved model predictive safety filter (MPSF) formulation, which incorporates system level synthesis techniques in the design. The resulting SL-MPSF scheme ensures safety for linear systems subject to bounded disturbances in an enlarged safe set. It requires less severe and frequent modifications of potentially unsafe control inputs compared to existing MPSF formulations to certify safety. In addition, we propose an explicit variant of the SL-MPSF formulation, which maintains scalability, and reduces the required online computational effort - the main drawback of the MPSF. The benefits of the proposed system level safety filter formulations compared to state-of-the-art MPSF formulations are demonstrated using a numerical example. △ Less

Submitted 9 June, 2023; v1 submitted 5 December, 2022; originally announced December 2022.

Comments: https://gitlab.ethz.ch/ics/SLS_safety_filter/

Journal ref: Proceedings of The 5th Annual Learning for Dynamics and Control Conference, PMLR 211:1180-1192 (2023)

Robust peak-to-peak gain analysis using integral quadratic constraints

Authors: Lukas Schwenkel, Johannes Köhler, Matthias A. Müller, Frank Allgöwer

Abstract: This work provides a framework to compute an upper bound on the robust peak-to-peak gain of discrete-time uncertain linear systems using integral quadratic constraints (IQCs). Such bounds are of particular interest in the computation of reachable sets and the $\ell_1$-norm, as well as when safety-critical constraints need to be satisfied pointwise in time. The use of $ρ$-hard IQCs with a terminal… ▽ More This work provides a framework to compute an upper bound on the robust peak-to-peak gain of discrete-time uncertain linear systems using integral quadratic constraints (IQCs). Such bounds are of particular interest in the computation of reachable sets and the $\ell_1$-norm, as well as when safety-critical constraints need to be satisfied pointwise in time. The use of $ρ$-hard IQCs with a terminal cost enables us to deal with a wide variety of uncertainty classes, for example, we provide $ρ$-hard IQCs with a terminal cost for the class of parametric uncertainties. This approach unifies, generalizes, and significantly improves state-of-the-art methods, which is also demonstrated in a numerical example. △ Less

Submitted 17 November, 2022; originally announced November 2022.

Comments: 6 pages, submitted to IFAC WC 2023

Online convex optimization for constrained control of linear systems using a reference governor

Authors: Marko Nonhoff, Johannes Köhler, Matthias A. Müller

Abstract: In this work, we propose a control scheme for linear systems subject to pointwise in time state and input constraints that aims to minimize time-varying and a priori unknown cost functions. The proposed controller is based on online convex optimization and a reference governor. In particular, we apply online gradient descent to track the time-varying and a priori unknown optimal steady state of th… ▽ More In this work, we propose a control scheme for linear systems subject to pointwise in time state and input constraints that aims to minimize time-varying and a priori unknown cost functions. The proposed controller is based on online convex optimization and a reference governor. In particular, we apply online gradient descent to track the time-varying and a priori unknown optimal steady state of the system. Moreover, we use a $λ$-contractive set to enforce constraint satisfaction and a sufficient convergence rate of the closed-loop system to the optimal steady state. We prove that the proposed scheme is recursively feasible, ensures that the state and input constraints are satisfied at all times, and achieves a dynamic regret that is linearly bounded by the variation of the cost functions. The algorithm's performance and constraint satisfaction is illustrated by means of a simulation example. △ Less

Submitted 15 June, 2023; v1 submitted 16 November, 2022; originally announced November 2022.

Comments: Accepted for publication in the proceedings of the 2023 IFAC World Congress

Motion Planning using Reactive Circular Fields: A 2D Analysis of Collision Avoidance and Goal Convergence

Authors: Marvin Becker, Johannes Köhler, Sami Haddadin, Matthias A. Müller

Abstract: Recently, many reactive trajectory planning approaches were suggested in the literature because of their inherent immediate adaption in the ever more demanding cluttered and unpredictable environments of robotic systems. However, typically those approaches are only locally reactive without considering global path planning and no guarantees for simultaneous collision avoidance and goal convergence… ▽ More Recently, many reactive trajectory planning approaches were suggested in the literature because of their inherent immediate adaption in the ever more demanding cluttered and unpredictable environments of robotic systems. However, typically those approaches are only locally reactive without considering global path planning and no guarantees for simultaneous collision avoidance and goal convergence can be given. In this paper, we study a recently developed circular field (CF)-based motion planner that combines local reactive control with global trajectory generation by adapting an artificial magnetic field such that multiple trajectories around obstacles can be evaluated. In particular, we provide a mathematically rigorous analysis of this planner in a planar environment to ensure safe motion of the controlled robot. Contrary to existing results, the derived collision avoidance analysis covers the entire CF motion planning algorithm including attractive forces for goal convergence and is not limited to a specific choice of the rotation field, i.e., our guarantees are not limited to a specific potentially suboptimal trajectory. Our Lyapunov-type collision avoidance analysis is based on the definition of an (equivalent) two-dimensional auxiliary system, which enables us to provide tight, if and only if conditions for the case of a collision with point obstacles. Furthermore, we show how this analysis naturally extends to multiple obstacles and we specify sufficient conditions for goal convergence. Finally, we provide a challenging simulation scenario with multiple non-convex point cloud obstacles and demonstrate collision avoidance and goal convergence. △ Less

Submitted 3 November, 2023; v1 submitted 28 October, 2022; originally announced October 2022.

Comments: Published in IEEE Transactions on Automatic Control (Early Access)

Robust adaptive MPC using control contraction metrics

Authors: András Sasfi, Melanie N. Zeilinger, Johannes Köhler

Abstract: We present a robust adaptive model predictive control (MPC) framework for nonlinear continuous-time systems with bounded parametric uncertainty and additive disturbance. We utilize general control contraction metrics (CCMs) to parameterize a homothetic tube around a nominal prediction that contains all uncertain trajectories. Furthermore, we incorporate model adaptation using set-membership estima… ▽ More We present a robust adaptive model predictive control (MPC) framework for nonlinear continuous-time systems with bounded parametric uncertainty and additive disturbance. We utilize general control contraction metrics (CCMs) to parameterize a homothetic tube around a nominal prediction that contains all uncertain trajectories. Furthermore, we incorporate model adaptation using set-membership estimation. As a result, the proposed MPC formulation is applicable to a large class of nonlinear systems, reduces conservatism during online operation, and guarantees robust constraint satisfaction and convergence to a neighborhood of the desired setpoint. One of the main technical contributions is the derivation of corresponding tube dynamics based on CCMs that account for the state and input dependent nature of the model mismatch. Furthermore, we online optimize over the nominal parameter, which enables general set-membership updates for the parametric uncertainty in the MPC. Benefits of the proposed homothetic tube MPC and online adaptation are demonstrated using a numerical example involving a planar quadrotor. △ Less

Submitted 11 July, 2023; v1 submitted 23 September, 2022; originally announced September 2022.

Comments: This is the accepted version of the paper in Automatica, 2023

Journal ref: Automatica 155 (2023) 111169

Globally stable and locally optimal model predictive control using a softened initial state constraint -- extended version

Authors: Johannes Köhler, Melanie N. Zeilinger

Abstract: To address feasibility issues in model predictive control (MPC), most implementations relax hard state constraints using additional slack variables with a suitable penalty. We propose an alternative strategy for open-loop asymptotically/Lyapunov stable nonlinear systems by relaxing the initial state constraint with a suitable penalty. The proposed MPC framework is globally feasible, ensures (semi-… ▽ More To address feasibility issues in model predictive control (MPC), most implementations relax hard state constraints using additional slack variables with a suitable penalty. We propose an alternative strategy for open-loop asymptotically/Lyapunov stable nonlinear systems by relaxing the initial state constraint with a suitable penalty. The proposed MPC framework is globally feasible, ensures (semi-)global asymptotic stability, and (approximately) recovers the closed-loop properties of the nominal MPC on the feasible set. The proposed framework can be naturally combined with a robust formulation to ensure robustness subject to bounded disturbances while retaining input-ot-state stability in case of arbitrarily large disturbances. We also show how the overall design can be simplified in case the nonlinear system is exponentially stable. In the special case of linear systems, the proposed MPC formulation reduces to a quadratic program and the offline design and online computational complexity is only marginally increased compared to anominal design. Benefits compared to classical soft contrained MPC formulations are demonstrated with numerical examples. △ Less

Submitted 20 July, 2022; originally announced July 2022.

Stability in data-driven MPC: an inherent robustness perspective

Authors: Julian Berberich, Johannes Köhler, Matthias A. Müller, Frank Allgöwer

Abstract: Data-driven model predictive control (DD-MPC) based on Willems' Fundamental Lemma has received much attention in recent years, allowing to control systems directly based on an implicit data-dependent system description. The literature contains many successful practical applications as well as theoretical results on closed-loop stability and robustness. In this paper, we provide a tutorial introduc… ▽ More Data-driven model predictive control (DD-MPC) based on Willems' Fundamental Lemma has received much attention in recent years, allowing to control systems directly based on an implicit data-dependent system description. The literature contains many successful practical applications as well as theoretical results on closed-loop stability and robustness. In this paper, we provide a tutorial introduction to DD-MPC for unknown linear time-invariant (LTI) systems with focus on (robust) closed-loop stability. We first address the scenario of noise-free data, for which we present a DD-MPC scheme with terminal equality constraints and derive closed-loop properties. In case of noisy data, we introduce a simple yet powerful approach to analyze robust stability of DD-MPC by combining continuity of DD-MPC w.r.t. noise with inherent robustness of model-based MPC, i.e., robustness of nominal MPC w.r.t. small disturbances. Moreover, we discuss how the presented proof technique allows to show closed-loop stability of a variety of DD-MPC schemes with noisy data, as long as the corresponding model-based MPC is inherently robust. △ Less

Submitted 25 August, 2022; v1 submitted 24 May, 2022; originally announced May 2022.

Comments: Final version, accepted for presentation at the 61st IEEE Conference on Decision and Control 2022. This version contains the full proof of Theorem IV.1

State space models vs. multi-step predictors in predictive control: Are state space models complicating safe data-driven designs?

Authors: Johannes Köhler, Kim P. Wabersich, Julian Berberich, Melanie N. Zeilinger

Abstract: This paper contrasts recursive state space models and direct multi-step predictors for linear predictive control. We provide a tutorial exposition for both model structures to solve the following problems: 1. stochastic optimal control; 2. system identification; 3. stochastic optimal control based on the estimated model. Throughout the paper, we provide detailed discussions of the benefits and lim… ▽ More This paper contrasts recursive state space models and direct multi-step predictors for linear predictive control. We provide a tutorial exposition for both model structures to solve the following problems: 1. stochastic optimal control; 2. system identification; 3. stochastic optimal control based on the estimated model. Throughout the paper, we provide detailed discussions of the benefits and limitations of these two model parametrizations for predictive control and highlight the relation to existing works. Additionally, we derive a novel (partially tight) constraint tightening for stochastic predictive control with parametric uncertainty in the multi-step predictor. △ Less

Submitted 6 October, 2023; v1 submitted 29 March, 2022; originally announced March 2022.

Comments: Fixed an error in Equ. (15) (two matrices where added instead of concatenated)

Recursively feasible stochastic predictive control using an interpolating initial state constraint -- extended version

Authors: Johannes Köhler, Melanie N. Zeilinger

Abstract: We present a stochastic model predictive control (SMPC) framework for linear systems subject to possibly unbounded disturbances. State of the art SMPC approaches with closed-loop chance constraint satisfaction recursively initialize the nominal state based on the previously predicted nominal state or possibly the measured state under some case distinction. We improve these initialization strategie… ▽ More We present a stochastic model predictive control (SMPC) framework for linear systems subject to possibly unbounded disturbances. State of the art SMPC approaches with closed-loop chance constraint satisfaction recursively initialize the nominal state based on the previously predicted nominal state or possibly the measured state under some case distinction. We improve these initialization strategies by allowing for a continuous optimization over the nominal initial state in an interpolation of these two extremes. The resulting SMPC scheme can be implemented as one standard quadratic program and is more flexible compared to state-of-the-art initialization strategies. As the main technical contribution, we show that the proposed SMPC framework also ensures closed-loop satisfaction of chance constraints and suitable performance bounds. △ Less

Submitted 20 June, 2022; v1 submitted 2 March, 2022; originally announced March 2022.

Comments: Extended version of accepted paper in IEEE Control Systems Letters, 2022. Contains additional details regarding the proof and an additional example

Journal ref: IEEE Control Systems Letters, 2022

A Lyapunov function for robust stability of moving horizon estimation

Authors: Julian D. Schiller, Simon Muntwiler, Johannes Köhler, Melanie N. Zeilinger, Matthias A. Müller

Abstract: We provide a novel robust stability analysis for moving horizon estimation (MHE) using a Lyapunov function. Additionally, we introduce linear matrix inequalities (LMIs) to verify the necessary incremental input/output-to-state stability ($δ$-IOSS) detectability condition. We consider an MHE formulation with time-discounted quadratic objective for nonlinear systems admitting an exponential $δ$-IOSS… ▽ More We provide a novel robust stability analysis for moving horizon estimation (MHE) using a Lyapunov function. Additionally, we introduce linear matrix inequalities (LMIs) to verify the necessary incremental input/output-to-state stability ($δ$-IOSS) detectability condition. We consider an MHE formulation with time-discounted quadratic objective for nonlinear systems admitting an exponential $δ$-IOSS Lyapunov function. We show that with a suitable parameterization of the MHE objective, the $δ$-IOSS Lyapunov function serves as an $M$-step Lyapunov function for MHE. Provided that the estimation horizon is chosen large enough, this directly implies exponential stability of MHE. The stability analysis is also applicable to full information estimation, where the restriction to exponential $δ$-IOSS can be relaxed. Moreover, we provide simple LMI conditions to systematically derive $δ$-IOSS Lyapunov functions, which allows us to easily verify $δ$-IOSS for a large class of nonlinear detectable systems. This is useful in the context of MHE in general, since most of the existing nonlinear (robust) stability results for MHE depend on the system being $δ$-IOSS (detectable). In combination, we thus provide a framework for designing MHE schemes with guaranteed robust exponential stability. The applicability of the proposed methods is demonstrated with a nonlinear chemical reactor process and a 12-state quadrotor model. △ Less

Submitted 8 June, 2023; v1 submitted 25 February, 2022; originally announced February 2022.

Comments: *Julian D. Schiller and Simon Muntwiler contributed equally to this paper. 16 pages, 3 figures. Published in: IEEE Transactions on Automatic Control. This version contains an additional numerical example in Section V.B

A Study on the Ambiguity in Human Annotation of German Oral History Interviews for Perceived Emotion Recognition and Sentiment Analysis

Authors: Michael Gref, Nike Matthiesen, Sreenivasa Hikkal Venugopala, Shalaka Satheesh, Aswinkumar Vijayananth, Duc Bach Ha, Sven Behnke, Joachim Köhler

Abstract: For research in audiovisual interview archives often it is not only of interest what is said but also how. Sentiment analysis and emotion recognition can help capture, categorize and make these different facets searchable. In particular, for oral history archives, such indexing technologies can be of great interest. These technologies can help understand the role of emotions in historical remember… ▽ More For research in audiovisual interview archives often it is not only of interest what is said but also how. Sentiment analysis and emotion recognition can help capture, categorize and make these different facets searchable. In particular, for oral history archives, such indexing technologies can be of great interest. These technologies can help understand the role of emotions in historical remembering. However, humans often perceive sentiments and emotions ambiguously and subjectively. Moreover, oral history interviews have multi-layered levels of complex, sometimes contradictory, sometimes very subtle facets of emotions. Therefore, the question arises of the chance machines and humans have capturing and assigning these into predefined categories. This paper investigates the ambiguity in human perception of emotions and sentiment in German oral history interviews and the impact on machine learning systems. Our experiments reveal substantial differences in human perception for different emotions. Furthermore, we report from ongoing machine learning experiments with different modalities. We show that the human perceptual ambiguity and other challenges, such as class imbalance and lack of training data, currently limit the opportunities of these technologies for oral history archives. Nonetheless, our work uncovers promising observations and possibilities for further research. △ Less

Submitted 18 January, 2022; originally announced January 2022.

Comments: Submitted to LREC 2022

Human and Automatic Speech Recognition Performance on German Oral History Interviews

Authors: Michael Gref, Nike Matthiesen, Christoph Schmidt, Sven Behnke, Joachim Köhler

Abstract: Automatic speech recognition systems have accomplished remarkable improvements in transcription accuracy in recent years. On some domains, models now achieve near-human performance. However, transcription performance on oral history has not yet reached human accuracy. In the present work, we investigate how large this gap between human and machine transcription still is. For this purpose, we analy… ▽ More Automatic speech recognition systems have accomplished remarkable improvements in transcription accuracy in recent years. On some domains, models now achieve near-human performance. However, transcription performance on oral history has not yet reached human accuracy. In the present work, we investigate how large this gap between human and machine transcription still is. For this purpose, we analyze and compare transcriptions of three humans on a new oral history data set. We estimate a human word error rate of 8.7% for recent German oral history interviews with clean acoustic conditions. For comparison with recent machine transcription accuracy, we present experiments on the adaptation of an acoustic model achieving near-human performance on broadcast speech. We investigate the influence of different adaptation data on robustness and generalization for clean and noisy oral history interviews. We optimize our acoustic models by 5 to 8% relative for this task and achieve 23.9% WER on noisy and 15.6% word error rate on clean oral history interviews. △ Less

Submitted 18 January, 2022; originally announced January 2022.

Comments: Submitted to LREC 2022

Stability and performance analysis of NMPC: Detectable stage costs and general terminal costs

Authors: Johannes Köhler, Melanie N. Zeilinger, Lars Grüne

Abstract: We provide a stability and performance analysis for nonlinear model predictive control (NMPC) schemes subject to input constraints. Given an exponential stabilizability and detectability condition w.r.t. the employed state cost, we provide a sufficiently long prediction horizon to ensure asymptotic stability and a desired performance bound w.r.t. the infinite-horizon optimal controller. Compared t… ▽ More We provide a stability and performance analysis for nonlinear model predictive control (NMPC) schemes subject to input constraints. Given an exponential stabilizability and detectability condition w.r.t. the employed state cost, we provide a sufficiently long prediction horizon to ensure asymptotic stability and a desired performance bound w.r.t. the infinite-horizon optimal controller. Compared to existing results, the provided analysis is applicable to positive semi-definite (detectable) cost functions, provides tight bounds using a linear programming analysis, and allows for a seamless integration of general positive-definite terminal cost functions in the analysis. The practical applicability of the derived theoretical results are demonstrated with numerical examples. △ Less

Submitted 5 January, 2023; v1 submitted 21 October, 2021; originally announced October 2021.

Comments: This is the accepted version of the paper in IEEE Transaction on Automatic Control, 2023. This version contains additionally the proof of Theorem 7 in the appendix

Journal ref: IEEE Transactions on Automatic Control 2023; 68(10)

Data-driven model predictive control: closed-loop guarantees and experimental results

Authors: Julian Berberich, Johannes Köhler, Matthias A. Müller, Frank Allgöwer

Abstract: We provide a comprehensive review and practical implementation of a recently developed model predictive control (MPC) framework for controlling unknown systems using only measured data and no explicit model knowledge. Our approach relies on an implicit system parametrization from behavioral systems theory based on one measured input-output trajectory. The presented MPC schemes guarantee closed-loo… ▽ More We provide a comprehensive review and practical implementation of a recently developed model predictive control (MPC) framework for controlling unknown systems using only measured data and no explicit model knowledge. Our approach relies on an implicit system parametrization from behavioral systems theory based on one measured input-output trajectory. The presented MPC schemes guarantee closed-loop stability for unknown linear time-invariant (LTI) systems, even if the data are affected by noise. Further, we extend this MPC framework to control unknown nonlinear systems by continuously updating the data-driven system representation using new measurements. The simple and intuitive applicability of our approach is demonstrated with a nonlinear four-tank system in simulation and in an experiment. △ Less

Submitted 2 July, 2021; originally announced July 2021.

Journal ref: at-Automatisierungstechnik, vol. 69, no. 7, pp. 608-618, 2021

Linear tracking MPC for nonlinear systems Part II: The data-driven case

Authors: Julian Berberich, Johannes Köhler, Matthias A. Müller, Frank Allgöwer

Abstract: We present a novel data-driven model predictive control (MPC) approach to control unknown nonlinear systems using only measured input-output data with closed-loop stability guarantees. Our scheme relies on the data-driven system parametrization provided by the Fundamental Lemma of Willems et al. We use new input-output measurements online to update the data, exploiting local linear approximations… ▽ More We present a novel data-driven model predictive control (MPC) approach to control unknown nonlinear systems using only measured input-output data with closed-loop stability guarantees. Our scheme relies on the data-driven system parametrization provided by the Fundamental Lemma of Willems et al. We use new input-output measurements online to update the data, exploiting local linear approximations of the underlying system. We prove that our MPC scheme, which only requires solving strictly convex quadratic programs online, ensures that the closed loop (practically) converges to the (unknown) optimal reachable equilibrium that tracks a desired output reference while satisfying polytopic input constraints. As intermediate results of independent interest, we extend the Fundamental Lemma to affine systems and we derive novel robustness bounds w.r.t. noisy data for the open-loop optimal control problem, which are directly transferable to other data-driven MPC schemes in the literature. The applicability of our approach is illustrated with a numerical application to a continuous stirred tank reactor. △ Less

Submitted 14 April, 2022; v1 submitted 18 May, 2021; originally announced May 2021.

Journal ref: IEEE Transactions on Automatic Control, vol. 67, no. 9, pp. 4406-4421, 2022

Linear tracking MPC for nonlinear systems Part I: The model-based case

Authors: Julian Berberich, Johannes Köhler, Matthias A. Müller, Frank Allgöwer

Abstract: We develop a tracking model predictive control (MPC) scheme for nonlinear systems using the linearized dynamics at the current state as a prediction model. Under reasonable assumptions on the linearized dynamics, we prove that the proposed MPC scheme exponentially stabilizes the optimal reachable equilibrium w.r.t. a desired target setpoint. Our theoretical results rely on the fact that, close to… ▽ More We develop a tracking model predictive control (MPC) scheme for nonlinear systems using the linearized dynamics at the current state as a prediction model. Under reasonable assumptions on the linearized dynamics, we prove that the proposed MPC scheme exponentially stabilizes the optimal reachable equilibrium w.r.t. a desired target setpoint. Our theoretical results rely on the fact that, close to the steady-state manifold, the prediction error of the linearization is small and hence, we can slide along the steady-state manifold towards the optimal reachable equilibrium. The closed-loop stability properties mainly depend on a cost matrix which allows us to trade off performance, robustness, and the size of the region of attraction. In an application to a nonlinear continuous stirred tank reactor, we show that the scheme, which only requires solving a convex quadratic program online, has comparable performance to a nonlinear MPC scheme while being computationally significantly more efficient. Further, our results provide the basis for controlling nonlinear systems based on data-dependent linear prediction models, which we explore in our companion paper. △ Less

Submitted 14 April, 2022; v1 submitted 18 May, 2021; originally announced May 2021.

Journal ref: IEEE Transactions on Automatic Control, vol. 67, no. 9, pp. 4390-4405, 2022

Robust output feedback model predictive control using online estimation bounds

Authors: Johannes Köhler, Matthias A. Müller, Frank Allgöwer

Abstract: We present a framework to design nonlinear robust output feedback model predictive control (MPC) schemes that ensure constraint satisfaction under noisy output measurements and disturbances. We provide novel estimation methods to bound the magnitude of the estimation error based on: stability properties of the observer; detectability; set-membership estimation; moving horizon estimation (MHE). Rob… ▽ More We present a framework to design nonlinear robust output feedback model predictive control (MPC) schemes that ensure constraint satisfaction under noisy output measurements and disturbances. We provide novel estimation methods to bound the magnitude of the estimation error based on: stability properties of the observer; detectability; set-membership estimation; moving horizon estimation (MHE). Robust constraint satisfaction is guaranteed by suitably incorporating these online validated bounds on the estimation error in a homothetic tube based MPC formulation. In addition, we show how the performance can be further improved by combining MHE and MPC in a single optimization problem. The framework is applicable to a general class of detectable and (incrementally) stabilizable nonlinear systems. While standard output feedback MPC schemes use offline computed worst-case bounds on the estimation error, the proposed framework utilizes online validated bounds, thus reducing conservatism and improving performance. We demonstrate the reduced conservatism of the proposed framework using a nonlinear 10-state quadrotor example. △ Less

Submitted 7 May, 2021; originally announced May 2021.

Model predictive control for linear uncertain systems using integral quadratic constraints

Authors: Lukas Schwenkel, Johannes Köhler, Matthias A. Müller, Frank Allgöwer

Abstract: In this work, we propose a tube-based MPC scheme for state- and input-constrained linear systems subject to dynamic uncertainties characterized by dynamic integral quadratic constraints (IQCs). In particular, we extend the framework of $ρ$-hard IQCs for exponential stability analysis to external inputs. This result yields that the error between the true uncertain system and the nominal prediction… ▽ More In this work, we propose a tube-based MPC scheme for state- and input-constrained linear systems subject to dynamic uncertainties characterized by dynamic integral quadratic constraints (IQCs). In particular, we extend the framework of $ρ$-hard IQCs for exponential stability analysis to external inputs. This result yields that the error between the true uncertain system and the nominal prediction model is bounded by an exponentially stable scalar system. In the proposed tube-based MPC scheme, the state of this error bounding system is predicted along with the nominal model and used as a scaling parameter for the tube size. We prove that this method achieves robust constraint satisfaction and input-to-state stability despite dynamic uncertainties and additive bounded disturbances. A numerical example demonstrates the reduced conservatism of this IQC approach compared to state-of-the-art robust MPC approaches for dynamic uncertainties. △ Less

Submitted 27 April, 2022; v1 submitted 12 April, 2021; originally announced April 2021.

Robust stability analysis of a simple data-driven model predictive control approach

Authors: Joscha Bongard, Julian Berberich, Johannes Köhler, Frank Allgöwer

Abstract: In this paper, we provide a theoretical analysis of closed-loop properties of a simple data-driven model predictive control (MPC) scheme. The formulation does not involve any terminal ingredients, thus allowing for a simple implementation without (potential) feasibility issues. The proposed approach relies on an implicit description of linear time-invariant systems based on behavioral systems theo… ▽ More In this paper, we provide a theoretical analysis of closed-loop properties of a simple data-driven model predictive control (MPC) scheme. The formulation does not involve any terminal ingredients, thus allowing for a simple implementation without (potential) feasibility issues. The proposed approach relies on an implicit description of linear time-invariant systems based on behavioral systems theory, which only requires one input-output trajectory of an unknown system. For the nominal case with noise-free data, we prove that the data-driven MPC scheme ensures exponential stability for the closed loop if the prediction horizon is sufficiently long. Moreover, we analyze the robust data-driven MPC scheme for noisy output measurements for which we prove closed-loop practical exponential stability. The advantages of the presented approach are illustrated with a numerical example. △ Less

Submitted 14 April, 2022; v1 submitted 1 March, 2021; originally announced March 2021.

Journal ref: IEEE Transactions on Automatic Control, 2023

On the design of terminal ingredients for data-driven MPC

Authors: Julian Berberich, Johannes Köhler, Matthias A. Müller, Frank Allgöwer

Abstract: We present a model predictive control (MPC) scheme to control linear time-invariant systems using only measured input-output data and no model knowledge. The scheme includes a terminal cost and a terminal set constraint on an extended state containing past input-output values. We provide an explicit design procedure for the corresponding terminal ingredients that only uses measured input-output da… ▽ More We present a model predictive control (MPC) scheme to control linear time-invariant systems using only measured input-output data and no model knowledge. The scheme includes a terminal cost and a terminal set constraint on an extended state containing past input-output values. We provide an explicit design procedure for the corresponding terminal ingredients that only uses measured input-output data. Further, we prove that the MPC scheme based on these terminal ingredients exponentially stabilizes the desired setpoint in closed loop. Finally, we illustrate the advantages over existing data-driven MPC approaches with a numerical example. △ Less

Submitted 25 May, 2021; v1 submitted 14 January, 2021; originally announced January 2021.

Comments: Final version, accepted for presentation at the 7th IFAC Conference on Nonlinear Model Predictive Control 2021

Journal ref: IFAC-PapersOnLine, vol. 54, no. 6, pp. 257-263, 2021

Stability and performance in MPC using a finite-tail cost

Authors: Johannes Köhler, Frank Allgöwer

Abstract: In this paper, we provide a stability and performance analysis of model predictive control (MPC) schemes based on finite-tail costs. We study the MPC formulation originally proposed by Magni et al. (2001) wherein the standard terminal penalty is replaced by a finite-horizon cost of some stabilizing control law. In order to analyse the closed loop, we leverage the more recent technical machinery de… ▽ More In this paper, we provide a stability and performance analysis of model predictive control (MPC) schemes based on finite-tail costs. We study the MPC formulation originally proposed by Magni et al. (2001) wherein the standard terminal penalty is replaced by a finite-horizon cost of some stabilizing control law. In order to analyse the closed loop, we leverage the more recent technical machinery developed for MPC without terminal ingredients. For a specified set of initial conditions, we obtain sufficient conditions for stability and a performance bound in dependence of the prediction horizon and the extended horizon used for the terminal penalty. The main practical benefit of the considered finite-tail cost MPC formulation is the simpler offline design in combination with typically significantly less restrictive bounds on the prediction horizon to ensure stability. We demonstrate the benefits of the considered MPC formulation using the classical example of a four tank system. △ Less

Submitted 21 June, 2021; v1 submitted 12 January, 2021; originally announced January 2021.

Comments: Final version, accepted for presentation at the 7th IFAC Conference on Nonlinear Model Predictive Control 2021

Offset-free setpoint tracking using neural network controllers

Authors: Patricia Pauli, Johannes Köhler, Julian Berberich, Anne Koch, Frank Allgöwer

Abstract: In this paper, we present a method to analyze local and global stability in offset-free setpoint tracking using neural network controllers and we provide ellipsoidal inner approximations of the corresponding region of attraction. We consider a feedback interconnection of a linear plant in connection with a neural network controller and an integrator, which allows for offset-free tracking of a desi… ▽ More In this paper, we present a method to analyze local and global stability in offset-free setpoint tracking using neural network controllers and we provide ellipsoidal inner approximations of the corresponding region of attraction. We consider a feedback interconnection of a linear plant in connection with a neural network controller and an integrator, which allows for offset-free tracking of a desired piecewise constant reference that enters the controller as an external input. Exploiting the fact that activation functions used in neural networks are slope-restricted, we derive linear matrix inequalities to verify stability using Lyapunov theory. After stating a global stability result, we present less conservative local stability conditions (i) for a given reference and (ii) for any reference from a certain set. The latter result even enables guaranteed tracking under setpoint changes using a reference governor which can lead to a significant increase of the region of attraction. Finally, we demonstrate the applicability of our analysis by verifying stability and offset-free tracking of a neural network controller that was trained to stabilize a linearized inverted pendulum. △ Less

Submitted 29 April, 2021; v1 submitted 23 November, 2020; originally announced November 2020.

Multi-Staged Cross-Lingual Acoustic Model Adaption for Robust Speech Recognition in Real-World Applications -- A Case Study on German Oral History Interviews

Authors: Michael Gref, Oliver Walter, Christoph Schmidt, Sven Behnke, Joachim Köhler

Abstract: While recent automatic speech recognition systems achieve remarkable performance when large amounts of adequate, high quality annotated speech data is used for training, the same systems often only achieve an unsatisfactory result for tasks in domains that greatly deviate from the conditions represented by the training data. For many real-world applications, there is a lack of sufficient data that… ▽ More While recent automatic speech recognition systems achieve remarkable performance when large amounts of adequate, high quality annotated speech data is used for training, the same systems often only achieve an unsatisfactory result for tasks in domains that greatly deviate from the conditions represented by the training data. For many real-world applications, there is a lack of sufficient data that can be directly used for training robust speech recognition systems. To address this issue, we propose and investigate an approach that performs a robust acoustic model adaption to a target domain in a cross-lingual, multi-staged manner. Our approach enables the exploitation of large-scale training data from other domains in both the same and other languages. We evaluate our approach using the challenging task of German oral history interviews, where we achieve a relative reduction of the word error rate by more than 30% compared to a model trained from scratch only on the target domain, and 6-7% relative compared to a model trained robustly on 1000 hours of same-language out-of-domain training data. △ Less

Submitted 26 May, 2020; originally announced May 2020.

Comments: Published version of the paper can be accessed via https://www.aclweb.org/anthology/2020.lrec-1.780

Journal ref: 12th International Conference on Language Resources and Evaluation (LREC 2020), pages 6354-6362

Constrained nonlinear output regulation using model predictive control -- extended version

Authors: Johannes Köhler, Matthias A. Müller, Frank Allgöwer

Abstract: We present a model predictive control (MPC) framework to solve the constrained nonlinear output regulation problem. The main feature of the proposed framework is that the application does not require the solution to classical regulator (Francis-Byrnes-Isidori) equations or any other offline design procedure. In particular, the proposed formulation simply minimizes the predicted output error, possi… ▽ More We present a model predictive control (MPC) framework to solve the constrained nonlinear output regulation problem. The main feature of the proposed framework is that the application does not require the solution to classical regulator (Francis-Byrnes-Isidori) equations or any other offline design procedure. In particular, the proposed formulation simply minimizes the predicted output error, possibly with some input regularization. Instead of using terminal cost/sets or a positive definite stage cost as is standard in MPC theory, we build on the theoretical results by Grimm et al. 2005 using a detectability notion. The proposed formulation is applicable if the constrained nonlinear regulation problem is (strictly) feasible, the plant is incrementally stabilizable and incrementally input-output to state stable (i-IOSS/detectable). We show that for minimum phase systems such a design ensures exponential stability of the regulator manifold. We also provide a design procedure in case of unstable zero dynamics using an incremental input regularization and a nonresonance condition. Inherent robustness properties for the noisy error/output-feedback case are established under simplifying assumptions (e.g. no state constraints). The theoretical results are illustrated with an example involving offset free tracking with noisy error feedback. The paper also contains novel results for MPC without terminal constraints with positive semidefinite input/output stage costs that are of independent interest. △ Less

Submitted 1 June, 2021; v1 submitted 25 May, 2020; originally announced May 2020.

Comments: Extended version of accepted paper in Transaction on Automatic Control, 2021. Contains the following additional results: Exponential bounds on the suboptimality index using an observability condition and an extension of the derived theory to the noisy error feedback case

Journal ref: Transaction on Automatic Control, 2021

Periodic optimal control of nonlinear constrained systems using economic model predictive control

Authors: Johannes Köhler, Matthias A. Müller, Frank Allgöwer

Abstract: In this paper, we consider the problem of periodic optimal control of nonlinear systems subject to online changing and periodically time-varying economic performance measures using model predictive control (MPC). The proposed economic MPC scheme uses an online optimized artificial periodic orbit to ensure recursive feasibility and constraint satisfaction despite unpredictable changes in the econom… ▽ More In this paper, we consider the problem of periodic optimal control of nonlinear systems subject to online changing and periodically time-varying economic performance measures using model predictive control (MPC). The proposed economic MPC scheme uses an online optimized artificial periodic orbit to ensure recursive feasibility and constraint satisfaction despite unpredictable changes in the economic performance index. We demonstrate that the direct extension of existing methods to periodic orbits does not necessarily yield the desirable closed-loop economic performance. Instead, we carefully revise the constraints on the artificial trajectory, which ensures that the closed-loop average performance is no worse than a locally optimal periodic orbit. In the special case that the prediction horizon is set to zero, the proposed scheme is a modified version of recent publications using periodicity constraints, with the important difference that the resulting closed loop has more degrees of freedom which are vital to ensure convergence to an optimal periodic orbit. In addition, we detail a tailored offline computation of suitable terminal ingredients, which are both theoretically and practically beneficial for closed-loop performance improvement. Finally, we demonstrate the practicality and performance improvements of the proposed approach on benchmark examples. △ Less

Submitted 20 October, 2020; v1 submitted 11 May, 2020; originally announced May 2020.

Comments: This is the accepted version of the paper in Journal of Process Control, 2020. This version contains additional details in the appendix regarding the numerical example

Journal ref: Journal of Process Control 92 (2020) pp. 185-201

Robust and optimal predictive control of the COVID-19 outbreak

Authors: Johannes Köhler, Lukas Schwenkel, Anne Koch, Julian Berberich, Patricia Pauli, Frank Allgöwer

Abstract: We investigate adaptive strategies to robustly and optimally control the COVID-19 pandemic via social distancing measures based on the example of Germany. Our goal is to minimize the number of fatalities over the course of two years without inducing excessive social costs. We consider a tailored model of the German COVID-19 outbreak with different parameter sets to design and validate our approach… ▽ More We investigate adaptive strategies to robustly and optimally control the COVID-19 pandemic via social distancing measures based on the example of Germany. Our goal is to minimize the number of fatalities over the course of two years without inducing excessive social costs. We consider a tailored model of the German COVID-19 outbreak with different parameter sets to design and validate our approach. Our analysis reveals that an open-loop optimal control policy can significantly decrease the number of fatalities when compared to simpler policies under the assumption of exact model knowledge. In a more realistic scenario with uncertain data and model mismatch, a feedback strategy that updates the policy weekly using model predictive control (MPC) leads to a reliable performance, even when applied to a validation model with deviant parameters. On top of that, we propose a robust MPC-based feedback policy using interval arithmetic that adapts the social distancing measures cautiously and safely, thus leading to a minimum number of fatalities even if measurements are inaccurate and the infection rates cannot be precisely specified by social distancing. Our theoretical findings support various recent studies by showing that 1) adaptive feedback strategies are required to reliably contain the COVID-19 outbreak, 2) well-designed policies can significantly reduce the number of fatalities compared to simpler ones while kee** the amount of social distancing measures on the same level, and 3) imposing stronger social distancing measures early on is more effective and cheaper in the long run than opening up too soon and restoring stricter measures at a later time. △ Less

Submitted 8 February, 2021; v1 submitted 7 May, 2020; originally announced May 2020.

Comments: This is the accepted version of the paper in Annual Reviews in Control, 2020

Journal ref: Annual Reviews in Control (2020)

Robust Dual Control based on Gain Scheduling

Authors: Janani Venkatasubramanian, Johannes Köhler, Julian Berberich, Frank Allgöwer

Abstract: We present a novel strategy for robust dual control of linear time-invariant systems based on gain scheduling with performance guarantees. This work relies on prior results of determining uncertainty bounds of system parameters estimated through exploration. Existing approaches are unable to account for changes of the mean of system parameters in the exploration phase and thus to accurately captur… ▽ More We present a novel strategy for robust dual control of linear time-invariant systems based on gain scheduling with performance guarantees. This work relies on prior results of determining uncertainty bounds of system parameters estimated through exploration. Existing approaches are unable to account for changes of the mean of system parameters in the exploration phase and thus to accurately capture the dual effect. We address this limitation by selecting the future (uncertain) mean as a scheduling variable in the control design. The result is a semi-definite program-based design that computes a suitable exploration strategy and a robust gain-scheduled controller with probabilistic quadratic performance bounds after the exploration phase. △ Less

Submitted 13 May, 2021; v1 submitted 9 April, 2020; originally announced April 2020.

Comments: Final version, 59th IEEE Conference on Decision and Control (CDC), 2020

Robust Constraint Satisfaction in Data-Driven MPC

Authors: Julian Berberich, Johannes Köhler, Matthias A. Müller, Frank Allgöwer

Abstract: We propose a purely data-driven model predictive control (MPC) scheme to control unknown linear time-invariant systems with guarantees on stability and constraint satisfaction in the presence of noisy data. The scheme predicts future trajectories based on data-dependent Hankel matrices, which span the full system behavior if the input is persistently exciting. This paper extends previous work on d… ▽ More We propose a purely data-driven model predictive control (MPC) scheme to control unknown linear time-invariant systems with guarantees on stability and constraint satisfaction in the presence of noisy data. The scheme predicts future trajectories based on data-dependent Hankel matrices, which span the full system behavior if the input is persistently exciting. This paper extends previous work on data-driven MPC by including a suitable constraint tightening which ensures that the closed-loop trajectory satisfies desired pointwise-in-time output constraints. Furthermore, we provide estimation procedures to compute system constants related to controllability and observability, which are required to implement the constraint tightening. The practicality of the proposed approach is illustrated via a numerical example. △ Less

Submitted 24 March, 2021; v1 submitted 15 March, 2020; originally announced March 2020.

Comments: This version fixes a minor typo in the published version (definition of equilibrium on page 2, change marked in blue color)

Journal ref: in Proc. Conference on Decision and Control, 2020, pp. 1260-1267

Determining optimal input-output properties: A data-driven approach

Authors: Anne Koch, Julian Berberich, Johannes Köhler, Frank Allgöwer

Abstract: Due to their relevance in systems analysis and (robust) controller design, we consider the problem of determining control-theoretic system properties of an a priori unknown system from data only. More specifically, we introduce a necessary and sufficient condition for a discrete-time linear time-invariant system to satisfy a given integral quadratic constraint (IQC) over a finite time horizon usin… ▽ More Due to their relevance in systems analysis and (robust) controller design, we consider the problem of determining control-theoretic system properties of an a priori unknown system from data only. More specifically, we introduce a necessary and sufficient condition for a discrete-time linear time-invariant system to satisfy a given integral quadratic constraint (IQC) over a finite time horizon using only one input-output trajectory of finite length. Furthermore, for certain classes of IQCs, we provide convex optimization problems in form of semidefinite programs (SDPs) to retrieve the optimal, i.e. the tightest, system property description that is satisfied by the unknown system. Finally, we provide bounds on the difference between finite and infinite horizon IQCs and illustrate the effectiveness of the proposed scheme in a variety of simulation studies including noisy measurements and a high dimensional system. △ Less

Submitted 10 February, 2020; originally announced February 2020.

Safe and Fast Tracking on a Robot Manipulator: Robust MPC and Neural Network Control

Authors: Julian Nubert, Johannes Köhler, Vincent Berenz, Frank Allgöwer, Sebastian Trimpe

Abstract: Fast feedback control and safety guarantees are essential in modern robotics. We present an approach that achieves both by combining novel robust model predictive control (MPC) with function approximation via (deep) neural networks (NNs). The result is a new approach for complex tasks with nonlinear, uncertain, and constrained dynamics as are common in robotics. Specifically, we leverage recent re… ▽ More Fast feedback control and safety guarantees are essential in modern robotics. We present an approach that achieves both by combining novel robust model predictive control (MPC) with function approximation via (deep) neural networks (NNs). The result is a new approach for complex tasks with nonlinear, uncertain, and constrained dynamics as are common in robotics. Specifically, we leverage recent results in MPC research to propose a new robust setpoint tracking MPC algorithm, which achieves reliable and safe tracking of a dynamic setpoint while guaranteeing stability and constraint satisfaction. The presented robust MPC scheme constitutes a one-layer approach that unifies the often separated planning and control layers, by directly computing the control command based on a reference and possibly obstacle positions. As a separate contribution, we show how the computation time of the MPC can be drastically reduced by approximating the MPC law with a NN controller. The NN is trained and validated from offline samples of the MPC, yielding statistical guarantees, and used in lieu thereof at run time. Our experiments on a state-of-the-art robot manipulator are the first to show that both the proposed robust and approximate MPC schemes scale to real-world robotic systems. △ Less

Submitted 2 March, 2020; v1 submitted 21 December, 2019; originally announced December 2019.

Comments: 8 pages, 4 figures,

Journal ref: Robotics and Automation Letters, 2020

Robust Economic Model Predictive Control without Terminal Conditions

Authors: Lukas Schwenkel, Johannes Köhler, Matthias A. Müller, Frank Allgöwer

Abstract: In this paper, a novel tube-based economic Model Predictive Control (MPC) scheme for uncertain systems that uses neither terminal costs nor terminal constraints is investigated. We show that the results from the undisturbed case can be extended to systems with bounded disturbances by using similar turnpike arguments and a properly modified stage cost. We prove robust guarantees on the closed-loop… ▽ More In this paper, a novel tube-based economic Model Predictive Control (MPC) scheme for uncertain systems that uses neither terminal costs nor terminal constraints is investigated. We show that the results from the undisturbed case can be extended to systems with bounded disturbances by using similar turnpike arguments and a properly modified stage cost. We prove robust guarantees on the closed-loop performance, convergence, and stability under suitable dissipativity and controllability conditions and discuss them in a numerical example. △ Less

Submitted 27 July, 2020; v1 submitted 27 November, 2019; originally announced November 2019.

A nonlinear tracking model predictive control scheme for dynamic target signals

Authors: Johannes Köhler, Matthias A. Müller, Frank Allgöwer

Abstract: We present a nonlinear model predictive control (MPC) scheme for tracking of dynamic target signals. The scheme combines stabilization and dynamic trajectory planning in one layer, thus ensuring constraint satisfaction irrespective of changes in the dynamic target signal. For periodic target signals we ensure exponential stability of the optimal reachable periodic trajectory using suitable termina… ▽ More We present a nonlinear model predictive control (MPC) scheme for tracking of dynamic target signals. The scheme combines stabilization and dynamic trajectory planning in one layer, thus ensuring constraint satisfaction irrespective of changes in the dynamic target signal. For periodic target signals we ensure exponential stability of the optimal reachable periodic trajectory using suitable terminal ingredients and a convexity condition for the underlying periodic optimal control problem. Furthermore, we introduce an online optimization of the terminal set size to automate the trade-off between fast convergence and operation close to the constraints. In addition, we show how stabilization and dynamic trajectory planning can be formulated as partially decoupled optimization problems, which reduces the computational demand while ensuring recursive feasibility and convergence. The main tool to enable the proposed design is a novel reference generic offline computation that provides suitable terminal ingredients for tracking of dynamic reference trajectories. The practicality of this approach is demonstrated on benchmark examples, which demonstrates superior performance compared to state of the art approaches. △ Less

Submitted 20 October, 2020; v1 submitted 8 November, 2019; originally announced November 2019.

Comments: This is an extended version of the paper in Automatica (2020), which contains the theoretical proofs for Theorem~8 and Propositions 11-13

Journal ref: Automatica 118 (2020) 109030