Showing 1–50 of 149 results for author: Allgöwer, F

An overview of systems-theoretic guarantees in data-driven model predictive control

Authors: Julian Berberich, Frank Allgöwer

Abstract: The development of control methods based on data has seen a surge of interest in recent years. When applying data-driven controllers in real-world applications, providing theoretical guarantees for the closed-loop system is of crucial importance to ensure reliable operation. In this review, we provide an overview of data-driven model predictive control (MPC) methods for controlling unknown systems… ▽ More The development of control methods based on data has seen a surge of interest in recent years. When applying data-driven controllers in real-world applications, providing theoretical guarantees for the closed-loop system is of crucial importance to ensure reliable operation. In this review, we provide an overview of data-driven model predictive control (MPC) methods for controlling unknown systems with guarantees on systems-theoretic properties such as stability, robustness, and constraint satisfaction. The considered approaches rely on the Fundamental Lemma from behavioral theory in order to predict input-output trajectories directly from data. We cover various setups, ranging from linear systems and noise-free data to more realistic formulations with noise and nonlinearities, and we provide an overview of different techniques to ensure guarantees for the closed-loop system. Moreover, we discuss avenues for future research that may further improve the theoretical understanding and practical applicability of data-driven MPC. △ Less

Submitted 6 June, 2024; originally announced June 2024.

On discount functions for economic model predictive control without terminal conditions

Authors: Lukas Schwenkel, Daniel Briem, Matthias A. Müller, Frank Allgöwer

Abstract: In this paper, we investigate discounted economic model predictive control (E-MPC) schemes without terminal conditions in scenarios where the optimal operating behavior is a periodic orbit. For such a setting, it is known that a linearly discounted stage cost guarantees asymptotic stability of any arbitrarily small neighborhood of the optimal orbit if the prediction horizon is sufficiently long. H… ▽ More In this paper, we investigate discounted economic model predictive control (E-MPC) schemes without terminal conditions in scenarios where the optimal operating behavior is a periodic orbit. For such a setting, it is known that a linearly discounted stage cost guarantees asymptotic stability of any arbitrarily small neighborhood of the optimal orbit if the prediction horizon is sufficiently long. However, in some examples very long prediction horizons are needed to achieve the desired performance. In this work, we extend these results by providing the same qualitative stability guarantees for a large class of discount functions. Numerical examples illustrate the influence of the discount function and show that with suitable discounting we can achieve significantly better performance than the linearly discounted E-MPC, even for short prediction horizons. △ Less

Submitted 23 May, 2024; originally announced May 2024.

How improving performance may imply losing consistency in event-triggered consensus

Authors: David Meister, Duarte J. Antunes, Frank Allgöwer

Abstract: Event-triggered control is often argued to lower the average triggering rate compared to time-triggered control while still achieving a desired control goal, e.g., the same performance level. However, this property, often called consistency, cannot be taken for granted and can be hard to analyze in many settings. In particular, although numerous decentralized event-triggered control schemes have b… ▽ More Event-triggered control is often argued to lower the average triggering rate compared to time-triggered control while still achieving a desired control goal, e.g., the same performance level. However, this property, often called consistency, cannot be taken for granted and can be hard to analyze in many settings. In particular, although numerous decentralized event-triggered control schemes have been proposed in the past years, their performance properties with respect to time-triggered control remain mostly unexplored. In this paper, we therefore examine the performance properties of event-triggered control (relative to time-triggered control) for a single-integrator consensus problem with a level-triggering rule. We consider the long-term average quadratic deviation from consensus as a performance measure. For this setting, we show that enriching the information the local controllers use improves the performance of the consensus algorithm but renders a previously consistent event-triggered control scheme inconsistent. In addition, we do so while deploying optimal control inputs which we derive for both information cases and all triggering schemes. With this insight, we can furthermore explain the relationship between two contrasting consistency results from the literature on decentralized event-triggered control. We support our theoretical findings with simulation results. △ Less

Submitted 6 May, 2024; originally announced May 2024.

Lipschitz constant estimation for general neural network architectures using control tools

Authors: Patricia Pauli, Dennis Gramlich, Frank Allgöwer

Abstract: This paper is devoted to the estimation of the Lipschitz constant of neural networks using semidefinite programming. For this purpose, we interpret neural networks as time-varying dynamical systems, where the $k$-th layer corresponds to the dynamics at time $k$. A key novelty with respect to prior work is that we use this interpretation to exploit the series interconnection structure of neural net… ▽ More This paper is devoted to the estimation of the Lipschitz constant of neural networks using semidefinite programming. For this purpose, we interpret neural networks as time-varying dynamical systems, where the $k$-th layer corresponds to the dynamics at time $k$. A key novelty with respect to prior work is that we use this interpretation to exploit the series interconnection structure of neural networks with a dynamic programming recursion. Nonlinearities, such as activation functions and nonlinear pooling layers, are handled with integral quadratic constraints. If the neural network contains signal processing layers (convolutional or state space model layers), we realize them as 1-D/2-D/N-D systems and exploit this structure as well. We distinguish ourselves from related work on Lipschitz constant estimation by more extensive structure exploitation (scalability) and a generalization to a large class of common neural network architectures. To show the versatility and computational advantages of our method, we apply it to different neural network architectures trained on MNIST and CIFAR-10. △ Less

Submitted 2 May, 2024; originally announced May 2024.

Data-Driven Min-Max MPC for Linear Systems: Robustness and Adaptation

Authors: Yifan Xie, Julian Berberich, Frank Allgöwer

Abstract: Data-driven controllers design is an important research problem, in particular when data is corrupted by the noise. In this paper, we propose a data-driven min-max model predictive control (MPC) scheme using noisy input-state data for unknown linear time-invariant (LTI) system. The unknown system matrices are characterized by a set-membership representation using the noisy input-state data. Levera… ▽ More Data-driven controllers design is an important research problem, in particular when data is corrupted by the noise. In this paper, we propose a data-driven min-max model predictive control (MPC) scheme using noisy input-state data for unknown linear time-invariant (LTI) system. The unknown system matrices are characterized by a set-membership representation using the noisy input-state data. Leveraging this representation, we derive an upper bound on the worst-case cost and determine the corresponding optimal state-feedback control law through a semidefinite program (SDP). We prove that the resulting closed-loop system is robustly stabilized and satisfies the input and state constraints. Further, we propose an adaptive data-driven min-max MPC scheme which exploits additional online input-state data to improve closed-loop performance. Numerical examples show the effectiveness of the proposed methods. △ Less

Submitted 29 April, 2024; originally announced April 2024.

Comments: arXiv admin note: text overlap with arXiv:2309.17307

Bootstrap** Guarantees: Stability and Performance Analysis for Dynamic Encrypted Control

Authors: Sebastian Schlor, Frank Allgöwer

Abstract: Encrypted dynamic controllers that operate for an unlimited time have been a challenging subject of research. The fundamental difficulty is the accumulation of errors and scaling factors in the internal state during operation. Bootstrap**, a technique commonly employed in fully homomorphic cryptosystems, can be used to avoid overflows in the controller state but can potentially introduce signifi… ▽ More Encrypted dynamic controllers that operate for an unlimited time have been a challenging subject of research. The fundamental difficulty is the accumulation of errors and scaling factors in the internal state during operation. Bootstrap**, a technique commonly employed in fully homomorphic cryptosystems, can be used to avoid overflows in the controller state but can potentially introduce significant numerical errors. In this paper, we analyze dynamic encrypted control with explicit consideration of bootstrap**. By recognizing the bootstrap** errors occurring in the controller's state as an uncertainty in the robust control framework, we can provide stability and performance guarantees for the whole encrypted control system. Further, the conservatism of the stability and performance test is reduced by using a lifted version of the control system. △ Less

Submitted 27 March, 2024; originally announced March 2024.

Collision Avoidance Safety Filter for an Autonomous E-Scooter using Ultrasonic Sensors

Authors: Robin Strässer, Marc Seidel, Felix Brändle, David Meister, Raffaele Soloperto, David Hambach Ferrer, Frank Allgöwer

Abstract: In this paper, we propose a collision avoidance safety filter for autonomous electric scooters to enable safe operation of such vehicles in pedestrian areas. In particular, we employ multiple low-cost ultrasonic sensors to detect a wide range of possible obstacles in front of the e-scooter. Based on possibly faulty distance measurements, we design a filter to mitigate measurement noise and missing… ▽ More In this paper, we propose a collision avoidance safety filter for autonomous electric scooters to enable safe operation of such vehicles in pedestrian areas. In particular, we employ multiple low-cost ultrasonic sensors to detect a wide range of possible obstacles in front of the e-scooter. Based on possibly faulty distance measurements, we design a filter to mitigate measurement noise and missing values as well as a gain-scheduled controller to limit the velocity commanded to the e-scooter when required due to imminent collisions. The proposed controller structure is able to prevent collisions with unknown obstacles by deploying a reduced safe velocity ensuring a sufficiently large safety distance. The collision avoidance approach is designed such that it may be easily deployed in similar applications of general micromobility vehicles. The effectiveness of our proposed safety filter is demonstrated in real-world experiments. △ Less

Submitted 27 May, 2024; v1 submitted 22 March, 2024; originally announced March 2024.

Comments: Accepted for presentation at the 17th IFAC Symposium on Control in Transportation Systems (CTS 2024)

State space representations of the Roesser type for convolutional layers

Authors: Patricia Pauli, Dennis Gramlich, Fran Allgöwer

Abstract: From the perspective of control theory, convolutional layers (of neural networks) are 2-D (or N-D) linear time-invariant dynamical systems. The usual representation of convolutional layers by the convolution kernel corresponds to the representation of a dynamical system by its impulse response. However, many analysis tools from control theory, e.g., involving linear matrix inequalities, require a… ▽ More From the perspective of control theory, convolutional layers (of neural networks) are 2-D (or N-D) linear time-invariant dynamical systems. The usual representation of convolutional layers by the convolution kernel corresponds to the representation of a dynamical system by its impulse response. However, many analysis tools from control theory, e.g., involving linear matrix inequalities, require a state space representation. For this reason, we explicitly provide a state space representation of the Roesser type for 2-D convolutional layers with $c_\mathrm{in}r_1 + c_\mathrm{out}r_2$ states, where $c_\mathrm{in}$/$c_\mathrm{out}$ is the number of input/output channels of the layer and $r_1$/$r_2$ characterizes the width/length of the convolution kernel. This representation is shown to be minimal for $c_\mathrm{in} = c_\mathrm{out}$. We further construct state space representations for dilated, strided, and N-D convolutions. △ Less

Submitted 18 March, 2024; originally announced March 2024.

SafEDMD: A certified learning architecture tailored to data-driven control of nonlinear dynamical systems

Authors: Robin Strässer, Manuel Schaller, Karl Worthmann, Julian Berberich, Frank Allgöwer

Abstract: The Koopman operator serves as the theoretical backbone for machine learning of dynamical control systems, where the operator is heuristically approximated by extended dynamic mode decomposition (EDMD). In this paper, we propose Stability- and certificate-oriented EDMD (SafEDMD): a novel EDMD-based learning architecture which comes along with rigorous certificates, resulting in a reliable surrogat… ▽ More The Koopman operator serves as the theoretical backbone for machine learning of dynamical control systems, where the operator is heuristically approximated by extended dynamic mode decomposition (EDMD). In this paper, we propose Stability- and certificate-oriented EDMD (SafEDMD): a novel EDMD-based learning architecture which comes along with rigorous certificates, resulting in a reliable surrogate model generated in a data-driven fashion. To ensure the trustworthiness of SafEDMD, we derive proportional error bounds, which vanish at the origin and are tailored to control tasks, leading to certified controller design based on semi-definite programming. We illustrate the developed method by means of several benchmark examples and highlight the advantages over state-of-the-art methods. △ Less

Submitted 17 May, 2024; v1 submitted 5 February, 2024; originally announced February 2024.

Novel Quadratic Constraints for Extending LipSDP beyond Slope-Restricted Activations

Authors: Patricia Pauli, Aaron Havens, Alexandre Araujo, Siddharth Garg, Farshad Khorrami, Frank Allgöwer, Bin Hu

Abstract: Recently, semidefinite programming (SDP) techniques have shown great promise in providing accurate Lipschitz bounds for neural networks. Specifically, the LipSDP approach (Fazlyab et al., 2019) has received much attention and provides the least conservative Lipschitz upper bounds that can be computed with polynomial time guarantees. However, one main restriction of LipSDP is that its formulation r… ▽ More Recently, semidefinite programming (SDP) techniques have shown great promise in providing accurate Lipschitz bounds for neural networks. Specifically, the LipSDP approach (Fazlyab et al., 2019) has received much attention and provides the least conservative Lipschitz upper bounds that can be computed with polynomial time guarantees. However, one main restriction of LipSDP is that its formulation requires the activation functions to be slope-restricted on $[0,1]$, preventing its further use for more general activation functions such as GroupSort, MaxMin, and Householder. One can rewrite MaxMin activations for example as residual ReLU networks. However, a direct application of LipSDP to the resultant residual ReLU networks is conservative and even fails in recovering the well-known fact that the MaxMin activation is 1-Lipschitz. Our paper bridges this gap and extends LipSDP beyond slope-restricted activation functions. To this end, we provide novel quadratic constraints for GroupSort, MaxMin, and Householder activations via leveraging their underlying properties such as sum preservation. Our proposed analysis is general and provides a unified approach for estimating $\ell_2$ and $\ell_\infty$ Lipschitz bounds for a rich class of neural network architectures, including non-residual and residual neural networks and implicit models, with GroupSort, MaxMin, and Householder activations. Finally, we illustrate the utility of our approach with a variety of experiments and show that our proposed SDPs generate less conservative Lipschitz bounds in comparison to existing approaches. △ Less

Submitted 25 January, 2024; originally announced January 2024.

Comments: accepted as a conference paper at ICLR 2024

Towards non-stochastic targeted exploration

Authors: Janani Venkatasubramanian, Johannes Köhler, Mark Cannon, Frank Allgöwer

Abstract: We present a novel targeted exploration strategy for linear time-invariant systems without stochastic assumptions on the noise, i.e., without requiring independence or zero mean, allowing for deterministic model misspecifications. This work utilizes classical data-dependent uncertainty bounds on the least-squares parameter estimates in the presence of energy-bounded noise. We provide a sufficient… ▽ More We present a novel targeted exploration strategy for linear time-invariant systems without stochastic assumptions on the noise, i.e., without requiring independence or zero mean, allowing for deterministic model misspecifications. This work utilizes classical data-dependent uncertainty bounds on the least-squares parameter estimates in the presence of energy-bounded noise. We provide a sufficient condition on the exploration data that ensures a desired error bound on the estimated parameter. Using common approximations, we derive a semidefinite program to compute the optimal sinusoidal input excitation. Finally, we highlight the differences and commonalities between the developed non-stochastic targeted exploration strategy and conventional exploration strategies based on classical identification bounds through a numerical example. △ Less

Submitted 10 December, 2023; originally announced December 2023.

Comments: submitted to IFAC Symposium on System Identification, 2024

Koopman-based feedback design with stability guarantees

Authors: Robin Strässer, Manuel Schaller, Karl Worthmann, Julian Berberich, Frank Allgöwer

Abstract: We present a method to design a state-feedback controller ensuring exponential stability for nonlinear systems using only measurement data. Our approach relies on Koopman-operator theory and uses robust control to explicitly account for approximation errors due to finitely many data samples. To simplify practical usage across various applications, we provide a tutorial-style exposition of the feed… ▽ More We present a method to design a state-feedback controller ensuring exponential stability for nonlinear systems using only measurement data. Our approach relies on Koopman-operator theory and uses robust control to explicitly account for approximation errors due to finitely many data samples. To simplify practical usage across various applications, we provide a tutorial-style exposition of the feedback design and its stability guarantees for single-input systems. Moreover, we extend this controller design to multi-input systems and more flexible nonlinear state-feedback controllers using gain-scheduling techniques to increase the guaranteed region of attraction. As the proposed controller design is framed as a semidefinite program, it allows for an efficient solution. Further, we enhance the geometry of the region of attraction through a heuristic algorithm that establishes a connection between the employed Koopman lifting and the dynamics of the system. Finally, we validate the proposed feedback design procedure by means of numerical examples. △ Less

Submitted 3 May, 2024; v1 submitted 3 December, 2023; originally announced December 2023.

Decrypting Nonlinearity: Koopman Interpretation and Analysis of Cryptosystems

Authors: Robin Strässer, Sebastian Schlor, Frank Allgöwer

Abstract: Public-key cryptosystems rely on computationally difficult problems for security, traditionally analyzed using number theory methods. In this paper, we introduce a novel perspective on cryptosystems by viewing the Diffie-Hellman key exchange and the Rivest-Shamir-Adleman cryptosystem as nonlinear dynamical systems. By applying Koopman theory, we transform these dynamical systems into higher-dimens… ▽ More Public-key cryptosystems rely on computationally difficult problems for security, traditionally analyzed using number theory methods. In this paper, we introduce a novel perspective on cryptosystems by viewing the Diffie-Hellman key exchange and the Rivest-Shamir-Adleman cryptosystem as nonlinear dynamical systems. By applying Koopman theory, we transform these dynamical systems into higher-dimensional spaces and analytically derive equivalent purely linear systems. This formulation allows us to reconstruct the secret integers of the cryptosystems through straightforward manipulations, leveraging the tools available for linear systems analysis. Additionally, we establish an upper bound on the minimum lifting dimension required to achieve perfect accuracy. Our results on the required lifting dimension are in line with the intractability of brute-force attacks. To showcase the potential of our approach, we establish connections between our findings and existing results on algorithmic complexity. Furthermore, we extend this methodology to a data-driven context, where the Koopman representation is learned from data samples of the cryptosystems. △ Less

Submitted 21 November, 2023; originally announced November 2023.

Data-Driven Min-Max MPC for Linear Systems

Authors: Yifan Xie, Julian Berberich, Frank Allgower

Abstract: Designing data-driven controllers in the presence of noise is an important research problem, in particular when guarantees on stability, robustness, and constraint satisfaction are desired. In this paper, we propose a data-driven min-max model predictive control (MPC) scheme to design state-feedback controllers from noisy data for unknown linear time-invariant (LTI) system. The considered min-max… ▽ More Designing data-driven controllers in the presence of noise is an important research problem, in particular when guarantees on stability, robustness, and constraint satisfaction are desired. In this paper, we propose a data-driven min-max model predictive control (MPC) scheme to design state-feedback controllers from noisy data for unknown linear time-invariant (LTI) system. The considered min-max problem minimizes the worst-case cost over the set of system matrices consistent with the data. We show that the resulting optimization problem can be reformulated as a semidefinite program (SDP). By solving the SDP, we obtain a state-feedback control law that stabilizes the closed-loop system and guarantees input and state constraint satisfaction. A numerical example demonstrates the validity of our theoretical results. △ Less

Submitted 29 September, 2023; originally announced September 2023.

Performance implications of different $p$-norms in level-triggered sampling

Authors: David Meister, Frank Allgöwer

Abstract: This work studies the performance of an event-based control approach, namely level-triggered sampling, in a standard multidimensional single-integrator setup. We falsify a conjecture from the literature that the deployed $p$-norm in the triggering condition supposedly has no impact on the performance of the sampling scheme in that setting. In particular, we show for the considered setup that the u… ▽ More This work studies the performance of an event-based control approach, namely level-triggered sampling, in a standard multidimensional single-integrator setup. We falsify a conjecture from the literature that the deployed $p$-norm in the triggering condition supposedly has no impact on the performance of the sampling scheme in that setting. In particular, we show for the considered setup that the usage of the maximum norm instead of the Euclidean norm induces a performance deterioration of level-triggered sampling for sufficiently large system dimensions, when compared to periodic control at the same sampling rate. Moreover, we investigate the performance for other $p$-norms in simulation and observe that it degrades with increasing $p$. In addition, our findings reveal the previously unknown role of the triggering rule in the cause of a recently discovered phenomenon: Previous work has shown for a single-integrator consensus setup that the commonly observed performance advantage of event-based control over periodic control can be lost in distributed settings with a cooperative control goal. In our work, we obtain similar results for a non-cooperative setting only by adjusting the norm in the level-triggered sampling scheme. We therefore demonstrate that the performance degradation found in the distributed setting originates from the triggering rule and not from the considered cooperative control goal. △ Less

Submitted 7 September, 2023; originally announced September 2023.

Comments: 7 pages, 2 figures, accepted: 62nd IEEE Conf. on Decision and Control (CDC 2023)

Analysis and design of model predictive control frameworks for dynamic operation -- An overview

Authors: Johannes Köhler, Matthas A. Müller, Frank Allgöwer

Abstract: This article provides an overview of model predictive control (MPC) frameworks for dynamic operation of nonlinear constrained systems. Dynamic operation is often an integral part of the control objective, ranging from tracking of reference signals to the general economic operation of a plant under online changing time-varying operating conditions. We focus on the particular challenges that arise w… ▽ More This article provides an overview of model predictive control (MPC) frameworks for dynamic operation of nonlinear constrained systems. Dynamic operation is often an integral part of the control objective, ranging from tracking of reference signals to the general economic operation of a plant under online changing time-varying operating conditions. We focus on the particular challenges that arise when dealing with such more general control goals and present methods that have emerged in the literature to address these issues. The goal of this article is to present an overview of the state-of-the-art techniques, providing a diverse toolkit to apply and further develop MPC formulations that can handle the challenges intrinsic to dynamic operation. We also critically assess the applicability of the different research directions, discussing limitations and opportunities for further research. △ Less

Submitted 9 January, 2024; v1 submitted 6 July, 2023; originally announced July 2023.

Comments: This is the accepted version of the paper in Annual Reviews in Control, 2024

Journal ref: Annual Reviews in Control (2024)

Guarantees for data-driven control of nonlinear systems using semidefinite programming: A survey

Authors: Tim Martin, Thomas B. Schön, Frank Allgöwer

Abstract: This survey presents recent research on determining control-theoretic properties and designing controllers with rigorous guarantees using semidefinite programming and for nonlinear systems for which no mathematical models but measured trajectories are available. Data-driven control techniques have been developed to circumvent a time-consuming modelling by first principles and because of the increa… ▽ More This survey presents recent research on determining control-theoretic properties and designing controllers with rigorous guarantees using semidefinite programming and for nonlinear systems for which no mathematical models but measured trajectories are available. Data-driven control techniques have been developed to circumvent a time-consuming modelling by first principles and because of the increasing availability of data. Recently, this research field has gained increased attention by the application of Willems' fundamental lemma, which provides a fertile ground for the development of data-driven control schemes with guarantees for linear time-invariant systems. While the fundamental lemma can be generalized to further system classes, there does not exist a comparable data-based system representation for nonlinear systems. At the same time, nonlinear systems constitute the majority of practical systems. Moreover, they include additional challenges such as data-based surrogate models that prevent system analysis and controller design by convex optimization. Therefore, a variety of data-driven control approaches has been developed with different required prior insights into the system to ensure a guaranteed inference. In this survey, we will discuss developments in the context of data-driven control for nonlinear systems. In particular, we will focus on methods based on system representations providing guarantees from finite data, while the analysis and the controller design boil down to convex optimization problems given as SDP. Thus, these approaches achieve reasonable advances compared to the state-of-the-art system analysis and controller design by models from system identification. Specifically, the paper covers system representations based on extensions of Willems' fundamental lemma, set membership, kernel techniques, the Koopman operator, and feedback linearization. △ Less

Submitted 3 November, 2023; v1 submitted 28 June, 2023; originally announced June 2023.

On $\ell_2$-performance of weakly-hard real-time control systems

Authors: Marc Seidel, Simon Lang, Frank Allgöwer

Abstract: This paper considers control systems with failures in the feedback channel, that occasionally lead to loss of the control input signal. A useful approach for modeling such failures is to consider window-based constraints on possible loss sequences, for example that at least r control attempts in every window of s are successful. A powerful framework to model such constraints are weakly-hard real-t… ▽ More This paper considers control systems with failures in the feedback channel, that occasionally lead to loss of the control input signal. A useful approach for modeling such failures is to consider window-based constraints on possible loss sequences, for example that at least r control attempts in every window of s are successful. A powerful framework to model such constraints are weakly-hard real-time constraints. Various approaches for stability analysis and the synthesis of stabilizing controllers for such systems have been presented in the past. However, existing results are mostly limited to asymptotic stability and rarely consider performance measures such as the resulting $\ell_2$-gain. To address this problem, we adapt a switched system description where the switching sequence is constrained by a graph that captures the loss information. We present an approach for $\ell_2$-performance analysis involving linear matrix inequalities (LMI). Further, leveraging a system lifting method, we propose an LMI-based approach for synthesizing state-feedback controllers with guaranteed $\ell_2$-performance. The results are illustrated by a numerical example. △ Less

Submitted 12 June, 2024; v1 submitted 13 May, 2023; originally announced May 2023.

Comments: accepted in the European Journal of Control, accepted for presentation at ECC 2024

Stochastic Model Predictive Control using Initial State and Variance Interpolation

Authors: Henning Schlüter, Frank Allgöwer

Abstract: We present a Stochastic Model Predictive Control (SMPC) framework for linear systems subject to Gaussian disturbances. In order to avoid feasibility issues, we employ a recent initialization strategy, optimizing over an interpolation of the initial state between the current measurement and previous prediction. By also considering the variance in the interpolation, we can employ variable-size tubes… ▽ More We present a Stochastic Model Predictive Control (SMPC) framework for linear systems subject to Gaussian disturbances. In order to avoid feasibility issues, we employ a recent initialization strategy, optimizing over an interpolation of the initial state between the current measurement and previous prediction. By also considering the variance in the interpolation, we can employ variable-size tubes, to ensure constraint satisfaction in closed-loop. We show that this novel method improves control performance and enables following the constraint closer, then previous methods. Using a DC-DC converter as numerical example we illustrated the improvement over previous methods. △ Less

Submitted 14 April, 2023; originally announced April 2023.

Comments: 7 pages, 4 figures

MSC Class: 93B45 (Primary); 93E20 (Secondary)

Control of bilinear systems using gain-scheduling: Stability and performance guarantees

Authors: Robin Strässer, Julian Berberich, Frank Allgöwer

Abstract: In this paper, we present a state-feedback controller design method for bilinear systems. To this end, we write the bilinear system as a linear fractional representation by interpreting the state in the bilinearity as a structured uncertainty. Based on that, we derive convex conditions in terms of linear matrix inequalities for the controller design, which are efficiently solvable by semidefinite… ▽ More In this paper, we present a state-feedback controller design method for bilinear systems. To this end, we write the bilinear system as a linear fractional representation by interpreting the state in the bilinearity as a structured uncertainty. Based on that, we derive convex conditions in terms of linear matrix inequalities for the controller design, which are efficiently solvable by semidefinite programming. Further, we prove asymptotic stability and quadratic performance of the resulting closed-loop system locally in a predefined region. The proposed design uses gain-scheduling techniques and results in a state feedback with rational dependence on the state, which can substantially reduce conservatism and improve performance in comparison to a simpler, linear state feedback. Moreover, the design method is easily adaptable to various scenarios due to its modular formulation in the robust control framework. Finally, we apply the developed approaches to numerical examples and illustrate the benefits of the approach. △ Less

Submitted 12 September, 2023; v1 submitted 10 April, 2023; originally announced April 2023.

Comments: Accepted for presentation at the 62nd IEEE Conference on Decision and Control (CDC2023)

Journal ref: in Proc. 62nd IEEE Conference on Decision and Control (CDC), 2023, pp. 4344-4351

Robust data-driven control for nonlinear systems using the Koopman operator

Authors: Robin Strässer, Julian Berberich, Frank Allgöwer

Abstract: Data-driven analysis and control of dynamical systems have gained a lot of interest in recent years. While the class of linear systems is well studied, theoretical results for nonlinear systems are still rare. In this paper, we present a data-driven controller design method for discrete-time control-affine nonlinear systems. Our approach relies on the Koopman operator, which is a linear but infini… ▽ More Data-driven analysis and control of dynamical systems have gained a lot of interest in recent years. While the class of linear systems is well studied, theoretical results for nonlinear systems are still rare. In this paper, we present a data-driven controller design method for discrete-time control-affine nonlinear systems. Our approach relies on the Koopman operator, which is a linear but infinite-dimensional operator lifting the nonlinear system to a higher-dimensional space. Particularly, we derive a linear fractional representation of a lifted bilinear system representation based on measured data. Further, we restrict the lifting to finite dimensions, but account for the truncation error using a finite-gain argument. We derive a linear matrix inequality based design procedure to guarantee robust local stability for the resulting bilinear system for all error terms satisfying the finite-gain bound and, thus, also for the underlying nonlinear system. Finally, we apply the developed design method to the nonlinear Van der Pol oscillator. △ Less

Submitted 9 May, 2023; v1 submitted 7 April, 2023; originally announced April 2023.

Comments: Accepted for presentation at the IFAC World Congress 2023

Journal ref: in Proc. 22nd IFAC World Congress, Yokohama, Japan, 2023, pp. 2257-2262

Distributed Model Predictive Control for Periodic Cooperation of Multi-Agent Systems

Authors: Matthias Köhler, Matthias A. Müller, Frank Allgöwer

Abstract: We consider multi-agent systems with heterogeneous, nonlinear agents subject to individual constraints that want to achieve a periodic, dynamic cooperative control goal which can be characterised by a set and a suitable cost. We propose a sequential distributed model predictive control (MPC) scheme in which agents sequentially solve an individual optimisation problem to track an artificial periodi… ▽ More We consider multi-agent systems with heterogeneous, nonlinear agents subject to individual constraints that want to achieve a periodic, dynamic cooperative control goal which can be characterised by a set and a suitable cost. We propose a sequential distributed model predictive control (MPC) scheme in which agents sequentially solve an individual optimisation problem to track an artificial periodic output trajectory. The optimisation problems are coupled through these artificial periodic output trajectories, which are communicated and penalised using the cost that characterises the cooperative goal. The agents communicate only their artificial trajectories and only once per time step. We show that under suitable assumptions, the agents can incrementally move their artificial output trajectories towards the cooperative goal, and, hence, their closed-loop output trajectories asymptotically achieve it. We illustrate the scheme with a simulation example. △ Less

Submitted 6 April, 2023; originally announced April 2023.

Self-triggered output feedback control for nonlinear networked control systems based on hybrid Lyapunov functions

Authors: Michael Hertneck, Frank Allgöwer

Abstract: Most approaches for self-triggered control (STC) of nonlinear networked control systems (NCS) require measurements of the full system state to determine transmission times. However, for most control systems only a lower dimensional output is available. To bridge this gap, we present in this paper an output-feedback STC approach for nonlinear NCS. An asymptotically stable observer is used to recons… ▽ More Most approaches for self-triggered control (STC) of nonlinear networked control systems (NCS) require measurements of the full system state to determine transmission times. However, for most control systems only a lower dimensional output is available. To bridge this gap, we present in this paper an output-feedback STC approach for nonlinear NCS. An asymptotically stable observer is used to reconstruct the plant state and transmission times are determined based on the observer state. The approach employs hybrid Lyapunov functions and a dynamic variable to encode past state information and to maximize the time between transmissions. It is non-conservative in the sense that the assumptions on plant and controller are the same as for dynamic STC based on hybrid Lyapunov functions with full state measurements and any asymptotically stabilizing observer can be used. We conclude that the proposed STC approach guarantees asymptotic stability of the origin for the closed-loop system. △ Less

Submitted 22 March, 2023; originally announced March 2023.

Comments: Final version, accepted for presentation at the 22nd IFAC World Congress, 2023. This version contains the full proof of Theorem 1

Lipschitz-bounded 1D convolutional neural networks using the Cayley transform and the controllability Gramian

Authors: Patricia Pauli, Ruigang Wang, Ian R. Manchester, Frank Allgöwer

Abstract: We establish a layer-wise parameterization for 1D convolutional neural networks (CNNs) with built-in end-to-end robustness guarantees. In doing so, we use the Lipschitz constant of the input-output map** characterized by a CNN as a robustness measure. We base our parameterization on the Cayley transform that parameterizes orthogonal matrices and the controllability Gramian of the state space rep… ▽ More We establish a layer-wise parameterization for 1D convolutional neural networks (CNNs) with built-in end-to-end robustness guarantees. In doing so, we use the Lipschitz constant of the input-output map** characterized by a CNN as a robustness measure. We base our parameterization on the Cayley transform that parameterizes orthogonal matrices and the controllability Gramian of the state space representation of the convolutional layers. The proposed parameterization by design fulfills linear matrix inequalities that are sufficient for Lipschitz continuity of the CNN, which further enables unconstrained training of Lipschitz-bounded 1D CNNs. Finally, we train Lipschitz-bounded 1D CNNs for the classification of heart arrythmia data and show their improved robustness. △ Less

Submitted 25 January, 2024; v1 submitted 20 March, 2023; originally announced March 2023.

Comments: Published as a conference paper at CDC 2023

Time- versus event-triggered consensus of a single-integrator multi-agent system

Authors: David Meister, Frank Aurzada, Mikhail A. Lifshits, Frank Allgöwer

Abstract: Event-triggered control has shown the potential for providing improved control performance at the same average sampling rate when compared to time-triggered control. While this observation motivates numerous event-triggered control schemes, proving it from a theoretical perspective has only been achieved for a limited number of settings. Inspired by existing performance analyses for the single-loo… ▽ More Event-triggered control has shown the potential for providing improved control performance at the same average sampling rate when compared to time-triggered control. While this observation motivates numerous event-triggered control schemes, proving it from a theoretical perspective has only been achieved for a limited number of settings. Inspired by existing performance analyses for the single-loop case, we provide a first fundamental performance comparison of time- and event-triggered control in a multi-agent consensus setting. For this purpose, we consider undirected connected network topologies without communication delays, a level-triggering rule for event-triggered control, and the long-term average of the quadratic deviation from consensus as a performance measure. The main finding of our analysis is that time-triggered control provably outperforms event-triggered control beyond a certain number of agents in our particular setting. We thereby provide an illustrative distributed problem setup in which event-triggered control results in a performance disadvantage when compared to time-triggered control in the case of large networks. Moreover, we derive the asymptotic order of the performance measure under both triggering schemes which gives more insights into the cost relationship for large numbers of agents. Thus, by presenting an analysis for a particular setup, this work points out that transferring an event-triggering scheme from the single-loop to the multi-agent setting can lead to a loss of the often presumed superiority of event-triggered control over time-triggered control. In particular, the design of performant decentralized event-triggering schemes can therefore pose additional challenges when compared to the analogue single-loop case. △ Less

Submitted 30 April, 2024; v1 submitted 20 March, 2023; originally announced March 2023.

Comments: 19 pages, 3 figures. This article builds upon our preceding work: https://doi.org/10.1109/CDC51059.2022.9993301

Journal ref: Nonlinear Analysis: Hybrid Systems, 53, 101494 (2024)

Data-driven Dissipativity Analysis of Linear Parameter-Varying Systems

Authors: Chris Verhoek, Julian Berberich, Sofie Haesaert, Frank Allgöwer, Roland Tóth

Abstract: We derive direct data-driven dissipativity analysis methods for Linear Parameter-Varying (LPV) systems using a single sequence of input-scheduling-output data. By means of constructing a semi-definite program subject to linear matrix inequality constraints based on this data-dictionary, direct data-driven verification of $(Q,S,R)$-type of dissipativity properties of the data-generating LPV system… ▽ More We derive direct data-driven dissipativity analysis methods for Linear Parameter-Varying (LPV) systems using a single sequence of input-scheduling-output data. By means of constructing a semi-definite program subject to linear matrix inequality constraints based on this data-dictionary, direct data-driven verification of $(Q,S,R)$-type of dissipativity properties of the data-generating LPV system is achieved. Multiple implementation methods are proposed to achieve efficient computational properties and to even exploit structural information on the scheduling, e.g., rate bounds. The effectiveness and trade-offs of the proposed methodologies are shown in simulation studies of academic and physically realistic examples. △ Less

Submitted 17 October, 2023; v1 submitted 17 March, 2023; originally announced March 2023.

Comments: Submitted to IEEE Transactions on Automatic Control

Transient Performance of MPC for Tracking

Authors: Matthias Köhler, Lisa Krügel, Lars Grüne, Matthias A. Müller, Frank Allgöwer

Abstract: We analyse the closed-loop performance of a model predictive control (MPC) for tracking formulation with artificial references. It has been shown that such a scheme guarantees closed-loop stability and recursive feasibility for any externally supplied reference, even if it is unreachable or time-varying. The basic idea is to consider an artificial reference as an additional decision variable and t… ▽ More We analyse the closed-loop performance of a model predictive control (MPC) for tracking formulation with artificial references. It has been shown that such a scheme guarantees closed-loop stability and recursive feasibility for any externally supplied reference, even if it is unreachable or time-varying. The basic idea is to consider an artificial reference as an additional decision variable and to formulate generalised terminal ingredients with respect to it. In addition, its offset is penalised in the MPC optimisation problem, leading to closed-loop convergence to the best reachable reference. In this paper, we provide a transient performance bound on the closed loop using MPC for tracking. We employ mild assumptions on the offset cost and scale it with the prediction horizon. In this case, an increasing horizon in MPC for tracking recovers the infinite horizon optimal solution. △ Less

Submitted 24 January, 2024; v1 submitted 17 March, 2023; originally announced March 2023.

Journal ref: IEEE Control Systems Letters, vol. 7, pp. 2545-2550, 2023

Convolutional Neural Networks as 2-D systems

Authors: Dennis Gramlich, Patricia Pauli, Carsten W. Scherer, Frank Allgöwer, Christian Ebenbauer

Abstract: This paper introduces a novel representation of convolutional Neural Networks (CNNs) in terms of 2-D dynamical systems. To this end, the usual description of convolutional layers with convolution kernels, i.e., the impulse responses of linear filters, is realized in state space as a linear time-invariant 2-D system. The overall convolutional Neural Network composed of convolutional layers and nonl… ▽ More This paper introduces a novel representation of convolutional Neural Networks (CNNs) in terms of 2-D dynamical systems. To this end, the usual description of convolutional layers with convolution kernels, i.e., the impulse responses of linear filters, is realized in state space as a linear time-invariant 2-D system. The overall convolutional Neural Network composed of convolutional layers and nonlinear activation functions is then viewed as a 2-D version of a Lur'e system, i.e., a linear dynamical system interconnected with static nonlinear components. One benefit of this 2-D Lur'e system perspective on CNNs is that we can use robust control theory much more efficiently for Lipschitz constant estimation than previously possible. △ Less

Submitted 11 April, 2023; v1 submitted 6 March, 2023; originally announced March 2023.

Sequential learning and control: Targeted exploration for robust performance

Authors: Janani Venkatasubramanian, Johannes Köhler, Julian Berberich, Frank Allgöwer

Abstract: We present a novel dual control strategy for uncertain linear systems based on targeted harmonic exploration and gain-scheduling with performance and excitation guarantees. In the proposed sequential approach, robust control is implemented after exploration with the main feature that the exploration is optimized with respect to the robust control performance. Specifically, we leverage recent resul… ▽ More We present a novel dual control strategy for uncertain linear systems based on targeted harmonic exploration and gain-scheduling with performance and excitation guarantees. In the proposed sequential approach, robust control is implemented after exploration with the main feature that the exploration is optimized with respect to the robust control performance. Specifically, we leverage recent results on finite excitation using spectral lines to determine a high probability lower bound on the resultant finite excitation of the exploration data. This provides an a priori upper bound on the remaining model uncertainty after exploration, which can further be leveraged in a gain-scheduling controller design that guarantees robust performance. This leads to a semidefinite program-based design which computes an exploration strategy with finite excitation bounds and minimal energy, and a gain-scheduled controller with probabilistic performance bounds that can be implemented after exploration. The effectiveness of our approach and its benefits over common random exploration strategies are demonstrated with an example of a system which is 'hard to learn'. △ Less

Submitted 12 October, 2023; v1 submitted 19 January, 2023; originally announced January 2023.

Comments: submitted to IEEE Transactions on Automatic Control (TAC)

Linear Data-Driven Economic MPC with Generalized Terminal Constraint

Authors: Yifan Xie, Julian Berberich, Frank Allgöwer

Abstract: In this paper, we propose a data-driven economic model predictive control (EMPC) scheme with generalized terminal constraint to control an unknown linear time-invariant system. Our scheme is based on the Fundamental Lemma to predict future system trajectories using a persistently exciting input-output trajectory. The control objective is to minimize an economic cost objective. By employing a gener… ▽ More In this paper, we propose a data-driven economic model predictive control (EMPC) scheme with generalized terminal constraint to control an unknown linear time-invariant system. Our scheme is based on the Fundamental Lemma to predict future system trajectories using a persistently exciting input-output trajectory. The control objective is to minimize an economic cost objective. By employing a generalized terminal constraint with artificial equilibrium, the scheme does not require prior knowledge of the optimal equilibrium. We prove that the asymptotic average performance of the closed-loop system can be made arbitrarily close to that of the optimal equilibrium. Moreover, we extend our results to the case of an unknown linear stage cost function, where the Fundamental lemma is used to predict the stage cost directly. The effectiveness of the proposed scheme is shown by a numerical example. △ Less

Submitted 5 December, 2022; v1 submitted 2 December, 2022; originally announced December 2022.

Lipschitz constant estimation for 1D convolutional neural networks

Authors: Patricia Pauli, Dennis Gramlich, Frank Allgöwer

Abstract: In this work, we propose a dissipativity-based method for Lipschitz constant estimation of 1D convolutional neural networks (CNNs). In particular, we analyze the dissipativity properties of convolutional, pooling, and fully connected layers making use of incremental quadratic constraints for nonlinear activation functions and pooling operations. The Lipschitz constant of the concatenation of these… ▽ More In this work, we propose a dissipativity-based method for Lipschitz constant estimation of 1D convolutional neural networks (CNNs). In particular, we analyze the dissipativity properties of convolutional, pooling, and fully connected layers making use of incremental quadratic constraints for nonlinear activation functions and pooling operations. The Lipschitz constant of the concatenation of these map**s is then estimated by solving a semidefinite program which we derive from dissipativity theory. To make our method as efficient as possible, we exploit the structure of convolutional layers by realizing these finite impulse response filters as causal dynamical systems in state space and carrying out the dissipativity analysis for the state space realizations. The examples we provide show that our Lipschitz bounds are advantageous in terms of accuracy and scalability. △ Less

Submitted 20 June, 2023; v1 submitted 28 November, 2022; originally announced November 2022.

Koopman interpretation and analysis of a public-key cryptosystem: Diffie-Hellman key exchange

Authors: Sebastian Schlor, Robin Strässer, Frank Allgöwer

Abstract: The security of public-key cryptosystems relies on computationally hard problems, that are classically analyzed by number theoretic methods. In this paper, we introduce a new perspective on cryptosystems by interpreting the Diffie-Hellman key exchange as a nonlinear dynamical system. Employing Koopman theory, we transfer this dynamical system into a higher-dimensional space to analytically derive… ▽ More The security of public-key cryptosystems relies on computationally hard problems, that are classically analyzed by number theoretic methods. In this paper, we introduce a new perspective on cryptosystems by interpreting the Diffie-Hellman key exchange as a nonlinear dynamical system. Employing Koopman theory, we transfer this dynamical system into a higher-dimensional space to analytically derive a purely linear system that equivalently describes the underlying cryptosystem. In this form, analytic tools for linear systems allow us to reconstruct the secret integers of the key exchange by simple manipulations. Moreover, we provide an upper bound on the minimal required lifting dimension to obtain perfect accuracy. To demonstrate the potential of our method, we relate our findings to existing results on algorithmic complexity. Finally, we transfer this approach to a data-driven setting where the Koopman representation is learned from data samples of the cryptosystem. △ Less

Submitted 22 June, 2023; v1 submitted 21 November, 2022; originally announced November 2022.

Comments: This work has been accepted to IFAC for publication at the 22nd IFAC World Congress 2023

Journal ref: in Proc. 22nd IFAC World Congress, Yokohama, Japan, 2023, pp. 984-990

Robust peak-to-peak gain analysis using integral quadratic constraints

Authors: Lukas Schwenkel, Johannes Köhler, Matthias A. Müller, Frank Allgöwer

Abstract: This work provides a framework to compute an upper bound on the robust peak-to-peak gain of discrete-time uncertain linear systems using integral quadratic constraints (IQCs). Such bounds are of particular interest in the computation of reachable sets and the $\ell_1$-norm, as well as when safety-critical constraints need to be satisfied pointwise in time. The use of $ρ$-hard IQCs with a terminal… ▽ More This work provides a framework to compute an upper bound on the robust peak-to-peak gain of discrete-time uncertain linear systems using integral quadratic constraints (IQCs). Such bounds are of particular interest in the computation of reachable sets and the $\ell_1$-norm, as well as when safety-critical constraints need to be satisfied pointwise in time. The use of $ρ$-hard IQCs with a terminal cost enables us to deal with a wide variety of uncertainty classes, for example, we provide $ρ$-hard IQCs with a terminal cost for the class of parametric uncertainties. This approach unifies, generalizes, and significantly improves state-of-the-art methods, which is also demonstrated in a numerical example. △ Less

Submitted 17 November, 2022; originally announced November 2022.

Comments: 6 pages, submitted to IFAC WC 2023

Shared Network Effects in Time- versus Event-Triggered Consensus of a Single-Integrator Multi-Agent System

Authors: David Meister, Frank Dürr, Frank Allgöwer

Abstract: Event-triggered control has the potential to provide a similar performance level as time-triggered (periodic) control while triggering events less frequently. It therefore appears intuitive that it is also a viable approach for distributed systems to save scarce shared network resources used for inter-agent communication. While this motivation is commonly used also for multi-agent systems, a theor… ▽ More Event-triggered control has the potential to provide a similar performance level as time-triggered (periodic) control while triggering events less frequently. It therefore appears intuitive that it is also a viable approach for distributed systems to save scarce shared network resources used for inter-agent communication. While this motivation is commonly used also for multi-agent systems, a theoretical analysis of the impact of network effects on the performance of event- and time-triggered control for such distributed systems is currently missing. With this paper, we contrast event- and time-triggered control performance for a single-integrator consensus problem under consideration of a shared communication medium. We therefore incorporate transmission delays and packet loss in our analysis and compare the triggering scheme performance under two simple medium access control protocols. We find that network effects can degrade the performance of event-triggered control beyond the performance level of time-triggered control for the same average triggering rate if the network is used intensively. Moreover, the performance advantage of event-triggered control shrinks with an increasing number of agents and is even lost for sufficiently large networks in the considered setup. △ Less

Submitted 4 April, 2023; v1 submitted 15 November, 2022; originally announced November 2022.

Comments: 7 pages, 1 figure, accepted: 22nd IFAC World Congress 2023

Data-driven Nonlinear Predictive Control for Feedback Linearizable Systems

Authors: Mohammad Alsalti, Victor G. Lopez, Julian Berberich, Frank Allgöwer, Matthias A. Müller

Abstract: We present a data-driven nonlinear predictive control approach for the class of discrete-time multi-input multi-output feedback linearizable nonlinear systems. The scheme uses a non-parametric predictive model based only on input and noisy output data along with a set of basis functions that approximate the unknown nonlinearities. Despite the noisy output data as well as the mismatch caused by the… ▽ More We present a data-driven nonlinear predictive control approach for the class of discrete-time multi-input multi-output feedback linearizable nonlinear systems. The scheme uses a non-parametric predictive model based only on input and noisy output data along with a set of basis functions that approximate the unknown nonlinearities. Despite the noisy output data as well as the mismatch caused by the use of basis functions, we show that the proposed multistep robust data-driven nonlinear predictive control scheme is recursively feasible and renders the closed-loop system practically exponentially stable. We illustrate our results on a model of a fully-actuated double inverted pendulum. △ Less

Submitted 27 March, 2023; v1 submitted 11 November, 2022; originally announced November 2022.

Comments: accepted to IFAC World Congress 2023. arXiv admin note: substantial text overlap with arXiv:2204.01148

Gaussian inference for data-driven state-feedback design of nonlinear systems

Authors: Tim Martin, Thomas B. Schön, Frank Allgöwer

Abstract: Data-driven control of nonlinear systems with rigorous guarantees is a challenging problem as it usually calls for nonconvex optimization and requires often knowledge of the true basis functions of the system dynamics. To tackle these drawbacks, this work is based on a data-driven polynomial representation of general nonlinear systems exploiting Taylor polynomials. Thereby, we design state-feedbac… ▽ More Data-driven control of nonlinear systems with rigorous guarantees is a challenging problem as it usually calls for nonconvex optimization and requires often knowledge of the true basis functions of the system dynamics. To tackle these drawbacks, this work is based on a data-driven polynomial representation of general nonlinear systems exploiting Taylor polynomials. Thereby, we design state-feedback laws that render a known equilibrium point globally asymptotically stable while operating with respect to a desired quadratic performance criterion. The calculation of the polynomial state feedback boils down to a single sum-ofsquares optimization problem, and hence to computationally tractable linear matrix inequalities. Moreover, we examine state-input data in presence of Gaussian noise by Bayesian inference to overcome the conservatism of deterministic noise characterizations from recent data-driven control approaches for Gaussian noise. △ Less

Submitted 24 March, 2023; v1 submitted 10 November, 2022; originally announced November 2022.

Comments: Final version, accepted for presentation at the 22nd IFAC World Congress, 2023

Distributed MPC for Self-Organized Cooperation of Multiagent Systems -- Extended Version

Authors: Matthias Köhler, Matthias A. Müller, Frank Allgöwer

Abstract: We present a sequential distributed model predictive control (MPC) scheme for cooperative control of multi-agent systems with dynamically decoupled heterogeneous nonlinear agents subject to individual constraints. In the scheme, we explore the idea of using tracking MPC with artificial references to let agents coordinate their cooperation without external guidance. Each agent combines a tracking M… ▽ More We present a sequential distributed model predictive control (MPC) scheme for cooperative control of multi-agent systems with dynamically decoupled heterogeneous nonlinear agents subject to individual constraints. In the scheme, we explore the idea of using tracking MPC with artificial references to let agents coordinate their cooperation without external guidance. Each agent combines a tracking MPC with artificial references, the latter penalized by a suitable coupling cost. They solve an individual optimization problem for this artificial reference and an input that tracks it, only communicating the former to its neighbors in a communication graph. This puts the cooperative problem on a different layer than the handling of the dynamics and constraints, loosening the connection between the two. We provide sufficient conditions on the formulation of the cooperative problem and the coupling cost for the closed-loop system to asymptotically achieve it. Since the dynamics and the cooperative problem are only loosely connected, classical results from distributed optimization can be used to this end. We illustrate the scheme's application to consensus and formation control. △ Less

Submitted 12 June, 2024; v1 submitted 18 October, 2022; originally announced October 2022.

Comments: Extended version of https://doi.org/10.1109/TAC.2024.3407633 containing a technical proof and additional numerical examples

Data-Driven Control of Distributed Event-Triggered Network Systems

Authors: Xin Wang, Jian Sun, Gang Wang, Frank Allgöwer, Jie Chen

Abstract: The present paper deals with data-driven event-triggered control of a class of unknown discrete-time interconnected systems (a.k.a. network systems). To this end, we start by putting forth a novel distributed event-triggering transmission strategy based on periodic sampling, under which a model-based stability criterion for the closed-loop network system is derived, by leveraging a discrete-time l… ▽ More The present paper deals with data-driven event-triggered control of a class of unknown discrete-time interconnected systems (a.k.a. network systems). To this end, we start by putting forth a novel distributed event-triggering transmission strategy based on periodic sampling, under which a model-based stability criterion for the closed-loop network system is derived, by leveraging a discrete-time looped-functional approach. Marrying the model-based criterion with a data-driven system representation recently developed in the literature, a purely data-driven stability criterion expressed in the form of linear matrix inequalities (LMIs) is established. Meanwhile, the data-driven stability criterion suggests a means for co-designing the event-triggering coefficient matrix and the feedback control gain matrix using only some offline collected state-input data. Finally, numerical results corroborate the efficacy of the proposed distributed data-driven ETS in cutting off data transmissions and the co-design procedure. △ Less

Submitted 22 August, 2022; originally announced August 2022.

Comments: 13 pages, 8 figures

A quantitative and constructive proof of Willems' Fundamental Lemma and its implications

Authors: Julian Berberich, Andrea Iannelli, Alberto Padoan, Jeremy Coulson, Florian Dörfler, Frank Allgöwer

Abstract: Willems' Fundamental Lemma provides a powerful data-driven parametrization of all trajectories of a controllable linear time-invariant system based on one trajectory with persistently exciting (PE) input. In this paper, we present a novel proof of this result which is inspired by the classical adaptive control literature and differs from existing proofs in multiple aspects. The proof involves a qu… ▽ More Willems' Fundamental Lemma provides a powerful data-driven parametrization of all trajectories of a controllable linear time-invariant system based on one trajectory with persistently exciting (PE) input. In this paper, we present a novel proof of this result which is inspired by the classical adaptive control literature and differs from existing proofs in multiple aspects. The proof involves a quantitative and directional PE notion, allowing to characterize robust PE properties via singular value bounds, as opposed to binary rank-based PE conditions. Further, the proof is constructive, i.e., we derive an explicit PE lower bound for the generated data. As a contribution of independent interest, we generalize existing PE results from the adaptive control literature and reveal a crucial role of the system's zeros. △ Less

Submitted 7 March, 2023; v1 submitted 1 August, 2022; originally announced August 2022.

Comments: Final version, accepted for presentation at the American Control Conference (ACC) 2023

Analysis of Time- versus Event-Triggered Consensus for a Single-Integrator Multi-Agent System

Authors: David Meister, Frank Aurzada, Mikhail A. Lifshits, Frank Allgöwer

Abstract: It is well known that the employed triggering scheme has great impact on the control performance when control loops operate under scarce communication resources. Various practical and simulative works have demonstrated the potential of event-triggered control to reduce communication while providing a similar performance level when compared to time-triggered control. For non-cooperative networked c… ▽ More It is well known that the employed triggering scheme has great impact on the control performance when control loops operate under scarce communication resources. Various practical and simulative works have demonstrated the potential of event-triggered control to reduce communication while providing a similar performance level when compared to time-triggered control. For non-cooperative networked control systems, analytical performance comparisons of time- and event-triggered control support this finding under certain assumptions. While being well-studied in the non-cooperative setting, it remains unclear if and how the performance relationship of the triggering schemes is altered in a multi-agent system setup. To close this gap, in this paper, we consider a homogeneous single-integrator multi-agent consensus problem for which we compare the performance of time- and event-triggered control schemes analytically. Under the assumption of equal average triggering rates, we use the long-term average of the quadratic deviation from consensus as a performance measure to contrast the triggering schemes. Contrary to the non-cooperative setting, we prove that event-triggered control performs worse than time-triggered control beyond a certain number of agents in this setup. In addition, we derive the asymptotic order of the performance measure as a function of the number of agents under both triggering schemes. △ Less

Submitted 12 September, 2022; v1 submitted 17 June, 2022; originally announced June 2022.

Comments: 7 pages, 1 figure, accepted: 61st IEEE Conference on Decision and Control (CDC 2022)

Stability in data-driven MPC: an inherent robustness perspective

Authors: Julian Berberich, Johannes Köhler, Matthias A. Müller, Frank Allgöwer

Abstract: Data-driven model predictive control (DD-MPC) based on Willems' Fundamental Lemma has received much attention in recent years, allowing to control systems directly based on an implicit data-dependent system description. The literature contains many successful practical applications as well as theoretical results on closed-loop stability and robustness. In this paper, we provide a tutorial introduc… ▽ More Data-driven model predictive control (DD-MPC) based on Willems' Fundamental Lemma has received much attention in recent years, allowing to control systems directly based on an implicit data-dependent system description. The literature contains many successful practical applications as well as theoretical results on closed-loop stability and robustness. In this paper, we provide a tutorial introduction to DD-MPC for unknown linear time-invariant (LTI) systems with focus on (robust) closed-loop stability. We first address the scenario of noise-free data, for which we present a DD-MPC scheme with terminal equality constraints and derive closed-loop properties. In case of noisy data, we introduce a simple yet powerful approach to analyze robust stability of DD-MPC by combining continuity of DD-MPC w.r.t. noise with inherent robustness of model-based MPC, i.e., robustness of nominal MPC w.r.t. small disturbances. Moreover, we discuss how the presented proof technique allows to show closed-loop stability of a variety of DD-MPC schemes with noisy data, as long as the corresponding model-based MPC is inherently robust. △ Less

Submitted 25 August, 2022; v1 submitted 24 May, 2022; originally announced May 2022.

Comments: Final version, accepted for presentation at the 61st IEEE Conference on Decision and Control 2022. This version contains the full proof of Theorem IV.1

Safe Exploration and Escape Local Minima with Model Predictive Control under Partially Unknown Constraints

Authors: Raffaele Soloperto, Ali Mesbah, Frank Allgöwer

Abstract: In this paper, we propose a novel model predictive control (MPC) framework for output tracking that deals with partially unknown constraints. The MPC scheme optimizes over a learning and a backup trajectory. The learning trajectory aims to explore unknown and potentially unsafe areas, if and only if this might lead to a potential performance improvement. On the contrary, the backup trajectory lies… ▽ More In this paper, we propose a novel model predictive control (MPC) framework for output tracking that deals with partially unknown constraints. The MPC scheme optimizes over a learning and a backup trajectory. The learning trajectory aims to explore unknown and potentially unsafe areas, if and only if this might lead to a potential performance improvement. On the contrary, the backup trajectory lies in the known space, and is intended to ensure safety and convergence. The cost function for the learning trajectory is divided into a tracking and an offset cost, while the cost function for the backup trajectory is only marginally considered and only penalizes the offset cost. We show that the proposed MPC scheme is not only able to safely explore the unknown constraints, but also escape from local minima that may arise from the presence of obstacles. Moreover, we provide formal guarantees for convergence and recursive feasibility of the MPC scheme, as well as closed-loop constraint satisfaction. Finally, the proposed MPC scheme is demonstrated in simulations using an example of autonomous vehicle driving in a partially unknown environment where unknown obstacles are present. △ Less

Submitted 7 May, 2022; originally announced May 2022.

Linearly discounted economic MPC without terminal conditions for periodic optimal operation

Authors: Lukas Schwenkel, Alexander Hadorn, Matthias A. Müller, Frank Allgöwer

Abstract: In this work, we study economic model predictive control (MPC) in situations where the optimal operating behavior is periodic. In such a setting, the performance of a standard economic MPC scheme without terminal conditions can generally be far from optimal even with arbitrarily long prediction horizons. Whereas there are modified economic MPC schemes that guarantee optimal performance, all of the… ▽ More In this work, we study economic model predictive control (MPC) in situations where the optimal operating behavior is periodic. In such a setting, the performance of a standard economic MPC scheme without terminal conditions can generally be far from optimal even with arbitrarily long prediction horizons. Whereas there are modified economic MPC schemes that guarantee optimal performance, all of them are based on prior knowledge of the optimal period length or of the optimal periodic orbit itself. In contrast to these approaches, we propose to achieve optimality by multiplying the stage cost by a linear discount factor. This modification is not only easy to implement but also independent of any system- or cost-specific properties, making the scheme robust against online changes therein. Under standard dissipativity and controllability assumptions, we can prove that the resulting linearly discounted economic MPC without terminal conditions achieves optimal asymptotic average performance up to an error that vanishes with growing prediction horizons. Moreover, we can guarantee practical asymptotic stability of the optimal periodic orbit under the additional technical assumption that dissipativity holds with a continuous storage function. We complement these qualitative guarantees with a quantitative analysis of the transient and asymptotic average performance of the linearly discounted MPC scheme in a numerical simulation study. △ Less

Submitted 8 January, 2024; v1 submitted 6 May, 2022; originally announced May 2022.

Journal ref: Automatica, Volume 159, 2024, pp. 111393

Bounding the difference between model predictive control and neural networks

Authors: Ross Drummond, Stephen R. Duncan, Matthew C. Turner, Patricia Pauli, Frank Allgöwer

Abstract: There is a growing debate on whether the future of feedback control systems will be dominated by data-driven or model-driven approaches. Each of these two approaches has their own complimentary set of advantages and disadvantages, however, only limited attempts have, so far, been developed to bridge the gap between them. To address this issue, this paper introduces a method to bound the worst-case… ▽ More There is a growing debate on whether the future of feedback control systems will be dominated by data-driven or model-driven approaches. Each of these two approaches has their own complimentary set of advantages and disadvantages, however, only limited attempts have, so far, been developed to bridge the gap between them. To address this issue, this paper introduces a method to bound the worst-case error between feedback control policies based upon model predictive control (MPC) and neural networks (NNs). This result is leveraged into an approach to automatically synthesize MPC policies minimising the worst-case error with respect to a NN. Numerical examples highlight the application of the bounds, with the goal of the paper being to encourage a more quantitative understanding of the relationship between data-driven and model-driven control. △ Less

Submitted 13 April, 2022; originally announced April 2022.

Practical exponential stability of a robust data-driven nonlinear predictive control scheme

Authors: Mohammad Alsalti, Victor G. Lopez, Julian Berberich, Frank Allgöwer, Matthias A. Müller

Abstract: We provide theoretical guarantees for recursive feasibility and practical exponential stability of the closed-loop system of a feedback linearizable nonlinear system when controlled by a robust data-driven nonlinear predictive control scheme. This technical report serves as a supplementary material to our recent paper "Data-driven Nonlinear Predictive Control for Feedback Linearizable Systems". Th… ▽ More We provide theoretical guarantees for recursive feasibility and practical exponential stability of the closed-loop system of a feedback linearizable nonlinear system when controlled by a robust data-driven nonlinear predictive control scheme. This technical report serves as a supplementary material to our recent paper "Data-driven Nonlinear Predictive Control for Feedback Linearizable Systems". The arguments shown in this report follow similar steps to those for the LTI case, since feedback linearizable systems are linear in transformed coordinates. However, the proof was suitably adapted to match the nonlinear setting under consideration, and the differences are emphasized throughout the proof. △ Less

Submitted 27 March, 2023; v1 submitted 3 April, 2022; originally announced April 2022.

Comments: This technical report serves as a supplementary material to our recent paper "Data-driven Nonlinear Predictive Control for Feedback Linearizable Systems"

Data-based Control of Feedback Linearizable Systems

Authors: Mohammad Alsalti, Victor G. Lopez, Julian Berberich, Frank Allgöwer, Matthias A. Müller

Abstract: We present an extension of Willems' Fundamental Lemma to the class of multi-input multi-output discrete-time feedback linearizable nonlinear systems, thus providing a data-based representation of their input-output trajectories. Two sources of uncertainty are considered. First, the unknown linearizing input is inexactly approximated by a set of basis functions. Second, the measured output data is… ▽ More We present an extension of Willems' Fundamental Lemma to the class of multi-input multi-output discrete-time feedback linearizable nonlinear systems, thus providing a data-based representation of their input-output trajectories. Two sources of uncertainty are considered. First, the unknown linearizing input is inexactly approximated by a set of basis functions. Second, the measured output data is contaminated by additive noise. Further, we propose an approach to approximate the solution of the data-based simulation and output matching problems, and show that the difference from the true solution is bounded. Finally, the results are illustrated on an example of a fully-actuated double inverted pendulum. △ Less

Submitted 16 March, 2023; v1 submitted 3 April, 2022; originally announced April 2022.

Journal ref: in IEEE Transactions on Automatic Control, 2023

Self-triggered MPC robust to bounded packet loss via a min-max approach: extended version

Authors: Stefan Wildhagen, Matthias Pezzutto, Luca Schenato, Frank Allgöwer

Abstract: Networked Control Systems typically come with a limited communication bandwidth and thus require special care when designing the underlying control and triggering law. A method that allows to consider hard constraints on the communication traffic as well as on states and inputs is self-triggered model predictive control (MPC). In this scheme, the optimal length of the sampling interval is determin… ▽ More Networked Control Systems typically come with a limited communication bandwidth and thus require special care when designing the underlying control and triggering law. A method that allows to consider hard constraints on the communication traffic as well as on states and inputs is self-triggered model predictive control (MPC). In this scheme, the optimal length of the sampling interval is determined proactively using predictions of the system behavior. However, previous formulations of self-triggered MPC have neglected the widespread phenomenon of packet loss, such that these approaches might fail in practice. In this paper, we present a novel self-triggered MPC scheme which is robust to bounded packet loss by virtue of a min-max optimization problem. We prove recursive feasibility, constraint satisfaction and convergence to the origin for any possible packet loss realization consistent with the boundedness constraint, and demonstrate the advantages of the proposed scheme in a numerical example. △ Less

Submitted 13 September, 2022; v1 submitted 1 April, 2022; originally announced April 2022.

Comments: 8 pages, 3 figures. This is an extended version of the paper accepted for CDC 2022, containing all proofs

A novel constraint tightening approach for robust data-driven predictive control

Authors: Christian Klöppelt, Julian Berberich, Frank Allgöwer, Matthias A. Müller

Abstract: In this paper, we present a data-driven model predictive control (MPC) scheme that is capable of stabilizing unknown linear time-invariant systems under the influence of process disturbances. To this end, Willems' lemma is used to predict the future behavior of the system. This allows the entire scheme to be set up using only a priori measured data and knowledge of an upper bound on the system ord… ▽ More In this paper, we present a data-driven model predictive control (MPC) scheme that is capable of stabilizing unknown linear time-invariant systems under the influence of process disturbances. To this end, Willems' lemma is used to predict the future behavior of the system. This allows the entire scheme to be set up using only a priori measured data and knowledge of an upper bound on the system order. First, we develop a state-feedback MPC scheme, based on input-state data, which guarantees closed-loop practical exponential stability and recursive feasibility as well as closed-loop constraint satisfaction. The scheme is extended by a suitable constraint tightening, which can also be constructed using only data. In order to control a priori unstable systems, the presented scheme contains a pre-stabilizing controller and an associated input constraint tightening. We first present the proposed data-driven MPC scheme for the case of full state measurements, and also provide extensions for obtaining similar closed-loop guarantees in case of output feedback. The presented scheme is applied to a numerical example. △ Less

Submitted 14 March, 2022; originally announced March 2022.

Comments: This paper has been submitted to International Journal of Robust and Nonlinear Control

Stochastic Model Predictive Control using Initial State Optimization

Authors: Henning Schlüter, Frank Allgöwer

Abstract: We propose a stochastic MPC scheme using an optimization over the initial state for the predicted trajectory. Considering linear discrete-time systems under unbounded additive stochastic disturbances subject to chance constraints, we use constraint tightening based on probabilistic reachable sets to design the MPC. The scheme avoids the infeasibility issues arising from unbounded disturbances by i… ▽ More We propose a stochastic MPC scheme using an optimization over the initial state for the predicted trajectory. Considering linear discrete-time systems under unbounded additive stochastic disturbances subject to chance constraints, we use constraint tightening based on probabilistic reachable sets to design the MPC. The scheme avoids the infeasibility issues arising from unbounded disturbances by including the initial state as a decision variable. We show that the stabilizing control scheme can guarantee constraint satisfaction in closed loop, assuming unimodal disturbances. In addition to illustrating these guarantees, the numerical example indicates further advantages of optimizing over the initial state for the transient behavior. △ Less

Submitted 18 July, 2022; v1 submitted 3 March, 2022; originally announced March 2022.

Comments: 6 pages, 1 figure; accepted for 25th International Symposium on Mathematical Theory of Networks and Systems (MTNS) 2022

MSC Class: 93B45 (Primary); 93E20 (Secondary)

Data-driven distributed MPC of dynamically coupled linear systems

Authors: Matthias Köhler, Julian Berberich, Matthias A. Müller, Frank Allgöwer

Abstract: In this paper, we present a data-driven distributed model predictive control (MPC) scheme to stabilise the origin of dynamically coupled discrete-time linear systems subject to decoupled input constraints. The local optimisation problems solved by the subsystems rely on a distributed adaptation of the Fundamental Lemma by Willems et al., allowing to parametrise system trajectories using only measu… ▽ More In this paper, we present a data-driven distributed model predictive control (MPC) scheme to stabilise the origin of dynamically coupled discrete-time linear systems subject to decoupled input constraints. The local optimisation problems solved by the subsystems rely on a distributed adaptation of the Fundamental Lemma by Willems et al., allowing to parametrise system trajectories using only measured input-output data without explicit model knowledge. For the local predictions, the subsystems rely on communicated assumed trajectories of neighbours. Each subsystem guarantees a small deviation from these trajectories via a consistency constraint. We provide a theoretical analysis of the resulting non-iterative distributed MPC scheme, including proofs of recursive feasibility and (practical) stability. Finally, the approach is successfully applied to a numerical example. △ Less

Submitted 11 August, 2023; v1 submitted 25 February, 2022; originally announced February 2022.

Journal ref: IFAC-PapersOnLine, 55(30), 365-370 (2022)