-
Invariance of Gaussian RKHSs under Koopman operators of stochastic differential equations with constant matrix coefficients
Authors:
Friedrich Philipp,
Manuel Schaller,
Karl Worthmann,
Sebastian Peitz,
Feliks Nüske
Abstract:
We consider the Koopman operator semigroup $(K^t)_{t\ge 0}$ associated with stochastic differential equations of the form $dX_t = AX_t\,dt + B\,dW_t$ with constant matrices $A$ and $B$ and Brownian motion $W_t$. We prove that the reproducing kernel Hilbert space $\bH_C$ generated by a Gaussian kernel with a positive definite covariance matrix $C$ is invariant under each Koopman operator $K^t$ if t…
▽ More
We consider the Koopman operator semigroup $(K^t)_{t\ge 0}$ associated with stochastic differential equations of the form $dX_t = AX_t\,dt + B\,dW_t$ with constant matrices $A$ and $B$ and Brownian motion $W_t$. We prove that the reproducing kernel Hilbert space $\bH_C$ generated by a Gaussian kernel with a positive definite covariance matrix $C$ is invariant under each Koopman operator $K^t$ if the matrices $A$, $B$, and $C$ satisfy the following Lyapunov-like matrix inequality: $AC^2 + C^2A^\top\le 2BB^\top$. In this course, we prove a characterization concerning the inclusion $\bH_{C_1}\subset\bH_{C_2}$ of Gaussian RKHSs for two positive definite matrices $C_1$ and $C_2$. The question of whether the sufficient Lyapunov-condition is also necessary is left as an open problem.
△ Less
Submitted 23 May, 2024;
originally announced May 2024.
-
Distributed Optimization for Energy Grids: A Tutorial on ADMM and ALADIN
Authors:
Lukas Lanza,
Timm Faulwasser,
Karl Worthmann
Abstract:
The ongoing transition towards energy and power systems dominated by a large number of renewable power injections to the distribution grid poses substantial challenges for system operation, coordination, and control. Optimization-based methods for coordination and control are of substantial research interest in this context. Hence, this chapter provides a tutorial introduction of distributed optim…
▽ More
The ongoing transition towards energy and power systems dominated by a large number of renewable power injections to the distribution grid poses substantial challenges for system operation, coordination, and control. Optimization-based methods for coordination and control are of substantial research interest in this context. Hence, this chapter provides a tutorial introduction of distributed optimization algorithms for energy systems with a large share of renewables. Specifically, we focus on the Alternating Direction Method of Multipliers (ADMM) and on the Augmented Lagrangian Alternating Direction Inexact Newton (ALADIN) method as both algorithms are frequently considered for coordination and control of power and energy systems. We discuss the application of ALADIN and ADMM to AC optimal power flow problems and to energy management problems. Moreover, we give an outlook on open problems.
△ Less
Submitted 5 April, 2024;
originally announced April 2024.
-
Towards Efficient Aggregation of Storage Flexibilities in Power Grids
Authors:
Emrah Öztürk,
Kevin Kaspar,
Timm Faulwasser,
Karl Worthmann,
Peter Kepplinger,
Klaus Rheinberger
Abstract:
The increasing penetration of volatile renewables combined with increasing demands poses a challenge to modern power grids. Furthermore, distributed energy resources and flexible devices (electric vehicles, PV generation, ...) are becoming more widespread, making their aggregate usage for ancillary services interesting. However, accurately quantifying the aggregate flexibility of numerous flexible…
▽ More
The increasing penetration of volatile renewables combined with increasing demands poses a challenge to modern power grids. Furthermore, distributed energy resources and flexible devices (electric vehicles, PV generation, ...) are becoming more widespread, making their aggregate usage for ancillary services interesting. However, accurately quantifying the aggregate flexibility of numerous flexible devices is known to be limited by the curse of dimensionality, i.e., it does not scale well computationally. This has led to the development of various approximation algorithms. In this study, we improve upon our previously proposed vertex-based inner approximation, extending it to more general storage devices. We demonstrate the efficacy and accuracy of the proposed method in a case study comparing our approach with an exact centralized control framework, where the flexibility of numerous electric vehicles is combined to reduce the peak load in a residential area.
△ Less
Submitted 29 March, 2024;
originally announced March 2024.
-
$L^\infty$-error bounds for approximations of the Koopman operator by kernel extended dynamic mode decomposition
Authors:
Frederik Köhne,
Friedrich M. Philipp,
Manuel Schaller,
Anton Schiela,
Karl Worthmann
Abstract:
Extended dynamic mode decomposition (EDMD) is a well-established method to generate a data-driven approximation of the Koopman operator for analysis and prediction of nonlinear dynamical systems. Recently, kernel EDMD (kEDMD) has gained popularity due to its ability to resolve the challenging task of choosing a suitable dictionary by using the kernel's canonical features and, thus, data-informed o…
▽ More
Extended dynamic mode decomposition (EDMD) is a well-established method to generate a data-driven approximation of the Koopman operator for analysis and prediction of nonlinear dynamical systems. Recently, kernel EDMD (kEDMD) has gained popularity due to its ability to resolve the challenging task of choosing a suitable dictionary by using the kernel's canonical features and, thus, data-informed observables. In this paper, we provide the first pointwise bounds on the approximation error of kEDMD. The main idea consists of two steps. First, we show that the reproducing kernel Hilbert spaces of Wendland functions are invariant under the Koopman operator. Second, exploiting that the learning problem given by regression in the native norm can be recast as an interpolation problem, we prove our novel error bounds by using interpolation estimates. Finally, we validate our findings with numerical experiments.
△ Less
Submitted 4 July, 2024; v1 submitted 27 March, 2024;
originally announced March 2024.
-
Perturbations in PDE-constrained optimal control decay exponentially in space
Authors:
Simone Göttlich,
Manuel Schaller,
Karl Worthmann
Abstract:
For linear-quadratic optimal control problems (OCPs) governed by elliptic and parabolic partial differential equations (PDEs), we investigate the impact of perturbations on optimal solutions. Local perturbations may occur, e.g., due to discretization of the optimality system or disturbed problem data. Whereas these perturbations may exhibit global effects in the uncontrolled case, we prove that th…
▽ More
For linear-quadratic optimal control problems (OCPs) governed by elliptic and parabolic partial differential equations (PDEs), we investigate the impact of perturbations on optimal solutions. Local perturbations may occur, e.g., due to discretization of the optimality system or disturbed problem data. Whereas these perturbations may exhibit global effects in the uncontrolled case, we prove that the ramifications are exponentially damped in space under stabilizability- and detectability-like conditions. To this end, we prove a bound on the optimality condition's solution operator that is uniform in the domain size. Then, this uniformity is used in a scaling argument to show the exponential decay of perturbations in space. We numerically validate and illustrate our results by solving OCPs involving Helmholtz, Poisson, and advection-diffusion-reaction equations.
△ Less
Submitted 22 March, 2024;
originally announced March 2024.
-
MPC without Terminal Ingredients Tailored to the SEIR Compartmental Epidemic Model
Authors:
Willem Esterhuizen,
Philipp Sauerteig,
Stefan Streif,
Karl Worthmann
Abstract:
We consider the SEIR compartmental epidemic model subject to state and input constraints (a cap on the proportion of infectious individuals and limits on the allowed social distancing and quarantining measures, respectively). We present a tailored model predictive control (MPC) scheme without terminal conditions. We rigorously show recursive feasibility and asymptotic convergence of the MPC closed…
▽ More
We consider the SEIR compartmental epidemic model subject to state and input constraints (a cap on the proportion of infectious individuals and limits on the allowed social distancing and quarantining measures, respectively). We present a tailored model predictive control (MPC) scheme without terminal conditions. We rigorously show recursive feasibility and asymptotic convergence of the MPC closed loop to the continuum of disease-free equilibrium points for suitably designed quadratic running cost and a sufficiently long prediction horizon (forecast window). Moreover, we establish the viability kernel (a.k.a. the admissible set) as a domain of attraction of the continuum of equilibria.
△ Less
Submitted 10 June, 2024; v1 submitted 14 March, 2024;
originally announced March 2024.
-
Fast and memory-efficient optimization for large-scale data-driven predictive control
Authors:
Philipp Schmitz,
Manuel Schaller,
Matthias Voigt,
Karl Worthmann
Abstract:
Recently, data-enabled predictive control (DeePC) schemes based on Willems' fundamental lemma have attracted considerable attention. At the core are computations using Hankel-like matrices and their connection to the concept of persistency of excitation. We propose an iterative solver for the underlying data-driven optimal control problems resulting from linear discrete-time systems. To this end,…
▽ More
Recently, data-enabled predictive control (DeePC) schemes based on Willems' fundamental lemma have attracted considerable attention. At the core are computations using Hankel-like matrices and their connection to the concept of persistency of excitation. We propose an iterative solver for the underlying data-driven optimal control problems resulting from linear discrete-time systems. To this end, we apply factorizations based on the discrete Fourier transform of the Hankel-like matrices, which enable fast and memory-efficient computations. To take advantage of this factorization in an optimal control solver and to reduce the effect of inherent bad conditioning of the Hankel-like matrices, we propose an augmented Lagrangian lBFGS-method. We illustrate the performance of our method by means of a numerical study.
△ Less
Submitted 20 February, 2024;
originally announced February 2024.
-
Reinforcement Learning for Docking Maneuvers with Prescribed Performance
Authors:
Simon Gottschalk,
Lukas Lanza,
Karl Worthmann,
Kerstin Lux-Gottschalk
Abstract:
We propose a two-component data-driven controller to safely perform docking maneuvers for satellites. Reinforcement Learning is used to deduce an optimal control policy based on measurement data. To safeguard the learning phase, an additional feedback law is implemented in the control unit, which guarantees the evolution of the system within predefined performance bounds. We define safe and safety…
▽ More
We propose a two-component data-driven controller to safely perform docking maneuvers for satellites. Reinforcement Learning is used to deduce an optimal control policy based on measurement data. To safeguard the learning phase, an additional feedback law is implemented in the control unit, which guarantees the evolution of the system within predefined performance bounds. We define safe and safety-critical areas to train the feedback controller based on actual measurements. To avoid chattering, a dwell-time activation scheme is implemented. We provide numerical evidence for the performance of the proposed controller for a satellite docking maneuver with collision avoidance.
△ Less
Submitted 13 February, 2024;
originally announced February 2024.
-
SafEDMD: A certified learning architecture tailored to data-driven control of nonlinear dynamical systems
Authors:
Robin Strässer,
Manuel Schaller,
Karl Worthmann,
Julian Berberich,
Frank Allgöwer
Abstract:
The Koopman operator serves as the theoretical backbone for machine learning of dynamical control systems, where the operator is heuristically approximated by extended dynamic mode decomposition (EDMD). In this paper, we propose Stability- and certificate-oriented EDMD (SafEDMD): a novel EDMD-based learning architecture which comes along with rigorous certificates, resulting in a reliable surrogat…
▽ More
The Koopman operator serves as the theoretical backbone for machine learning of dynamical control systems, where the operator is heuristically approximated by extended dynamic mode decomposition (EDMD). In this paper, we propose Stability- and certificate-oriented EDMD (SafEDMD): a novel EDMD-based learning architecture which comes along with rigorous certificates, resulting in a reliable surrogate model generated in a data-driven fashion. To ensure the trustworthiness of SafEDMD, we derive proportional error bounds, which vanish at the origin and are tailored to control tasks, leading to certified controller design based on semi-definite programming. We illustrate the developed method by means of several benchmark examples and highlight the advantages over state-of-the-art methods.
△ Less
Submitted 17 May, 2024; v1 submitted 5 February, 2024;
originally announced February 2024.
-
Variance representations and convergence rates for data-driven approximations of Koopman operators
Authors:
Friedrich M. Philipp,
Manuel Schaller,
Septimus Boshoff,
Sebastian Peitz,
Feliks Nüske,
Karl Worthmann
Abstract:
We rigorously derive novel error bounds for extended dynamic mode decomposition (EDMD) to approximate the Koopman operator for discrete- and continuous time (stochastic) systems; both for i.i.d. and ergodic sampling under non-restrictive assumptions. We show exponential convergence rates for i.i.d. sampling and provide the first superlinear convergence rates for ergodic sampling of deterministic s…
▽ More
We rigorously derive novel error bounds for extended dynamic mode decomposition (EDMD) to approximate the Koopman operator for discrete- and continuous time (stochastic) systems; both for i.i.d. and ergodic sampling under non-restrictive assumptions. We show exponential convergence rates for i.i.d. sampling and provide the first superlinear convergence rates for ergodic sampling of deterministic systems. The proofs are based on novel exact variance representations for the empirical estimators of mass and stiffness matrix. Moreover, we verify the accuracy of the derived error bounds and convergence rates by means of numerical simulations for highly-complex dynamical systems including a nonlinear partial differential equation.
△ Less
Submitted 23 May, 2024; v1 submitted 4 February, 2024;
originally announced February 2024.
-
Error analysis of kernel EDMD for prediction and control in the Koopman framework
Authors:
Friedrich Philipp,
Manuel Schaller,
Karl Worthmann,
Sebastian Peitz,
Feliks Nüske
Abstract:
Extended Dynamic Mode Decomposition (EDMD) is a popular data-driven method to approximate the Koopman operator for deterministic and stochastic (control) systems. This operator is linear and encompasses full information on the (expected stochastic) dynamics. In this paper, we analyze a kernel-based EDMD algorithm, known as kEDMD, where the dictionary consists of the canonical kernel features at th…
▽ More
Extended Dynamic Mode Decomposition (EDMD) is a popular data-driven method to approximate the Koopman operator for deterministic and stochastic (control) systems. This operator is linear and encompasses full information on the (expected stochastic) dynamics. In this paper, we analyze a kernel-based EDMD algorithm, known as kEDMD, where the dictionary consists of the canonical kernel features at the data points. The latter are acquired by i.i.d. samples from a user-defined and application-driven distribution on a compact set. We prove bounds on the prediction error of the kEDMD estimator when sampling from this (not necessarily ergodic) distribution. The error analysis is further extended to control-affine systems, where the considered invariance of the Reproducing Kernel Hilbert Space is significantly less restrictive in comparison to invariance assumptions on an a-priori chosen dictionary.
△ Less
Submitted 16 December, 2023;
originally announced December 2023.
-
Safe data-driven reference tracking with prescribed performance
Authors:
Philipp Schmitz,
Lukas Lanza,
Karl Worthmann
Abstract:
We study output reference tracking for unknown continuous-time systems with arbitrary relative degree. The control objective is to keep the tracking error within predefined time-varying bounds while measurement data is only available at discrete sampling times. To achieve the control objective, we propose a two-component controller. One part is a recently developed sampled-data zero-order hold con…
▽ More
We study output reference tracking for unknown continuous-time systems with arbitrary relative degree. The control objective is to keep the tracking error within predefined time-varying bounds while measurement data is only available at discrete sampling times. To achieve the control objective, we propose a two-component controller. One part is a recently developed sampled-data zero-order hold controller, which achieves reference tracking within prescribed error bounds. To further improve the control signal, we explore the system dynamics via input-output data, and include as the second component a data-driven MPC scheme based on Willems et al.'s fundamental lemma. This combination yields significantly improved input signals as illustrated by a numerical example.
△ Less
Submitted 14 December, 2023;
originally announced December 2023.
-
On model predictive control with sampled-data input for output tracking with prescribed performance
Authors:
Dario Dennstädt,
Lukas Lanza,
Karl Worthmann
Abstract:
We propose a model predictive control (MPC) scheme with sampled-data input which ensures output-reference tracking within prescribed error bounds for relative-degree-one systems. Hereby, we explicitly deduce bounds on the required maximal control input and sampling frequency such that the MPC scheme is both initially and recursively feasible. A key feature of the proposed approach is that neither…
▽ More
We propose a model predictive control (MPC) scheme with sampled-data input which ensures output-reference tracking within prescribed error bounds for relative-degree-one systems. Hereby, we explicitly deduce bounds on the required maximal control input and sampling frequency such that the MPC scheme is both initially and recursively feasible. A key feature of the proposed approach is that neither terminal conditions nor a sufficiently-large prediction horizon are imposed, rendering the MPC scheme computationally efficient. We illustrate the MPC algorithm via a numerical example of a torsional oscillator.
△ Less
Submitted 27 March, 2024; v1 submitted 12 December, 2023;
originally announced December 2023.
-
Koopman-based feedback design with stability guarantees
Authors:
Robin Strässer,
Manuel Schaller,
Karl Worthmann,
Julian Berberich,
Frank Allgöwer
Abstract:
We present a method to design a state-feedback controller ensuring exponential stability for nonlinear systems using only measurement data. Our approach relies on Koopman-operator theory and uses robust control to explicitly account for approximation errors due to finitely many data samples. To simplify practical usage across various applications, we provide a tutorial-style exposition of the feed…
▽ More
We present a method to design a state-feedback controller ensuring exponential stability for nonlinear systems using only measurement data. Our approach relies on Koopman-operator theory and uses robust control to explicitly account for approximation errors due to finitely many data samples. To simplify practical usage across various applications, we provide a tutorial-style exposition of the feedback design and its stability guarantees for single-input systems. Moreover, we extend this controller design to multi-input systems and more flexible nonlinear state-feedback controllers using gain-scheduling techniques to increase the guaranteed region of attraction. As the proposed controller design is framed as a semidefinite program, it allows for an efficient solution. Further, we enhance the geometry of the region of attraction through a heuristic algorithm that establishes a connection between the employed Koopman lifting and the dynamics of the system. Finally, we validate the proposed feedback design procedure by means of numerical examples.
△ Less
Submitted 3 May, 2024; v1 submitted 3 December, 2023;
originally announced December 2023.
-
Alleviating the Curse of Dimensionality in Minkowski Sum Approximations of Storage Flexibility
Authors:
Emrah Öztürk,
Timm Faulwasser,
Karl Worthmann,
Markus Preißinger,
Klaus Rheinberger
Abstract:
Many real-world applications require the joint optimization of a large number of flexible devices over time. The flexibility of, e.g., multiple batteries, thermostatically controlled loads, or electric vehicles can be used to support grid operation and to reduce operation costs. Using piecewise constant power values, the flexibility of each device over $d$ time periods can be described as a polyto…
▽ More
Many real-world applications require the joint optimization of a large number of flexible devices over time. The flexibility of, e.g., multiple batteries, thermostatically controlled loads, or electric vehicles can be used to support grid operation and to reduce operation costs. Using piecewise constant power values, the flexibility of each device over $d$ time periods can be described as a polytopic subset in power space. The aggregated flexibility is given by the Minkowski sum of these polytopes. As the computation of Minkowski sums is in general demanding, several approximations have been proposed in the literature. Yet, their application potential is often objective-dependent and limited by the curse of dimensionality. We show that up to $2^d$ vertices of each polytope can be computed efficiently and that the convex hull of their sums provides a computationally efficient inner approximation of the Minkowski sum. Via an extensive simulation study, we illustrate that our approach outperforms ten state-of-the-art inner approximations in terms of computational complexity and accuracy for different objectives. Moreover, we propose an efficient disaggregation method applicable to any vertex-based approximation. The proposed methods provide an efficient means to aggregate and to disaggregate energy storages in quarter-hourly periods over an entire day with reasonable accuracy for aggregated cost and for peak power optimization.
△ Less
Submitted 28 February, 2024; v1 submitted 2 November, 2023;
originally announced November 2023.
-
Data-driven MPC with stability guarantees using extended dynamic mode decomposition
Authors:
Lea Bold,
Lars Grüne,
Manuel Schaller,
Karl Worthmann
Abstract:
For nonlinear (control) systems, extended dynamic mode decomposition (EDMD) is a popular method to obtain data-driven surrogate models. Its theoretical foundation is the Koopman framework, in which one propagates observable functions of the state to obtain a linear representation in an infinite-dimensional space. In this work, we prove practical asymptotic stability of a (controlled) equilibrium f…
▽ More
For nonlinear (control) systems, extended dynamic mode decomposition (EDMD) is a popular method to obtain data-driven surrogate models. Its theoretical foundation is the Koopman framework, in which one propagates observable functions of the state to obtain a linear representation in an infinite-dimensional space. In this work, we prove practical asymptotic stability of a (controlled) equilibrium for EDMD-based model predictive control, in which the optimization step is conducted using the data-based surrogate model. To this end, we derive novel bounds on the estimation error that are proportional to the norm of state and control. This enables us to show that, if the underlying system is cost controllable, this stabilizablility property is preserved. We conduct numerical simulations illustrating the proven practical asymptotic stability.
△ Less
Submitted 11 March, 2024; v1 submitted 1 August, 2023;
originally announced August 2023.
-
Reprojection methods for Koopman-based modelling and prediction
Authors:
Pieter van Goor,
Robert Mahony,
Manuel Schaller,
Karl Worthmann
Abstract:
Extended Dynamic Mode Decomposition (eDMD) is a powerful tool to generate data-driven surrogate models for the prediction and control of nonlinear dynamical systems in the Koopman framework. In eDMD a compression of the lifted system dynamics on the space spanned by finitely many observables is computed, in which the original space is embedded as a low-dimensional manifold. While this manifold is…
▽ More
Extended Dynamic Mode Decomposition (eDMD) is a powerful tool to generate data-driven surrogate models for the prediction and control of nonlinear dynamical systems in the Koopman framework. In eDMD a compression of the lifted system dynamics on the space spanned by finitely many observables is computed, in which the original space is embedded as a low-dimensional manifold. While this manifold is invariant for the infinite-dimensional Koopman operator, this invariance is typically not preserved for its eDMD-based approximation. Hence, an additional (re-)projection step is often tacitly incorporated to improve the prediction capability. We propose a novel framework for consistent reprojectors respecting the underlying manifold structure. Further, we present a new geometric reprojector based on maximum-likelihood arguments, which significantly enhances the approximation accuracy and preserves known finite-data error bounds.
△ Less
Submitted 30 July, 2023;
originally announced July 2023.
-
Partial observations, coarse graining and equivariance in Koopman operator theory for large-scale dynamical systems
Authors:
Sebastian Peitz,
Hans Harder,
Feliks Nüske,
Friedrich Philipp,
Manuel Schaller,
Karl Worthmann
Abstract:
The Koopman operator has become an essential tool for data-driven analysis, prediction and control of complex systems, the main reason being the enormous potential of identifying linear function space representations of nonlinear dynamics from measurements. Until now, the situation where for large-scale systems, we (i) only have access to partial observations (i.e., measurements, as is very common…
▽ More
The Koopman operator has become an essential tool for data-driven analysis, prediction and control of complex systems, the main reason being the enormous potential of identifying linear function space representations of nonlinear dynamics from measurements. Until now, the situation where for large-scale systems, we (i) only have access to partial observations (i.e., measurements, as is very common for experimental data) or (ii) deliberately perform coarse graining (for efficiency reasons) has not been treated to its full extent. In this paper, we address the pitfall associated with this situation, that the classical EDMD algorithm does not automatically provide a Koopman operator approximation for the underlying system if we do not carefully select the number of observables. Moreover, we show that symmetries in the system dynamics can be carried over to the Koopman operator, which allows us to massively increase the model efficiency. We also briefly draw a connection to domain decomposition techniques for partial differential equations and present numerical evidence using the Kuramoto--Sivashinsky equation.
△ Less
Submitted 28 July, 2023;
originally announced July 2023.
-
Energy-optimal control of adaptive structures
Authors:
Manuel Schaller,
Amelie Zeller,
Michael Böhm,
Oliver Sawodny,
Cristina Tarín,
Karl Worthmann
Abstract:
Adaptive structures are equipped with sensors and actuators to actively counteract external loads such as wind. This can significantly reduce resource consumption and emissions during the life cycle compared to conventional structures. A common approach for active dam** is to derive a port-Hamiltonian model and to employ linear-quadratic control. However, the quadratic control penalization lacks…
▽ More
Adaptive structures are equipped with sensors and actuators to actively counteract external loads such as wind. This can significantly reduce resource consumption and emissions during the life cycle compared to conventional structures. A common approach for active dam** is to derive a port-Hamiltonian model and to employ linear-quadratic control. However, the quadratic control penalization lacks physical interpretation and merely serves as a regularization term. Rather, we propose a controller, which achieves the goal of vibration dam** while acting energy-optimal. Leveraging the port-Hamiltonian structure, we show that the optimal control is uniquely determined, even on singular arcs. Further, we prove a stable long-time behavior of optimal trajectories by means of a turnpike property. Last, the proposed controller's efficiency is evaluated in a numerical study.
△ Less
Submitted 8 December, 2023; v1 submitted 23 June, 2023;
originally announced June 2023.
-
Optimal control of port-Hamiltonian systems: energy, entropy, and exergy
Authors:
Friedrich Philipp,
Manuel Schaller,
Karl Worthmann,
Timm Faulwasser,
Bernhard Maschke
Abstract:
We consider irreversible and coupled reversible-irreversible nonlinear port-Hamiltonian systems and the respective sets of thermodynamic equilibria. In particular, we are concerned with optimal state transitions and output stabilization on finite-time horizons. We analyze a class of optimal control problems, where the performance functional can be interpreted as a linear combination of energy supp…
▽ More
We consider irreversible and coupled reversible-irreversible nonlinear port-Hamiltonian systems and the respective sets of thermodynamic equilibria. In particular, we are concerned with optimal state transitions and output stabilization on finite-time horizons. We analyze a class of optimal control problems, where the performance functional can be interpreted as a linear combination of energy supply, entropy generation, or exergy supply. Our results establish the integral turnpike property towards the set of thermodynamic equilibria providing a rigorous connection of optimal system trajectories to optimal steady states. Throughout the paper, we illustrate our findings by means of two examples: a network of heat exchangers and a gas-piston system.
△ Less
Submitted 15 June, 2023;
originally announced June 2023.
-
Globally convergent homotopies for discrete-time optimal control
Authors:
Willem Esterhuizen,
Kathrin Flaßkamp,
Matthias Hoffmann,
Karl Worthmann
Abstract:
Homotopy methods are attractive due to their capability of solving difficult optimisation and optimal control problems. The underlying idea is to construct a homotopy, which may be considered as a continuous (zero) curve between the difficult original problem and a related, comparatively easy one. Then, the solution of the easier one is continuously perturbed along the zero curve towards the sough…
▽ More
Homotopy methods are attractive due to their capability of solving difficult optimisation and optimal control problems. The underlying idea is to construct a homotopy, which may be considered as a continuous (zero) curve between the difficult original problem and a related, comparatively easy one. Then, the solution of the easier one is continuously perturbed along the zero curve towards the sought-after solution of the original problem. We propose a methodology for the systematic construction of such zero curves for discrete-time optimal control problems drawing upon the theory of globally convergent homotopies for nonlinear programs. The proposed framework ensures that for almost every initial guess at a solution there exists a suitable homotopy path that is, in addition, numerically convenient to track. We demonstrate the results by solving difficult optimal path planning problems for a linear system and the nonlinear nonholonomic car (Dubins' vehicle).
△ Less
Submitted 12 July, 2024; v1 submitted 13 June, 2023;
originally announced June 2023.
-
Hidden regularity in singular optimal control of port-Hamiltonian systems
Authors:
Timm Faulwasser,
Jonas Kirchhoff,
Volker Mehrmann,
Friedrich Philipp,
Manuel Schaller,
Karl Worthmann
Abstract:
We study the problem of state transition on a finite time interval with minimal energy supply for linear port-Hamiltonian systems. While the cost functional of minimal energy supply is intrinsic to the port-Hamiltonian structure, the necessary conditions of optimality resulting from Pontryagin's maximum principle may yield singular arcs. The underlying reason is the linear dependence on the contro…
▽ More
We study the problem of state transition on a finite time interval with minimal energy supply for linear port-Hamiltonian systems. While the cost functional of minimal energy supply is intrinsic to the port-Hamiltonian structure, the necessary conditions of optimality resulting from Pontryagin's maximum principle may yield singular arcs. The underlying reason is the linear dependence on the control, which makes the problem of determining the optimal control as a function of the state and the adjoint more complicated or even impossible. To resolve this issue, we fully characterize regularity of the (differential-algebraic) optimality system by using the interplay of the cost functional and the dynamics. In case of the optimality DAE being characterized by a regular matrix pencil, we fully determine the control on the singular arc. In case of singular matrix pencils of the optimality system, we propose an approach to compute rank-minimal quadratic perturbations of the objective such that the optimal control problem becomes regular. We illustrate the applicability of our results by a general second-order mechanical system and a discretized boundary-controlled heat equation.
△ Less
Submitted 20 November, 2023; v1 submitted 5 May, 2023;
originally announced May 2023.
-
Safe continual learning in MPC with prescribed bounds on the tracking error
Authors:
Lukas Lanza,
Dario Dennstädt,
Thomas Berger,
Karl Worthmann
Abstract:
Recently, robust funnel Model Predictive Control (MPC) was introduced, which consists of model-based funnel MPC and model-free funnel control for its robustification w.r.t. model-plant mismatches, bounded disturbances, and uncertainties. It achieves output-reference tracking within prescribed bounds on the tracking error for a class of unknown nonlinear systems. We extend robust funnel MPC by a le…
▽ More
Recently, robust funnel Model Predictive Control (MPC) was introduced, which consists of model-based funnel MPC and model-free funnel control for its robustification w.r.t. model-plant mismatches, bounded disturbances, and uncertainties. It achieves output-reference tracking within prescribed bounds on the tracking error for a class of unknown nonlinear systems. We extend robust funnel MPC by a learning component to adapt the underlying model to the system data and hence to improve the contribution of MPC. Since robust funnel MPC is inherently robust and the evolution of the tracking error in the prescribed performance funnel is guaranteed, the additional learning component is able to perform the learning task online - even without an initial model or offline training.
△ Less
Submitted 25 August, 2023; v1 submitted 21 April, 2023;
originally announced April 2023.
-
On Koopman-based surrogate models for non-holonomic robots
Authors:
Lea Bold,
Hannes Eschmann,
Mario Rosenfelder,
Henrik Ebel,
Karl Worthmann
Abstract:
Data-driven surrogate models of dynamical systems based on the extended dynamic mode decomposition are nowadays well-established and widespread in applications. Further, for non-holonomic systems exhibiting a multiplicative coupling between states and controls, the usage of bi-linear surrogate models has proven beneficial. However, an in-depth analysis of the approximation quality and its dependen…
▽ More
Data-driven surrogate models of dynamical systems based on the extended dynamic mode decomposition are nowadays well-established and widespread in applications. Further, for non-holonomic systems exhibiting a multiplicative coupling between states and controls, the usage of bi-linear surrogate models has proven beneficial. However, an in-depth analysis of the approximation quality and its dependence on different hyperparameters based on both simulation and experimental data is still missing. We investigate a differential-drive mobile robot to close this gap and provide first guidelines on the systematic design of data-efficient surrogate models.
△ Less
Submitted 16 March, 2023;
originally announced March 2023.
-
Sampled-data funnel control and its use for safe continual learning
Authors:
Lukas Lanza,
Dario Dennstädt,
Karl Worthmann,
Philipp Schmitz,
Gökçen Devlet Şen,
Stephan Trenn,
Manuel Schaller
Abstract:
We propose a novel sampled-data output-feedback controller for nonlinear systems of arbitrary relative degree that ensures reference tracking within prescribed error bounds. We provide explicit bounds on the maximum input signal and the required uniform sampling time. A key strength of this approach is its capability to serve as a safety filter for various learning-based controller designs, enabli…
▽ More
We propose a novel sampled-data output-feedback controller for nonlinear systems of arbitrary relative degree that ensures reference tracking within prescribed error bounds. We provide explicit bounds on the maximum input signal and the required uniform sampling time. A key strength of this approach is its capability to serve as a safety filter for various learning-based controller designs, enabling the use of learning techniques in safety-critical applications. We illustrate its versatility by integrating it with two different controllers: a reinforcement learning controller and a non-parametric predictive controller based on Willems et al.'s fundamental lemma. Numerical simulations illustrate effectiveness of the combined controller design.
△ Less
Submitted 10 June, 2024; v1 submitted 1 March, 2023;
originally announced March 2023.
-
Robust Funnel Model Predictive Control for output tracking with prescribed performance
Authors:
Thomas Berger,
Dario Dennstädt,
Lukas Lanza,
Karl Worthmann
Abstract:
We propose a novel robust Model Predictive Control (MPC) scheme for nonlinear multi-input multi-output systems of relative degree one with stable internal dynamics. The proposed algorithm is a combination of funnel MPC, i.e., MPC with a particular stage cost, and the model-free adaptive funnel controller. The new robust funnel MPC scheme guarantees output tracking of reference signals within presc…
▽ More
We propose a novel robust Model Predictive Control (MPC) scheme for nonlinear multi-input multi-output systems of relative degree one with stable internal dynamics. The proposed algorithm is a combination of funnel MPC, i.e., MPC with a particular stage cost, and the model-free adaptive funnel controller. The new robust funnel MPC scheme guarantees output tracking of reference signals within prescribed performance bounds -- even in the presence of unknown disturbances and a structural model-plant mismatch. We show initial and recursive feasibility of the proposed control scheme without imposing terminal conditions or any requirements on the prediction horizon. Moreover, we allow for model updates at runtime. To this end, we propose a proper initialization strategy, which ensures that recursive feasibility is preserved. Finally, we validate the performance of the proposed robust MPC scheme by simulations.
△ Less
Submitted 12 December, 2023; v1 submitted 3 February, 2023;
originally announced February 2023.
-
Error bounds for kernel-based approximations of the Koopman operator
Authors:
Friedrich Philipp,
Manuel Schaller,
Karl Worthmann,
Sebastian Peitz,
Feliks Nüske
Abstract:
We consider the data-driven approximation of the Koopman operator for stochastic differential equations on reproducing kernel Hilbert spaces (RKHS). Our focus is on the estimation error if the data are collected from long-term ergodic simulations. We derive both an exact expression for the variance of the kernel cross-covariance operator, measured in the Hilbert-Schmidt norm, and probabilistic bou…
▽ More
We consider the data-driven approximation of the Koopman operator for stochastic differential equations on reproducing kernel Hilbert spaces (RKHS). Our focus is on the estimation error if the data are collected from long-term ergodic simulations. We derive both an exact expression for the variance of the kernel cross-covariance operator, measured in the Hilbert-Schmidt norm, and probabilistic bounds for the finite-data estimation error. Moreover, we derive a bound on the prediction error of observables in the RKHS using a finite Mercer series expansion. Further, assuming Koopman-invariance of the RKHS, we provide bounds on the full approximation error. Numerical experiments using the Ornstein-Uhlenbeck process illustrate our results.
△ Less
Submitted 19 December, 2023; v1 submitted 20 January, 2023;
originally announced January 2023.
-
Path Planning for Concentric Tube Robots: a Toolchain with Application to Stereotactic Neurosurgery
Authors:
Matthias K. Hoffmann,
Willem Esterhuizen,
Karl Worthmann,
Kathrin Flaßkamp
Abstract:
We present a toolchain for solving path planning problems for concentric tube robots through obstacle fields. First, ellipsoidal sets representing the target area and obstacles are constructed from labelled point clouds. Then, the nonlinear and highly nonconvex optimal control problem is solved by introducing a homotopy on the obstacle positions where at one extreme of the parameter the obstacles…
▽ More
We present a toolchain for solving path planning problems for concentric tube robots through obstacle fields. First, ellipsoidal sets representing the target area and obstacles are constructed from labelled point clouds. Then, the nonlinear and highly nonconvex optimal control problem is solved by introducing a homotopy on the obstacle positions where at one extreme of the parameter the obstacles are removed from the operating space, and at the other extreme they are located at their intended positions. We present a detailed example (with more than a thousand obstacles) from stereotactic neurosurgery with real-world data obtained from labelled MPRI scans.
△ Less
Submitted 28 November, 2022;
originally announced November 2022.
-
Behavioral Theory for Stochastic Systems? A Data-driven Journey from Willems to Wiener and Back Again
Authors:
Timm Faulwasser,
Ruchuan Ou,
Guanru Pan,
Philipp Schmitz,
Karl Worthmann
Abstract:
The fundamental lemma by Jan C. Willems and co-workers, which is deeply rooted in behavioral systems theory, has become one of the supporting pillars of the recent progress on data-driven control and system analysis. This tutorial-style paper combines recent insights into stochastic and descriptor-system formulations of the lemma to further extend and broaden the formal basis for behavioral theory…
▽ More
The fundamental lemma by Jan C. Willems and co-workers, which is deeply rooted in behavioral systems theory, has become one of the supporting pillars of the recent progress on data-driven control and system analysis. This tutorial-style paper combines recent insights into stochastic and descriptor-system formulations of the lemma to further extend and broaden the formal basis for behavioral theory of stochastic linear systems. We show that series expansions -- in particular Polynomial Chaos Expansions (PCE) of $L^2$-random variables, which date back to Norbert Wiener's seminal work -- enable equivalent behavioral characterizations of linear stochastic systems. Specifically, we prove that under mild assumptions the behavior of the dynamics of the $L^2$-random variables is equivalent to the behavior of the dynamics of the series expansion coefficients and that it entails the behavior composed of sampled realization trajectories. We also illustrate the short-comings of the behavior associated to the time-evolution of the statistical moments. The paper culminates in the formulation of the stochastic fundamental lemma for linear (descriptor) systems, which in turn enables numerically tractable formulations of data-driven stochastic optimal control combining Hankel matrices in realization data (i.e. in measurements) with PCE concepts.
△ Less
Submitted 28 April, 2023; v1 submitted 14 September, 2022;
originally announced September 2022.
-
Data-driven MPC of descriptor systems: A case study for power networks
Authors:
Philipp Schmitz,
Alexander Engelmann,
Timm Faulwasser,
Karl Worthmann
Abstract:
Recently, data-driven predictive control of linear systems has received wide-spread research attention. It hinges on the fundamental lemma by Willems et al. In a previous paper, we have shown how this framework can be applied to predictive control of linear time-invariant descriptor systems. In the present paper, we present a case study wherein we apply data-driven predictive control to a discrete…
▽ More
Recently, data-driven predictive control of linear systems has received wide-spread research attention. It hinges on the fundamental lemma by Willems et al. In a previous paper, we have shown how this framework can be applied to predictive control of linear time-invariant descriptor systems. In the present paper, we present a case study wherein we apply data-driven predictive control to a discrete-time descriptor model obtained by discretization of the power-swing equations for a nine-bus system. Our results shows the efficacy of the proposed control scheme and they underpin the prospect of the data-driven framework for control of descriptor systems.
△ Less
Submitted 4 March, 2022;
originally announced March 2022.
-
Optimal control of thermodynamic port-Hamiltonian Systems
Authors:
Bernhard Maschke,
Friedrich Philipp,
Manuel Schaller,
Karl Worthmann,
Timm Faulwasser
Abstract:
We consider the problem of minimizing the entropy, energy, or exergy production for state transitions of irreversible port-Hamiltonian systems subject to control constraints. Via a dissipativity-based analysis we show that optimal solutions exhibit the manifold turnpike phenomenon with respect to the manifold of thermodynamic equilibria. We illustrate our analytical findings via numerical results…
▽ More
We consider the problem of minimizing the entropy, energy, or exergy production for state transitions of irreversible port-Hamiltonian systems subject to control constraints. Via a dissipativity-based analysis we show that optimal solutions exhibit the manifold turnpike phenomenon with respect to the manifold of thermodynamic equilibria. We illustrate our analytical findings via numerical results for a heat exchanger.
△ Less
Submitted 18 February, 2022;
originally announced February 2022.
-
Towards reliable data-based optimal and predictive control using extended DMD
Authors:
Manuel Schaller,
Karl Worthmann,
Friedrich Philipp,
Sebastian Peitz,
Feliks Nüske
Abstract:
While Koopman-based techniques like extended Dynamic Mode Decomposition are nowadays ubiquitous in the data-driven approximation of dynamical systems, quantitative error estimates were only recently established. To this end, both sources of error resulting from a finite dictionary and only finitely-many data points in the generation of the surrogate model have to be taken into account. We generali…
▽ More
While Koopman-based techniques like extended Dynamic Mode Decomposition are nowadays ubiquitous in the data-driven approximation of dynamical systems, quantitative error estimates were only recently established. To this end, both sources of error resulting from a finite dictionary and only finitely-many data points in the generation of the surrogate model have to be taken into account. We generalize the rigorous analysis of the approximation error to the control setting while simultaneously reducing the impact of the curse of dimensionality by using a recently proposed bilinear approach. In particular, we establish uniform bounds on the approximation error of state-dependent quantities like constraints or a performance index enabling data-based optimal and predictive control with guarantees.
△ Less
Submitted 13 November, 2022; v1 submitted 18 February, 2022;
originally announced February 2022.
-
Willems' fundamental lemma for linear descriptor systems and its use for data-driven output-feedback MPC
Authors:
Philipp Schmitz,
Timm Faulwasser,
Karl Worthmann
Abstract:
In this paper we investigate data-driven predictive control of discrete-time linear descriptor systems. Specifically, we give a tailored variant of Willems' fundamental lemma, which shows that for descriptor systems the non-parametric modelling via a Hankel matrix requires less data compared to linear time-invariant systems without algebraic constraints. Moreover, we use this description to propos…
▽ More
In this paper we investigate data-driven predictive control of discrete-time linear descriptor systems. Specifically, we give a tailored variant of Willems' fundamental lemma, which shows that for descriptor systems the non-parametric modelling via a Hankel matrix requires less data compared to linear time-invariant systems without algebraic constraints. Moreover, we use this description to propose a data-driven framework for optimal control and predictive control of discrete-time linear descriptor systems. For the latter, we provide a sufficient stability condition for receding-horizon control before we illustrate our findings with an example.
△ Less
Submitted 16 February, 2022;
originally announced February 2022.
-
Model predictive control for singular differential-algebraic equations
Authors:
Achim Ilchmann,
Jonas Witschel,
Karl Worthmann
Abstract:
We study model predictive control for singular differential-algebraic equations with higher index. This is a novelty when compared to the literature where only regular differential-algebraic equations with additional assumptions on the index and/or controllability are considered. By regularization techniques, we are able to derive an equivalent optimal control problem for an ordinary differential…
▽ More
We study model predictive control for singular differential-algebraic equations with higher index. This is a novelty when compared to the literature where only regular differential-algebraic equations with additional assumptions on the index and/or controllability are considered. By regularization techniques, we are able to derive an equivalent optimal control problem for an ordinary differential equation to which well-known model predictive control techniques can be applied. This allows the construction of terminal constraints and costs such that the origin is asymptotically stable w.r.t. the resulting closed-loop system.
△ Less
Submitted 7 February, 2022;
originally announced February 2022.
-
Model Predictive Control Tailored to Epidemic Models
Authors:
Philipp Sauerteig,
Willem Esterhuizen,
Mitsuru Wilson,
Tobias K. S. Ritschel,
Karl Worthmann,
Stefan Streif
Abstract:
We propose a model predictive control (MPC) approach for minimising the social distancing and quarantine measures during a pandemic while maintaining a hard infection cap. To this end, we study the admissible and the maximal robust positively invariant set (MRPI) of the standard SEIR compartmental model with control inputs. Exploiting the fact that in the MRPI all restrictions can be lifted withou…
▽ More
We propose a model predictive control (MPC) approach for minimising the social distancing and quarantine measures during a pandemic while maintaining a hard infection cap. To this end, we study the admissible and the maximal robust positively invariant set (MRPI) of the standard SEIR compartmental model with control inputs. Exploiting the fact that in the MRPI all restrictions can be lifted without violating the infection cap, we choose a suitable subset of the MRPI to define terminal constraints in our MPC routine and show that the number of infected people decays exponentially within this set. Furthermore, under mild assumptions we prove existence of a uniform bound on the time required to reach this terminal region (without violating the infection cap) starting in the admissible set. The findings are substantiated based on a numerical case study.
△ Less
Submitted 4 May, 2022; v1 submitted 12 November, 2021;
originally announced November 2021.
-
Finite-data error bounds for Koopman-based prediction and control
Authors:
Feliks Nüske,
Sebastian Peitz,
Friedrich Philipp,
Manuel Schaller,
Karl Worthmann
Abstract:
The Koopman operator has become an essential tool for data-driven approximation of dynamical (control) systems, e.g., via extended dynamic mode decomposition. Despite its popularity, convergence results and, in particular, error bounds are still scarce. In this paper, we derive probabilistic bounds for the approximation error and the prediction error depending on the number of training data points…
▽ More
The Koopman operator has become an essential tool for data-driven approximation of dynamical (control) systems, e.g., via extended dynamic mode decomposition. Despite its popularity, convergence results and, in particular, error bounds are still scarce. In this paper, we derive probabilistic bounds for the approximation error and the prediction error depending on the number of training data points; for both ordinary and stochastic differential equations while using either ergodic trajectories or i.i.d. samples. We illustrate these bounds by means of an example with the Ornstein-Uhlenbeck process. Moreover, we extend our analysis to (stochastic) nonlinear control-affine systems. We prove error estimates for a previously proposed approach that exploits the linearity of the Koopman generator to obtain a bilinear surrogate control system and, thus, circumvents the curse of dimensionality since the system is not autonomized by augmenting the state by the control inputs. To the best of our knowledge, this is the first finite-data error analysis in the stochastic and/or control setting. Finally, we demonstrate the effectiveness of the bilinear approach by comparing it with state-of-the-art techniques showing its superiority whenever state and control are coupled.
△ Less
Submitted 15 February, 2022; v1 submitted 16 August, 2021;
originally announced August 2021.
-
Funnel MPC for nonlinear systems with relative degree one
Authors:
Thomas Berger,
Dario Dennstädt,
Achim Ilchmann,
Karl Worthmann
Abstract:
We show that Funnel MPC, a novel Model Predictive Control (MPC) scheme, allows tracking of smooth reference signals with prescribed performance for nonlinear multi-input multi-output systems of relative degree one with stable internal dynamics. The optimal control problem solved in each iteration of Funnel MPC resembles the basic idea of penalty methods used in optimization. To this end, we presen…
▽ More
We show that Funnel MPC, a novel Model Predictive Control (MPC) scheme, allows tracking of smooth reference signals with prescribed performance for nonlinear multi-input multi-output systems of relative degree one with stable internal dynamics. The optimal control problem solved in each iteration of Funnel MPC resembles the basic idea of penalty methods used in optimization. To this end, we present a new stage cost design to mimic the high-gain idea of (adaptive) funnel control. We rigorously show initial and recursive feasibility of Funnel MPC without imposing terminal conditions or other requirements like a sufficiently long prediction horizon.
△ Less
Submitted 16 March, 2022; v1 submitted 7 July, 2021;
originally announced July 2021.
-
Optimal control of port-Hamiltonian descriptor systems with minimal energy supply
Authors:
Timm Faulwasser,
Bernhard Maschke,
Friedrich Philipp,
Manuel Schaller,
Karl Worthmann
Abstract:
We consider the singular optimal control problem of minimizing the energy supply of linear dissipative port-Hamiltonian descriptor systems subject to control and terminal state constraints. To this end, after reducing the problem to an ODE with feed-through term, we derive an input-state turnpike towards a subspace for optimal control of generalized port-Hamiltonian ordinary differential equations…
▽ More
We consider the singular optimal control problem of minimizing the energy supply of linear dissipative port-Hamiltonian descriptor systems subject to control and terminal state constraints. To this end, after reducing the problem to an ODE with feed-through term, we derive an input-state turnpike towards a subspace for optimal control of generalized port-Hamiltonian ordinary differential equations. We study the reachability properties of the system and prove that optimal states exhibit a turnpike behavior with respect to the conservative subspace. By means of the port-Hamiltonian structure, we show that, despite control constraints, this turnpike property is global in the initial state. Further, we characterize the class of dissipative Hamiltonian matrices and pencils.
△ Less
Submitted 15 February, 2022; v1 submitted 11 June, 2021;
originally announced June 2021.
-
Minimizing the energy supply of infinite-dimensional linear port-Hamiltonian systems
Authors:
Friedrich Philipp,
Manuel Schaller,
Timm Faulwasser,
Bernhard Maschke,
Karl Worthmann
Abstract:
We consider the problem of minimizing the supplied energy of infinite-dimensional linear port-Hamiltonian systems and prove that optimal trajectories exhibit the turnpike phenomenon towards certain subspaces induced by the dissipation of the dynamics.
We consider the problem of minimizing the supplied energy of infinite-dimensional linear port-Hamiltonian systems and prove that optimal trajectories exhibit the turnpike phenomenon towards certain subspaces induced by the dissipation of the dynamics.
△ Less
Submitted 9 May, 2021;
originally announced May 2021.
-
Manifold Turnpikes, Trims and Symmetries
Authors:
Timm Faulwasser,
Kathrin Flaßkamp,
Sina Ober-Blöbaum,
Manuel Schaller,
Karl Worthmann
Abstract:
Classical turnpikes correspond to optimal steady states which are attractors of optimal control problems. In this paper, motivated by mechanical systems with symmetries, we generalize this concept to manifold turnpikes. Specifically, the necessary optimality conditions on a symmetry-induced manifold coincide with those of a reduced-order problem under certain conditions. We also propose sufficient…
▽ More
Classical turnpikes correspond to optimal steady states which are attractors of optimal control problems. In this paper, motivated by mechanical systems with symmetries, we generalize this concept to manifold turnpikes. Specifically, the necessary optimality conditions on a symmetry-induced manifold coincide with those of a reduced-order problem under certain conditions. We also propose sufficient conditions for the existence of manifold turnpikes based on a tailored notion of dissipativity with respect to manifolds. We show how the classical Legendre transformation between Euler-Lagrange and Hamilton formalisms can be extended to the adjoint variables. Finally, we draw upon the Kepler problem to illustrate our findings.
△ Less
Submitted 7 April, 2021;
originally announced April 2021.
-
On MPC without terminal conditions for dynamic non-holonomic robots
Authors:
Franz Rußwurm,
Willem Esterhuizen,
Karl Worthmann,
Stefan Streif
Abstract:
We consider an input-constrained differential-drive robot with actuator dynamics. For this system, we establish asymptotic stability of the origin on arbitrary compact, convex sets using Model Predictive Control (MPC) without stabilizing terminal conditions despite the presence of state constraints and actuator dynamics. We note that the problem without those two additional ingredients was essenti…
▽ More
We consider an input-constrained differential-drive robot with actuator dynamics. For this system, we establish asymptotic stability of the origin on arbitrary compact, convex sets using Model Predictive Control (MPC) without stabilizing terminal conditions despite the presence of state constraints and actuator dynamics. We note that the problem without those two additional ingredients was essentially solved beforehand, despite the fact that the linearization is not stabilizable. We propose an approach successfully solving the task at hand by combining the theory of barriers to characterize the viability kernel and an MPC framework based on so-called cost controllability. Moreover, we present a numerical case study to derive quantitative bounds on the required length of the prediction horizon. To this end, we investigate the boundary of the viability kernel and a neighbourhood of the origin, i.e. the most interesting areas.
△ Less
Submitted 3 June, 2021; v1 submitted 18 February, 2021;
originally announced February 2021.
-
Control of port-Hamiltonian systems with minimal energy supply
Authors:
Manuel Schaller,
Friedrich Philipp,
Timm Faulwasser,
Karl Worthmann,
Bernhard Maschke
Abstract:
We investigate optimal control of linear port-Hamiltonian systems with control constraints, in which one aims to perform a state transition with minimal energy supply. Decomposing the state space into dissipative and non-dissipative (i.e. conservative) subspaces, we show that the set of reachable states is bounded w.r.t. the dissipative subspace. We prove that the optimal control problem exhibits…
▽ More
We investigate optimal control of linear port-Hamiltonian systems with control constraints, in which one aims to perform a state transition with minimal energy supply. Decomposing the state space into dissipative and non-dissipative (i.e. conservative) subspaces, we show that the set of reachable states is bounded w.r.t. the dissipative subspace. We prove that the optimal control problem exhibits the turnpike property with respect to the non-dissipative subspace, i.e., for varying initial conditions and time horizons optimal state trajectories evolve close to the conservative subspace most of the time. We analyze the corresponding steady-state optimization problem and prove that all optimal steady states lie in the non-dissipative subspace. We conclude this paper by illustrating these results by a numerical example from mechanics.
△ Less
Submitted 12 April, 2021; v1 submitted 20 November, 2020;
originally announced November 2020.
-
How much testing and social distancing is required to control COVID-19? Some insight based on an age-differentiated compartmental model
Authors:
Sara Grundel,
Stefan Heyder,
Thomas Hotz,
Tobias K. S. Ritschel,
Philipp Sauerteig,
Karl Worthmann
Abstract:
In this paper, we provide insights on how much testing and social distancing is required to control COVID-19. To this end, we develop a compartmental model that accounts for key aspects of the disease: 1) incubation time, 2) age-dependent symptom severity, and 3) testing and hospitalization delays; the model's parameters are chosen based on medical evidence, and, for concreteness, adapted to the G…
▽ More
In this paper, we provide insights on how much testing and social distancing is required to control COVID-19. To this end, we develop a compartmental model that accounts for key aspects of the disease: 1) incubation time, 2) age-dependent symptom severity, and 3) testing and hospitalization delays; the model's parameters are chosen based on medical evidence, and, for concreteness, adapted to the German situation. Then, optimal mass-testing and age-dependent social-distancing policies are determined by solving optimal control problems both in open loop and within a model predictive control framework. We aim to minimize testing and/or social distancing until herd immunity sets in under a constraint on the number of available intensive care units. We find that an early and short lockdown is inevitable but can be slowly relaxed over the following months.
△ Less
Submitted 2 November, 2020;
originally announced November 2020.
-
Distributed Optimization using ALADIN for MPC in Smart Grids
Authors:
Yuning Jiang,
Philipp Sauerteig,
Boris Houska,
Karl Worthmann
Abstract:
This paper presents a distributed optimization algorithm tailored to solve optimization problems arising in smart grids. In detail, we propose a variant of the Augmented Lagrangian based Alternating Direction Inexact Newton (ALADIN) method, which comes along with global convergence guarantees for the considered class of linear-quadratic optimization problems. We establish local quadratic convergen…
▽ More
This paper presents a distributed optimization algorithm tailored to solve optimization problems arising in smart grids. In detail, we propose a variant of the Augmented Lagrangian based Alternating Direction Inexact Newton (ALADIN) method, which comes along with global convergence guarantees for the considered class of linear-quadratic optimization problems. We establish local quadratic convergence of the proposed scheme and elaborate its advantages compared to the Alternating Direction Method of Multipliers (ADMM). In particular, we show that, at the cost of more communication, ALADIN requires fewer iterations to achieve the desired accuracy. Furthermore, it is numerically demonstrated that the number of iterations is independent of the number of subsystems. The effectiveness of the proposed scheme is illustrated by running both an ALADIN and an ADMM based model predictive controller on a benchmark case study.
△ Less
Submitted 3 April, 2020;
originally announced April 2020.
-
Recursive feasibility of continuous-time model predictive control without stabilising constraints
Authors:
Willem Esterhuizen,
Karl Worthmann,
Stefan Streif
Abstract:
We consider sampled-data Model Predictive Control (MPC) of nonlinear continuous-time control systems. We derive sufficient conditions to guarantee recursive feasibility and asymptotic stability without stabilising costs and/or constraints. Moreover, we present formulas to explicitly estimate the required length of the prediction horizon based on the concept of (local) cost controllability. For the…
▽ More
We consider sampled-data Model Predictive Control (MPC) of nonlinear continuous-time control systems. We derive sufficient conditions to guarantee recursive feasibility and asymptotic stability without stabilising costs and/or constraints. Moreover, we present formulas to explicitly estimate the required length of the prediction horizon based on the concept of (local) cost controllability. For the linear-quadratic case, cost controllability can be inferred from standard assumptions. In addition, we extend results on the relationship between the horizon length and the distance of the initial state to the boundary of the viability kernel from the discrete-time to the continuous-time setting.
△ Less
Submitted 2 March, 2021; v1 submitted 17 March, 2020;
originally announced March 2020.
-
A Dissipativity Characterization of Velocity Turnpikes in Optimal Control Problems for Mechanical Systems
Authors:
Timm Faulwasser,
Kathrin Flaßkamp,
Sina Ober-Blöbaum,
Karl Worthmann
Abstract:
Turnpikes have recently gained significant research interest in optimal control, since they allow for pivotal insights into the structure of solutions to optimal control problems. So far, mainly steady state solutions which serve as optimal operation points, are studied. This is in contrast to time-varying turnpikes, which are in the focus of this paper. More concretely, we analyze symmetry-induce…
▽ More
Turnpikes have recently gained significant research interest in optimal control, since they allow for pivotal insights into the structure of solutions to optimal control problems. So far, mainly steady state solutions which serve as optimal operation points, are studied. This is in contrast to time-varying turnpikes, which are in the focus of this paper. More concretely, we analyze symmetry-induced velocity turnpikes, i.e. controlled relative equilibria, called trim primitives, which are optimal operation points regarding the given cost criterion. We characterize velocity turnpikes by means of dissipativity inequalities. Moreover, we study the equivalence between optimal control problems and steady-state problems via the corresponding necessary optimality conditions. An academic example is given for illustration.
△ Less
Submitted 11 February, 2020;
originally announced February 2020.
-
Distributed Control Enforcing Group Sparsity in Smart Grids
Authors:
Philipp Sauerteig,
Yuning Jiang,
Boris Houska,
Karl Worthmann
Abstract:
In modern smart grids, charging of local energy storage devices is coordinated on a residential level to compensate the volatile aggregated power demand on the time interval of interest. However, this results in a perpetual usage of all batteries which reduces their lifetime. We enforce group sparsity by using an $\ell_{p,q}$-regularization on the control to counteract this phenomenon. This leads…
▽ More
In modern smart grids, charging of local energy storage devices is coordinated on a residential level to compensate the volatile aggregated power demand on the time interval of interest. However, this results in a perpetual usage of all batteries which reduces their lifetime. We enforce group sparsity by using an $\ell_{p,q}$-regularization on the control to counteract this phenomenon. This leads to a non-smooth convex optimization problem, for which we propose a tailored Alternating Direction Method of Multipliers algorithm. We elaborate further how to embed it in a Model Predictive Control framework. We show that the proposed scheme yields sparse control while achieving reasonable overall peak shaving by numerical simulations.
△ Less
Submitted 9 February, 2020;
originally announced February 2020.
-
Learning-based Funnel-MPC for output-constrained nonlinear systems
Authors:
Thomas Berger,
Carolin Kästner,
Karl Worthmann
Abstract:
We exploit an adaptive control technique, namely funnel control, in order to establish both initial and recursive feasibility in Model Predictive Control (MPC) for output-constrained nonlinear systems. Moreover, we show that the resulting feedback controller outperforms the funnel controller both w.r.t. the required sampling rate for a zero-order-hold implementation and required control action. We…
▽ More
We exploit an adaptive control technique, namely funnel control, in order to establish both initial and recursive feasibility in Model Predictive Control (MPC) for output-constrained nonlinear systems. Moreover, we show that the resulting feedback controller outperforms the funnel controller both w.r.t. the required sampling rate for a zero-order-hold implementation and required control action. We further propose a combination of funnel control and MPC, exploiting the performance guarantees of the model-free funnel controller during a learning phase and the advantages of the model-based MPC scheme thereafter.
△ Less
Submitted 4 December, 2019;
originally announced December 2019.
-
Surrogate Models in Bidirectional Optimization of Coupled Microgrids
Authors:
Manuel Baumann,
Sara Grundel,
Philipp Sauerteig,
Karl Worthmann
Abstract:
The energy transition entails a rapid uptake of renewable energy sources. Besides physical changes within the grid infrastructure, energy storage devices and their smart operation are key measures to master the resulting challenges like, e.g., a highly fluctuating power generation. For the latter, optimization based control has demonstrated its potential on a microgrid level. However, if a network…
▽ More
The energy transition entails a rapid uptake of renewable energy sources. Besides physical changes within the grid infrastructure, energy storage devices and their smart operation are key measures to master the resulting challenges like, e.g., a highly fluctuating power generation. For the latter, optimization based control has demonstrated its potential on a microgrid level. However, if a network of coupled microgrids is considered, iterative optimization schemes including several communication rounds are typically used. Here, we propose to replace the optimization on the microgrid level by using surrogate models either derived from radial basis functions or neural networks to avoid this iterative procedure. We prove well-posedness of our approach and demonstrate its efficiency by numerical simulations based on real data provided by an Australian grid operator.
△ Less
Submitted 11 November, 2019;
originally announced November 2019.
-
Towards multiobjective optimization and control of smart grids
Authors:
Philipp Sauerteig,
Karl Worthmann
Abstract:
The rapid uptake of renewable energy sources in the electricity grid leads to a demand in load sha** and flexibility. Energy storage devices such as batteries are a key element to provide solutions to these tasks. However, typically a trade-off between the performance related goal of load sha** and the objective of having flexibility in store for auxiliary services, which is for example linked…
▽ More
The rapid uptake of renewable energy sources in the electricity grid leads to a demand in load sha** and flexibility. Energy storage devices such as batteries are a key element to provide solutions to these tasks. However, typically a trade-off between the performance related goal of load sha** and the objective of having flexibility in store for auxiliary services, which is for example linked to robustness and resilience of the grid, can be observed. We propose to make use of the concept of Pareto optimality in order to resolve this issue in a multiobjective framework. In particular, we analyse the Pareto frontier and quantify the trade-off between the non-aligned objectives to properly balance them.
△ Less
Submitted 15 July, 2019; v1 submitted 12 July, 2019;
originally announced July 2019.
