-
Towards Safe Multi-Task Bayesian Optimization
Authors:
Jannis O. Lübsen,
Christian Hespe,
Annika Eichler
Abstract:
Bayesian optimization has emerged as a highly effective tool for the safe online optimization of systems, due to its high sample efficiency and noise robustness. To further enhance its efficiency, reduced physical models of the system can be incorporated into the optimization process, accelerating it. These models are able to offer an approximation of the actual system, and evaluating them is sign…
▽ More
Bayesian optimization has emerged as a highly effective tool for the safe online optimization of systems, due to its high sample efficiency and noise robustness. To further enhance its efficiency, reduced physical models of the system can be incorporated into the optimization process, accelerating it. These models are able to offer an approximation of the actual system, and evaluating them is significantly cheaper. The similarity between the model and reality is represented by additional hyperparameters, which are learned within the optimization process. Safety is a crucial criterion for online optimization methods such as Bayesian optimization, which has been addressed by recent works that provide safety guarantees under the assumption of known hyperparameters. In practice, however, this does not apply. Therefore, we extend the robust Gaussian process uniform error bounds to meet the multi-task setting, which involves the calculation of a confidence region from the hyperparameter posterior distribution utilizing Markov chain Monte Carlo methods. Subsequently, the robust safety bounds are employed to facilitate the safe optimization of the system, while incorporating measurements of the models. Simulation results indicate that the optimization can be significantly accelerated for expensive to evaluate functions in comparison to other state-of-the-art safe Bayesian optimization methods, contingent on the fidelity of the models.
△ Less
Submitted 17 June, 2024; v1 submitted 12 December, 2023;
originally announced December 2023.
-
Structured IQC Synthesis of Robust $\mathcal{H}_2$ Controllers in the Frequency Domain
Authors:
Maximilian Schütte,
Annika Eichler,
Herbert Werner
Abstract:
The problem of robust controller synthesis for plants affected by structured uncertainty, captured by integral quadratic constraints, is discussed. The solution is optimized towards a worst-case white noise rejection specification, which is a generalization of the standard $\mathcal{H}_2$-norm to the robust setting including possibly non-LTI uncertainty. Arbitrary structural constraints can be imp…
▽ More
The problem of robust controller synthesis for plants affected by structured uncertainty, captured by integral quadratic constraints, is discussed. The solution is optimized towards a worst-case white noise rejection specification, which is a generalization of the standard $\mathcal{H}_2$-norm to the robust setting including possibly non-LTI uncertainty. Arbitrary structural constraints can be imposed on the control solution, making this method suitable for distributed systems. The nonsmooth optimization algorithm used to solve the robust synthesis problem operates directly in the frequency domain, eliminating scalability issues for complex systems and providing local optimality certificates. The method is evaluated using a literature example and a real-world system using a novel implementation of a robust $\mathcal{H}_2$-performance bound.
△ Less
Submitted 2 December, 2023; v1 submitted 11 April, 2023;
originally announced April 2023.
-
Online Computation of Terminal Ingredients in Distributed Model Predictive Control for Reference Tracking
Authors:
Ahmed Aboudonia,
Goran Banjac,
Annika Eichler,
John Lygeros
Abstract:
A distributed model predictive control scheme is developed for tracking piecewise constant references where the terminal set is reconfigured online, whereas the terminal controller is computed offline. Unlike many standard existing schemes, this scheme yields large feasible regions without performing offline centralized computations. Although the resulting optimal control problem (OCP) is a semide…
▽ More
A distributed model predictive control scheme is developed for tracking piecewise constant references where the terminal set is reconfigured online, whereas the terminal controller is computed offline. Unlike many standard existing schemes, this scheme yields large feasible regions without performing offline centralized computations. Although the resulting optimal control problem (OCP) is a semidefinite program (SDP), an SDP scalability method based on diagonal dominance is used to approximate the derived SDP by a second-order cone program. The OCPs of the proposed scheme and its approximation are amenable to distributed optimization. Both schemes are evaluated using a power network example and compared to a scheme where the terminal controller is reconfigured online as well. It is found that fixing the terminal controller results in better performance, noticeable reduction in computational cost and similar feasible region compared to the case in which this controller is reconfigured online.
△ Less
Submitted 19 July, 2022;
originally announced July 2022.
-
Multiperiod Stochastic Peak Shaving Using Storage
Authors:
Benjamin Flamm,
Guillermo Ramos,
Annika Eichler,
John Lygeros
Abstract:
We present an online stochastic model predictive control framework for demand charge management for a grid-connected consumer with attached electrical energy storage. The consumer we consider must satisfy an inflexible but stochastic electricity demand, and also receives a stochastic electricity inflow. The optimization problem formulated solves a stochastic cost minimization problem, with given w…
▽ More
We present an online stochastic model predictive control framework for demand charge management for a grid-connected consumer with attached electrical energy storage. The consumer we consider must satisfy an inflexible but stochastic electricity demand, and also receives a stochastic electricity inflow. The optimization problem formulated solves a stochastic cost minimization problem, with given weather forecast scenarios converted into forecast demand and inflow. We introduce a novel weighting scheme to account for cases where the optimization horizon spans multiple demand charge periods. The optimization scheme is tested in a setting with building demand and photovoltaic array inflow data from a real office building. The simulation study allows us to compare various design and modeling alternatives, ultimately proposing a policy based on causal affine decision rules.
△ Less
Submitted 6 July, 2020;
originally announced July 2020.
-
Distributed Model Predictive Control with Reconfigurable Terminal Ingredients for Reference Tracking
Authors:
Ahmed Aboudonia,
Annika Eichler,
Francesco Cordiano,
Goran Banjac,
John Lygeros
Abstract:
Various efforts have been devoted to develo** stabilizing distributed Model Predictive Control (MPC) schemes for tracking piecewise constant references. In these schemes, terminal sets are usually computed offline and used in the MPC online phase to guarantee recursive feasibility and asymptotic stability. Maximal invariant terminal sets do not necessarily respect the distributed structure of th…
▽ More
Various efforts have been devoted to develo** stabilizing distributed Model Predictive Control (MPC) schemes for tracking piecewise constant references. In these schemes, terminal sets are usually computed offline and used in the MPC online phase to guarantee recursive feasibility and asymptotic stability. Maximal invariant terminal sets do not necessarily respect the distributed structure of the network, hindering the distributed implementation of the controller. On the other hand, ellipsoidal terminal sets respect the distributed structure, but may lead to conservative schemes. In this paper, a novel distributed MPC scheme is proposed for reference tracking of networked dynamical systems where the terminal ingredients are reconfigured online depending on the closed-loop states to alleviate the aforementioned issues. The resulting non-convex infinite-dimensional problem is approximated using a quadratic program. The proposed scheme is tested in simulation where the proposed MPC problem is solved using distributed optimization.
△ Less
Submitted 27 October, 2021; v1 submitted 1 July, 2020;
originally announced July 2020.
-
Distributed Model Predictive Control with Asymmetric Adaptive Terminal Sets for the Regulation of Large-scale Systems
Authors:
Ahmed Aboudonia,
Annika Eichler,
John Lygeros
Abstract:
In this paper, a novel distributed model predictive control (MPC) scheme with asymmetric adaptive terminal sets is developed for the regulation of large-scale systems with a distributed structure. Similar to typical MPC schemes, a structured Lyapunov matrix and a distributed terminal controller, respecting the distributed structure of the system, are computed offline. However, in this scheme, a di…
▽ More
In this paper, a novel distributed model predictive control (MPC) scheme with asymmetric adaptive terminal sets is developed for the regulation of large-scale systems with a distributed structure. Similar to typical MPC schemes, a structured Lyapunov matrix and a distributed terminal controller, respecting the distributed structure of the system, are computed offline. However, in this scheme, a distributed positively invariant terminal set is computed online and updated at each time instant taking into consideration the current state of the system. In particular, we consider ellipsoidal terminal sets as they are easy to compute for large-scale systems. The size and the center of these terminal sets, together with the predicted state and input trajectories, are considered as decision variables in the online phase. Determining the terminal set center online is found to be useful specifically in the presence of asymmetric constraints. Finally, a relaxation of the resulting online optimal control problem is provided. The efficacy of the proposed scheme is illustrated in simulation by comparing it to a recent distributed MPC scheme with adaptive terminal sets.
△ Less
Submitted 8 May, 2020;
originally announced May 2020.
-
Distributed Control Design for Heterogeneous Interconnected Systems
Authors:
Yvonne R. Stürz,
Annika Eichler,
Roy S. Smith
Abstract:
This paper presents scalable controller synthesis methods for heterogeneous and partially heterogeneous systems. First, heterogeneous systems composed of different subsystems that are interconnected over a directed graph are considered. Techniques from robust and gain-scheduled controller synthesis are employed, in particular the full-block S-procedure, to deal with the decentralized system part i…
▽ More
This paper presents scalable controller synthesis methods for heterogeneous and partially heterogeneous systems. First, heterogeneous systems composed of different subsystems that are interconnected over a directed graph are considered. Techniques from robust and gain-scheduled controller synthesis are employed, in particular the full-block S-procedure, to deal with the decentralized system part in a nominal condition and with the interconnection part in a multiplier condition. Under some structural assumptions, we can decompose the synthesis conditions into conditions that are the size of the individual subsystems. To solve these decomposed synthesis conditions that are coupled only over neighboring subsystems, we propose a distributed method based on the alternating direction method of multipliers. It only requires nearest-neighbor communication and no central coordination is needed. Then, a new classification of systems is introduced that consists of groups of homogeneous subsystems with different interconnection types. This classification includes heterogeneous systems as the most general and homogeneous systems as the most specific case. Based on this classification, we show how the interconnected system model and the decomposed synthesis conditions can be formulated in a more compact way. The computational scalability of the presented methods with respect to a growing number of subsystems and interconnections is analyzed, and the results are demonstrated in numerical examples.
△ Less
Submitted 9 April, 2020;
originally announced April 2020.
-
Distributed Model Predictive Control for Linear Systems with Adaptive Terminal Sets
Authors:
Georgios Darivianakis,
Annika Eichler,
John Lygeros
Abstract:
In this paper, we propose a distributed model predictive control (DMPC) scheme for linear time-invariant constrained systems which admit a separable structure. To exploit the merits of distributed computation algorithms, the stabilizing terminal controller, value function and invariant terminal set of the DMPC optimization problem need to respect the loosely coupled structure of the system. Althou…
▽ More
In this paper, we propose a distributed model predictive control (DMPC) scheme for linear time-invariant constrained systems which admit a separable structure. To exploit the merits of distributed computation algorithms, the stabilizing terminal controller, value function and invariant terminal set of the DMPC optimization problem need to respect the loosely coupled structure of the system. Although existing methods in the literature address this task, they typically decouple the synthesis of terminal controllers and value functions from the one of terminal sets. In addition, these approaches do not explicitly consider the effect of the current state of the system in the synthesis process. These limitations can lead the resulting DMPC scheme to poor performance since it may admit small or even empty terminal sets. Unlike other approaches, this paper presents a unified framework to encapsulate the synthesis of both the stabilizing terminal controller and invariant terminal set into the DMPC formulation. Conditions for Lyapunov stability and invariance are imposed in the synthesis problem in a way that allows the value function and invariant terminal set to admit the desired distributed structure. We illustrate the effectiveness of the proposed method on several examples including a benchmark spring-mass-damper problem.
△ Less
Submitted 20 March, 2018;
originally announced March 2018.
