Showing 1–31 of 31 results for author: Ebenbauer, C

Flexible-step MPC for Switched Linear Systems with No Quadratic Common Lyapunov Function

Authors: Annika Fürnsinn, Christian Ebenbauer, Bahman Gharesifard

Abstract: In this paper, we develop a systematic method for constructing a generalized discrete-time control Lyapunov function for the flexible-step Model Predictive Control (MPC) scheme, recently introduced in [3], when restricted to the class of linear systems. Specifically, we show that a set of Linear Matrix Inequalities (LMIs) can be used for this purpose, demonstrating its tractability. The main conse… ▽ More In this paper, we develop a systematic method for constructing a generalized discrete-time control Lyapunov function for the flexible-step Model Predictive Control (MPC) scheme, recently introduced in [3], when restricted to the class of linear systems. Specifically, we show that a set of Linear Matrix Inequalities (LMIs) can be used for this purpose, demonstrating its tractability. The main consequence of this LMI formulation is that, when combined with flexible-step MPC, we can effectively stabilize switched control systems, for which no quadratic common Lyapunov function exists. △ Less

Submitted 11 April, 2024; originally announced April 2024.

On moment relaxations for linear state feedback controller synthesis with non-convex quadratic costs and constraints

Authors: Dennis Gramlich, Sheng Gao, Hao Zhang, Carsten W. Scherer, Christian Ebenbauer

Abstract: We present a simple and effective way to account for non-convex costs and constraints~in~state feedback synthesis, and an interpretation for the variables in which state feedback synthesis is typically convex. We achieve this by deriving the controller design using moment matrices of state and input. It turns out that this approach allows the consideration of non-convex constraints by relaxing the… ▽ More We present a simple and effective way to account for non-convex costs and constraints~in~state feedback synthesis, and an interpretation for the variables in which state feedback synthesis is typically convex. We achieve this by deriving the controller design using moment matrices of state and input. It turns out that this approach allows the consideration of non-convex constraints by relaxing them as expectation constraints, and that the variables in which state feedback synthesis is typically convexified can be identified with blocks of these moment matrices. △ Less

Submitted 22 March, 2024; originally announced March 2024.

Comments: Preprent to be submitted to IEEE Conference on Decision and Control

Synthesis of constrained robust feedback policies and model predictive control

Authors: Dennis Gramlich, Carsten W. Scherer, Hannah Häring, Christian Ebenbauer

Abstract: In this work, we develop a method based on robust control techniques to synthesize robust time-varying state-feedback policies for finite, infinite, and receding horizon control problems subject to convex quadratic state and input constraints. To ensure constraint satisfaction of our policy, we employ (initial state)-to-peak gain techniques. Based on this idea, we formulate linear matrix inequalit… ▽ More In this work, we develop a method based on robust control techniques to synthesize robust time-varying state-feedback policies for finite, infinite, and receding horizon control problems subject to convex quadratic state and input constraints. To ensure constraint satisfaction of our policy, we employ (initial state)-to-peak gain techniques. Based on this idea, we formulate linear matrix inequality conditions, which are simultaneously convex in the parameters of an affine control policy, a Lyapunov function along the trajectory and multiplier variables for the uncertainties in a time-varying linear fractional transformation model. In our experiments this approach is less conservative than standard tube-based robust model predictive control methods. △ Less

Submitted 18 October, 2023; v1 submitted 17 October, 2023; originally announced October 2023.

Comments: Extended version of a contribution to be submitted to the European Control Conference 2024

Optimization Algorithm Synthesis based on Integral Quadratic Constraints: A Tutorial

Authors: Carsten W. Scherer, Christian Ebenbauer, Tobias Holicki

Abstract: We expose in a tutorial fashion the mechanisms which underlie the synthesis of optimization algorithms based on dynamic integral quadratic constraints. We reveal how these tools from robust control allow to design accelerated gradient descent algorithms with optimal guaranteed convergence rates by solving small-sized convex semi-definite programs. It is shown that this extends to the design of ext… ▽ More We expose in a tutorial fashion the mechanisms which underlie the synthesis of optimization algorithms based on dynamic integral quadratic constraints. We reveal how these tools from robust control allow to design accelerated gradient descent algorithms with optimal guaranteed convergence rates by solving small-sized convex semi-definite programs. It is shown that this extends to the design of extremum controllers, with the goal to regulate the output of a general linear closed-loop system to the minimum of an objective function. Numerical experiments illustrate that we can not only recover gradient decent and the triple momentum variant of Nesterov's accelerated first order algorithm, but also automatically synthesize optimal algorithms even if the gradient information is passed through non-trivial dynamics, such as time-delays. △ Less

Submitted 15 September, 2023; v1 submitted 1 June, 2023; originally announced June 2023.

Comments: A short version of this paper has been accepted for publication at the CDC 2023

A structure exploiting SDP solver for robust controller synthesis

Authors: Dennis Gramlich, Tobias Holicki, Carsten W. Scherer, Christian Ebenbauer

Abstract: In this paper, we revisit structure exploiting SDP solvers dedicated to the solution of Kalman-Yakubovic-Popov semi-definite programs (KYP-SDPs). These SDPs inherit their name from the KYP Lemma and they play a crucial role in e.g. robustness analysis, robust state feedback synthesis, and robust estimator synthesis for uncertain dynamical systems. Off-the-shelve SDP solvers require $O(n^6)$ arithm… ▽ More In this paper, we revisit structure exploiting SDP solvers dedicated to the solution of Kalman-Yakubovic-Popov semi-definite programs (KYP-SDPs). These SDPs inherit their name from the KYP Lemma and they play a crucial role in e.g. robustness analysis, robust state feedback synthesis, and robust estimator synthesis for uncertain dynamical systems. Off-the-shelve SDP solvers require $O(n^6)$ arithmetic operations per Newton step to solve this class of problems, where $n$ is the state dimension of the dynamical system under consideration. Specialized solvers reduce this complexity to $O(n^3)$. However, existing specialized solvers do not include semi-definite constraints on the Lyapunov matrix, which is necessary for controller synthesis. In this paper, we show how to include such constraints in structure exploiting KYP-SDP solvers. △ Less

Submitted 11 April, 2023; originally announced April 2023.

Comments: Submitted to Conference on Decision and Control, copyright owned by ieee

Convolutional Neural Networks as 2-D systems

Authors: Dennis Gramlich, Patricia Pauli, Carsten W. Scherer, Frank Allgöwer, Christian Ebenbauer

Abstract: This paper introduces a novel representation of convolutional Neural Networks (CNNs) in terms of 2-D dynamical systems. To this end, the usual description of convolutional layers with convolution kernels, i.e., the impulse responses of linear filters, is realized in state space as a linear time-invariant 2-D system. The overall convolutional Neural Network composed of convolutional layers and nonl… ▽ More This paper introduces a novel representation of convolutional Neural Networks (CNNs) in terms of 2-D dynamical systems. To this end, the usual description of convolutional layers with convolution kernels, i.e., the impulse responses of linear filters, is realized in state space as a linear time-invariant 2-D system. The overall convolutional Neural Network composed of convolutional layers and nonlinear activation functions is then viewed as a 2-D version of a Lur'e system, i.e., a linear dynamical system interconnected with static nonlinear components. One benefit of this 2-D Lur'e system perspective on CNNs is that we can use robust control theory much more efficiently for Lipschitz constant estimation than previously possible. △ Less

Submitted 11 April, 2023; v1 submitted 6 March, 2023; originally announced March 2023.

Flexible-step Model Predictive Control based on Generalized Lyapunov Functions

Authors: Annika Fürnsinn, Christian Ebenbauer, Bahman Gharesifard

Abstract: We present a novel nonlinear model predictive control (MPC) scheme with relaxed stability criteria, based on the idea of generalized discrete-time control Lyapunov functions. These functions need to satisfy an average descent over a finite window of time, rather than a descent at every time step. One feature of this scheme is that it allows for implementing a flexible number of control inputs in e… ▽ More We present a novel nonlinear model predictive control (MPC) scheme with relaxed stability criteria, based on the idea of generalized discrete-time control Lyapunov functions. These functions need to satisfy an average descent over a finite window of time, rather than a descent at every time step. One feature of this scheme is that it allows for implementing a flexible number of control inputs in each iteration, in a computationally attractive manner, while guaranteeing recursive feasibility and stability. The benefits of our flexible-step implementation are also demonstrated in an application to nonholonomic systems, where the one-step standard implementation may suffer from lack of asymptotic convergence. △ Less

Submitted 10 April, 2024; v1 submitted 4 November, 2022; originally announced November 2022.

Comments: 24 pages, 10 figures

Fast identification and stabilization of unknown linear systems

Authors: Dennis Gramlich, Christian Ebenbauer

Abstract: In the present work, a simple algorithm for stabilizing an unknown linear time-invariant system is proposed, assuming only that this system is stabilizable. The suggested algorithm is based on first performing a partial identification of the system and then stabilizing the controllable subsystem. It should be emphasized that our approach does not depend on any prior model knowledge and requires on… ▽ More In the present work, a simple algorithm for stabilizing an unknown linear time-invariant system is proposed, assuming only that this system is stabilizable. The suggested algorithm is based on first performing a partial identification of the system and then stabilizing the controllable subsystem. It should be emphasized that our approach does not depend on any prior model knowledge and requires only a minimal number of samples. △ Less

Submitted 11 November, 2022; v1 submitted 22 August, 2022; originally announced August 2022.

Robust Differential Dynamic Programming

Authors: Dennis Gramlich, Carsten W. Scherer, Christian Ebenbauer

Abstract: Differential Dynamic Programming is an optimal control technique often used for trajectory generation. Many variations of this algorithm have been developed in the literature, including algorithms for stochastic dynamics or state and input constraints. In this contribution, we develop a robust version of Differential Dynamic Programming that uses generalized plants and multiplier relaxations for u… ▽ More Differential Dynamic Programming is an optimal control technique often used for trajectory generation. Many variations of this algorithm have been developed in the literature, including algorithms for stochastic dynamics or state and input constraints. In this contribution, we develop a robust version of Differential Dynamic Programming that uses generalized plants and multiplier relaxations for uncertainties. To this end, we study a version of the Bellman principle and use convex relaxations to account for uncertainties in the dynamic program. The resulting algorithm can be seen as a robust trajectory generation tool for nonlinear systems. △ Less

Submitted 25 May, 2022; originally announced May 2022.

Comments: submitted to IEEE Conference on Decision and Control, 2022

Extremum Seeking with Intermittent Measurements: A Lie-brackets Approach

Authors: Christophe Labar, Christian Ebenbauer, Lorenzo Marconi

Abstract: Extremum seeking systems are powerful methods able to steer the input of a (dynamical) cost function towards an optimizer, without any prior knowledge of the cost function. To achieve their objective, they typically combine time-periodic signals with the on-line measurement of the cost. However, in some practical applications, the cost can only be measured during some regular time-intervals, and n… ▽ More Extremum seeking systems are powerful methods able to steer the input of a (dynamical) cost function towards an optimizer, without any prior knowledge of the cost function. To achieve their objective, they typically combine time-periodic signals with the on-line measurement of the cost. However, in some practical applications, the cost can only be measured during some regular time-intervals, and not continuously, contravening the classical extremum seeking framework. In this paper, we first analyze how existing Lie-bracket based extremum seeking systems behave when being fed with intermittent measurements, instead of continuous ones. We then propose two modifications of those schemes to improve both the convergence time and the steady-state accuracy in presence of intermittent measurements. The performances of the different schemes are compared on a case study. △ Less

Submitted 7 April, 2022; originally announced April 2022.

A Note on Nussbaum-type Control and Lie-bracket Approximation

Authors: Marc Weber, Christian Ebenbauer, Bahman Gharesifard

Abstract: In this paper, we propose an adaptive control law for completely unknown scalar linear systems based on Lie-bracket approximation methods. We investigate stability and convergence properties for the resulting Lie-bracket system, compare our proposal with existing Nussbaum-type solutions and demonstrate our results with an example. Even though we prove global stability properties of the Lie-bracket… ▽ More In this paper, we propose an adaptive control law for completely unknown scalar linear systems based on Lie-bracket approximation methods. We investigate stability and convergence properties for the resulting Lie-bracket system, compare our proposal with existing Nussbaum-type solutions and demonstrate our results with an example. Even though we prove global stability properties of the Lie-bracket system, the stability properties of the proposed dynamics remain open, making the proposed control law an object of further studies. We elaborate the difficulties of establishing stability results by investigating connections to partial stability as well as studying the corresponding Chen-Fliess expansion. △ Less

Submitted 25 October, 2021; v1 submitted 28 September, 2021; originally announced September 2021.

Comments: This is the extended version of our conference paper for CDC2021 with additional calculation steps

MSC Class: 93D21 (Primary); 93D21 (Secondary)

Convex Synthesis of Accelerated Gradient Algorithms

Authors: Carsten Scherer, Christian Ebenbauer

Abstract: We present a convex solution for the design of generalized accelerated gradient algorithms for strongly convex objective functions with Lipschitz continuous gradients. We utilize integral quadratic constraints and the Youla parameterization from robust control theory to formulate a solution of the algorithm design problem as a convex semi-definite program. We establish explicit formulas for the op… ▽ More We present a convex solution for the design of generalized accelerated gradient algorithms for strongly convex objective functions with Lipschitz continuous gradients. We utilize integral quadratic constraints and the Youla parameterization from robust control theory to formulate a solution of the algorithm design problem as a convex semi-definite program. We establish explicit formulas for the optimal convergence rates and extend the proposed synthesis solution to extremum control problems. △ Less

Submitted 16 May, 2021; v1 submitted 12 February, 2021; originally announced February 2021.

Control of Unknown (Linear) Systems with Receding Horizon Learning

Authors: Christian Ebenbauer, Fabian Pfitz, Shuyou Yu

Abstract: A receding horizon learning scheme is proposed to transfer the state of a discrete-time dynamical control system to zero without the need of a system model. Global state convergence to zero is proved for the class of stabilizable and detectable linear time-invariant systems, assuming that only input and output data is available and an upper bound of the state dimension is known. The proposed schem… ▽ More A receding horizon learning scheme is proposed to transfer the state of a discrete-time dynamical control system to zero without the need of a system model. Global state convergence to zero is proved for the class of stabilizable and detectable linear time-invariant systems, assuming that only input and output data is available and an upper bound of the state dimension is known. The proposed scheme consists of a receding horizon control scheme and a proximity-based estimation scheme to estimate and control the closed-loop trajectory. Simulations are presented for linear and nonlinear systems. △ Less

Submitted 15 December, 2020; v1 submitted 12 October, 2020; originally announced October 2020.

Anytime Proximity Moving Horizon Estimation: Stability and Regret

Authors: Meriem Gharbi, Bahman Gharesifard, Christian Ebenbauer

Abstract: In this paper, we address the efficient implementation of moving horizon state estimation of constrained discrete-time linear systems. We propose a novel iteration scheme which employs a proximity-based formulation of the underlying optimization algorithm and reduces computational effort by performing only a limited number of optimization iterations each time a new measurement is received. We outl… ▽ More In this paper, we address the efficient implementation of moving horizon state estimation of constrained discrete-time linear systems. We propose a novel iteration scheme which employs a proximity-based formulation of the underlying optimization algorithm and reduces computational effort by performing only a limited number of optimization iterations each time a new measurement is received. We outline conditions under which global exponential stability of the underlying estimation errors is ensured. Performance guarantees of the iteration scheme in terms of regret upper bounds are also established. A combined result shows that both exponential stability and a sublinear regret which can be rendered smaller by increasing the number of optimization iterations can be guaranteed. The stability and regret results of the proposed estimator are showcased through numerical simulations. △ Less

Submitted 8 November, 2021; v1 submitted 25 June, 2020; originally announced June 2020.

Convex Synthesis of Accelerated Gradient Algorithms for Optimization and Saddle Point Problems using Lyapunov functions

Authors: Dennis Gramlich, Christian Ebenbauer, Carsten W. Scherer

Abstract: This paper considers the problem of designing accelerated gradient-based algorithms for optimization and saddle-point problems. The class of objective functions is defined by a generalized sector condition. This class of functions contains strongly convex functions with Lipschitz gradients but also non-convex functions, which allows not only to address optimization problems but also saddle-point p… ▽ More This paper considers the problem of designing accelerated gradient-based algorithms for optimization and saddle-point problems. The class of objective functions is defined by a generalized sector condition. This class of functions contains strongly convex functions with Lipschitz gradients but also non-convex functions, which allows not only to address optimization problems but also saddle-point problems. The proposed design procedure relies on a suitable class of Lyapunov functions and on convex semi-definite programming. The proposed synthesis allows the design of algorithms that reach the performance of state-of-the-art accelerated gradient methods and beyond. △ Less

Submitted 16 November, 2020; v1 submitted 17 June, 2020; originally announced June 2020.

Comments: 15 pages, 3 figures. This article has been submitted to Systems & Control Letters (https://www.journals.elsevier.com/systems-and-control-letters/)

Gradient Approximation and Multi-Variable Derivative-Free Optimization based on Non-Commutative Maps

Authors: Jan Feiling, Mohamed-Ali Belabbas, Christian Ebenbauer

Abstract: In this work, multi-variable derivative-free optimization algorithms for unconstrained optimization problems are developed. A novel procedure for approximating the gradient of multi-variable objective functions based on non-commutative maps is introduced. The procedure is based on the construction of an exploration sequence to specify where the objective function is evaluated and the definition of… ▽ More In this work, multi-variable derivative-free optimization algorithms for unconstrained optimization problems are developed. A novel procedure for approximating the gradient of multi-variable objective functions based on non-commutative maps is introduced. The procedure is based on the construction of an exploration sequence to specify where the objective function is evaluated and the definition of so-called gradient generating functions which are composed with the objective function such that the procedure mimics a gradient descent algorithm. Various theoretical properties of the proposed class of algorithms are investigated and numerical examples are presented. △ Less

Submitted 15 November, 2021; v1 submitted 1 June, 2020; originally announced June 2020.

Comments: 25 pages; Matlab Toolbox attached. To view attachments, please download the files listed under "Ancillary Files"

Robust and structure exploiting optimization algorithms: An integral quadratic constraint approach

Authors: Simon Michalowsky, Carsten Scherer, Christian Ebenbauer

Abstract: We consider the problem of analyzing and designing gradient-based discrete-time optimization algorithms for a class of unconstrained optimization problems having strongly convex objective functions with Lipschitz continuous gradient. By formulating the problem as a robustness analysis problem and making use of a suitable adaptation of the theory of integral quadratic constraints, we establish a fr… ▽ More We consider the problem of analyzing and designing gradient-based discrete-time optimization algorithms for a class of unconstrained optimization problems having strongly convex objective functions with Lipschitz continuous gradient. By formulating the problem as a robustness analysis problem and making use of a suitable adaptation of the theory of integral quadratic constraints, we establish a framework that allows to analyze convergence rates and robustness properties of existing algorithms and enables the design of novel robust optimization algorithms with prespecified guarantees capable of exploiting additional structure in the objective function. △ Less

Submitted 28 November, 2019; v1 submitted 1 May, 2019; originally announced May 2019.

Online learning with stability guarantees: A memory-based real-time model predictive controller

Authors: Lukas Schwenkel, Meriem Gharbi, Sebastian Trimpe, Christian Ebenbauer

Abstract: We propose and analyze a real-time model predictive control (MPC) scheme that utilizes stored data to improve its performance by learning the value function online with stability guarantees. For linear and nonlinear systems, a learning method is presented that makes use of basic analytic properties of the cost function and is proven to learn the MPC control law and the value function on the limit… ▽ More We propose and analyze a real-time model predictive control (MPC) scheme that utilizes stored data to improve its performance by learning the value function online with stability guarantees. For linear and nonlinear systems, a learning method is presented that makes use of basic analytic properties of the cost function and is proven to learn the MPC control law and the value function on the limit set of the closed-loop state trajectory. The main idea is to generate a smart warm start based on historical data that improves future data points and thus future warm starts. We show that these warm starts are asymptotically exact and converge to the solution of the MPC optimization problem. Thereby, the suboptimality of the applied control input resulting from the real-time requirements vanishes over time. Simulative examples show that existing real-time MPC schemes can be improved by storing data and the proposed learning scheme. △ Less

Submitted 22 September, 2020; v1 submitted 22 December, 2018; originally announced December 2018.

Comments: This article is an extended version of the paper "Online learning with stability guarantees: A memory-based warm starting for real-time MPC" published in Automatica, Volume 122, 109247, 2020, including all proofs, an application example, and a detailed description of the used algorithm

Journal ref: Automatica, Volume 122, 109247, 2020

Characterizing the learning dynamics in extremum seeking

Authors: Stefan Wildhagen, Simon Michalowsky, Jan Feiling, Christian Ebenbauer

Abstract: We consider perturbation-based extremum seeking, which recovers an approximate gradient of an analytically unknown objective function through measurements. Using classical needle variation analysis, we are able to explicitly quantify the recovered gradient in the scalar case. We reveal that it corresponds to an averaged gradient of the objective function, even for very general extremum seeking sys… ▽ More We consider perturbation-based extremum seeking, which recovers an approximate gradient of an analytically unknown objective function through measurements. Using classical needle variation analysis, we are able to explicitly quantify the recovered gradient in the scalar case. We reveal that it corresponds to an averaged gradient of the objective function, even for very general extremum seeking systems. From this, we create a recursion which represents the learning dynamics along the recovered gradient. These results give rise to the interpretation that extremum seeking actually optimizes a function other than the original one. From this insight, a new perspective on global optimization of functions with local extrema emerges: because the gradient is averaged over a certain time period, local extrema might be evened out in the learning dynamics. Moreover, a multidimensional extension of the scalar results is given. △ Less

Submitted 12 September, 2018; originally announced September 2018.

Derivative-Free Optimization Algorithms based on Non-Commutative Maps

Authors: Jan Feiling, Amelie Zeller, Christian Ebenbauer

Abstract: A novel class of derivative-free optimization algorithms is developed. The main idea is to utilize certain non-commutative maps in order to approximate the gradient of the objective function. Convergence properties of the novel algorithms are established and simulation examples are presented. A novel class of derivative-free optimization algorithms is developed. The main idea is to utilize certain non-commutative maps in order to approximate the gradient of the objective function. Convergence properties of the novel algorithms are established and simulation examples are presented. △ Less

Submitted 18 May, 2018; originally announced May 2018.

On the Lie bracket approximation approach to distributed optimization: Extensions and limitations

Authors: Simon Michalowsky, Bahman Gharesifard, Christian Ebenbauer

Abstract: We consider the problem of solving a smooth convex optimization problem with equality and inequality constraints in a distributed fashion. Assuming that we have a group of agents available capable of communicating over a communication network described by a time-invariant directed graph, we derive distributed continuous-time agent dynamics that ensure convergence to a neighborhood of the optimal s… ▽ More We consider the problem of solving a smooth convex optimization problem with equality and inequality constraints in a distributed fashion. Assuming that we have a group of agents available capable of communicating over a communication network described by a time-invariant directed graph, we derive distributed continuous-time agent dynamics that ensure convergence to a neighborhood of the optimal solution of the optimization problem. Following the ideas introduced in our previous work, we combine saddle-point dynamics with Lie bracket approximation techniques. While the methodology was previously limited to linear constraints and objective functions given by a sum of strictly convex separable functions, we extend these result here and show that it applies to a very general class of optimization problems under mild assumptions on the communication topology. △ Less

Submitted 28 February, 2018; originally announced February 2018.

A family of extremum seeking laws for a unicycle model with a moving target: theoretical and experimental studies

Authors: Victoria Grushkovskaya, Simon Michalowsky, Alexander Zuyev, Max May, Christian Ebenbauer

Abstract: In this paper, we propose and practically evaluate a class of gradient-free control functions ensuring the motion of a unicycle-type system towards the extremum point of a time-varying cost function. We prove that the unicycle is able to track the extremum point, and illustrate our results by numerical simulations and experiments that show that the proposed control functions exhibit an improved tr… ▽ More In this paper, we propose and practically evaluate a class of gradient-free control functions ensuring the motion of a unicycle-type system towards the extremum point of a time-varying cost function. We prove that the unicycle is able to track the extremum point, and illustrate our results by numerical simulations and experiments that show that the proposed control functions exhibit an improved tracking performance in comparison to standard extremum seeking laws based on Lie bracket approximations. △ Less

Submitted 28 February, 2018; v1 submitted 26 February, 2018; originally announced February 2018.

Comments: A preprint version of the manuscript accepted for ECC 2018 (17th annual European Control Conference, June 12-15, 2018)

Journal ref: Proceedings of 2018 European Control Conference

A Lie bracket approximation approach to distributed optimization over directed graphs

Authors: Simon Michalowsky, Bahman Gharesifard, Christian Ebenbauer

Abstract: We consider a group of computation units trying to cooperatively solve a distributed optimization problem with shared linear equality and inequality constraints. Assuming that the computation units are communicating over a network whose topology is described by a time-invariant directed graph, by combining saddle-point dynamics with Lie bracket approximation techniques we derive a methodology that… ▽ More We consider a group of computation units trying to cooperatively solve a distributed optimization problem with shared linear equality and inequality constraints. Assuming that the computation units are communicating over a network whose topology is described by a time-invariant directed graph, by combining saddle-point dynamics with Lie bracket approximation techniques we derive a methodology that allows to design distributed continuous-time optimization algorithms that solve this problem under minimal assumptions on the graph topology as well as on the structure of the constraints. We discuss several extensions as well as special cases in which the proposed procedure becomes particularly simple. △ Less

Submitted 5 June, 2019; v1 submitted 15 November, 2017; originally announced November 2017.

On a class of generating vector fields for the extremum seeking problem: Lie bracket approximation and stability properties

Authors: Victoria Grushkovskaya, Alexander Zuyev, Christian Ebenbauer

Abstract: In this paper, we describe a broad class of control functions for extremum seeking problems. We show that it unifies and generalizes existing extremum seeking strategies which are based on Lie bracket approximations, and allows to design new controls with favorable properties in extremum seeking and vibrational stabilization tasks. The second result of this paper is a novel approach for studying t… ▽ More In this paper, we describe a broad class of control functions for extremum seeking problems. We show that it unifies and generalizes existing extremum seeking strategies which are based on Lie bracket approximations, and allows to design new controls with favorable properties in extremum seeking and vibrational stabilization tasks. The second result of this paper is a novel approach for studying the asymptotic behavior of extremum seeking systems. It provides a constructive procedure for defining frequencies of control functions to ensure the practical asymptotic and exponential stability. In contrast to many known results, we also prove asymptotic and exponential stability in the sense of Lyapunov for the proposed class of extremum seeking systems under appropriate assumptions on the vector fields. △ Less

Submitted 13 November, 2017; v1 submitted 7 March, 2017; originally announced March 2017.

Journal ref: Automatica,Volume 94, Pages 151-160, 2018

A stabilizing iteration scheme for model predictive control based on relaxed barrier functions

Authors: Christian Feller, Christian Ebenbauer

Abstract: We propose and analyze a stabilizing iteration scheme for the algorithmic implementation of model predictive control for linear discrete-time systems. Polytopic input and state constraints are considered and handled by means of so-called relaxed logarithmic barrier functions. The required on-line optimization is based on warm starting and performs only a limited, possibly small, number of optimiza… ▽ More We propose and analyze a stabilizing iteration scheme for the algorithmic implementation of model predictive control for linear discrete-time systems. Polytopic input and state constraints are considered and handled by means of so-called relaxed logarithmic barrier functions. The required on-line optimization is based on warm starting and performs only a limited, possibly small, number of optimization algorithm iterations between two consecutive sampling instants. The optimization algorithm dynamics as well as the resulting suboptimality of the applied control input are taken into account explicitly in the stability analysis, and the origin of the resulting overall closed-loop system, consisting of state and optimization algorithm dynamics, is proven to be asymptotically stable. The corresponding constraint satisfaction properties are also analyzed. The theoretical results and a presented numerical example illustrate the fact that asymptotic stability as well as a satisfactory closed-loop performance can be achieved by performing only a single optimization algorithm iteration at each sampling step. △ Less

Submitted 6 April, 2016; v1 submitted 15 March, 2016; originally announced March 2016.

Gradient approximation and extremum seeking via needle variations

Authors: Simon Michalowsky, Christian Ebenbauer

Abstract: We consider a gradient approximation scheme that is based on applying needle shaped inputs. By using ideas known from the classic proof of the Pontryagin Maximum Principle we derive an approximation that reveals that the considered system moves along a weighted averaged gradient. Moreover, based on the same ideas, we give similar results for arbitrary periodic inputs. We also present a new gradien… ▽ More We consider a gradient approximation scheme that is based on applying needle shaped inputs. By using ideas known from the classic proof of the Pontryagin Maximum Principle we derive an approximation that reveals that the considered system moves along a weighted averaged gradient. Moreover, based on the same ideas, we give similar results for arbitrary periodic inputs. We also present a new gradient-based optimization algorithm that is motivated by our calculations and that can be interpreted as a combination of the heavy ball method and Nesterov's method. △ Less

Submitted 14 March, 2016; originally announced March 2016.

Iterative Learning and Extremum Seeking for Repetitive Time-Varying Map**s

Authors: Zhixing Cao, Hans-Bernd Dürr, Christian Ebenbauer, Frank Allgöwer, Furong Gao

Abstract: In this paper, we develop an extremum seeking control method integrated with iterative learning control to track a time-varying optimizer within finite time. The behavior of the extremum seeking system is analyzed via an approximating system - the modified Lie bracket system. The modified Lie bracket system is essentially an online integral-type iterative learning control law. The paper contribute… ▽ More In this paper, we develop an extremum seeking control method integrated with iterative learning control to track a time-varying optimizer within finite time. The behavior of the extremum seeking system is analyzed via an approximating system - the modified Lie bracket system. The modified Lie bracket system is essentially an online integral-type iterative learning control law. The paper contributes to two fields, namely, iterative learning control and extremum seeking. First, an online integral type iterative learning control with a forgetting factor is proposed. Its convergence is analyzed via $k$-dependent (iteration- dependent) contraction map** in a Banach space equipped with $λ$-norm. Second, the iterative learning extremum seeking system can be regarded as an iterative learning control with "control input disturbance." The tracking error of its modified Lie bracket system can be shown uniformly bounded in terms of iterations by selecting a sufficiently large frequency. Furthermore, it is shown that the tracking error will finally converge to a set, which is a $λ$-norm ball. Its center is the same with the limit solution of its corresponding "disturbance-free" system (the iterative learning control law); and its radius can be controlled by the frequency. △ Less

Submitted 16 December, 2017; v1 submitted 7 September, 2015; originally announced September 2015.

Comments: 15 pages

Journal ref: IEEE Transactions on Automatic Control ( Volume: 62, Issue: 7, July 2017 )

Ensemble Observability of Linear Systems

Authors: Shen Zeng, Steffen Waldherr, Christian Ebenbauer, Frank Allgower

Abstract: We address the observability problem for ensembles that are described by probability distributions. The problem is to reconstruct a probability distribution of the initial state from the time-evolution of the probability distribution of the output under a classical finite-dimensional linear system. We present two solutions to this problem, one based on formulating the problem as an inverse problem… ▽ More We address the observability problem for ensembles that are described by probability distributions. The problem is to reconstruct a probability distribution of the initial state from the time-evolution of the probability distribution of the output under a classical finite-dimensional linear system. We present two solutions to this problem, one based on formulating the problem as an inverse problem and the other one based on reconstructing all the moments of the distribution. The first approach leads us to a connection between the reconstruction problem and mathematical tomography problems. In the second approach we use the framework of tensor systems to describe the dynamics of the moments which leads to a more systems theoretic treatment of the reconstruction problem. Furthermore we show that both frameworks are inherently related. The appeal of having two dual view points, the first being more geometric and the second one being more systems theoretic, is illuminated in several examples of theoretical or practical importance. △ Less

Submitted 8 July, 2015; v1 submitted 7 July, 2015; originally announced July 2015.

Relaxed Logarithmic Barrier Function Based Model Predictive Control of Linear Systems

Authors: Christian Feller, Christian Ebenbauer

Abstract: In this paper, we investigate the use of relaxed logarithmic barrier functions in the context of linear model predictive control. We present results that allow to guarantee asymptotic stability of the corresponding closed-loop system, and discuss further properties like performance and constraint satisfaction in dependence of the underlying relaxation. The proposed stabilizing MPC schemes are not… ▽ More In this paper, we investigate the use of relaxed logarithmic barrier functions in the context of linear model predictive control. We present results that allow to guarantee asymptotic stability of the corresponding closed-loop system, and discuss further properties like performance and constraint satisfaction in dependence of the underlying relaxation. The proposed stabilizing MPC schemes are not necessarily based on an explicit terminal set or state constraint and allow to characterize the stabilizing control input sequence as the minimizer of a globally defined, continuously differentiable, and strongly convex function. The results are illustrated by means of a numerical example. △ Less

Submitted 11 March, 2015; originally announced March 2015.

On the differential equation $\dotΘ=(Θ^{T}-Θ)Θ$ with $Θ\in{SO(n)}$

Authors: Gerd Simon Schmidt, Christian Ebenbauer, Frank Allgöwer

Abstract: In this note we consider the global convergence properties of the differential equation $\dotΘ=(Θ^{T}-Θ)Θ$ with $Θ\in{SO(n)}$, which is a gradient flow of the function $f:SO(n)\rightarrow\mathbb{R},Θ\mapsto{2n-2\trΘ}$. Many of the presented results are not new, but scattered throughout literature. The motivation of this note is to summarize and extend the convergence results known from literature.… ▽ More In this note we consider the global convergence properties of the differential equation $\dotΘ=(Θ^{T}-Θ)Θ$ with $Θ\in{SO(n)}$, which is a gradient flow of the function $f:SO(n)\rightarrow\mathbb{R},Θ\mapsto{2n-2\trΘ}$. Many of the presented results are not new, but scattered throughout literature. The motivation of this note is to summarize and extend the convergence results known from literature. Rather than giving an exhaustive list of references, the results are presented in a self-contained fashion. △ Less

Submitted 30 August, 2013; originally announced August 2013.

Lie Bracket Approximation of Extremum Seeking Systems

Authors: Hans-Bernd Dürr, Miloš S. Stanković, Christian Ebenbauer, Karl H. Johansson

Abstract: Extremum seeking feedback is a powerful method to steer a dynamical system to an extremum of a partially or completely unknown map. It often requires advanced system-theoretic tools to understand the qualitative behavior of extremum seeking systems. In this paper, a novel interpretation of extremum seeking is introduced. We show that the trajectories of an extremum seeking system can be approximat… ▽ More Extremum seeking feedback is a powerful method to steer a dynamical system to an extremum of a partially or completely unknown map. It often requires advanced system-theoretic tools to understand the qualitative behavior of extremum seeking systems. In this paper, a novel interpretation of extremum seeking is introduced. We show that the trajectories of an extremum seeking system can be approximated by the trajectories of a system which involves certain Lie brackets of the vector fields of the extremum seeking system. It turns out that the Lie bracket system directly reveals the optimizing behavior of the extremum seeking system. Furthermore, we establish a theoretical foundation and prove that uniform asymptotic stability of the Lie bracket system implies practical uniform asymptotic stability of the corresponding extremum seeking system. We use the established results in order to prove local and semi-global practical uniform asymptotic stability of the extrema of a certain map for multi-agent extremum seeking systems. △ Less

Submitted 6 December, 2012; v1 submitted 28 September, 2011; originally announced September 2011.