-
Cautious optimization via data informativity
Authors:
Jaap Eising,
Jorge Cortes
Abstract:
This paper deals with the problem of accurately determining guaranteed suboptimal values of an unknown cost function on the basis of noisy measurements. We consider a set-valued variant to regression where, instead of finding a best estimate of the cost function, we reason over all functions compatible with the measurements and apply robust methods explicitly in terms of the data. Our treatment pr…
▽ More
This paper deals with the problem of accurately determining guaranteed suboptimal values of an unknown cost function on the basis of noisy measurements. We consider a set-valued variant to regression where, instead of finding a best estimate of the cost function, we reason over all functions compatible with the measurements and apply robust methods explicitly in terms of the data. Our treatment provides data-based conditions under which closed-forms expressions of upper bounds of the unknown function can be obtained, and regularity properties like convexity and Lipschitzness can be established. These results allow us to provide tests for point- and set-wise verification of suboptimality, and tackle the cautious optimization of the unknown function in both one-shot and online scenarios. We showcase the versatility of the proposed methods in two control-relevant problems: data-driven contraction analysis of unknown nonlinear systems and suboptimal regulation with unknown dynamics and cost. Simulations illustrate our results.
△ Less
Submitted 15 July, 2023;
originally announced July 2023.
-
Data-driven mode detection and stabilization of unknown switched linear systems
Authors:
Jaap Eising,
Shenyu Liu,
Sonia Martinez,
Jorge Cortes
Abstract:
This paper considers the stabilization of unknown switched linear systems using data. Instead of a full system model, we have access to a finite number of trajectories of each of the different modes prior to the online operation of the system. On the basis of informative enough measurements, formally characterized in terms of linear matrix inequalities, we design an online switched controller that…
▽ More
This paper considers the stabilization of unknown switched linear systems using data. Instead of a full system model, we have access to a finite number of trajectories of each of the different modes prior to the online operation of the system. On the basis of informative enough measurements, formally characterized in terms of linear matrix inequalities, we design an online switched controller that alternates between a mode detection phase and a stabilization phase. Since the specific currently-active mode is unknown, the controller employs the most recent online measurements to determine it by implementing computationally efficient tests that check compatibility with the set of systems consistent with the pre-collected measurements. The stabilization phase applies the stabilizing feedback gain corresponding to the identified active mode and monitors the evolution of the associated Lyapunov function to detect switches. When a switch is detected, the controller returns to the mode-detection phase. Under average dwell- and activation-time assumptions on the switching signal, we show that the proposed controller guarantees an input-to-state-like stability property of the closed-loop switched system. Various simulations illustrate our results.
△ Less
Submitted 20 March, 2023;
originally announced March 2023.
-
The informativity approach to data-driven analysis and control
Authors:
Henk J. van Waarde,
Jaap Eising,
M. Kanat Camlibel,
Harry L. Trentelman
Abstract:
The goal of this paper is to provide a tutorial on the so-called informativity framework for direct data-driven analysis and control. This framework achieves certified data-based analysis and control by assessing system properties and determining controllers for sets of systems unfalsified by the data. We will first introduce the informativity approach at an abstract level. Thereafter, we will rep…
▽ More
The goal of this paper is to provide a tutorial on the so-called informativity framework for direct data-driven analysis and control. This framework achieves certified data-based analysis and control by assessing system properties and determining controllers for sets of systems unfalsified by the data. We will first introduce the informativity approach at an abstract level. Thereafter, we will report case studies where we highlight the strength of the framework in the context of various problems involving both noiseless and noisy data. In particular, we will treat controllability and stabilizability, and stabilization, linear quadratic regulation, and tracking and regulation using exact input-state measurements. Thereafter, we will treat dissipativity analysis, stabilization, and H_inf control using noisy input-state data. Finally, we will study dynamic measurement feedback stabilization using noisy input-output data. We will provide several examples to illustrate the approach. In addition, we will highlight the main tools underlying the framework, such as quadratic matrix inequalities in robust control and quadratic difference forms in behavioral systems theory.
△ Less
Submitted 21 February, 2023;
originally announced February 2023.
-
When sampling works in data-driven control: Informativity for stabilization in continuous time
Authors:
Jaap Eising,
Jorge Cortes
Abstract:
This paper introduces a notion of data informativity for stabilization tailored to continuous-time signals and systems. We establish results comparable to those known for discrete-time systems with sampled data. We justify that additional assumptions on the properties of the noise signals are needed to understand when sampled versions of continuous-time signals are informative for stabilization, t…
▽ More
This paper introduces a notion of data informativity for stabilization tailored to continuous-time signals and systems. We establish results comparable to those known for discrete-time systems with sampled data. We justify that additional assumptions on the properties of the noise signals are needed to understand when sampled versions of continuous-time signals are informative for stabilization, thereby introducing the notions of square Lipschitzness and total bounded variation. This allows us to connect the continuous and discrete domains, yielding sufficient conditions to synthesize a stabilizing controller for the true continuous-time system on the basis of sampled data. Simulations illustrate our results.
△ Less
Submitted 13 June, 2024; v1 submitted 25 January, 2023;
originally announced January 2023.
-
Informativity for centralized design of distributed controllers for networked systems
Authors:
Jaap Eising,
Jorge Cortes
Abstract:
Recent work in data-driven control has led to methods that find stabilizing controllers directly from measurements of an unknown system. However, for multi-agent systems we are often interested in finding controllers that take their distributed nature into account. For instance, the full state might not be available for feedback at every agent. In order to deal with such information, we consider t…
▽ More
Recent work in data-driven control has led to methods that find stabilizing controllers directly from measurements of an unknown system. However, for multi-agent systems we are often interested in finding controllers that take their distributed nature into account. For instance, the full state might not be available for feedback at every agent. In order to deal with such information, we consider the problem of finding a feedback controller with a given block structure based on measured data. Moreover, we provide an algorithm that, if it converges, leads to a maximally sparse controller.
△ Less
Submitted 29 July, 2022;
originally announced July 2022.
-
Using data informativity for online stabilization of unknown switched linear systems
Authors:
Jaap Eising,
Shenyu Liu,
Sonia Martinez,
Jorge Cortes
Abstract:
This work studies data-driven switched controller design for discrete-time switched linear systems. Instead of having access to the full system dynamics, an initialization phase is performed, during which noiseless measurements of the state and the input are collected for each mode. Under certain conditions on these measurements, we develop a stabilizing switched controller for the switched system…
▽ More
This work studies data-driven switched controller design for discrete-time switched linear systems. Instead of having access to the full system dynamics, an initialization phase is performed, during which noiseless measurements of the state and the input are collected for each mode. Under certain conditions on these measurements, we develop a stabilizing switched controller for the switched system. To be precise, the controller switches between identifying the active mode of the system and applying a predetermined stabilizing feedback. We prove that if the system switches according to certain specifications, this controller stabilizes the closed-loop system. Simulations on a network example illustrate our approach.
△ Less
Submitted 12 September, 2022; v1 submitted 29 July, 2022;
originally announced July 2022.
-
A behavioral approach to data-driven control with noisy input-output data
Authors:
Henk J. van Waarde,
Jaap Eising,
M. Kanat Camlibel,
Harry L. Trentelman
Abstract:
This paper deals with data-driven stability analysis and feedback stabillization of linear input-output systems in autoregressive (AR) form. We assume that noisy input-output data on a finite time-interval have been obtained from some unknown AR system. Data-based tests are then developed to analyse whether the unknown system is stable, or to verify whether a stabilizing dynamic feedback controlle…
▽ More
This paper deals with data-driven stability analysis and feedback stabillization of linear input-output systems in autoregressive (AR) form. We assume that noisy input-output data on a finite time-interval have been obtained from some unknown AR system. Data-based tests are then developed to analyse whether the unknown system is stable, or to verify whether a stabilizing dynamic feedback controller exists. If so, stabilizing controllers are computed using the data. In order to do this, we employ the behavioral approach to systems and control, meaning a departure from existing methods in data driven control. Our results heavily rely on a characterization of asymptotic stability of systems in AR form using the notion of quadratic difference form (QDF) as a natural framework for Lyapunov functions of autonomous AR systems. We introduce the concepts of informative data for quadratic stability and quadratic stabilization in the context of input-output AR systems and establish necessary and sufficient conditions for these properties to hold. In addition, this paper will build on results on quadratic matrix inequalties (QMIs) and a matrix version of Yakubovich's S-lemma.
△ Less
Submitted 16 June, 2022;
originally announced June 2022.
-
Quadratic matrix inequalities with applications to data-based control
Authors:
Henk J. van Waarde,
M. Kanat Camlibel,
Jaap Eising,
Harry L. Trentelman
Abstract:
This paper studies several problems related to quadratic matrix inequalities (QMI's), i.e., inequalities in the Loewner order involving quadratic functions of matrix variables. In particular, we provide conditions under which the solution set of a QMI is nonempty, convex, bounded, or has nonempty interior. We also provide a parameterization of the solution set of a given QMI. In addition, we state…
▽ More
This paper studies several problems related to quadratic matrix inequalities (QMI's), i.e., inequalities in the Loewner order involving quadratic functions of matrix variables. In particular, we provide conditions under which the solution set of a QMI is nonempty, convex, bounded, or has nonempty interior. We also provide a parameterization of the solution set of a given QMI. In addition, we state results regarding the image of such sets under linear maps, which characterize a subset of ``structured" solutions to a QMI. Thereafter, we derive matrix versions of the classical S-lemma and Finsler's lemma, that provide conditions under which all solutions to one QMI also satisfy another QMI. The results will be compared to related work in the robust control literature, such as the full block S-procedure and Petersen's lemma, and it is demonstrated how existing results can be obtained from the results of this paper as special cases. Finally, we show how the various results for QMI's can be applied to the problem of data-driven stabilization. This problem involves finding a stabilizing feedback controller for an unknown dynamical system influenced by noise on the basis of a finite set of data. We provide general necessary and sufficient conditions for data-based quadratic stabilization. In addition, we demonstrate how to reduce the computational complexity of data-based stabilization by leveraging the aforementioned results. This involves separating the computation of the Lyapunov function and the controller, and also leads to explicit formulas for data-guided feedback gains.
△ Less
Submitted 21 February, 2023; v1 submitted 24 March, 2022;
originally announced March 2022.
-
On reachability and null-controllability of nonstrict convex processes
Authors:
Jaap Eising,
M. Kanat Camlibel
Abstract:
This paper studies reachability and null-controllability for difference inclusions involving convex processes. Such difference inclusions arise, for instance, in the study of linear discrete-time systems whose inputs and/or states are constrained to lie within a convex cone. After develo** a geometric framework for convex processes relying on invariance properties, we provide necessary and suffi…
▽ More
This paper studies reachability and null-controllability for difference inclusions involving convex processes. Such difference inclusions arise, for instance, in the study of linear discrete-time systems whose inputs and/or states are constrained to lie within a convex cone. After develo** a geometric framework for convex processes relying on invariance properties, we provide necessary and sufficient conditions for both reachability and null-controllability in terms of the spectrum of dual processes.
△ Less
Submitted 28 December, 2021; v1 submitted 30 June, 2021;
originally announced June 2021.
-
A geometric approach to convex processes: from reachability to stabilizability
Authors:
Jaap Eising,
M. Kanat Camlibel
Abstract:
This paper studies system theoretic properties of the class of difference inclusions of convex processes. We will develop a framework considering eigenvalues and eigenvectors, weakly and strongly invariant cones, and a decomposition of convex processes. This will allow us to characterize reachability, stabilizability and (null-)controllability of nonstrict convex processes in terms of spectral pro…
▽ More
This paper studies system theoretic properties of the class of difference inclusions of convex processes. We will develop a framework considering eigenvalues and eigenvectors, weakly and strongly invariant cones, and a decomposition of convex processes. This will allow us to characterize reachability, stabilizability and (null-)controllability of nonstrict convex processes in terms of spectral properties. These characterizations generalize all previously known results regarding for instance linear processes and specific classes of nonstrict convex processes.
△ Less
Submitted 28 December, 2021; v1 submitted 9 June, 2021;
originally announced June 2021.
-
On eigenvectors of convex processes in non-pointed cones
Authors:
Jaap Eising,
M. Kanat Camlibel
Abstract:
Spectral analysis of convex processes has led to many results in the analysis of differential inclusions with a convex process. In particular the characterization of eigenvalues with eigenvectors in a given cone has led to results on controllability and stabilizability. However, these characterizations can handle only pointed cones. This paper will generalize all known results characterizing eigen…
▽ More
Spectral analysis of convex processes has led to many results in the analysis of differential inclusions with a convex process. In particular the characterization of eigenvalues with eigenvectors in a given cone has led to results on controllability and stabilizability. However, these characterizations can handle only pointed cones. This paper will generalize all known results characterizing eigenvalues of convex processes with eigenvectors in a given cone. In addition, we reveal the link between the assumptions on our main theorem and classical geometric control theory.
△ Less
Submitted 30 March, 2022; v1 submitted 9 June, 2021;
originally announced June 2021.
-
Data informativity for analysis of linear systems with convex conic constraints
Authors:
Jaap Eising,
M. Kanat Camlibel
Abstract:
This paper studies the informativity problem for reachability and null-controllability of constrained systems. To be precise, we will focus on an unknown linear systems with convex conic constraints from which we measure data consisting of exact state trajectories of finite length. We are interested in performing system analysis of such an unknown system on the basis of the measured data. However,…
▽ More
This paper studies the informativity problem for reachability and null-controllability of constrained systems. To be precise, we will focus on an unknown linear systems with convex conic constraints from which we measure data consisting of exact state trajectories of finite length. We are interested in performing system analysis of such an unknown system on the basis of the measured data. However, from such measurements it is only possible to obtain a unique system explaining the data in very restrictive cases. This means that we can not approach this problem using system identification combined with model based analysis. As such, we will formulate conditions on the data under which any such system consistent with the measurements is guaranteed to be reachable or null-controllable. These conditions are stated in terms of spectral conditions and subspace inclusions, and therefore they are easy to verify.
△ Less
Submitted 30 April, 2021; v1 submitted 3 March, 2021;
originally announced March 2021.
-
On Duality for Lyapunov Functions of Nonstrict Convex Processes
Authors:
Jaap Eising,
M. Kanat Camlibel
Abstract:
This paper provides a novel definition for Lyapunov functions for difference inclusions defined by convex processes. It is shown that this definition reflects stability properties of nonstrict convex processes better than previously used definitions. In addition the paper presents conditions under which a weak Lyapunov function for a convex process yields a strong Lyapunov function for the dual of…
▽ More
This paper provides a novel definition for Lyapunov functions for difference inclusions defined by convex processes. It is shown that this definition reflects stability properties of nonstrict convex processes better than previously used definitions. In addition the paper presents conditions under which a weak Lyapunov function for a convex process yields a strong Lyapunov function for the dual of the convex process.
△ Less
Submitted 29 October, 2020;
originally announced October 2020.
-
Informativity of noisy data for structural properties of linear systems
Authors:
Jaap Eising,
Harry Trentelman
Abstract:
This paper deals with develo** tests for checking whether an unknown system has certain structural properties. The tests that we are aiming at are in terms of noisy input-state-output data obtained from the unknown system. Since, in general, the data do not determine the unknown system uniquely, many systems are compatible with the same set of data. Therefore we can not apply system identificati…
▽ More
This paper deals with develo** tests for checking whether an unknown system has certain structural properties. The tests that we are aiming at are in terms of noisy input-state-output data obtained from the unknown system. Since, in general, the data do not determine the unknown system uniquely, many systems are compatible with the same set of data. Therefore we can not apply system identification and apply existing, model based, tests. Instead, we will use the concept of informativity, and establish tests for informativity of the given noisy data. We will do this for a range of system properties, among which strong observability and detectability and strong controllability and stabilizability. These informativity tests will be in terms of rank tests on polynomial matrices that can be constructed from the noisy data. We will also set up a geometric framework for informativity analysis. Within that framework we will give geometric tests for informativity for strong observability, observability, and left-invertibilty.
△ Less
Submitted 29 October, 2020;
originally announced October 2020.
-
Data informativity: a new perspective on data-driven analysis and control
Authors:
Henk J. van Waarde,
Jaap Eising,
Harry L. Trentelman,
M. Kanat Camlibel
Abstract:
The use of persistently exciting data has recently been popularized in the context of data-driven analysis and control. Such data have been used to assess system theoretic properties and to construct control laws, without using a system model. Persistency of excitation is a strong condition that also allows unique identification of the underlying dynamical system from the data within a given model…
▽ More
The use of persistently exciting data has recently been popularized in the context of data-driven analysis and control. Such data have been used to assess system theoretic properties and to construct control laws, without using a system model. Persistency of excitation is a strong condition that also allows unique identification of the underlying dynamical system from the data within a given model class. In this paper, we develop a new framework in order to work with data that are not necessarily persistently exciting. Within this framework, we investigate necessary and sufficient conditions on the informativity of data for several data-driven analysis and control problems. For certain analysis and design problems, our results reveal that persistency of excitation is not necessary. In fact, in these cases data-driven analysis/control is possible while the combination of (unique) system identification and model-based control is not. For certain other control problems, our results justify the use of persistently exciting data as data-driven control is possible only with data that are informative for system identification.
△ Less
Submitted 10 January, 2020; v1 submitted 1 August, 2019;
originally announced August 2019.