Showing 1–42 of 42 results for author: Tesi, P

Meta results on data-driven control of nonlinear systems

Authors: Nima Monshizadeh, Claudio De Persis, Pietro Tesi

Abstract: This note aims to provide a systematic understanding of direct data-driven control, enriching the existing literature not by adding another isolated result, but rather by offering a comprehensive, versatile, and unifying framework that sets the stage for future explorations and applications in this domain. To this end, we formulate the nonlinear design problem from a high-level perspective as a se… ▽ More This note aims to provide a systematic understanding of direct data-driven control, enriching the existing literature not by adding another isolated result, but rather by offering a comprehensive, versatile, and unifying framework that sets the stage for future explorations and applications in this domain. To this end, we formulate the nonlinear design problem from a high-level perspective as a set of desired controlled systems and propose systematic procedures to synthesize data-driven control algorithms that meet the design requirements specified in the desired set. Various examples are presented to demonstrate the comprehensiveness and adaptability of the proposed approach. △ Less

Submitted 16 May, 2024; originally announced May 2024.

Enforcing contraction via data

Authors: Zhongjie Hu, Claudio De Persis, Pietro Tesi

Abstract: We present data-based conditions for enforcing contractivity via feedback control and obtain desired asymptotic properties of the closed-loop system. We focus on unknown nonlinear control systems whose vector fields are expressible via a dictionary of functions and derive data-dependent semidefinite programs whose solution returns the controller that guarantees contractivity. When data are perturb… ▽ More We present data-based conditions for enforcing contractivity via feedback control and obtain desired asymptotic properties of the closed-loop system. We focus on unknown nonlinear control systems whose vector fields are expressible via a dictionary of functions and derive data-dependent semidefinite programs whose solution returns the controller that guarantees contractivity. When data are perturbed by disturbances that are linear combination of sinusoids of known frequencies (but unknown amplitude and phase) and constants, we remarkably obtain conditions for contractivity that do not depend on the magnitude of the disturbances, with imaginable positive consequences for the synthesis of the controller. Finally, we show how to design from data an integral controller for nonlinear systems that achieves constant reference tracking and constant disturbance rejection. △ Less

Submitted 15 January, 2024; originally announced January 2024.

Data-driven control of nonlinear systems from input-output data

Authors: Xiaoyan Dai, Claudio De Persis, Nima Monshizadeh, Pietro Tesi

Abstract: The design of controllers from data for nonlinear systems is a challenging problem. In a recent paper, De Persis, Rotulo and Tesi, "Learning controllers from data via approximate nonlinearity cancellation," IEEE Transactions on Automatic Control, 2023, a method to learn controllers that make the closed-loop system stable and dominantly linear was proposed. The approach leads to a simple solution b… ▽ More The design of controllers from data for nonlinear systems is a challenging problem. In a recent paper, De Persis, Rotulo and Tesi, "Learning controllers from data via approximate nonlinearity cancellation," IEEE Transactions on Automatic Control, 2023, a method to learn controllers that make the closed-loop system stable and dominantly linear was proposed. The approach leads to a simple solution based on data-dependent semidefinite programs. The method uses input-state measurements as data, while in a realistic setup it is more likely that only input-output measurements are available. In this note we report how the design principle of the above mentioned paper can be adjusted to deal with input-output data and obtain dynamic output feedback controllers in a favourable setting. △ Less

Submitted 17 September, 2023; originally announced September 2023.

Comments: Submitted for peer review on 31 March 2023. To appear in the Proceedings of the 62nd IEEE Conference on Decision and Control, 13-15 December 2023, Singapore

Feedback linearization through the lens of data

Authors: C. De Persis, D. Gadginmath, F. Pasqualetti, P. Tesi

Abstract: Controlling nonlinear systems, especially when data are being used to offset uncertainties in the model, is hard. A natural approach when dealing with the challenges of nonlinear control is to reduce the system to a linear one via change of coordinates and feedback, an approach commonly known as feedback linearization. Here we consider the feedback linearization problem of an unknown system when t… ▽ More Controlling nonlinear systems, especially when data are being used to offset uncertainties in the model, is hard. A natural approach when dealing with the challenges of nonlinear control is to reduce the system to a linear one via change of coordinates and feedback, an approach commonly known as feedback linearization. Here we consider the feedback linearization problem of an unknown system when the solution must be found using experimental data. We propose a new method that learns the change of coordinates and the linearizing controller from a library (a dictionary) of candidate functions with a simple algebraic procedure - the computation of the null space of a data-dependent matrix. Remarkably, we show that the solution is valid over the entire state space of interest and not just on the dataset used to determine the solution. △ Less

Submitted 24 June, 2024; v1 submitted 22 August, 2023; originally announced August 2023.

Comments: This is the extended version of a paper that appeared in abridged form in the Proceedings of the 62nd IEEE Conference on Decision and Control, 13-15 December 2023, Singapore

Learning controllers from data via kernel-based interpolation

Authors: Zhongjie Hu, Claudio De Persis, Pietro Tesi

Abstract: We propose a data-driven control design method for nonlinear systems that builds on kernel-based interpolation. Under some assumptions on the system dynamics, kernel-based functions are built from data and a model of the system, along with deterministic model error bounds, is determined. Then, we derive a controller design method that aims at stabilizing the closed-loop system by cancelling out th… ▽ More We propose a data-driven control design method for nonlinear systems that builds on kernel-based interpolation. Under some assumptions on the system dynamics, kernel-based functions are built from data and a model of the system, along with deterministic model error bounds, is determined. Then, we derive a controller design method that aims at stabilizing the closed-loop system by cancelling out the system nonlinearities. The proposed method can be implemented using semidefinite programming and returns positively invariant sets for the closed-loop system. △ Less

Submitted 19 April, 2023; originally announced April 2023.

Data-based Transfer Stabilization in Linear Systems

Authors: Lidong Li, Claudio De Persis, Pietro Tesi, Nima Monshizadeh

Abstract: We present a novel framework for transferring the knowledge from one system (source) to design a stabilizing controller for a second system (target). Our motivation stems from the hypothesis that abundant data can be collected from the source system, whereas the data from the target system is scarce. We consider both cases where data collected from the source system is noiseless and noisy. For eac… ▽ More We present a novel framework for transferring the knowledge from one system (source) to design a stabilizing controller for a second system (target). Our motivation stems from the hypothesis that abundant data can be collected from the source system, whereas the data from the target system is scarce. We consider both cases where data collected from the source system is noiseless and noisy. For each case, by leveraging the data collected from the source system and a priori knowledge on the maximum distance of the two systems, we find a suitable, and relatively small, compact set of systems that contains the actual target system, and then provide a controller that stabilizes the compact set. In particular, the controller can be obtained by solving a set of linear matrix inequalities (LMIs). Feasibility of those LMIs is discussed in details. We complement our theoretical findings by two numerical case studies of low-order and high-order systems. △ Less

Submitted 7 November, 2023; v1 submitted 10 November, 2022; originally announced November 2022.

Data-driven stabilizer design and closed-loop analysis of general nonlinear systems via Taylor's expansion

Authors: Meichen Guo, Claudio De Persis, Pietro Tesi

Abstract: For data-driven control of nonlinear systems, the basis functions characterizing the dynamics are usually essential. In existing works, the basis functions are often carefully chosen based on pre-knowledge of the dynamics so that the system can be expressed or well-approximated by the basis functions and the experimental data. For a more general setting where explicit information on the basis func… ▽ More For data-driven control of nonlinear systems, the basis functions characterizing the dynamics are usually essential. In existing works, the basis functions are often carefully chosen based on pre-knowledge of the dynamics so that the system can be expressed or well-approximated by the basis functions and the experimental data. For a more general setting where explicit information on the basis functions is not available, this paper presents a data-driven approach for stabilizer design and closed-loop analysis via the Lyapunov method. First, based on Taylor's expansion and using input-state data, a stabilizer and a Lyapunov function are designed to render the known equilibrium locally asymptotically stable. Then, data-driven conditions are derived to check whether a given sublevel set of the found Lyapunov function is an invariant subset of the region of attraction. One of the main challenges is how to handle Taylor's remainder in the design of the local stabilizers and the analysis of the closed-loop performance. △ Less

Submitted 26 April, 2023; v1 submitted 2 September, 2022; originally announced September 2022.

Event-triggered Control From Data

Authors: Claudio De Persis, Romain Postoyan, Pietro Tesi

Abstract: We present a data-based approach to design event-triggered state-feedback controllers for unknown continuous-time linear systems affected by disturbances. By an event, we mean state measurements transmission from the sensors to the controller over a digital network. By exploiting a sufficiently rich finite set of noisy state measurements and inputs collected off-line, we first design a data-driven… ▽ More We present a data-based approach to design event-triggered state-feedback controllers for unknown continuous-time linear systems affected by disturbances. By an event, we mean state measurements transmission from the sensors to the controller over a digital network. By exploiting a sufficiently rich finite set of noisy state measurements and inputs collected off-line, we first design a data-driven state-feedback controller to ensure an input-to-state stability property for the closed-loop system ignoring the network. We then take into account sampling induced by the network and we present robust data-driven triggering strategies to (approximately) preserve this stability property. The approach is general in the sense that it allows deriving data-based versions of various popular triggering rules of the literature. In all cases, the designed transmission policies ensure the existence of a (global) strictly positive minimum inter-event times thereby excluding Zeno phenomenon despite disturbances. These results can be viewed as a step towards plug-and-play control for networked control systems, i.e., mechanisms that automatically learn to control and to communicate over a network. △ Less

Submitted 24 August, 2022; originally announced August 2022.

Comments: Submitted to IEEE Transactions on Automatic Control

Learning Controllers from Data via Approximate Nonlinearity Cancellation

Authors: Claudio De Persis, Monica Rotulo, Pietro Tesi

Abstract: We introduce a method to deal with the data-driven control design of nonlinear systems. We derive conditions to design controllers via (approximate) nonlinearity cancellation. These conditions take the compact form of data-dependent semi-definite programs. The method returns controllers that can be certified to stabilize the system even when data are perturbed and disturbances affect the dynamics… ▽ More We introduce a method to deal with the data-driven control design of nonlinear systems. We derive conditions to design controllers via (approximate) nonlinearity cancellation. These conditions take the compact form of data-dependent semi-definite programs. The method returns controllers that can be certified to stabilize the system even when data are perturbed and disturbances affect the dynamics of the system during the execution of the control task, in which case an estimate of the robustly positively invariant set is provided. △ Less

Submitted 25 January, 2022; originally announced January 2022.

Comments: Submitted to IEEE Transactions on Automatic Control

Data-driven design of safe control for polynomial systems

Authors: Alessandro Luppi, Andrea Bisoffi, Claudio De Persis, Pietro Tesi

Abstract: We consider the problem of designing an invariant set using only a finite set of input-state data collected from an unknown polynomial system in continuous time. We consider noisy data, i.e., corrupted by an unknown-but-bounded disturbance. We derive a data-dependent sum-of-squares program that enforces invariance of a set and also optimizes the size of the invariant set while kee** it within a… ▽ More We consider the problem of designing an invariant set using only a finite set of input-state data collected from an unknown polynomial system in continuous time. We consider noisy data, i.e., corrupted by an unknown-but-bounded disturbance. We derive a data-dependent sum-of-squares program that enforces invariance of a set and also optimizes the size of the invariant set while kee** it within a set of user-defined safety constraints; the solution of this program directly provides a polynomial invariant set and a state-feedback controller. We numerically test the design on a system of two platooning cars. △ Less

Submitted 23 December, 2021; originally announced December 2021.

Topology identification of autonomous quantum dynamical networks

Authors: Stefano Gherardini, Henk J. van Waarde, Pietro Tesi, Filippo Caruso

Abstract: Topology identification comprises reconstructing the interaction Hamiltonian of a quantum network by properly processing measurements of its density operator within a fixed time interval. It finds application in several quantum technology contexts, ranging from quantum communication to quantum computing or sensing. In this paper, we provide analytical conditions for the solvability of the topology… ▽ More Topology identification comprises reconstructing the interaction Hamiltonian of a quantum network by properly processing measurements of its density operator within a fixed time interval. It finds application in several quantum technology contexts, ranging from quantum communication to quantum computing or sensing. In this paper, we provide analytical conditions for the solvability of the topology identification problem for autonomous quantum dynamical networks. The solvability condition is then converted in an algorithm for quantum network reconstruction that is easily implementable on standard computer facilities. The obtained algorithm is tested for Hamiltonian reconstruction on numerical examples based on the quantum walks formalism. △ Less

Submitted 16 May, 2022; v1 submitted 1 November, 2021; originally announced November 2021.

Comments: 12 pages, 2 figures; v2: misprints corrected and presentation of the results improved with respect to v1

Journal ref: Phys. Rev. A 106 (5), 052426 (2022)

Learning controllers for performance through LMI regions

Authors: Andrea Bisoffi, Claudio De Persis, Pietro Tesi

Abstract: In an open-loop experiment, an input sequence is applied to an unknown linear time-invariant system (in continuous or discrete time) affected also by an unknown-but-bounded disturbance sequence (with an energy or instantaneous bound); the corresponding state sequence is measured. The goal is to design directly from the input and state sequences a controller that enforces a certain performance spec… ▽ More In an open-loop experiment, an input sequence is applied to an unknown linear time-invariant system (in continuous or discrete time) affected also by an unknown-but-bounded disturbance sequence (with an energy or instantaneous bound); the corresponding state sequence is measured. The goal is to design directly from the input and state sequences a controller that enforces a certain performance specification on the transient behaviour of the unknown system. The performance specification is expressed through a subset of the complex plane where closed-loop eigenvalues need to belong, a so called LMI region. For this control design problem, we provide here convex programs to enforce the performance specification from data in the form of linear matrix inequalities (LMI). For generic LMI regions, these are sufficient conditions to assign the eigenvalues within the LMI region for all possible dynamics consistent with data, and become necessary and sufficient conditions for special LMI regions. In this way, we extend classical model-based conditions from a seminal work in the literature to the setting of data-driven control from noisy data. Through two numerical examples, we investigate how these data-based conditions compare with each other. △ Less

Submitted 20 October, 2021; originally announced October 2021.

Data-driven control via Petersen's lemma

Authors: Andrea Bisoffi, Claudio De Persis, Pietro Tesi

Abstract: We address the problem of designing a stabilizing closed-loop control law directly from input and state measurements collected in an open-loop experiment. In the presence of noise in data, we have that a set of dynamics could have generated the collected data and we need the designed controller to stabilize such set of data-consistent dynamics robustly. For this problem of data-driven control with… ▽ More We address the problem of designing a stabilizing closed-loop control law directly from input and state measurements collected in an open-loop experiment. In the presence of noise in data, we have that a set of dynamics could have generated the collected data and we need the designed controller to stabilize such set of data-consistent dynamics robustly. For this problem of data-driven control with noisy data, we advocate the use of a popular tool from robust control, Petersen's lemma. In the cases of data generated by linear and polynomial systems, we conveniently express the uncertainty captured in the set of data-consistent dynamics through a matrix ellipsoid, and we show that a specific form of this matrix ellipsoid makes it possible to apply Petersen's lemma to all of the mentioned cases. In this way, we obtain necessary and sufficient conditions for data-driven stabilization of linear systems through a linear matrix inequality. The matrix ellipsoid representation enables insights and interpretations of the designed control laws. In the same way, we also obtain sufficient conditions for data-driven stabilization of polynomial systems through (convex) sum-of-squares programs. The findings are illustrated numerically. △ Less

Submitted 24 September, 2021; originally announced September 2021.

Online learning of data-driven controllers for unknown switched linear systems

Authors: Monica Rotulo, Claudio De Persis, Pietro Tesi

Abstract: Motivated by the goal of learning controllers for complex systems whose dynamics change over time, we consider the problem of designing control laws for systems that switch among a finite set of unknown discrete-time linear subsystems under unknown switching signals. To this end, we propose a method that uses data to directly design a control mechanism without any explicit identification step. Our… ▽ More Motivated by the goal of learning controllers for complex systems whose dynamics change over time, we consider the problem of designing control laws for systems that switch among a finite set of unknown discrete-time linear subsystems under unknown switching signals. To this end, we propose a method that uses data to directly design a control mechanism without any explicit identification step. Our approach is online, meaning that the data are collected over time while the system is evolving in closed-loop, and are directly used to iteratively update the controller. A major benefit of the proposed online implementation is therefore the ability of the controller to automatically adjust to changes in the operating mode of the system. We show that the proposed control mechanism guarantees stability of the closed-loop switched linear system provided that the switching is slow enough. Effectiveness of the proposed design technique is illustrated for two aerospace applications. △ Less

Submitted 24 May, 2021; originally announced May 2021.

Designing Experiments for Data-Driven Control of Nonlinear Systems

Authors: Claudio De Persis, Pietro Tesi

Abstract: In a recent paper we have shown that data collected from linear systems excited by persistently exciting inputs during low-complexity experiments, can be used to design state- and output-feedback controllers, including optimal Linear Quadratic Regulators (LQR), by solving linear matrix inequalities (LMI) and semidefinite programs. We have also shown how to stabilize in the first approximation unkn… ▽ More In a recent paper we have shown that data collected from linear systems excited by persistently exciting inputs during low-complexity experiments, can be used to design state- and output-feedback controllers, including optimal Linear Quadratic Regulators (LQR), by solving linear matrix inequalities (LMI) and semidefinite programs. We have also shown how to stabilize in the first approximation unknown nonlinear systems using data. In contrast to the case of linear systems, however, in the case of nonlinear systems the conditions for learning a controller directly from data may not be fulfilled even when the data are collected in experiments performed using persistently exciting inputs. In this paper we show how to design experiments that lead to the fulfilment of these conditions. △ Less

Submitted 30 March, 2021; originally announced March 2021.

Comments: Submitted to the "24th International Symposium on Mathematical Theory of Networks and Systems" on January 2020

On data-driven stabilization of systems with quadratic nonlinearities

Authors: Alessandro Luppi, Claudio De Persis, Pietro Tesi

Abstract: In this paper, we directly design a state feedback controller that stabilizes a class of uncertain nonlinear systems solely based on input-state data collected from a finite-length experiment. Necessary and sufficient conditions are derived to guarantee that the system is absolutely stabilizable and a controller is designed. Results derived under some relaxed prior information about the system and… ▽ More In this paper, we directly design a state feedback controller that stabilizes a class of uncertain nonlinear systems solely based on input-state data collected from a finite-length experiment. Necessary and sufficient conditions are derived to guarantee that the system is absolutely stabilizable and a controller is designed. Results derived under some relaxed prior information about the system and strengthened data assumptions are also discussed. Numerical examples illustrate the method with different levels of prior information. △ Less

Submitted 29 March, 2021; originally announced March 2021.

Direct data-driven model-reference control with Lyapunov stability guarantees

Authors: Valentina Breschi, Claudio De Persis, Simone Formentin, Pietro Tesi

Abstract: In this work, we introduce a novel data-driven model-reference control design approach for unknown linear systems with fully measurable state. The proposed control action is composed by a static feedback term and a reference tracking block, which are shaped from data to reproduce the desired behavior in closed-loop. By focusing on the case where the reference model and the plant share the same ord… ▽ More In this work, we introduce a novel data-driven model-reference control design approach for unknown linear systems with fully measurable state. The proposed control action is composed by a static feedback term and a reference tracking block, which are shaped from data to reproduce the desired behavior in closed-loop. By focusing on the case where the reference model and the plant share the same order, we propose an optimal design procedure with Lyapunov stability guarantees, tailored to handle state measurements with additive noise. Two simulation examples are finally illustrated to show the potential of the proposed strategy as compared to the state of the art approaches. △ Less

Submitted 28 September, 2021; v1 submitted 23 March, 2021; originally announced March 2021.

Comments: 8 pages, 10 figures, Preprint submitted to the 60th IEEE Conference on Decision and Control (CDC) 2021

Trade-offs in learning controllers from noisy data

Authors: Andrea Bisoffi, Claudio De Persis, Pietro Tesi

Abstract: In data-driven control, a central question is how to handle noisy data. In this work, we consider the problem of designing a stabilizing controller for an unknown linear system using only a finite set of noisy data collected from the system. For this problem, many recent works have considered a disturbance model based on energy-type bounds. Here, we consider an alternative more natural model where… ▽ More In data-driven control, a central question is how to handle noisy data. In this work, we consider the problem of designing a stabilizing controller for an unknown linear system using only a finite set of noisy data collected from the system. For this problem, many recent works have considered a disturbance model based on energy-type bounds. Here, we consider an alternative more natural model where the disturbance obeys instantaneous bounds. In this case, the existing approaches, which would convert instantaneous bounds into energy-type bounds, can be overly conservative. In contrast, without any conversion step, simple arguments based on the S-procedure lead to a very effective controller design through a convex program. Specifically, the feasible set of the latter design problem is always larger, and the set of system matrices consistent with data is always smaller and decreases significantly with the number of data points. These findings and some computational aspects are examined in a number of numerical examples. △ Less

Submitted 15 March, 2021; originally announced March 2021.

Data-driven stabilization of nonlinear polynomial systems with noisy data

Authors: Meichen Guo, Claudio De Persis, Pietro Tesi

Abstract: In a recent paper we have shown how to learn controllers for unknown linear systems using finite-sized noisy data by solving linear matrix inequalities. In this note we extend this approach to deal with unknown nonlinear polynomial systems by formulating stability certificates in the form of data-dependent sum of squares programs, whose solution directly provides a stabilizing controller and a Lya… ▽ More In a recent paper we have shown how to learn controllers for unknown linear systems using finite-sized noisy data by solving linear matrix inequalities. In this note we extend this approach to deal with unknown nonlinear polynomial systems by formulating stability certificates in the form of data-dependent sum of squares programs, whose solution directly provides a stabilizing controller and a Lyapunov function. We then derive variations of this result that lead to more advantageous controller designs. The results also reveal connections to the problem of designing a controller starting from a least-square estimate of the polynomial system. △ Less

Submitted 16 November, 2020; originally announced November 2020.

Controller design for robust invariance from noisy data

Authors: Andrea Bisoffi, Claudio De Persis, Pietro Tesi

Abstract: For an unknown linear system, starting from noisy open-loop input-state data collected during a finite-length experiment, we directly design a linear feedback controller that guarantees robust invariance of a given polyhedral set of the state in the presence of disturbances. The main result is a necessary and sufficient condition for the existence of such a controller, and amounts to the solution… ▽ More For an unknown linear system, starting from noisy open-loop input-state data collected during a finite-length experiment, we directly design a linear feedback controller that guarantees robust invariance of a given polyhedral set of the state in the presence of disturbances. The main result is a necessary and sufficient condition for the existence of such a controller, and amounts to the solution of a linear program. The benefits of large and rich data sets for the solution of the problem are discussed. A numerical example about a simplified platoon of two vehicles illustrates the method. △ Less

Submitted 26 July, 2020; originally announced July 2020.

Low-complexity Learning of Linear Quadratic Regulators from Noisy Data

Authors: Claudio De Persis, Pietro Tesi

Abstract: This paper considers the Linear Quadratic Regulator problem for linear systems with unknown dynamics, a central problem in data-driven control and reinforcement learning. We propose a method that uses data to directly return a controller without estimating a model of the system. Sufficient conditions are given under which this method returns a stabilizing controller with guaranteed relative error… ▽ More This paper considers the Linear Quadratic Regulator problem for linear systems with unknown dynamics, a central problem in data-driven control and reinforcement learning. We propose a method that uses data to directly return a controller without estimating a model of the system. Sufficient conditions are given under which this method returns a stabilizing controller with guaranteed relative error when the data used to design the controller are affected by noise. This method has low complexity as it only requires a finite number of samples of the system response to a sufficiently exciting input, and can be efficiently implemented as a semi-definite program. Further, the method does not require assumptions on the noise statistics, and the relative error nicely scales with the noise magnitude. △ Less

Submitted 3 May, 2020; originally announced May 2020.

Data-based stabilization of unknown bilinear systems with guaranteed basin of attraction

Authors: Andrea Bisoffi, Claudio De Persis, Pietro Tesi

Abstract: Motivated by the goal of having a building block in the direct design of data-driven controllers for nonlinear systems, we show how, for an unknown discrete-time bilinear system, the data collected in an offline open-loop experiment enable us to design a feedback controller and provide a guaranteed under-approximation of its basin of attraction. Both can be obtained by solving a linear matrix ineq… ▽ More Motivated by the goal of having a building block in the direct design of data-driven controllers for nonlinear systems, we show how, for an unknown discrete-time bilinear system, the data collected in an offline open-loop experiment enable us to design a feedback controller and provide a guaranteed under-approximation of its basin of attraction. Both can be obtained by solving a linear matrix inequality for a fixed scalar parameter, and possibly iterating on different values of that parameter. The results of this data-based approach are compared with the ideal case when the model is known perfectly. △ Less

Submitted 24 April, 2020; originally announced April 2020.

Journal ref: Systems & Control Letters 145 (2020) 104788

Learning control for polynomial systems using sum of squares relaxations

Authors: Meichen Guo, Claudio De Persis, Pietro Tesi

Abstract: This paper considers the problem of learning control laws for nonlinear polynomial systems directly from the data, which are input-output measurements collected in an experiment over a finite time period. Without explicitly identifying the system dynamics, stabilizing laws are directly designed for nonlinear polynomial systems using experimental data alone. By using data-based sum of square progra… ▽ More This paper considers the problem of learning control laws for nonlinear polynomial systems directly from the data, which are input-output measurements collected in an experiment over a finite time period. Without explicitly identifying the system dynamics, stabilizing laws are directly designed for nonlinear polynomial systems using experimental data alone. By using data-based sum of square programming, the stabilizing state-dependent control gains can be constructed. △ Less

Submitted 2 October, 2020; v1 submitted 2 April, 2020; originally announced April 2020.

Data-based guarantees of set invariance properties

Authors: Andrea Bisoffi, Claudio De Persis, Pietro Tesi

Abstract: For a discrete-time linear system, we use data from a single open-loop experiment to design directly a feedback controller enforcing that a given (polyhedral) set of the state is invariant and given (polyhedral) constraints on the control are satisfied. By building on classical results from model-based set invariance and a fundamental result from Willems et al., the controller designed from data h… ▽ More For a discrete-time linear system, we use data from a single open-loop experiment to design directly a feedback controller enforcing that a given (polyhedral) set of the state is invariant and given (polyhedral) constraints on the control are satisfied. By building on classical results from model-based set invariance and a fundamental result from Willems et al., the controller designed from data has the following desirable features. The satisfaction of the above properties is guaranteed only from data, it can be assessed by solving a numerically-efficient linear program, and, under a certain rank condition, a data-based solution is feasible if and only if a model-based solution is feasible. △ Less

Submitted 27 November, 2019; originally announced November 2019.

Data-driven Linear Quadratic Regulation via Semidefinite Programming

Authors: Monica Rotulo, Claudio De Persis, Pietro Tesi

Abstract: This paper studies the finite-horizon linear quadratic regulation problem where the dynamics of the system are assumed to be unknown and the state is accessible. Information on the system is given by a finite set of input-state data, where the input injected in the system is persistently exciting of a sufficiently high order. Using data, the optimal control law is then obtained as the solution of… ▽ More This paper studies the finite-horizon linear quadratic regulation problem where the dynamics of the system are assumed to be unknown and the state is accessible. Information on the system is given by a finite set of input-state data, where the input injected in the system is persistently exciting of a sufficiently high order. Using data, the optimal control law is then obtained as the solution of a suitable semidefinite program. The effectiveness of the approach is illustrated via numerical examples. △ Less

Submitted 12 August, 2020; v1 submitted 18 November, 2019; originally announced November 2019.

Comments: Accepted for publication in the IFAC World Congress 2020

Bias estimation in sensor networks

Authors: Mingming Shi, Claudio De Persis, Pietro Tesi, Nima Monshizadeh

Abstract: This paper investigates the problem of estimating biases affecting relative state measurements in a sensor network. Each sensor measures the relative states of its neighbors and this measurement is corrupted by a constant bias. We analyse under what conditions on the network topology and the maximum number of biased sensors the biases can be correctly estimated. We show that for non-bipartite grap… ▽ More This paper investigates the problem of estimating biases affecting relative state measurements in a sensor network. Each sensor measures the relative states of its neighbors and this measurement is corrupted by a constant bias. We analyse under what conditions on the network topology and the maximum number of biased sensors the biases can be correctly estimated. We show that for non-bipartite graphs the biases can always be determined even when all the sensors are corrupted, while for bipartite graphs more than half of the sensors should be unbiased to ensure the correctness of the bias estimation. If the biases are heterogeneous, then the number of unbiased sensors can be reduced to two. Based on these conditions, we propose some algorithms to estimate the biases. △ Less

Submitted 22 May, 2019; originally announced May 2019.

Comments: 12 pages, 8 figures

Formulas for Data-driven Control: Stabilization, Optimality and Robustness

Authors: Claudio De Persis, Pietro Tesi

Abstract: In a paper by Willems and coauthors it was shown that persistently exciting data can be used to represent the input-output behavior of a linear system. Based on this fundamental result, we derive a parametrization of linear feedback systems that paves the way to solve important control problems using data-dependent Linear Matrix Inequalities only. The result is remarkable in that no explicit syste… ▽ More In a paper by Willems and coauthors it was shown that persistently exciting data can be used to represent the input-output behavior of a linear system. Based on this fundamental result, we derive a parametrization of linear feedback systems that paves the way to solve important control problems using data-dependent Linear Matrix Inequalities only. The result is remarkable in that no explicit system's matrices identification is required. The examples of control problems we solve include the state and output feedback stabilization, and the linear quadratic regulation problem. We also discuss robustness to noise-corrupted measurements and show how the approach can be used to stabilize unstable equilibria of nonlinear systems. △ Less

Submitted 8 September, 2019; v1 submitted 15 March, 2019; originally announced March 2019.

Comments: Revised version of the paper "On Persistency of Excitation and Formulas for Data-driven Control". Abridged version to appear in the 58th IEEE Conference on Decision and Control, Nice, France, 2019. First submitted on 15 March 2019

Data Rates for Stabilizing Control under Denial-of-Service Attacks

Authors: Shuai Feng, Ahmet Cetinkaya, Hideaki Ishii, Pietro Tesi, Claudio De Persis

Abstract: We study communication-constrained networked control problems for linear time-invariant systems in the presence of Denial-of-Service (DoS) attacks, namely attacks that prevent transmissions over the communication network. Our work aims at exploring the relationship between system resilience and network bandwidth capacity. Given a class of DoS attacks, we first characterize time-invariant bit-rate… ▽ More We study communication-constrained networked control problems for linear time-invariant systems in the presence of Denial-of-Service (DoS) attacks, namely attacks that prevent transmissions over the communication network. Our work aims at exploring the relationship between system resilience and network bandwidth capacity. Given a class of DoS attacks, we first characterize time-invariant bit-rate bounds that are dependent on the unstable eigenvalues of the dynamic matrix of the plant and the parameters of DoS attacks, beyond which exponential stability of the closed-loop system can be guaranteed. Second, we design the time-varying bit-rate protocol and show that it can enable the system to maintain the comparable robustness as the one under the time-invariant bit-rate protocol and meanwhile promote the possibility of transmitting fewer bits especially when the attack levels are low. Our characterization clearly shows the trade-off between the communication bandwidth and resilience against DoS. An example is given to illustrate the proposed solution approach. △ Less

Submitted 13 September, 2018; originally announced September 2018.

Self-Triggered Network Coordination over Noisy Communication Channels

Authors: Mingming Shi, Pietro Tesi, Claudio De Persis

Abstract: This paper investigates coordination problems over packet-based communication channels. We consider the scenario in which the communication between network nodes is corrupted by unknown-but-bounded noise. We introduce a novel coordination scheme, which ensures practical consensus in the noiseless case, while preserving bounds on the nodes disagreement in the noisy case. The proposed scheme does no… ▽ More This paper investigates coordination problems over packet-based communication channels. We consider the scenario in which the communication between network nodes is corrupted by unknown-but-bounded noise. We introduce a novel coordination scheme, which ensures practical consensus in the noiseless case, while preserving bounds on the nodes disagreement in the noisy case. The proposed scheme does not require any global information about the network parameters and/or the operating environment (the noise characteristics). Moreover, network nodes can sample at independent rates and in an aperiodic manner. The analysis is substantiated by extensive numerical simulations. △ Less

Submitted 12 August, 2018; originally announced August 2018.

Comments: 15 pages, 15 figures

Classification for Dynamical Systems: Model-based Approach and Support Vector Machines

Authors: Giorgio Battistelli, Pietro Tesi

Abstract: We consider the problem of classifying trajectories generated by dynamical systems. We investigate a model-based approach, the common approach in control engineering, and a data-driven approach based on Support Vector Machines, a popular method in the area of machine learning. The analysis points out connections between the two approaches and their relative merits. We consider the problem of classifying trajectories generated by dynamical systems. We investigate a model-based approach, the common approach in control engineering, and a data-driven approach based on Support Vector Machines, a popular method in the area of machine learning. The analysis points out connections between the two approaches and their relative merits. △ Less

Submitted 28 March, 2018; originally announced March 2018.

Resilience against Misbehaving Nodes in Asynchronous Networks

Authors: D. Senejohnny, S. Sundaram, C. De Persis, P. Tesi

Abstract: Network systems are one of the most active research areas in the engineering community as they feature a paradigm shift from centralized to distributed control and computation. When dealing with network systems, a fundamental challenge is to ensure their functioning even when some of the network nodes do not operate as intended due to faults or attacks. The objective of this paper is to address th… ▽ More Network systems are one of the most active research areas in the engineering community as they feature a paradigm shift from centralized to distributed control and computation. When dealing with network systems, a fundamental challenge is to ensure their functioning even when some of the network nodes do not operate as intended due to faults or attacks. The objective of this paper is to address the problem of resilient consensus in a context where the nodes have their own clocks, possibly operating in an asynchronous way, and can make updates at arbitrary time instants. The results represent a first step towards the development of resilient event-triggered and self-triggered coordination protocols. △ Less

Submitted 23 February, 2018; originally announced February 2018.

Towards Stabilization of Distributed Systems under Denial-of-Service

Authors: Shuai Feng, Pietro Tesi, Claudio De Persis

Abstract: In this paper, we consider networked distributed systems in the presence of Denial-of-Service (DoS) attacks, namely attacks that prevent transmissions over the communication network. First, we consider a simple and typical scenario where communication sequence is purely Round-robin and we explicitly calculate a bound of attack frequency and duration, under which the interconnected large-scale syst… ▽ More In this paper, we consider networked distributed systems in the presence of Denial-of-Service (DoS) attacks, namely attacks that prevent transmissions over the communication network. First, we consider a simple and typical scenario where communication sequence is purely Round-robin and we explicitly calculate a bound of attack frequency and duration, under which the interconnected large-scale system is asymptotically stable. Second, trading-off system resilience and communication load, we design a hybrid transmission strategy consisting of Zeno-free distributed event-triggered control and Round-robin. We show that with lower communication loads, the hybrid communication strategy enables the systems to have the same resilience as in pure Round-robin. △ Less

Submitted 17 September, 2017; v1 submitted 12 September, 2017; originally announced September 2017.

Networked Systems under Denial-of-Service: Co-located vs. Remote Control Architectures

Authors: Shuai Feng, Pietro Tesi

Abstract: In this paper, we study networked systems in the presence of Denial-of-Service (DoS) attacks, namely attacks that prevent transmissions over the communication network. Previous studies have shown that co-located architectures (control unit co-located with the actuators and networked sensor channel) can ensure a high level of robustness against DoS. However, co-location requires a wired or dedicate… ▽ More In this paper, we study networked systems in the presence of Denial-of-Service (DoS) attacks, namely attacks that prevent transmissions over the communication network. Previous studies have shown that co-located architectures (control unit co-located with the actuators and networked sensor channel) can ensure a high level of robustness against DoS. However, co-location requires a wired or dedicated actuator channel, which could not meet flexibility and cost requirements. In this paper we consider a control architecture that approximates co-location while enabling remote implementation (networked sensor and actuator channels). We analyze closed-loop stability and quantify the robustness "gap" between this architecture and the co-located one. △ Less

Submitted 27 March, 2017; v1 submitted 22 March, 2017; originally announced March 2017.

Comments: arXiv admin note: text overlap with arXiv:1603.02564

Optimized Thermal-Aware Job Scheduling and Control of Data Centers

Authors: Tobias Van Damme, Claudio De Persis, Pietro Tesi

Abstract: Analyzing data centers with thermal-aware optimization techniques is a viable approach to reduce energy consumption of data centers. By taking into account thermal consequences of job placements among the servers of a data center, it is possible to reduce the amount of cooling necessary to keep the servers below a given safe temperature threshold. We set up an optimization problem to analyze and c… ▽ More Analyzing data centers with thermal-aware optimization techniques is a viable approach to reduce energy consumption of data centers. By taking into account thermal consequences of job placements among the servers of a data center, it is possible to reduce the amount of cooling necessary to keep the servers below a given safe temperature threshold. We set up an optimization problem to analyze and characterize the optimal setpoints for the workload distribution and the supply temperature of the cooling equipment. Furthermore under mild assumptions we design and analyze controllers that drive the data center to the optimal state without knowledge of the current total workload to be handled by the data center. The response of our controller is validated by simulations and convergence to the optimal setpoints is achieved under varying workload conditions. △ Less

Submitted 2 November, 2016; originally announced November 2016.

Quasi-Optimal Regulation of FlowNetworks with Input Constraints

Authors: Tjardo Scholten, Claudio De Persis, Pietro Tesi

Abstract: In this work we consider a flow network for which the goal is to solve a practical optimal regulation problem in the presence of input saturation. Based on Lyapunov arguments we propose distributed controllers which guarantee global convergence to an arbitrarily small neighborhood of the desired optimal steady state while fulfilling the constraints. As a case study we apply our distributed control… ▽ More In this work we consider a flow network for which the goal is to solve a practical optimal regulation problem in the presence of input saturation. Based on Lyapunov arguments we propose distributed controllers which guarantee global convergence to an arbitrarily small neighborhood of the desired optimal steady state while fulfilling the constraints. As a case study we apply our distributed controller to a district heating network. △ Less

Submitted 27 June, 2016; originally announced June 2016.

Comments: 14 pages, 4 figures

Resilient Control under Denial-of-Service:Robust Design

Authors: Shuai Feng, Pietro Tesi

Abstract: In this paper, we study networked control systems in the presence of Denial-of-Service (DoS) attacks, namely attacks that prevent transmissions over the communication network. The control objective is to maximize frequency and duration of the DoS attacks under which closed-loop stability is not destroyed. Analog and digital predictor-based controllers with state resetting are proposed, which achie… ▽ More In this paper, we study networked control systems in the presence of Denial-of-Service (DoS) attacks, namely attacks that prevent transmissions over the communication network. The control objective is to maximize frequency and duration of the DoS attacks under which closed-loop stability is not destroyed. Analog and digital predictor-based controllers with state resetting are proposed, which achieve the considered control objective for a general class of DoS signals. An example is given to illustrate the proposed solution approach. △ Less

Submitted 15 March, 2016; v1 submitted 8 March, 2016; originally announced March 2016.

Comments: 8 pages, 5 figures

A Jamming-resilient Algorithm for Self-triggered Network Coordination

Authors: Danial Senejohnny, Pietro Tesi, Claudio De Persis

Abstract: The issue of cyber-security has become ever more prevalent in the analysis and design of cyber-physical systems. In this paper, we investigate self-triggered consensus networks in the presence of communication failures caused by Denialof- Service (DoS) attacks. A general framework is considered in which the network links can fail independent of each other. By introducing a notion of Persistency-of… ▽ More The issue of cyber-security has become ever more prevalent in the analysis and design of cyber-physical systems. In this paper, we investigate self-triggered consensus networks in the presence of communication failures caused by Denialof- Service (DoS) attacks. A general framework is considered in which the network links can fail independent of each other. By introducing a notion of Persistency-of-Communication (PoC), we provide an explicit characterization of DoS frequency and duration under which consensus can be preserved by suitably designing time-varying control and communication policies. An explicit characterization of the effects of DoS on the consensus time is also provided. The considered notion of PoC is compared with classic average connectivity conditions that are found in pure continuous-time consensus networks. Finally, examples are given to substantiate the analysis. △ Less

Submitted 8 March, 2016; originally announced March 2016.

Comments: arXiv admin note: text overlap with arXiv:1504.06810

Self-triggered Coordination over a Shared Network under Denial-of-Service

Authors: Danial Senejohnny, Pietro Tesi, Claudio De Persis

Abstract: The issue of security has become ever more prevalent in the analysis and design of cyber-physical systems. In this paper, we analyze a consensus network in the presence of Denial-of-Service (DoS) attacks, namely attacks that prevent communication among the network agents. By introducing a notion of Persistency-of-Communication (PoC), we provide a characterization of DoS frequency and duration such… ▽ More The issue of security has become ever more prevalent in the analysis and design of cyber-physical systems. In this paper, we analyze a consensus network in the presence of Denial-of-Service (DoS) attacks, namely attacks that prevent communication among the network agents. By introducing a notion of Persistency-of-Communication (PoC), we provide a characterization of DoS frequency and duration such that consensus is not destroyed. An example is given to substantiate the analysis. △ Less

Submitted 26 April, 2015; originally announced April 2015.

Switching Control for Parameter Identifiability of Uncertain Systems

Authors: G. Battistelli, P. Tesi

Abstract: This paper considers the problem of identifying the parameters of an uncertain linear system by means of feedback control. The problem is approached by considering time-varying controllers. It is shown that even when the uncertainty set is not finite, parameter identifiability can be generically ensured by switching among a finite number of linear time-invariant controllers. The results are shown… ▽ More This paper considers the problem of identifying the parameters of an uncertain linear system by means of feedback control. The problem is approached by considering time-varying controllers. It is shown that even when the uncertainty set is not finite, parameter identifiability can be generically ensured by switching among a finite number of linear time-invariant controllers. The results are shown to have several implications, ranging from fault detection and isolation to adaptive and supervisory control. Practical aspects of the problem are also discussed in details. △ Less

Submitted 16 April, 2015; originally announced April 2015.

Detecting Topology Variations in Dynamical Networks

Authors: G. Battistelli, P. Tesi

Abstract: This paper considers the problem of detecting topology variations in dynamical networks. We consider a network whose behavior can be represented via a linear dynamical system. The problem of interest is then that of finding conditions under which it is possible to detect node or link disconnections from prior knowledge of the nominal network behavior and on-line measurements. The considered approa… ▽ More This paper considers the problem of detecting topology variations in dynamical networks. We consider a network whose behavior can be represented via a linear dynamical system. The problem of interest is then that of finding conditions under which it is possible to detect node or link disconnections from prior knowledge of the nominal network behavior and on-line measurements. The considered approach makes use of analysis tools from switching systems theory. A number of results are presented along with examples. △ Less

Submitted 16 April, 2015; originally announced April 2015.

On Resilient Control of Nonlinear Systems under Denial-of-Service

Authors: Claudio De Persis, Pietro Tesi

Abstract: We analyze and design a control strategy for nonlinear systems under Denial-of-Service attacks. Based on an ISS-Lyapunov function analysis, we provide a characterization of the maximal percentage of time during which feedback information can be lost without resulting in the instability of the system. Motivated by the presence of a digital channel we consider event-based controllers for which a min… ▽ More We analyze and design a control strategy for nonlinear systems under Denial-of-Service attacks. Based on an ISS-Lyapunov function analysis, we provide a characterization of the maximal percentage of time during which feedback information can be lost without resulting in the instability of the system. Motivated by the presence of a digital channel we consider event-based controllers for which a minimal inter-sampling time is explicitly characterized. △ Less

Submitted 7 April, 2014; originally announced April 2014.

Comments: 7 pages, 1 figure

Resilient Control under Denial-of-Service

Authors: Claudio De Persis, Pietro Tesi

Abstract: We investigate resilient control strategies for linear systems under Denial-of-Service (DoS) attacks. By DoS attacks we mean interruptions of communication on measurement (sensor-to-controller) and/or control (controller-to-actuator) channels carried out by an intelligent adversary. We characterize the duration of these interruptions under which stability of the closed-loop system is preserved. Th… ▽ More We investigate resilient control strategies for linear systems under Denial-of-Service (DoS) attacks. By DoS attacks we mean interruptions of communication on measurement (sensor-to-controller) and/or control (controller-to-actuator) channels carried out by an intelligent adversary. We characterize the duration of these interruptions under which stability of the closed-loop system is preserved. The resilient nature of the control descends from its ability to adapt the sampling rate to the occurrence of the DoS. △ Less

Submitted 19 November, 2013; originally announced November 2013.

Comments: 10 pages, abridged version submitted