Showing 1–50 of 125 results for author: Cortes, J

Performance-Barrier Event-Triggered Control of a Class of Reaction-Diffusion PDEs

Authors: Bhathiya Rathnayake, Mamadou Diagne, Jorge Cortes, Miroslav Krstic

Abstract: We employ the recent performance-barrier event-triggered control (P-ETC) for achieving global exponential convergence of a class of reaction-diffusion PDEs via PDE backstep** control. Rather than insisting on a strictly monotonic decrease of the Lyapunov function for the closed-loop system, P-ETC allows the Lyapunov function to increase as long as it remains below an acceptable performance-barri… ▽ More We employ the recent performance-barrier event-triggered control (P-ETC) for achieving global exponential convergence of a class of reaction-diffusion PDEs via PDE backstep** control. Rather than insisting on a strictly monotonic decrease of the Lyapunov function for the closed-loop system, P-ETC allows the Lyapunov function to increase as long as it remains below an acceptable performance-barrier. This approach integrates a performance residual, the difference between the value of the performance-barrier and the Lyapunov function, into the triggering mechanism. The integration adds flexibility and results in fewer control updates than with regular ETC (R-ETC) that demands a monotonic decrease of the Lyapunov function. Our P-ETC PDE backstep** design ensures global exponential convergence of the closed-loop system in the spatial L^2 norm, without encountering Zeno phenomenon. To avoid continuous monitoring of the triggering function that generates events, we develop periodic event-triggered and self-triggered variants (P-PETC and P-STC, respectively) of the P-ETC. The P-PETC only requires periodic evaluation of the triggering function whereas the P-STC preemptively computes the time of the next event at the current event time using the system model and continuously available system states. The P-PETC and P-STC also ensure a Zeno-free behavior and deliver performance equivalent to that of the continuous-time P-ETC which requires continuous evaluation of the triggering function, in addition to the continuous sensing of the state. We provide numerical simulations to illustrate the proposed technique and to compare it with R-ETC associated with strictly decreasing Lyapunov functions. △ Less

Submitted 11 July, 2024; originally announced July 2024.

Converse Theorems for Certificates of Safety and Stability

Authors: Pol Mestres, Jorge Cortés

Abstract: Motivated by the key role of control barrier functions (CBFs) in assessing safety and enabling the synthesis of safe controllers in nonlinear control systems, this paper presents a suite of converse results on CBFs. Given any safe set, we first identify a set of general sufficient conditions which guarantee the existence of a CBF. Our technical analysis also enables us to define an extended notion… ▽ More Motivated by the key role of control barrier functions (CBFs) in assessing safety and enabling the synthesis of safe controllers in nonlinear control systems, this paper presents a suite of converse results on CBFs. Given any safe set, we first identify a set of general sufficient conditions which guarantee the existence of a CBF. Our technical analysis also enables us to define an extended notion of CBF which is always guaranteed to exist if the set is safe. We next turn our attention to the problem of joint safety and stability, and give conditions under which the notions of control Lyapunov-barrier function (CLBF) and compatible control Lyapunov function (CLF) and CBF pair are guaranteed to exist. Finally, we identify conditions under which a CLBF and a compatible CLF-CBF pair can be constructed from a non-compatible CLF-CBF pair. Throughout the paper, we intersperse different examples and counterexamples to motivate our results and position them within the state of the art. △ Less

Submitted 20 June, 2024; originally announced June 2024.

Sensor-Based Distributionally Robust Control for Safe Robot Navigation in Dynamic Environments

Authors: Kehan Long, Yinzhuang Yi, Zhirui Dai, Sylvia Herbert, Jorge Cortés, Nikolay Atanasov

Abstract: We introduce a novel method for safe mobile robot navigation in dynamic, unknown environments, utilizing onboard sensing to impose safety constraints without the need for accurate map reconstruction. Traditional methods typically rely on detailed map information to synthesize safe stabilizing controls for mobile robots, which can be computationally demanding and less effective, particularly in dyn… ▽ More We introduce a novel method for safe mobile robot navigation in dynamic, unknown environments, utilizing onboard sensing to impose safety constraints without the need for accurate map reconstruction. Traditional methods typically rely on detailed map information to synthesize safe stabilizing controls for mobile robots, which can be computationally demanding and less effective, particularly in dynamic operational conditions. By leveraging recent advances in distributionally robust optimization, we develop a distributionally robust control barrier function (DR-CBF) constraint that directly processes range sensor data to impose safety constraints. Coupling this with a control Lyapunov function (CLF) for path tracking, we demonstrate that our CLF-DR-CBF control synthesis method achieves safe, efficient, and robust navigation in uncertain dynamic environments. We demonstrate the effectiveness of our approach in simulated and real autonomous robot navigation experiments, marking a substantial advancement in real-time safety guarantees for mobile robots. △ Less

Submitted 28 May, 2024; originally announced May 2024.

Comments: Submitted to the International Journal of Robotics Research (IJRR). Project page: https://existentialrobotics.org/DR_Safe_Navigation_Webpage

Distributionally Robust Policy and Lyapunov-Certificate Learning

Authors: Kehan Long, Jorge Cortes, Nikolay Atanasov

Abstract: This article presents novel methods for synthesizing distributionally robust stabilizing neural controllers and certificates for control systems under model uncertainty. A key challenge in designing controllers with stability guarantees for uncertain systems is the accurate determination of and adaptation to shifts in model parametric uncertainty during online deployment. We tackle this with a nov… ▽ More This article presents novel methods for synthesizing distributionally robust stabilizing neural controllers and certificates for control systems under model uncertainty. A key challenge in designing controllers with stability guarantees for uncertain systems is the accurate determination of and adaptation to shifts in model parametric uncertainty during online deployment. We tackle this with a novel distributionally robust formulation of the Lyapunov derivative chance constraint ensuring a monotonic decrease of the Lyapunov certificate. To avoid the computational complexity involved in dealing with the space of probability measures, we identify a sufficient condition in the form of deterministic convex constraints that ensures the Lyapunov derivative constraint is satisfied. We integrate this condition into a loss function for training a neural network-based controller and show that, for the resulting closed-loop system, the global asymptotic stability of its equilibrium can be certified with high confidence, even with Out-of-Distribution (OoD) model uncertainties. To demonstrate the efficacy and efficiency of the proposed methodology, we compare it with an uncertainty-agnostic baseline approach and several reinforcement learning approaches in two control problems in simulation. △ Less

Submitted 3 April, 2024; originally announced April 2024.

Comments: Submitted to IEEE Open Journal of Control Systems

Designing Poisson Integrators Through Machine Learning

Authors: Miguel Vaquero, David Martín de Diego, Jorge Cortés

Abstract: This paper presents a general method to construct Poisson integrators, i.e., integrators that preserve the underlying Poisson geometry. We assume the Poisson manifold is integrable, meaning there is a known local symplectic groupoid for which the Poisson manifold serves as the set of units. Our constructions build upon the correspondence between Poisson diffeomorphisms and Lagrangian bisections, w… ▽ More This paper presents a general method to construct Poisson integrators, i.e., integrators that preserve the underlying Poisson geometry. We assume the Poisson manifold is integrable, meaning there is a known local symplectic groupoid for which the Poisson manifold serves as the set of units. Our constructions build upon the correspondence between Poisson diffeomorphisms and Lagrangian bisections, which allows us to reformulate the design of Poisson integrators as solutions to a certain PDE (Hamilton-Jacobi). The main novelty of this work is to understand the Hamilton-Jacobi PDE as an optimization problem, whose solution can be easily approximated using machine learning related techniques. This research direction aligns with the current trend in the PDE and machine learning communities, as initiated by Physics- Informed Neural Networks, advocating for designs that combine both physical modeling (the Hamilton-Jacobi PDE) and data. △ Less

Submitted 29 March, 2024; originally announced March 2024.

Comments: 5 pages, 5 figures

MSC Class: 37J06; 70H15; 70H20; 70G45; 65L05; 68T07 ACM Class: G.1.8; J.2

Continuous Approximations of Projected Dynamical Systems via Control Barrier Functions

Authors: Giannis Delimpaltadakis, Jorge Cortés, W. P. M. H. Heemels

Abstract: Projected Dynamical Systems (PDSs) form a class of discontinuous constrained dynamical systems, and have been used widely to solve optimization problems and variational inequalities. Recently, they have also gained significant attention for control purposes, such as high-performance integrators, saturated control and feedback optimization. In this work, we establish that locally Lipschitz continuo… ▽ More Projected Dynamical Systems (PDSs) form a class of discontinuous constrained dynamical systems, and have been used widely to solve optimization problems and variational inequalities. Recently, they have also gained significant attention for control purposes, such as high-performance integrators, saturated control and feedback optimization. In this work, we establish that locally Lipschitz continuous dynamics, involving Control Barrier Functions (CBFs), namely CBF-based dynamics, approximate PDSs. Specifically, we prove that trajectories of CBF-based dynamics uniformly converge to trajectories of PDSs, as a CBF-parameter is taken to infinity. Towards this, we also prove that CBF-based dynamics are perturbations of PDSs, with quantitative bounds on the perturbation. Our results pave the way to implement discontinuous PDS-based controllers in a continuous fashion, employing CBFs. Moreover, they can be employed to numerically simulate PDSs, overcoming disadvantages of existing discretization schemes, such as computing projections to possibly non-convex sets. Finally, this bridge between CBFs and PDSs may yield other potential benefits, including novel insights on stability. △ Less

Submitted 8 March, 2024; v1 submitted 1 March, 2024; originally announced March 2024.

Optimal Power Flow Pursuit via Feedback-based Safe Gradient Flow

Authors: Antonin Colot, Yiting Chen, Bertrand Cornelusse, Jorge Cortes, Emiliano Dall'Anese

Abstract: This paper considers the problem of controlling the operation of inverter-interfaced distributed energy resources (DERs) in a distribution grid, to achieve operational and performance goals with limited system-level information. We develop an online feedback optimization method to drive the DERs' power setpoints to solutions of an AC optimal power flow (OPF) problem based only on voltage measureme… ▽ More This paper considers the problem of controlling the operation of inverter-interfaced distributed energy resources (DERs) in a distribution grid, to achieve operational and performance goals with limited system-level information. We develop an online feedback optimization method to drive the DERs' power setpoints to solutions of an AC optimal power flow (OPF) problem based only on voltage measurements (and without requiring measurements of the power consumption of non-controllable assets). The proposed method - grounded on the theory of control barrier functions - is based on a continuous approximation of the projected gradient flow, appropriately modified to accommodate measurements from the power network. We provide results in terms of local exponential stability, and assess the robustness to errors in the measurements and in the system Jacobian matrix. We show that the proposed method ensures anytime satisfaction of the voltage constraints when no model and measurement errors are present; if these errors are present and are small, the voltage violation is practically negligible. We also discuss extensions of the framework to virtual power plant setups. Numerical experiments on a 93-bus distribution system and with realistic load and production profiles show a superior performance in terms of voltage regulation relative to existing methods. △ Less

Submitted 2 May, 2024; v1 submitted 19 December, 2023; originally announced December 2023.

Online Regulation of Dynamical Systems to Solutions of Constrained Optimization Problems

Authors: Yiting Chen, Liliaokeawawa Cothren, Jorge Cortes, Emiliano Dall'Anese

Abstract: This paper considers the problem of regulating a dynamical system to equilibria that are defined as solutions of an input- and state-constrained optimization problem. To solve this regulation task, we design a state feedback controller based on a continuous approximation of the projected gradient flow. We first show that the equilibria of the interconnection between the plant and the proposed cont… ▽ More This paper considers the problem of regulating a dynamical system to equilibria that are defined as solutions of an input- and state-constrained optimization problem. To solve this regulation task, we design a state feedback controller based on a continuous approximation of the projected gradient flow. We first show that the equilibria of the interconnection between the plant and the proposed controller correspond to critical points of the constrained optimization problem. We then derive sufficient conditions to ensure that, for the closed-loop system, isolated locally optimal solutions of the optimization problem are locally exponentially stable and show that input constraints are satisfied at all times by identifying an appropriate forward-invariant set. △ Less

Submitted 12 December, 2023; v1 submitted 29 November, 2023; originally announced November 2023.

Comments: This paper has been accepted for publication on IEEE Control Systems Letters

Regularity Properties of Optimization-Based Controllers

Authors: Pol Mestres, Ahmed Allibhoy, Jorge Cortés

Abstract: This paper studies regularity properties of optimization-based controllers, which are obtained by solving optimization problems where the parameter is the system state and the optimization variable is the input to the system. Under a wide range of assumptions on the optimization problem data, we provide an exhaustive collection of results about their regularity, and examine their implications on t… ▽ More This paper studies regularity properties of optimization-based controllers, which are obtained by solving optimization problems where the parameter is the system state and the optimization variable is the input to the system. Under a wide range of assumptions on the optimization problem data, we provide an exhaustive collection of results about their regularity, and examine their implications on the existence and uniqueness of solutions and the forward invariance guarantees for the resulting closed-loop systems. We discuss the broad relevance of the results in different areas of systems and controls. △ Less

Submitted 30 May, 2024; v1 submitted 22 November, 2023; originally announced November 2023.

Efficient Computation of Invariance Proximity: Closed-Form Error Bounds for Finite-Dimensional Koopman-Based Models

Authors: Masih Haseli, Jorge Cortés

Abstract: A popular way to approximate the Koopman operator's action on a finite-dimensional subspace of functions is via orthogonal projections. The quality of the projected model directly depends on the selected subspace, specifically on how close it is to being invariant under the Koopman operator. The notion of invariance proximity provides a tight upper bound on the worst-case relative prediction error… ▽ More A popular way to approximate the Koopman operator's action on a finite-dimensional subspace of functions is via orthogonal projections. The quality of the projected model directly depends on the selected subspace, specifically on how close it is to being invariant under the Koopman operator. The notion of invariance proximity provides a tight upper bound on the worst-case relative prediction error of the finite-dimensional model. However, its direct calculation is computationally challenging. This paper leverages the geometric structure behind the definition of invariance proximity to provide a closed-form expression in terms of Jordan principal angles on general inner product spaces. Unveiling this connection allows us to exploit specific isomorphisms to circumvent the computational challenges associated with spaces of functions and enables the use of existing efficient numerical routines to compute invariance proximity. △ Less

Submitted 2 March, 2024; v1 submitted 21 November, 2023; originally announced November 2023.

Comments: 11 pages

Anytime Solvers for Variational Inequalities: the (Recursive) Safe Monotone Flows

Authors: Ahmed Allibhoy, Jorge Cortés

Abstract: This paper synthesizes anytime algorithms, in the form of continuous-time dynamical systems, to solve monotone variational inequalities. We introduce three algorithms that solve this problem: the projected monotone flow, the safe monotone flow, and the recursive safe monotone flow. The first two systems admit dual interpretations: either as projected dynamical systems or as dynamical systems contr… ▽ More This paper synthesizes anytime algorithms, in the form of continuous-time dynamical systems, to solve monotone variational inequalities. We introduce three algorithms that solve this problem: the projected monotone flow, the safe monotone flow, and the recursive safe monotone flow. The first two systems admit dual interpretations: either as projected dynamical systems or as dynamical systems controlled with a feedback controller synthesized using techniques from safety-critical control. The third flow bypasses the need to solve quadratic programs along the trajectories by incorporating a dynamics whose equilibria precisely correspond to such solutions, and interconnecting the dynamical systems on different time scales. We perform a thorough analysis of the dynamical properties of all three systems. For the safe monotone flow, we show that equilibria correspond exactly with critical points of the original problem, and the constraint set is forward invariant and asymptotically stable. The additional assumption of convexity and monotonicity allows us to derive global stability guarantees, as well as establish the system is contracting when the constraint set is polyhedral. For the recursive safe monotone flow, we use tools from singular perturbation theory for contracting systems to show KKT points are locally exponentially stable and globally attracting, and obtain practical safety guarantees. We illustrate the performance of the flows on a two-player game example and also demonstrate the versatility for interconnection and regulation of dynamical processes of the safe monotone flow in an example of a receding horizon linear quadratic dynamic game. △ Less

Submitted 9 July, 2024; v1 submitted 15 November, 2023; originally announced November 2023.

Feasibility Analysis and Regularity Characterization of Distributionally Robust Safe Stabilizing Controllers

Authors: Pol Mestres, Kehan Long, Nikolay Atanasov, Jorge Cortés

Abstract: This paper studies the well-posedness and regularity of safe stabilizing optimization-based controllers for control-affine systems in the presence of model uncertainty. When the system dynamics contain unknown parameters, a finite set of samples can be used to formulate distributionally robust versions of control barrier function and control Lyapunov function constraints. Control synthesis with su… ▽ More This paper studies the well-posedness and regularity of safe stabilizing optimization-based controllers for control-affine systems in the presence of model uncertainty. When the system dynamics contain unknown parameters, a finite set of samples can be used to formulate distributionally robust versions of control barrier function and control Lyapunov function constraints. Control synthesis with such distributionally robust constraints can be achieved by solving a (convex) second-order cone program (SOCP). We provide one necessary and two sufficient conditions to check the feasibility of such optimization problems, characterize their computational complexity and numerically show that they are significantly faster to check than direct use of SOCP solvers. Finally, we also analyze the regularity of the resulting control laws. △ Less

Submitted 29 December, 2023; v1 submitted 9 November, 2023; originally announced November 2023.

Post-clustering Inference under Dependency

Authors: Javier González-Delgado, Juan Cortés, Pierre Neuvial

Abstract: Recent work by Gao et al. has laid the foundations for post-clustering inference. For the first time, the authors established a theoretical framework allowing to test for differences between means of estimated clusters. Additionally, they studied the estimation of unknown parameters while controlling the selective type I error. However, their theory was developed for independent observations ident… ▽ More Recent work by Gao et al. has laid the foundations for post-clustering inference. For the first time, the authors established a theoretical framework allowing to test for differences between means of estimated clusters. Additionally, they studied the estimation of unknown parameters while controlling the selective type I error. However, their theory was developed for independent observations identically distributed as $p$-dimensional Gaussian variables with a spherical covariance matrix. Here, we aim at extending this framework to a more convenient scenario for practical applications, where arbitrary dependence structures between observations and features are allowed. We show that a $p$-value for post-clustering inference under general dependency can be defined, and we assess the theoretical conditions allowing the compatible estimation of a covariance matrix. The theory is developed for hierarchical agglomerative clustering algorithms with several types of linkages, and for the $k$-means algorithm. We illustrate our method with synthetic data and real data of protein structures. △ Less

Submitted 18 October, 2023; originally announced October 2023.

Distributed and Anytime Algorithm for Network Optimization Problems with Separable Structure

Authors: Pol Mestres, Jorge Cortés

Abstract: This paper considers the problem of designing a dynamical system to solve constrained optimization problems in a distributed way and in an anytime fashion (i.e., such that the feasible set is forward invariant). For problems with separable objective function and constraints, we design an algorithm with the desired properties and establish its convergence. Simulations illustrate our results. This paper considers the problem of designing a dynamical system to solve constrained optimization problems in a distributed way and in an anytime fashion (i.e., such that the feasible set is forward invariant). For problems with separable objective function and constraints, we design an algorithm with the desired properties and establish its convergence. Simulations illustrate our results. △ Less

Submitted 6 September, 2023; originally announced September 2023.

Symmetry Preservation in Hamiltonian Systems: Simulation and Learning

Authors: Miguel Vaquero, Jorge Cortés, David Martín de Diego

Abstract: This work presents a general geometric framework for simulating and learning the dynamics of Hamiltonian systems that are invariant under a Lie group of transformations. This means that a group of symmetries is known to act on the system respecting its dynamics and, as a consequence, Noether's Theorem, conserved quantities are observed. We propose to simulate and learn the map**s of interest thr… ▽ More This work presents a general geometric framework for simulating and learning the dynamics of Hamiltonian systems that are invariant under a Lie group of transformations. This means that a group of symmetries is known to act on the system respecting its dynamics and, as a consequence, Noether's Theorem, conserved quantities are observed. We propose to simulate and learn the map**s of interest through the construction of $G$-invariant Lagrangian submanifolds, which are pivotal objects in symplectic geometry. A notable property of our constructions is that the simulated/learned dynamics also preserves the same conserved quantities as the original system, resulting in a more faithful surrogate of the original dynamics than non-symmetry aware methods, and in a more accurate predictor of non-observed trajectories. Furthermore, our setting is able to simulate/learn not only Hamiltonian flows, but any Lie group-equivariant symplectic transformation. Our designs leverage pivotal techniques and concepts in symplectic geometry and geometric mechanics: reduction theory, Noether's Theorem, Lagrangian submanifolds, momentum map**s, and coisotropic reduction among others. We also present methods to learn Poisson transformations while preserving the underlying geometry and how to endow non-geometric integrators with geometric properties. Thus, this work presents a novel attempt to harness the power of symplectic and Poisson geometry towards simulating and learning problems. △ Less

Submitted 30 August, 2023; originally announced August 2023.

Comments: 32 pages, 19 figures

MSC Class: 37J06; 70H15; 70H30; 37C79; 65L05 ACM Class: I.6.1; I.2.6

Modeling Nonlinear Control Systems via Koopman Control Family: Universal Forms and Subspace Invariance Proximity

Authors: Masih Haseli, Jorge Cortés

Abstract: This paper introduces the Koopman Control Family (KCF), a mathematical framework for modeling general discrete-time nonlinear control systems with the aim of providing a solid theoretical foundation for the use of Koopman-based methods in systems with inputs. We demonstrate that the concept of KCF captures the behavior of nonlinear control systems on a (potentially infinite-dimensional) function s… ▽ More This paper introduces the Koopman Control Family (KCF), a mathematical framework for modeling general discrete-time nonlinear control systems with the aim of providing a solid theoretical foundation for the use of Koopman-based methods in systems with inputs. We demonstrate that the concept of KCF captures the behavior of nonlinear control systems on a (potentially infinite-dimensional) function space. By employing a generalized notion of subspace invariance under the KCF, we establish a universal form for finite-dimensional models, which encompasses the commonly used linear, bilinear, and linear switched models as specific instances. In cases where the subspace is not invariant under the KCF, we propose a method for approximating models in general form and characterize the model's accuracy using the concept of invariance proximity. We end by discussing how the proposed framework naturally lends itself to data-driven modeling of control systems. △ Less

Submitted 14 March, 2024; v1 submitted 28 July, 2023; originally announced July 2023.

Comments: 17 pages

Cautious optimization via data informativity

Authors: Jaap Eising, Jorge Cortes

Abstract: This paper deals with the problem of accurately determining guaranteed suboptimal values of an unknown cost function on the basis of noisy measurements. We consider a set-valued variant to regression where, instead of finding a best estimate of the cost function, we reason over all functions compatible with the measurements and apply robust methods explicitly in terms of the data. Our treatment pr… ▽ More This paper deals with the problem of accurately determining guaranteed suboptimal values of an unknown cost function on the basis of noisy measurements. We consider a set-valued variant to regression where, instead of finding a best estimate of the cost function, we reason over all functions compatible with the measurements and apply robust methods explicitly in terms of the data. Our treatment provides data-based conditions under which closed-forms expressions of upper bounds of the unknown function can be obtained, and regularity properties like convexity and Lipschitzness can be established. These results allow us to provide tests for point- and set-wise verification of suboptimality, and tackle the cautious optimization of the unknown function in both one-shot and online scenarios. We showcase the versatility of the proposed methods in two control-relevant problems: data-driven contraction analysis of unknown nonlinear systems and suboptimal regulation with unknown dynamics and cost. Simulations illustrate our results. △ Less

Submitted 15 July, 2023; originally announced July 2023.

Continuity and Boundedness of Minimum-Norm CBF-Safe Controllers

Authors: Mohammed Alyaseen, Nikolay Atanasov, Jorge Cortes

Abstract: The existence of a Control Barrier Function (CBF) for a control-affine system provides a powerful design tool to ensure safety. Any controller that satisfies the CBF condition and ensures that the trajectories of the closed-loop system are well defined makes the zero superlevel set forward invariant. Such a controller is referred to as safe. This paper studies the regularity properties of the mini… ▽ More The existence of a Control Barrier Function (CBF) for a control-affine system provides a powerful design tool to ensure safety. Any controller that satisfies the CBF condition and ensures that the trajectories of the closed-loop system are well defined makes the zero superlevel set forward invariant. Such a controller is referred to as safe. This paper studies the regularity properties of the minimum-norm safe controller as a step** stone towards the design of general continuous safe feedback controllers. We characterize the set of points where the minimum-norm safe controller is discontinuous and show that it depends solely on the safe set and not on the particular CBF that describes it. Our analysis of the controller behavior as we approach a point of discontinuity allows us to identify sufficient conditions to ensure it grows unbounded or it remains bounded. Examples illustrate our results, providing insight into the conditions that lead to (un)bounded discontinuous minimum-norm controllers. △ Less

Submitted 12 June, 2023; originally announced June 2023.

Data-driven mode detection and stabilization of unknown switched linear systems

Authors: Jaap Eising, Shenyu Liu, Sonia Martinez, Jorge Cortes

Abstract: This paper considers the stabilization of unknown switched linear systems using data. Instead of a full system model, we have access to a finite number of trajectories of each of the different modes prior to the online operation of the system. On the basis of informative enough measurements, formally characterized in terms of linear matrix inequalities, we design an online switched controller that… ▽ More This paper considers the stabilization of unknown switched linear systems using data. Instead of a full system model, we have access to a finite number of trajectories of each of the different modes prior to the online operation of the system. On the basis of informative enough measurements, formally characterized in terms of linear matrix inequalities, we design an online switched controller that alternates between a mode detection phase and a stabilization phase. Since the specific currently-active mode is unknown, the controller employs the most recent online measurements to determine it by implementing computationally efficient tests that check compatibility with the set of systems consistent with the pre-collected measurements. The stabilization phase applies the stabilizing feedback gain corresponding to the identified active mode and monitors the evolution of the associated Lyapunov function to detect switches. When a switch is detected, the controller returns to the mode-detection phase. Under average dwell- and activation-time assumptions on the switching signal, we show that the proposed controller guarantees an input-to-state-like stability property of the closed-loop switched system. Various simulations illustrate our results. △ Less

Submitted 20 March, 2023; originally announced March 2023.

Comments: arXiv admin note: text overlap with arXiv:2207.14767

When sampling works in data-driven control: Informativity for stabilization in continuous time

Authors: Jaap Eising, Jorge Cortes

Abstract: This paper introduces a notion of data informativity for stabilization tailored to continuous-time signals and systems. We establish results comparable to those known for discrete-time systems with sampled data. We justify that additional assumptions on the properties of the noise signals are needed to understand when sampled versions of continuous-time signals are informative for stabilization, t… ▽ More This paper introduces a notion of data informativity for stabilization tailored to continuous-time signals and systems. We establish results comparable to those known for discrete-time systems with sampled data. We justify that additional assumptions on the properties of the noise signals are needed to understand when sampled versions of continuous-time signals are informative for stabilization, thereby introducing the notions of square Lipschitzness and total bounded variation. This allows us to connect the continuous and discrete domains, yielding sufficient conditions to synthesize a stabilizing controller for the true continuous-time system on the basis of sampled data. Simulations illustrate our results. △ Less

Submitted 13 June, 2024; v1 submitted 25 January, 2023; originally announced January 2023.

Feasibility and Regularity Analysis of Safe Stabilizing Controllers under Uncertainty

Authors: Pol Mestres, Jorge Cortés

Abstract: This paper studies the problem of safe stabilization of control-affine systems under uncertainty. Our starting point is the availability of worst-case or probabilistic error descriptions for the dynamics and a control barrier function (CBF). These descriptions give rise to second-order cone constraints (SOCCs) whose simultaneous satisfaction guarantees safe stabilization. We study the feasibility… ▽ More This paper studies the problem of safe stabilization of control-affine systems under uncertainty. Our starting point is the availability of worst-case or probabilistic error descriptions for the dynamics and a control barrier function (CBF). These descriptions give rise to second-order cone constraints (SOCCs) whose simultaneous satisfaction guarantees safe stabilization. We study the feasibility of such SOCCs and the regularity properties of various controllers satisfying them. △ Less

Submitted 2 December, 2023; v1 submitted 11 January, 2023; originally announced January 2023.

Distributionally Robust Lyapunov Function Search Under Uncertainty

Authors: Kehan Long, Yinzhuang Yi, Jorge Cortes, Nikolay Atanasov

Abstract: This paper develops methods for proving Lyapunov stability of dynamical systems subject to disturbances with an unknown distribution. We assume only a finite set of disturbance samples is available and that the true online disturbance realization may be drawn from a different distribution than the given samples. We formulate an optimization problem to search for a sum-of-squares (SOS) Lyapunov fun… ▽ More This paper develops methods for proving Lyapunov stability of dynamical systems subject to disturbances with an unknown distribution. We assume only a finite set of disturbance samples is available and that the true online disturbance realization may be drawn from a different distribution than the given samples. We formulate an optimization problem to search for a sum-of-squares (SOS) Lyapunov function and introduce a distributionally robust version of the Lyapunov function derivative constraint. We show that this constraint may be reformulated as several SOS constraints, ensuring that the search for a Lyapunov function remains in the class of SOS polynomial optimization problems. For general systems, we provide a distributionally robust chance-constrained formulation for neural network Lyapunov function search. Simulations demonstrate the validity and efficiency of either formulation on non-linear uncertain dynamical systems. △ Less

Submitted 11 July, 2024; v1 submitted 3 December, 2022; originally announced December 2022.

Comments: 5th Annual Learning for Dynamics & Control Conference Code: https://github.com/KehanLong/DR-Lyapunov-Function

Safe and Stable Control Synthesis for Uncertain System Models via Distributionally Robust Optimization

Authors: Kehan Long, Yinzhuang Yi, Jorge Cortes, Nikolay Atanasov

Abstract: This paper considers enforcing safety and stability of dynamical systems in the presence of model uncertainty. Safety and stability constraints may be specified using a control barrier function (CBF) and a control Lyapunov function (CLF), respectively. To take model uncertainty into account, robust and chance formulations of the constraints are commonly considered. However, this requires known err… ▽ More This paper considers enforcing safety and stability of dynamical systems in the presence of model uncertainty. Safety and stability constraints may be specified using a control barrier function (CBF) and a control Lyapunov function (CLF), respectively. To take model uncertainty into account, robust and chance formulations of the constraints are commonly considered. However, this requires known error bounds or a known distribution for the model uncertainty, and the resulting formulations may suffer from over-conservatism or over-confidence. In this paper, we assume that only a finite set of model parametric uncertainty samples is available and formulate a distributionally robust chance-constrained program (DRCCP) for control synthesis with CBF safety and CLF stability guarantees. To facilitate efficient computation of control inputs during online execution, we present a reformulation of the DRCCP as a second-order cone program (SOCP). Our formulation is evaluated in an adaptive cruise control example in comparison to 1) a baseline CLF-CBF quadratic programming approach, 2) a robust approach that assumes known error bounds of the system uncertainty, and 3) a chance-constrained approach that assumes a known Gaussian Process distribution of the uncertainty. △ Less

Submitted 16 March, 2023; v1 submitted 3 October, 2022; originally announced October 2022.

Data-driven stabilization of switched and constrained linear systems

Authors: Mattia Bianchi, Sergio Grammatico, Jorge Cortés

Abstract: We consider the design of state feedback control laws for both the switching signal and the continuous input of an unknown switched linear system, given past noisy input-state trajectories measurements. Based on Lyapunov-Metzler inequalities, we derive data-dependent bilinear programs whose solution directly returns a provably stabilizing controller and ensures $\mathcal{H}_2$ or… ▽ More We consider the design of state feedback control laws for both the switching signal and the continuous input of an unknown switched linear system, given past noisy input-state trajectories measurements. Based on Lyapunov-Metzler inequalities, we derive data-dependent bilinear programs whose solution directly returns a provably stabilizing controller and ensures $\mathcal{H}_2$ or $\mathcal{H}_{\infty}$ performance. We further present relaxations that considerably reduce the computational cost, still without requiring stabilizability of any of the switching modes. Finally, we showcase the flexibility of our approach on the constrained stabilization problem for a perturbed linear system. △ Less

Submitted 24 August, 2022; originally announced August 2022.

Comments: Submitted to IEEE Transactions on Automatic Control

k-Dimensional Agreement in Multiagent Systems for Distributed Coordination

Authors: Gianluca Bianchin, Miguel Vaquero, Jorge Cortes, Emiliano Dall'Anese

Abstract: Given a network of agents, each characterized by an initial scalar value, we study the problem of designing distributed linear algorithms such that the agents agree in a generalized sense on a vector quantity that belongs to a k-dimensional subspace. This problem is motivated by applications in distributed computing and sensing, where agents seek to simultaneously evaluate k independent functions… ▽ More Given a network of agents, each characterized by an initial scalar value, we study the problem of designing distributed linear algorithms such that the agents agree in a generalized sense on a vector quantity that belongs to a k-dimensional subspace. This problem is motivated by applications in distributed computing and sensing, where agents seek to simultaneously evaluate k independent functions at a common vector point by running a single distributed algorithm. We show that linear protocols can agree only on quantities that are oblique projections of the vector of initial conditions, and we provide an algebraic characterization of all agreement protocols that are consistent with a certain communication graph. By leveraging this characterization, we propose a design procedure for constructing agreement protocols, and we investigate what are the structural properties of communication networks that can reach an agreement on arbitrary weights. More broadly, our results show that agreement algorithms are capable of simultaneously solving k consensus problems at a fraction of the communication volume and space complexity of classical algorithms but, in general, require higher network connectivity. The applicability of the framework is illustrated via simulations on two problems in robotic formation and distributed regression. △ Less

Submitted 3 July, 2023; v1 submitted 18 August, 2022; originally announced August 2022.

Informativity for centralized design of distributed controllers for networked systems

Authors: Jaap Eising, Jorge Cortes

Abstract: Recent work in data-driven control has led to methods that find stabilizing controllers directly from measurements of an unknown system. However, for multi-agent systems we are often interested in finding controllers that take their distributed nature into account. For instance, the full state might not be available for feedback at every agent. In order to deal with such information, we consider t… ▽ More Recent work in data-driven control has led to methods that find stabilizing controllers directly from measurements of an unknown system. However, for multi-agent systems we are often interested in finding controllers that take their distributed nature into account. For instance, the full state might not be available for feedback at every agent. In order to deal with such information, we consider the problem of finding a feedback controller with a given block structure based on measured data. Moreover, we provide an algorithm that, if it converges, leads to a maximally sparse controller. △ Less

Submitted 29 July, 2022; originally announced July 2022.

Using data informativity for online stabilization of unknown switched linear systems

Authors: Jaap Eising, Shenyu Liu, Sonia Martinez, Jorge Cortes

Abstract: This work studies data-driven switched controller design for discrete-time switched linear systems. Instead of having access to the full system dynamics, an initialization phase is performed, during which noiseless measurements of the state and the input are collected for each mode. Under certain conditions on these measurements, we develop a stabilizing switched controller for the switched system… ▽ More This work studies data-driven switched controller design for discrete-time switched linear systems. Instead of having access to the full system dynamics, an initialization phase is performed, during which noiseless measurements of the state and the input are collected for each mode. Under certain conditions on these measurements, we develop a stabilizing switched controller for the switched system. To be precise, the controller switches between identifying the active mode of the system and applying a predetermined stabilizing feedback. We prove that if the system switches according to certain specifications, this controller stabilizes the closed-loop system. Simulations on a network example illustrate our approach. △ Less

Submitted 12 September, 2022; v1 submitted 29 July, 2022; originally announced July 2022.

Temporal Forward-Backward Consistency, Not Residual Error, Measures the Prediction Accuracy of Extended Dynamic Mode Decomposition

Authors: Masih Haseli, Jorge Cortés

Abstract: Extended Dynamic Mode Decomposition (EDMD) is a popular data-driven method to approximate the action of the Koopman operator on a linear function space spanned by a dictionary of functions. The accuracy of EDMD model critically depends on the quality of the particular dictionary's span, specifically on how close it is to being invariant under the Koopman operator. Motivated by the observation that… ▽ More Extended Dynamic Mode Decomposition (EDMD) is a popular data-driven method to approximate the action of the Koopman operator on a linear function space spanned by a dictionary of functions. The accuracy of EDMD model critically depends on the quality of the particular dictionary's span, specifically on how close it is to being invariant under the Koopman operator. Motivated by the observation that the residual error of EDMD, typically used for dictionary learning, does not encode the quality of the function space and is sensitive to the choice of basis, we introduce the novel concept of consistency index. We show that this measure, based on using EDMD forward and backward in time, enjoys a number of desirable qualities that make it suitable for data-driven modeling of dynamical systems: it measures the quality of the function space, it is invariant under the choice of basis, can be computed in closed form from the data, and provides a tight upper-bound for the relative root mean square error of all function predictions on the entire span of the dictionary. △ Less

Submitted 6 November, 2022; v1 submitted 15 July, 2022; originally announced July 2022.

Comments: 7 pages

Reinforcement Learning for Distributed Transient Frequency Control with Stability and Safety Guarantees

Authors: Zhenyi Yuan, Changhong Zhao, Jorge Cortes

Abstract: This paper proposes a reinforcement learning-based approach for optimal transient frequency control in power systems with stability and safety guarantees. Building on Lyapunov stability theory and safety-critical control, we derive sufficient conditions on the distributed controller design that ensure the stability and transient frequency safety of the closed-loop system. Our idea of distributed d… ▽ More This paper proposes a reinforcement learning-based approach for optimal transient frequency control in power systems with stability and safety guarantees. Building on Lyapunov stability theory and safety-critical control, we derive sufficient conditions on the distributed controller design that ensure the stability and transient frequency safety of the closed-loop system. Our idea of distributed dynamic budget assignment makes these conditions less conservative than those in recent literature, so that they can impose less stringent restrictions on the search space of control policies. We construct neural network controllers that parameterize such control policies and use reinforcement learning to train an optimal one. Simulations on the IEEE 39-bus network illustrate the guaranteed stability and safety properties of the controller along with its significantly improved optimality. △ Less

Submitted 6 January, 2024; v1 submitted 7 July, 2022; originally announced July 2022.

Journal ref: Systems & Control Letters, vol. 185, p. 105753, 2024

Control Barrier Function Based Design of Gradient Flows for Constrained Nonlinear Programming

Authors: Ahmed Allibhoy, Jorge Cortés

Abstract: This paper considers the problem of designing a continuous-time dynamical system that solves a constrained nonlinear optimization problem and makes the feasible set forward invariant and asymptotically stable. The invariance of the feasible set makes the dynamics anytime, when viewed as an algorithm, meaning it returns a feasible solution regardless of when it is terminated. Our approach augments… ▽ More This paper considers the problem of designing a continuous-time dynamical system that solves a constrained nonlinear optimization problem and makes the feasible set forward invariant and asymptotically stable. The invariance of the feasible set makes the dynamics anytime, when viewed as an algorithm, meaning it returns a feasible solution regardless of when it is terminated. Our approach augments the gradient flow of the objective function with inputs defined by the constraint functions, treats the feasible set as a safe set, and synthesizes a safe feedback controller using techniques from the theory of control barrier functions. The resulting closed-loop system, termed safe gradient flow, can be viewed as a primal-dual flow, where the state corresponds to the primal variables and the inputs correspond to the dual ones. We provide a detailed suite of conditions based on constraint qualification under which (both isolated and nonisolated) local minimizers are stable with respect to the feasible set and the whole state space. Comparisons with other continuous-time methods for optimization in a simple example illustrate the advantages of the safe gradient flow. △ Less

Submitted 27 November, 2023; v1 submitted 4 April, 2022; originally announced April 2022.

Optimization-Based Safe Stabilizing Feedback with Guaranteed Region of Attraction

Authors: Pol Mestres, Jorge Cortés

Abstract: This paper proposes an optimization with penalty-based feedback design framework for safe stabilization of control affine systems. Our starting point is the availability of a control Lyapunov function (CLF) and a control barrier function (CBF) defining affine-in-the-input inequalities that certify, respectively, the stability and safety objectives for the dynamics. Leveraging ideas from penalty me… ▽ More This paper proposes an optimization with penalty-based feedback design framework for safe stabilization of control affine systems. Our starting point is the availability of a control Lyapunov function (CLF) and a control barrier function (CBF) defining affine-in-the-input inequalities that certify, respectively, the stability and safety objectives for the dynamics. Leveraging ideas from penalty methods for constrained optimization, the proposed design framework imposes one of the inequalities as a hard constraint and the other one as a soft constraint. We study the properties of the closed-loop system under the resulting feedback controller and identify conditions on the penalty parameter to eliminate undesired equilibria that might arise. Going beyond the local stability guarantees available in the literature, we are able to provide an inner approximation of the region of attraction of the equilibrium, and identify conditions under which the whole safe set belongs to it. Simulations illustrate our results. △ Less

Submitted 25 July, 2022; v1 submitted 23 March, 2022; originally announced March 2022.

Comments: 6 pages, 1 figure, submitted to IEEE Control Systems Letters and 61st IEEE Conference on Decision and Control

MSC Class: 93C10

Journal ref: IEEE Control Systems Letters, vol. 7, pp. 367-372, 2023

Safe Control Synthesis with Uncertain Dynamics and Constraints

Authors: Kehan Long, Vikas Dhiman, Melvin Leok, Jorge Cortés, Nikolay Atanasov

Abstract: This paper considers safe control synthesis for dynamical systems with either probabilistic or worst-case uncertainty in both the dynamics model and the safety constraints. We formulate novel probabilistic and robust (worst-case) control Lyapunov function (CLF) and control barrier function (CBF) constraints that take into account the effect of uncertainty in either case. We show that either the pr… ▽ More This paper considers safe control synthesis for dynamical systems with either probabilistic or worst-case uncertainty in both the dynamics model and the safety constraints. We formulate novel probabilistic and robust (worst-case) control Lyapunov function (CLF) and control barrier function (CBF) constraints that take into account the effect of uncertainty in either case. We show that either the probabilistic or the robust (worst-case) formulation leads to a second-order cone program (SOCP), which enables efficient safe and stable control synthesis. We evaluate our approach in PyBullet simulations of an autonomous robot navigating in unknown environments and compare the performance with a baseline CLF-CBF quadratic programming approach. △ Less

Submitted 30 September, 2022; v1 submitted 19 February, 2022; originally announced February 2022.

Comments: Fix typos

Data-Driven Optimal Control of Bilinear Systems

Authors: Zhenyi Yuan, Jorge Cortes

Abstract: This paper develops a method to learn optimal controls from data for bilinear systems without a priori knowledge of the system dynamics. Given an unknown bilinear system, we first characterize when the available data is suitable to solve the optimal control problem. This characterization leads us to propose an online control experiment design procedure that guarantees that any input/state trajecto… ▽ More This paper develops a method to learn optimal controls from data for bilinear systems without a priori knowledge of the system dynamics. Given an unknown bilinear system, we first characterize when the available data is suitable to solve the optimal control problem. This characterization leads us to propose an online control experiment design procedure that guarantees that any input/state trajectory can be represented as a linear combination of collected input/state data matrices. Leveraging this data-based representation, we transform the original optimal control problem into an equivalent data-based optimization problem with bilinear constraints. We solve the latter by iteratively employing a convex-concave procedure to convexify it and find a locally optimal control sequence. Simulations show that the performance of the proposed data-based approach is comparable with model-based methods. △ Less

Submitted 12 October, 2023; v1 submitted 31 December, 2021; originally announced December 2021.

Journal ref: IEEE Control Systems Letters, vol. 6, pp. 2479-2484, 2022

Nonsmooth Control Barrier Function Design of Continuous Constraints for Network Connectivity Maintenance

Authors: Pio Ong, Beatrice Capelli, Lorenzo Sabattini, Jorge Cortes

Abstract: This paper considers the problem of maintaining global connectivity of a multi-robot system while executing a desired coordination task. Our approach builds on optimization-based feedback design formulations, where the nominal cost function and constraints encode desirable control objectives for the resulting input. Our solution uses the algebraic connectivity of the multi-robot interconnection to… ▽ More This paper considers the problem of maintaining global connectivity of a multi-robot system while executing a desired coordination task. Our approach builds on optimization-based feedback design formulations, where the nominal cost function and constraints encode desirable control objectives for the resulting input. Our solution uses the algebraic connectivity of the multi-robot interconnection topology as a control barrier function and critically embraces its nonsmooth nature. We take advantage of the understanding of how Laplacian eigenvalues behave as their multiplicities change, in combination with the flexibility provided by the concept of control barrier function, to carefully design additional constraints that guarantee the resulting optimization-based controller is continuous and maintains network connectivity. The technical treatment combines elements from set-valued theory, nonsmooth analysis, and algebraic graph theory to imbue the proposed constraints with regularity properties so that they can be smoothly combined with other control constraints. We provide simulations and experimental results illustrating the effectiveness and continuity of the proposed approach in a resource gathering problem. △ Less

Submitted 28 June, 2023; v1 submitted 11 December, 2021; originally announced December 2021.

Comments: To appear in Automatica

Agent-Supervisor Coordination for Decentralized Event-Triggered Optimization

Authors: Priyank Srivastava, Guido Cavraro, Jorge Cortes

Abstract: This paper proposes decentralized resource-aware coordination schemes for solving network optimization problems defined by objective functions which combine locally evaluable costs with network-wide coupling components. These methods are well suited for a group of supervised agents trying to solve an optimization problem under mild coordination requirements. Each agent has information on its local… ▽ More This paper proposes decentralized resource-aware coordination schemes for solving network optimization problems defined by objective functions which combine locally evaluable costs with network-wide coupling components. These methods are well suited for a group of supervised agents trying to solve an optimization problem under mild coordination requirements. Each agent has information on its local cost and coordinates with the network supervisor for information about the coupling term of the cost. The proposed approach is feedback-based and asynchronous by design, guarantees anytime feasibility, and ensures the asymptotic convergence of the network state to the desired optimizer. Numerical simulations on a power system example illustrate our results. △ Less

Submitted 31 December, 2021; v1 submitted 11 September, 2021; originally announced September 2021.

Comments: 6 pages, 1 figure

Journal ref: in IEEE Control Systems Letters, vol. 6, pp. 1970-1975 (2021)

Online Stochastic Optimization for Unknown Linear Systems: Data-Driven Synthesis and Controller Analysis

Authors: Gianluca Bianchin, Miguel Vaquero, Jorge Cortes, Emiliano Dall'Anese

Abstract: This paper proposes a data-driven control framework to regulate an unknown, stochastic linear dynamical system to the solution of a (stochastic) convex optimization problem. Despite the centrality of this problem, most of the available methods critically rely on a precise knowledge of the system dynamics (thus requiring off-line system identification and model refinement). To this aim, in this pap… ▽ More This paper proposes a data-driven control framework to regulate an unknown, stochastic linear dynamical system to the solution of a (stochastic) convex optimization problem. Despite the centrality of this problem, most of the available methods critically rely on a precise knowledge of the system dynamics (thus requiring off-line system identification and model refinement). To this aim, in this paper we first show that the steady-state transfer function of a linear system can be computed directly from control experiments, bypassing explicit model identification. Then, we leverage the estimated transfer function to design a controller -- which is inspired by stochastic gradient descent methods -- that regulates the system to the solution of the prescribed optimization problem. A distinguishing feature of our methods is that they do not require any knowledge of the system dynamics, disturbance terms, or their distributions. Our technical analysis combines concepts and tools from behavioral system theory, stochastic optimization with decision-dependent distributions, and stability analysis. We illustrate the applicability of the framework on a case study for mobility-on-demand ride service scheduling in Manhattan, NY. △ Less

Submitted 30 August, 2021; originally announced August 2021.

Performance-Barrier-Based Event-Triggered Control with Applications to Network Systems

Authors: Pio Ong, Jorge Cortes

Abstract: This paper proposes a novel framework for resource-aware control design termed performance-barrier-based triggering. Given a feedback policy, along with a Lyapunov function certificate that guarantees its correctness, we examine the problem of designing its digital implementation through event-triggered control while ensuring a prescribed performance is met and triggers occur as sparingly as possi… ▽ More This paper proposes a novel framework for resource-aware control design termed performance-barrier-based triggering. Given a feedback policy, along with a Lyapunov function certificate that guarantees its correctness, we examine the problem of designing its digital implementation through event-triggered control while ensuring a prescribed performance is met and triggers occur as sparingly as possible. Our methodology takes into account the performance residual, i.e., how well the system is doing in regards to the prescribed performance. Inspired by the notion of control barrier function, the trigger design allows the certificate to deviate from monotonically decreasing, with leeway specified as an increasing function of the performance residual, resulting in greater flexibility in prescribing update times. We study different types of performance specifications, with particular attention to quantifying the benefits of the proposed approach in the exponential case. We build on this to design intrinsically Zeno-free distributed triggers for network systems. A comparison of event-triggered approaches in a vehicle platooning problem shows how the proposed design meets the prescribed performance with a significantly lower number of controller updates. △ Less

Submitted 28 August, 2021; originally announced August 2021.

Comments: 15 pages, 2 figures, submitted to IEEE Transactions on Automatic Control

Generalizing Dynamic Mode Decomposition: Balancing Accuracy and Expressiveness in Koopman Approximations

Authors: Masih Haseli, Jorge Cortés

Abstract: This paper tackles the data-driven approximation of unknown dynamical systems using Koopman-operator methods. Given a dictionary of functions, these methods approximate the projection of the action of the operator on the finite-dimensional subspace spanned by the dictionary. We propose the Tunable Symmetric Subspace Decomposition algorithm to refine the dictionary, balancing its expressiveness and… ▽ More This paper tackles the data-driven approximation of unknown dynamical systems using Koopman-operator methods. Given a dictionary of functions, these methods approximate the projection of the action of the operator on the finite-dimensional subspace spanned by the dictionary. We propose the Tunable Symmetric Subspace Decomposition algorithm to refine the dictionary, balancing its expressiveness and accuracy. Expressiveness corresponds to the ability of the dictionary to describe the evolution of as many observables as possible and accuracy corresponds to the ability to correctly predict their evolution. Based on the observation that Koopman-invariant subspaces give rise to exact predictions, we reason that prediction accuracy is a function of the degree of invariance of the subspace generated by the dictionary and provide a data-driven measure to measure invariance proximity. The proposed algorithm iteratively prunes the initial functional space to identify a refined dictionary of functions that satisfies the desired level of accuracy while retaining as much of the original expressiveness as possible. We provide a full characterization of the algorithm properties and show that it generalizes both Extended Dynamic Mode Decomposition and Symmetric Subspace Decomposition. Simulations on planar systems show the effectiveness of the proposed methods in producing Koopman approximations of tunable accuracy that capture relevant information about the dynamical system. △ Less

Submitted 26 February, 2023; v1 submitted 8 August, 2021; originally announced August 2021.

Data-Driven Synthesis of Optimization-Based Controllers for Regulation of Unknown Linear Systems

Authors: Gianluca Bianchin, Miguel Vaquero, Jorge Cortes, Emiliano Dall'Anese

Abstract: This paper proposes a data-driven framework to solve time-varying optimization problems associated with unknown linear dynamical systems. Making online control decisions to regulate a dynamical system to the solution of an optimization problem is a central goal in many modern engineering applications. Yet, the available methods critically rely on a precise knowledge of the system dynamics, thus ma… ▽ More This paper proposes a data-driven framework to solve time-varying optimization problems associated with unknown linear dynamical systems. Making online control decisions to regulate a dynamical system to the solution of an optimization problem is a central goal in many modern engineering applications. Yet, the available methods critically rely on a precise knowledge of the system dynamics, thus mandating a preliminary system identification phase before a controller can be designed. In this work, we leverage results from behavioral theory to show that the steady-state transfer function of a linear system can be computed from data samples without any knowledge or estimation of the system model. We then use this data-driven representation to design a controller, inspired by a gradient-descent optimization method, that regulates the system to the solution of a convex optimization problem, without requiring any knowledge of the time-varying disturbances affecting the model equation. Results are tailored to cost functions satisfy the Polyak-Łojasiewicz inequality. △ Less

Submitted 7 September, 2021; v1 submitted 30 March, 2021; originally announced March 2021.

Nesterov Acceleration for Equality-Constrained Convex Optimization via Continuously Differentiable Penalty Functions

Authors: Priyank Srivastava, Jorge Cortes

Abstract: We propose a framework to use Nesterov's accelerated method for constrained convex optimization problems. Our approach consists of first reformulating the original problem as an unconstrained optimization problem using a continuously differentiable exact penalty function. This reformulation is based on replacing the Lagrange multipliers in the augmented Lagrangian of the original problem by Lagran… ▽ More We propose a framework to use Nesterov's accelerated method for constrained convex optimization problems. Our approach consists of first reformulating the original problem as an unconstrained optimization problem using a continuously differentiable exact penalty function. This reformulation is based on replacing the Lagrange multipliers in the augmented Lagrangian of the original problem by Lagrange multiplier functions. The expressions of these Lagrange multiplier functions, which depend upon the gradients of the objective function and the constraints, can make the unconstrained penalty function non-convex in general even if the original problem is convex. We establish sufficient conditions on the objective function and the constraints of the original problem under which the unconstrained penalty function is convex. This enables us to use Nesterov's accelerated gradient method for unconstrained convex optimization and achieve a guaranteed rate of convergence which is better than the state-of-the-art first-order algorithms for constrained convex optimization. Simulations illustrate our results. △ Less

Submitted 11 March, 2021; originally announced March 2021.

Comments: 7 pages, 1 figure

Journal ref: IEEE Control Systems Letters, vol. 5, no. 2, pp. 415-420, April 2021

Solving Linear Equations with Separable Problem Data over Directed Networks

Authors: Priyank Srivastava, Jorge Cortes

Abstract: This paper deals with linear algebraic equations where the global coefficient matrix and constant vector are given respectively, by the summation of the coefficient matrices and constant vectors of the individual agents. Our approach is based on reformulating the original problem as an unconstrained optimization. Based on this exact reformulation, we first provide a gradient-based, centralized alg… ▽ More This paper deals with linear algebraic equations where the global coefficient matrix and constant vector are given respectively, by the summation of the coefficient matrices and constant vectors of the individual agents. Our approach is based on reformulating the original problem as an unconstrained optimization. Based on this exact reformulation, we first provide a gradient-based, centralized algorithm which serves as a reference for the ensuing design of distributed algorithms. We propose two sets of exponentially stable continuous-time distributed algorithms that do not require the individual agent matrices to be invertible, and are based on estimating non-distributed terms in the centralized algorithm using dynamic average consensus. The first algorithm works for time-varying weight-balanced directed networks, and the second algorithm works for general directed networks for which the communication graphs might not be balanced. Numerical simulations illustrate our results. △ Less

Submitted 26 May, 2021; v1 submitted 5 March, 2021; originally announced March 2021.

Comments: 7 pages, 2 figures

Structural Characterization of Oscillations in Brain Networks with Rate Dynamics

Authors: Erfan Nozari, Robert Planas, Jorge Cortes

Abstract: Among the versatile forms of dynamical patterns of activity exhibited by the brain, oscillations are one of the most salient and extensively studied, yet are still far from being well understood. In this paper, we provide various structural characterizations of the existence of oscillatory behavior in neural networks using a classical neural mass model of mesoscale brain activity called linear-thr… ▽ More Among the versatile forms of dynamical patterns of activity exhibited by the brain, oscillations are one of the most salient and extensively studied, yet are still far from being well understood. In this paper, we provide various structural characterizations of the existence of oscillatory behavior in neural networks using a classical neural mass model of mesoscale brain activity called linear-threshold dynamics. Exploiting the switched-affine nature of this dynamics, we obtain various necessary and/or sufficient conditions on the network structure and its external input for the existence of oscillations in (i) two-dimensional excitatory-inhibitory networks (E-I pairs), (ii) networks with one inhibitory but arbitrary number of excitatory nodes, (iii) purely inhibitory networks with an arbitrary number of nodes, and (iv) networks of E-I pairs. Throughout our treatment, and given the arbitrary dimensionality of the considered dynamics, we rely on the lack of stable equilibria as a system-based proxy for the existence of oscillations, and provide extensive numerical results to support its tight relationship with the more standard, signal-based definition of oscillations in computational neuroscience. △ Less

Submitted 10 August, 2021; v1 submitted 27 February, 2021; originally announced March 2021.

High-Confidence Data-Driven Ambiguity Sets for Time-Varying Linear Systems

Authors: Dimitris Boskos, Jorge Cortés, Sonia Martínez

Abstract: This paper builds Wasserstein ambiguity sets for the unknown probability distribution of dynamic random variables leveraging noisy partial-state observations. The constructed ambiguity sets contain the true distribution of the data with quantifiable probability and can be exploited to formulate robust stochastic optimization problems with out-of-sample guarantees. We assume the random variable evo… ▽ More This paper builds Wasserstein ambiguity sets for the unknown probability distribution of dynamic random variables leveraging noisy partial-state observations. The constructed ambiguity sets contain the true distribution of the data with quantifiable probability and can be exploited to formulate robust stochastic optimization problems with out-of-sample guarantees. We assume the random variable evolves in discrete time under uncertain initial conditions and dynamics, and that noisy partial measurements are available. All random elements have unknown probability distributions and we make inferences about the distribution of the state vector using several output samples from multiple realizations of the process. To this end, we leverage an observer to estimate the state of each independent realization and exploit the outcome to construct the ambiguity sets. We illustrate our results in an economic dispatch problem involving distributed energy resources over which the scheduler has no direct control. △ Less

Submitted 20 July, 2021; v1 submitted 1 February, 2021; originally announced February 2021.

Time-Varying Optimization of LTI Systems via Projected Primal-Dual Gradient Flows

Authors: Gianluca Bianchin, Jorge Cortes, Jorge I. Poveda, Emiliano Dall'Anese

Abstract: This paper investigates the problem of regulating in real time a linear dynamical system to the solution trajectory of a time-varying constrained convex optimization problem. The proposed feedback controller is based on an adaptation of the saddle-flow dynamics, modified to take into account projections on constraint sets and output-feedback from the plant. We derive sufficient conditions on the t… ▽ More This paper investigates the problem of regulating in real time a linear dynamical system to the solution trajectory of a time-varying constrained convex optimization problem. The proposed feedback controller is based on an adaptation of the saddle-flow dynamics, modified to take into account projections on constraint sets and output-feedback from the plant. We derive sufficient conditions on the tunable parameters of the controller (inherently related to the time-scale separation between plant and controller dynamics) to guarantee exponential and input-to-state stability of the closed-loop system. The analysis is tailored to the case of time-varying strongly convex cost functions and polytopic output constraints. The theoretical results are further validated in a ramp metering control problem in a network of traffic highways. △ Less

Submitted 10 September, 2021; v1 submitted 5 January, 2021; originally announced January 2021.

Network Optimization via Smooth Exact Penalty Functions Enabled by Distributed Gradient Computation

Authors: Priyank Srivastava, Jorge Cortes

Abstract: This paper proposes a distributed algorithm for a network of agents to solve an optimization problem with separable objective function and locally coupled constraints. Our strategy is based on reformulating the original constrained problem as the unconstrained optimization of a smooth (continuously differentiable) exact penalty function. Computing the gradient of this penalty function in a distrib… ▽ More This paper proposes a distributed algorithm for a network of agents to solve an optimization problem with separable objective function and locally coupled constraints. Our strategy is based on reformulating the original constrained problem as the unconstrained optimization of a smooth (continuously differentiable) exact penalty function. Computing the gradient of this penalty function in a distributed way is challenging even under the separability assumptions on the original optimization problem. Our technical approach shows that the distributed computation problem for the gradient can be formulated as a system of linear algebraic equations defined by separable problem data. To solve it, we design an exponentially fast, input-to-state stable distributed algorithm that does not require the individual agent matrices to be invertible. We employ this strategy to compute the gradient of the penalty function at the current network state. Our distributed algorithmic solver for the original constrained optimization problem interconnects this estimation with the prescription of having the agents follow the resulting direction. Numerical simulations illustrate the convergence and robustness properties of the proposed algorithm. △ Less

Submitted 11 March, 2021; v1 submitted 8 November, 2020; originally announced November 2020.

Comments: 12 pages, 3 figures

Resource-Aware Discretization of Accelerated Optimization Flows

Authors: Miguel Vaquero, Pol Mestres, Jorge Cortés

Abstract: This paper tackles the problem of discretizing accelerated optimization flows while retaining their convergence properties. Inspired by the success of resource-aware control in develo** efficient closed-loop feedback implementations on digital systems, we view the last sampled state of the system as the resource to be aware of. The resulting variable-stepsize discrete-time algorithms retain by d… ▽ More This paper tackles the problem of discretizing accelerated optimization flows while retaining their convergence properties. Inspired by the success of resource-aware control in develo** efficient closed-loop feedback implementations on digital systems, we view the last sampled state of the system as the resource to be aware of. The resulting variable-stepsize discrete-time algorithms retain by design the desired decrease of the Lyapunov certificate of their continuous-time counterparts. Our algorithm design employs various concepts and techniques from resource-aware control that, in the present context, have interesting parallelisms with the discrete-time implementation of optimization algorithms. These include derivative- and performance-based triggers to monitor the evolution of the Lyapunov function as a way of determining the algorithm stepsize, exploiting sampled information to enhance algorithm performance, and employing high-order holds using more accurate integrators of the original dynamics. Throughout the paper, we illustrate our approach on a newly introduced continuous-time dynamics termed heavy-ball dynamics with displaced gradient, but the ideas proposed here have broad applicability to other globally asymptotically stable flows endowed with a Lyapunov certificate. △ Less

Submitted 18 September, 2020; originally announced September 2020.

Stability Assessment of Stochastic Differential-Algebraic Systems via Lyapunov Exponents with an Application to Power Systems

Authors: Andrés González-Zumba, Pedro Fernández-de-Córdoba, Juan-Carlos Cortés, Volker Mehrmann

Abstract: In this paper we discuss Stochastic Differential-Algebraic Equations (SDAEs) and the asymptotic stability assessment for such systems via Lyapunov exponents (LEs). We focus on index-one SDAEs and their reformulation as ordinary stochastic differential equation (SDE). Via ergodic theory it is then feasible to analyze the LEs via the random dynamical system generated by the underlying SDE. Once the… ▽ More In this paper we discuss Stochastic Differential-Algebraic Equations (SDAEs) and the asymptotic stability assessment for such systems via Lyapunov exponents (LEs). We focus on index-one SDAEs and their reformulation as ordinary stochastic differential equation (SDE). Via ergodic theory it is then feasible to analyze the LEs via the random dynamical system generated by the underlying SDE. Once the existence of well-defined LEs is guaranteed, we proceed to the use of numerical simulation techniques to determine the LEs numerically. Discrete and continuous $QR$ decomposition-based numerical methods are implemented to compute the fundamental solution matrix and to use it in the computation of the LEs. Important computational features of both methods are illustrated via numerical tests. Finally, the methods are applied to two applications from power systems engineering, including the single-machine infinite-bus (SMIB) power system model. △ Less

Submitted 26 May, 2020; originally announced May 2020.

Parallel Learning of Koopman Eigenfunctions and Invariant Subspaces For Accurate Long-Term Prediction

Authors: Masih Haseli, Jorge Cortés

Abstract: We present a parallel data-driven strategy to identify finite-dimensional functional spaces invariant under the Koopman operator associated to an unknown dynamical system. We build on the Symmetric Subspace Decomposition (SSD) algorithm, a centralized method that under mild conditions on data sampling provably finds the maximal Koopman-invariant subspace and all Koopman eigenfunctions in an arbitr… ▽ More We present a parallel data-driven strategy to identify finite-dimensional functional spaces invariant under the Koopman operator associated to an unknown dynamical system. We build on the Symmetric Subspace Decomposition (SSD) algorithm, a centralized method that under mild conditions on data sampling provably finds the maximal Koopman-invariant subspace and all Koopman eigenfunctions in an arbitrary finite-dimensional functional space. A network of processors, each aware of a common dictionary of functions and equipped with a local set of data snapshots, repeatedly interact over a directed communication graph. Each processor receives its neighbors' estimates of the invariant dictionary and refines its estimate by applying SSD with its local data on the intersection of the subspaces spanned by its own dictionary and the neighbors' dictionaries. We identify conditions on the network topology to ensure the algorithm identifies the maximal Koopman-invariant subspace in the span of the original dictionary, characterize its time, computational, and communication complexity, and establish its robustness against communication failures. △ Less

Submitted 29 March, 2021; v1 submitted 12 May, 2020; originally announced May 2020.

Comments: 14 pages

Data-based Receding Horizon Control of Linear Network Systems

Authors: Ahmed Allibhoy, Jorge Cortés

Abstract: We propose a distributed data-based predictive control scheme to stabilize a network system described by linear dynamics. Agents cooperate to predict the future system evolution without knowledge of the dynamics, relying instead on learning a data-based representation from a single sample trajectory. We employ this representation to reformulate the finite-horizon Linear Quadratic Regulator problem… ▽ More We propose a distributed data-based predictive control scheme to stabilize a network system described by linear dynamics. Agents cooperate to predict the future system evolution without knowledge of the dynamics, relying instead on learning a data-based representation from a single sample trajectory. We employ this representation to reformulate the finite-horizon Linear Quadratic Regulator problem as a network optimization with separable objective functions and locally expressible constraints. We show that the controller resulting from approximately solving this problem using a distributed optimization algorithm in a receding horizon manner is stabilizing. We validate our results through numerical simulations. △ Less

Submitted 30 August, 2020; v1 submitted 22 March, 2020; originally announced March 2020.

Safety-Critical Event Triggered Control via Input-to-State Safe Barrier Functions

Authors: Andrew J. Taylor, Pio Ong, Jorge Cortes, Aaron D. Ames

Abstract: The efficient utilization of available resources while simultaneously achieving control objectives is a primary motivation in the event-triggered control paradigm. In many modern control applications, one such objective is enforcing the safety of a system. The goal of this paper is to carry out this vision by combining event-triggered and safety-critical control design. We discuss how a direct tra… ▽ More The efficient utilization of available resources while simultaneously achieving control objectives is a primary motivation in the event-triggered control paradigm. In many modern control applications, one such objective is enforcing the safety of a system. The goal of this paper is to carry out this vision by combining event-triggered and safety-critical control design. We discuss how a direct transcription, in the context of safety, of event-triggered methods for stabilization may result in designs that are not implementable on real hardware due to the lack of a minimum interevent time. We provide a counterexample showing this phenomena and, building on the insight gained, propose an event-triggered control approach via Input to State Safe Barrier Functions that achieves safety while ensuring that interevent times are uniformly lower bounded. We illustrate our results in simulation. △ Less

Submitted 15 March, 2020; originally announced March 2020.

Comments: 6 pages, 2 figures, submitted to L-CSS + CDC 2020