Showing 1–4 of 4 results for author: Cothren, L

Online Regulation of Dynamical Systems to Solutions of Constrained Optimization Problems

Authors: Yiting Chen, Liliaokeawawa Cothren, Jorge Cortes, Emiliano Dall'Anese

Abstract: This paper considers the problem of regulating a dynamical system to equilibria that are defined as solutions of an input- and state-constrained optimization problem. To solve this regulation task, we design a state feedback controller based on a continuous approximation of the projected gradient flow. We first show that the equilibria of the interconnection between the plant and the proposed cont… ▽ More This paper considers the problem of regulating a dynamical system to equilibria that are defined as solutions of an input- and state-constrained optimization problem. To solve this regulation task, we design a state feedback controller based on a continuous approximation of the projected gradient flow. We first show that the equilibria of the interconnection between the plant and the proposed controller correspond to critical points of the constrained optimization problem. We then derive sufficient conditions to ensure that, for the closed-loop system, isolated locally optimal solutions of the optimization problem are locally exponentially stable and show that input constraints are satisfied at all times by identifying an appropriate forward-invariant set. △ Less

Submitted 12 December, 2023; v1 submitted 29 November, 2023; originally announced November 2023.

Comments: This paper has been accepted for publication on IEEE Control Systems Letters

Perception-Based Sampled-Data Optimization of Dynamical Systems

Authors: Liliaokeawawa Cothren, Gianluca Bianchin, Sarah Dean, Emiliano Dall'Anese

Abstract: Motivated by perception-based control problems in autonomous systems, this paper addresses the problem of develo** feedback controllers to regulate the inputs and the states of a dynamical system to optimal solutions of an optimization problem when one has no access to exact measurements of the system states. In particular, we consider the case where the states need to be estimated from high-dim… ▽ More Motivated by perception-based control problems in autonomous systems, this paper addresses the problem of develo** feedback controllers to regulate the inputs and the states of a dynamical system to optimal solutions of an optimization problem when one has no access to exact measurements of the system states. In particular, we consider the case where the states need to be estimated from high-dimensional sensory data received only at discrete time intervals. We develop a sampled-data feedback controller that is based on adaptations of a projected gradient descent method, and that includes neural networks as integral components to estimate the state of the system from perceptual information. We derive sufficient conditions to guarantee (local) input-to-state stability of the control loop. Moreover, we show that the interconnected system tracks the solution trajectory of the underlying optimization problem up to an error that depends on the approximation errors of the neural network and on the time-variability of the optimization problem; the latter originates from time-varying safety and performance objectives, input constraints, and unknown disturbances. As a representative application, we illustrate our results with numerical simulations for vision-based autonomous driving. △ Less

Submitted 13 October, 2023; v1 submitted 17 November, 2022; originally announced November 2022.

Comments: This is an extended version of the paper accepted to IFAC World Congress 2023 for publication, containing proofs, and recently updated to address a typo in Assumption 3

Online Optimization of Dynamical Systems with Deep Learning Perception

Authors: Liliaokeawawa Cothren, Gianluca Bianchin, Emiliano Dall'Anese

Abstract: This paper considers the problem of controlling a dynamical system when the state cannot be directly measured and the control performance metrics are unknown or partially known. In particular, we focus on the design of data-driven controllers to regulate a dynamical system to the solution of a constrained convex optimization problem where: i) the state must be estimated from nonlinear and possibly… ▽ More This paper considers the problem of controlling a dynamical system when the state cannot be directly measured and the control performance metrics are unknown or partially known. In particular, we focus on the design of data-driven controllers to regulate a dynamical system to the solution of a constrained convex optimization problem where: i) the state must be estimated from nonlinear and possibly high-dimensional data; and, ii) the cost of the optimization problem -- which models control objectives associated with inputs and states of the system -- is not available and must be learned from data. We propose a data-driven feedback controller that is based on adaptations of a projected gradient-flow method; the controller includes neural networks as integral components for the estimation of the unknown functions. Leveraging stability theory for perturbed systems, we derive sufficient conditions to guarantee exponential input-to-state stability (ISS) of the control loop. In particular, we show that the interconnected system is ISS with respect to the approximation errors of the neural network and unknown disturbances affecting the system. The transient bounds combine the universal approximation property of deep neural networks with the ISS characterization. Illustrative numerical results are presented in the context of control of robotics and epidemics. △ Less

Submitted 30 August, 2023; v1 submitted 19 May, 2022; originally announced May 2022.

Comments: This is an extended version of the paper published in the IEEE Open Journal of Control Systems - Special Section on Machine Learning with Control, containing proofs with a correction in Section II.A

Data-Enabled Gradient Flow as Feedback Controller: Regulation of Linear Dynamical Systems to Minimizers of Unknown Functions

Authors: Liliaokeawawa Cothren, Gianluca Bianchin, Emiliano Dall'Anese

Abstract: This paper considers the problem of regulating a linear dynamical system to the solution of a convex optimization problem with an unknown or partially-known cost. We design a data-driven feedback controller - based on gradient flow dynamics - that (i) is augmented with learning methods to estimate the cost function based on infrequent (and possibly noisy) functional evaluations; and, concurrently,… ▽ More This paper considers the problem of regulating a linear dynamical system to the solution of a convex optimization problem with an unknown or partially-known cost. We design a data-driven feedback controller - based on gradient flow dynamics - that (i) is augmented with learning methods to estimate the cost function based on infrequent (and possibly noisy) functional evaluations; and, concurrently, (ii) is designed to drive the inputs and outputs of the dynamical system to the optimizer of the problem. We derive sufficient conditions on the learning error and the controller gain to ensure that the error between the optimizer of the problem and the state of the closed-loop system is ultimately bounded; the error bound accounts for the functional estimation errors and the temporal variability of the unknown disturbance affecting the linear dynamical system. Our results directly lead to exponential input-to-state stability of the closed-loop system. The proposed method and the theoretical bounds are validated numerically. △ Less

Submitted 2 April, 2022; v1 submitted 2 December, 2021; originally announced December 2021.

Comments: This is an extended version of the paper accepted to the 4th Annual Learning for Dynamics & Control Conference (L4DC 2022), containing proofs