Showing 1–34 of 34 results for author: Iannelli, A

A hybrid systems framework for data-based adaptive control of linear time-varying systems

Authors: Andrea Iannelli, Romain Postoyan

Abstract: We consider the data-driven stabilization of discrete-time linear time-varying systems. The controller is defined as a linear state-feedback law whose gain is adapted to the plant changes through a data-based event-triggering rule. To do so, we monitor the evolution of a data-based Lyapunov function along the solution. When this Lyapunov function does not satisfy a designed desirable condition, an… ▽ More We consider the data-driven stabilization of discrete-time linear time-varying systems. The controller is defined as a linear state-feedback law whose gain is adapted to the plant changes through a data-based event-triggering rule. To do so, we monitor the evolution of a data-based Lyapunov function along the solution. When this Lyapunov function does not satisfy a designed desirable condition, an episode is triggered to update the controller gain and the corresponding Lyapunov function using the last collected data. The resulting closed-loop dynamics hence exhibits both physical jumps, due to the system dynamics, and episodic jumps, which naturally leads to a hybrid discrete-time system. We leverage the inherent robustness of the controller and provide general conditions under which various stability notions can be established for the system. Two notable cases where these conditions are satisfied are treated, and numerical results illustrating the relevance of the approach are discussed. △ Less

Submitted 23 May, 2024; originally announced May 2024.

On the Regret of Recursive Methods for Discrete-Time Adaptive Control with Matched Uncertainty

Authors: Aren Karapetyan, Efe C. Balta, Anastasios Tsiamis, Andrea Iannelli, John Lygeros

Abstract: Continuous-time adaptive controllers for systems with a matched uncertainty often comprise an online parameter estimator and a corresponding parameterized controller to cancel the uncertainty. However, such methods are often unimplementable, as they depend on an unobserved estimation error. We consider the equivalent discrete-time setting with a causal information structure. We propose a novel, on… ▽ More Continuous-time adaptive controllers for systems with a matched uncertainty often comprise an online parameter estimator and a corresponding parameterized controller to cancel the uncertainty. However, such methods are often unimplementable, as they depend on an unobserved estimation error. We consider the equivalent discrete-time setting with a causal information structure. We propose a novel, online proximal point method-based adaptive controller, that under a weak persistence of excitation (PE) condition is asymptotically stable and achieves finite regret, scaling only with the time required to fulfill the PE condition. We show the same also for the widely-used recursive least squares with exponential forgetting controller under a stronger PE condition. △ Less

Submitted 2 April, 2024; originally announced April 2024.

Learning Soft Constrained MPC Value Functions: Efficient MPC Design and Implementation providing Stability and Safety Guarantees

Authors: Nicolas Chatzikiriakos, Kim P. Wabersich, Felix Berkel, Patricia Pauli, Andrea Iannelli

Abstract: Model Predictive Control (MPC) can be applied to safety-critical control problems, providing closed-loop safety and performance guarantees. Implementation of MPC controllers requires solving an optimization problem at every sampling instant, which is challenging to execute on embedded hardware. To address this challenge, we propose a framework that combines a tightened soft constrained MPC formula… ▽ More Model Predictive Control (MPC) can be applied to safety-critical control problems, providing closed-loop safety and performance guarantees. Implementation of MPC controllers requires solving an optimization problem at every sampling instant, which is challenging to execute on embedded hardware. To address this challenge, we propose a framework that combines a tightened soft constrained MPC formulation with supervised learning to approximate the MPC value function. This combination enables us to obtain a corresponding optimal control law, which can be implemented efficiently on embedded platforms. The framework ensures stability and constraint satisfaction for various nonlinear systems. While the design effort is similar to that of nominal MPC, the proposed formulation provides input-to-state stability (ISS) with respect to the approximation error of the value function. Furthermore, we prove that the value function corresponding to the soft constrained MPC problem is Lipschitz continuous for Lipschitz continuous systems, even if the optimal control law may be discontinuous. This serves two purposes: First, it allows to relate approximation errors to a sufficiently large constraint tightening to obtain constraint satisfaction guarantees. Second, it paves the way for an efficient supervised learning procedure to obtain a continuous value function approximation. We demonstrate the effectiveness of the method using a nonlinear numerical example. △ Less

Submitted 17 May, 2024; v1 submitted 15 January, 2024; originally announced January 2024.

The Role of Identification in Data-driven Policy Iteration: A System Theoretic Study

Authors: Bowen Song, Andrea Iannelli

Abstract: The goal of this article is to study fundamental mechanisms behind so-called indirect and direct data-driven control for unknown systems. Specifically, we consider policy iteration applied to the linear quadratic regulator problem. Two iterative procedures, where data collected from the system are repeatedly used to compute new estimates of the desired optimal controller, are considered. In indire… ▽ More The goal of this article is to study fundamental mechanisms behind so-called indirect and direct data-driven control for unknown systems. Specifically, we consider policy iteration applied to the linear quadratic regulator problem. Two iterative procedures, where data collected from the system are repeatedly used to compute new estimates of the desired optimal controller, are considered. In indirect policy iteration, data are used to obtain an updated model estimate through a recursive identification scheme, which is used in a certainty-equivalent fashion to perform the classic policy iteration update. By casting the concurrent model identification and control design as a feedback interconnection between two algorithmic systems, we provide a closed-loop analysis that shows convergence and robustness properties for arbitrary levels of excitation in the data. In direct policy iteration, data are used to approximate the value function and design the associated controller without requiring the intermediate identification step. After proposing an extension to a recently proposed scheme that overcomes potential identifiability issues, we establish under which conditions this procedure is guaranteed to deliver the optimal controller. Based on these analyses we are able to compare the strengths and limitations of the two approaches, highlighting aspects such as the required samples, convergence properties, and excitation requirement. Simulations are also provided to illustrate the results. △ Less

Submitted 29 April, 2024; v1 submitted 12 January, 2024; originally announced January 2024.

Closed-Loop Finite-Time Analysis of Suboptimal Online Control

Authors: Aren Karapetyan, Efe C. Balta, Andrea Iannelli, John Lygeros

Abstract: Suboptimal methods in optimal control arise due to a limited computational budget, unknown system dynamics, or a short prediction window among other reasons. Although these methods are ubiquitous, their transient performance remains relatively unstudied. We consider the control of discrete-time, nonlinear time-varying dynamical systems and establish sufficient conditions to analyze the finite-time… ▽ More Suboptimal methods in optimal control arise due to a limited computational budget, unknown system dynamics, or a short prediction window among other reasons. Although these methods are ubiquitous, their transient performance remains relatively unstudied. We consider the control of discrete-time, nonlinear time-varying dynamical systems and establish sufficient conditions to analyze the finite-time closed-loop performance of such methods in terms of the additional cost incurred due to suboptimality. Finite-time guarantees allow the control design to distribute a limited computational budget over a time horizon and estimate the on-the-go loss in performance due to sub-optimality. We study exponential incremental input-to-state stabilizing policies, and show that for nonlinear systems, under some mild conditions, this property is directly implied by exponential stability without further assumptions on global smoothness. The analysis is showcased on a suboptimal model predictive control use case. △ Less

Submitted 9 December, 2023; originally announced December 2023.

Stochastic Data-Driven Predictive Control: Regularization, Estimation, and Constraint Tightening

Authors: Mingzhou Yin, Andrea Iannelli, Roy S. Smith

Abstract: Data-driven predictive control methods based on the Willems' fundamental lemma have shown great success in recent years. These approaches use receding horizon predictive control with nonparametric data-driven predictors instead of model-based predictors. This study addresses three problems of applying such algorithms under unbounded stochastic uncertainties: 1) tuning-free regularizer design, 2) i… ▽ More Data-driven predictive control methods based on the Willems' fundamental lemma have shown great success in recent years. These approaches use receding horizon predictive control with nonparametric data-driven predictors instead of model-based predictors. This study addresses three problems of applying such algorithms under unbounded stochastic uncertainties: 1) tuning-free regularizer design, 2) initial condition estimation, and 3) reliable constraint satisfaction, by using stochastic prediction error quantification. The regularizer is designed by leveraging the expected output cost. An initial condition estimator is proposed by filtering the measurements with the one-step-ahead stochastic data-driven prediction. A novel constraint-tightening method, using second-order cone constraints, is presented to ensure high-probability chance constraint satisfaction. Numerical results demonstrate that the proposed methods lead to satisfactory control performance in terms of both control cost and constraint satisfaction, with significantly improved initial condition estimation. △ Less

Submitted 5 December, 2023; originally announced December 2023.

A harmonic framework for the identification of linear time-periodic systems

Authors: Flora Vernerey, Pierre Riedinger, Andrea Iannelli, Jamal Daafouz

Abstract: This paper presents a novel approach for the identification of linear time-periodic (LTP) systems in continuous time. This method is based on harmonic modeling and consists in converting any LTP system into an equivalent LTI system with infinite dimension. Leveraging specific harmonic properties, we demonstrate that solving this infinite-dimensional identification problem can be reduced to solving… ▽ More This paper presents a novel approach for the identification of linear time-periodic (LTP) systems in continuous time. This method is based on harmonic modeling and consists in converting any LTP system into an equivalent LTI system with infinite dimension. Leveraging specific harmonic properties, we demonstrate that solving this infinite-dimensional identification problem can be reduced to solving a finitedimensional linear least-squares problem. The result is an approximation of the original solution with an arbitrarily small error. Our approach offers several significant advantages. The first one is closely tied to the harmonic system's inherent LTI characteristic, along with the Toeplitz structure exhibited by its elements. The second advantage is related to the regularization property achieved through the integral action when computing the phasors from input and state trajectories. Finally, our method avoids the computation of signals' derivative. This sets our approach apart from existing methods that rely on such computations, which can be a notable drawback, especially in continuous-time settings. We provide numerical simulations that convincingly demonstrate the effectiveness of the proposed method, even in scenarios where signals are corrupted by noise. △ Less

Submitted 17 April, 2024; v1 submitted 28 September, 2023; originally announced September 2023.

An Online Learning Analysis of Minimax Adaptive Control

Authors: Venkatraman Renganathan, Andrea Iannelli, Anders Rantzer

Abstract: We present an online learning analysis of minimax adaptive control for the case where the uncertainty includes a finite set of linear dynamical systems. Precisely, for each system inside the uncertainty set, we define the model-based regret by comparing the state and input trajectories from the minimax adaptive controller against that of an optimal controller in hindsight that knows the true dynam… ▽ More We present an online learning analysis of minimax adaptive control for the case where the uncertainty includes a finite set of linear dynamical systems. Precisely, for each system inside the uncertainty set, we define the model-based regret by comparing the state and input trajectories from the minimax adaptive controller against that of an optimal controller in hindsight that knows the true dynamics. We then define the total regret as the worst case model-based regret with respect to all models in the considered uncertainty set. We study how the total regret accumulates over time and its effect on the adaptation mechanism employed by the controller. Moreover, we investigate the effect of the disturbance on the growth of the regret over time and draw connections between robustness of the controller and the associated regret rate. △ Less

Submitted 11 September, 2023; v1 submitted 14 July, 2023; originally announced July 2023.

On the Finite-Time Behavior of Suboptimal Linear Model Predictive Control

Authors: Aren Karapetyan, Efe C. Balta, Andrea Iannelli, John Lygeros

Abstract: Inexact methods for model predictive control (MPC), such as real-time iterative schemes or time-distributed optimization, alleviate the computational burden of exact MPC by providing suboptimal solutions. While the asymptotic stability of such algorithms is well studied, their finite-time performance has not received much attention. In this work, we quantify the performance of suboptimal linear mo… ▽ More Inexact methods for model predictive control (MPC), such as real-time iterative schemes or time-distributed optimization, alleviate the computational burden of exact MPC by providing suboptimal solutions. While the asymptotic stability of such algorithms is well studied, their finite-time performance has not received much attention. In this work, we quantify the performance of suboptimal linear model predictive control in terms of the additional closed-loop cost incurred due to performing only a finite number of optimization iterations. Leveraging this novel analysis framework, we propose a novel suboptimal MPC algorithm with a diminishing horizon length and finite-time closed-loop performance guarantees. This analysis allows the designer to plan a limited computational power budget distribution to achieve a desired performance level. We provide numerical examples to illustrate the algorithm's transient behavior and computational complexity. △ Less

Submitted 20 November, 2023; v1 submitted 17 May, 2023; originally announced May 2023.

Comments: Accepted for Publication at the 62nd IEEE Conference on Decision and Control (CDC), Singapore, 2023

Dual adaptive MPC using an exact set-membership reformulation

Authors: Anilkumar Parsi, Diyou Liu, Andrea Iannelli, Roy S. Smith

Abstract: Adaptive model predictive control (MPC) methods using set-membership identification to reduce parameter uncertainty are considered in this work. Strong duality is used to reformulate the set-membership equations exactly within the MPC optimization. A predicted worst-case cost is then used to enable performance-oriented exploration. The proposed approach guarantees robust constraint satisfaction an… ▽ More Adaptive model predictive control (MPC) methods using set-membership identification to reduce parameter uncertainty are considered in this work. Strong duality is used to reformulate the set-membership equations exactly within the MPC optimization. A predicted worst-case cost is then used to enable performance-oriented exploration. The proposed approach guarantees robust constraint satisfaction and recursive feasibility. It is shown that method can be implemented using homothetic tube and flexible tube parameterizations of state tubes, and a simulation study demonstrates performance improvement over state-of-the-art controllers. △ Less

Submitted 29 November, 2022; originally announced November 2022.

Comments: Submitted to IFAC World Congress 2023

Implications of Regret on Stability of Linear Dynamical Systems

Authors: Aren Karapetyan, Anastasios Tsiamis, Efe C. Balta, Andrea Iannelli, John Lygeros

Abstract: The setting of an agent making decisions under uncertainty and under dynamic constraints is common for the fields of optimal control, reinforcement learning, and recently also for online learning. In the online learning setting, the quality of an agent's decision is often quantified by the concept of regret, comparing the performance of the chosen decisions to the best possible ones in hindsight.… ▽ More The setting of an agent making decisions under uncertainty and under dynamic constraints is common for the fields of optimal control, reinforcement learning, and recently also for online learning. In the online learning setting, the quality of an agent's decision is often quantified by the concept of regret, comparing the performance of the chosen decisions to the best possible ones in hindsight. While regret is a useful performance measure, when dynamical systems are concerned, it is important to also assess the stability of the closed-loop system for a chosen policy. In this work, we show that for linear state feedback policies and linear systems subject to adversarial disturbances, linear regret implies asymptotic stability in both time-varying and time-invariant settings. Conversely, we also show that bounded input bounded state stability and summability of the state transition matrices imply linear regret. △ Less

Submitted 15 April, 2023; v1 submitted 14 November, 2022; originally announced November 2022.

Comments: Accepted for presentation at the IFAC World Congress 2023, Yokohama, Japan

A quantitative and constructive proof of Willems' Fundamental Lemma and its implications

Authors: Julian Berberich, Andrea Iannelli, Alberto Padoan, Jeremy Coulson, Florian Dörfler, Frank Allgöwer

Abstract: Willems' Fundamental Lemma provides a powerful data-driven parametrization of all trajectories of a controllable linear time-invariant system based on one trajectory with persistently exciting (PE) input. In this paper, we present a novel proof of this result which is inspired by the classical adaptive control literature and differs from existing proofs in multiple aspects. The proof involves a qu… ▽ More Willems' Fundamental Lemma provides a powerful data-driven parametrization of all trajectories of a controllable linear time-invariant system based on one trajectory with persistently exciting (PE) input. In this paper, we present a novel proof of this result which is inspired by the classical adaptive control literature and differs from existing proofs in multiple aspects. The proof involves a quantitative and directional PE notion, allowing to characterize robust PE properties via singular value bounds, as opposed to binary rank-based PE conditions. Further, the proof is constructive, i.e., we derive an explicit PE lower bound for the generated data. As a contribution of independent interest, we generalize existing PE results from the adaptive control literature and reveal a crucial role of the system's zeros. △ Less

Submitted 7 March, 2023; v1 submitted 1 August, 2022; originally announced August 2022.

Comments: Final version, accepted for presentation at the American Control Conference (ACC) 2023

Stochastic MPC with robustness to bounded parametric uncertainty

Authors: Elena Arcari, Andrea Iannelli, Andrea Carron, Melanie N. Zeilinger

Abstract: The performance of model-based control techniques strongly depends on the quality of the employed dynamics model. If strong guarantees are desired, it is therefore common to robustly treat all possible sources of uncertainty, such as model inaccuracies or external disturbances. This, however, can result in overly conservative control strategies. In this paper, we present a stochastic model predict… ▽ More The performance of model-based control techniques strongly depends on the quality of the employed dynamics model. If strong guarantees are desired, it is therefore common to robustly treat all possible sources of uncertainty, such as model inaccuracies or external disturbances. This, however, can result in overly conservative control strategies. In this paper, we present a stochastic model predictive control approach for discrete-time LTI systems subject to bounded parametric uncertainty and potentially unbounded stochastic additive noise. The proposed scheme makes use of homothetic tubes along the prediction horizon for a robust treatment of parametric uncertainty. Stochastic noise is handled by non-conservatively tightening constraints using the concept of probabilistic reachable sets (PRS). In order to accommodate all possible parametric uncertainties, we provide a strategy for generating "robustified" PRS based only on first and second moments of the noise sequence. In the case of quadratic cost functions, and under a further i.i.d. assumption on the noise distribution, we also provide an average asymptotic performance bound for the l2-norm of the closed-loop state. Finally, we demonstrate our scheme on both an illustrative example, and in a building temperature control problem. △ Less

Submitted 20 May, 2022; originally announced May 2022.

Regret Analysis of Online Gradient Descent-based Iterative Learning Control with Model Mismatch

Authors: Efe C. Balta, Andrea Iannelli, Roy S. Smith, John Lygeros

Abstract: In Iterative Learning Control (ILC), a sequence of feedforward control actions is generated at each iteration on the basis of partial model knowledge and past measurements with the goal of steering the system toward a desired reference trajectory. This is framed here as an online learning task, where the decision-maker takes sequential decisions by solving a sequence of optimization problems havin… ▽ More In Iterative Learning Control (ILC), a sequence of feedforward control actions is generated at each iteration on the basis of partial model knowledge and past measurements with the goal of steering the system toward a desired reference trajectory. This is framed here as an online learning task, where the decision-maker takes sequential decisions by solving a sequence of optimization problems having only partial knowledge of the cost functions. Having established this connection, the performance of an online gradient-descent based scheme using inexact gradient information is analyzed in the setting of dynamic and static regret, standard measures in online learning. Fundamental limitations of the scheme and its integration with adaptation mechanisms are further investigated, followed by numerical simulations on a benchmark ILC problem. △ Less

Submitted 10 April, 2022; originally announced April 2022.

Computationally efficient robust MPC using optimized constraint tightening

Authors: Anilkumar Parsi, Panagiotis Anagnostaras, Andrea Iannelli, Roy S. Smith

Abstract: A robust model predictive control (MPC) method is presented for linear, time-invariant systems affected by bounded additive disturbances. The main contribution is the offline design of a disturbance-affine feedback gain whereby the resulting constraint tightening is minimized. This is achieved by formulating the constraint tightening problem as a convex optimization problem with the feedback term… ▽ More A robust model predictive control (MPC) method is presented for linear, time-invariant systems affected by bounded additive disturbances. The main contribution is the offline design of a disturbance-affine feedback gain whereby the resulting constraint tightening is minimized. This is achieved by formulating the constraint tightening problem as a convex optimization problem with the feedback term as a variable. The resulting MPC controller has the computational complexity of nominal MPC, and guarantees recursive feasibility, stability and constraint satisfaction. The advantages of the proposed approach compared to existing robust MPC methods are demonstrated using numerical examples. △ Less

Submitted 15 November, 2022; v1 submitted 5 April, 2022; originally announced April 2022.

Comments: Accepted to the 61st IEEE Conference on Decision and Control, Cancun 2022

Scalable tube model predictive control of uncertain linear systems using ellipsoidal sets

Authors: Anilkumar Parsi, Andrea Iannelli, Roy S. Smith

Abstract: This work proposes a novel robust model predictive control (MPC) algorithm for linear systems affected by dynamic model uncertainty and exogenous disturbances. The uncertainty is modeled using a linear fractional perturbation structure with a time-varying perturbation matrix, enabling the algorithm to be applied to a large model class. The MPC controller constructs a state tube as a sequence of pa… ▽ More This work proposes a novel robust model predictive control (MPC) algorithm for linear systems affected by dynamic model uncertainty and exogenous disturbances. The uncertainty is modeled using a linear fractional perturbation structure with a time-varying perturbation matrix, enabling the algorithm to be applied to a large model class. The MPC controller constructs a state tube as a sequence of parameterized ellipsoidal sets to bound the state trajectories of the system. The proposed approach results in a semidefinite program to be solved online, whose size scales linearly with the order of the system. The design of the state tube is formulated as an offline optimization problem, which offers flexibility to impose desirable features such as robust invariance on the terminal set. This contrasts with most existing tube MPC strategies using polytopic sets in the state tube, which are difficult to design and whose complexity grows combinatorially with the system order. The algorithm guarantees constraint satisfaction, recursive feasibility, and stability of the closed loop. The advantages of the algorithm are demonstrated using two simulation studies. △ Less

Submitted 9 June, 2022; v1 submitted 5 April, 2022; originally announced April 2022.

Comments: Submitted to International Journal of Robust and Nonlinear Control

Kernel-Based Identification of Local Limit Cycle Dynamics with Linear Periodically Parameter-Varying Models

Authors: Defne E. Ozan, Mingzhou Yin, Andrea Iannelli, Roy S. Smith

Abstract: Limit cycle oscillations are phenomena arising in nonlinear dynamical systems and characterized by periodic, locally-stable, and self-sustained state trajectories. Systems controlled in a closed loop along a periodic trajectory can also be modelled as systems experiencing limit cycle behavior. The goal of this work is to identify from data, the local dynamics around the limit cycle using linear pe… ▽ More Limit cycle oscillations are phenomena arising in nonlinear dynamical systems and characterized by periodic, locally-stable, and self-sustained state trajectories. Systems controlled in a closed loop along a periodic trajectory can also be modelled as systems experiencing limit cycle behavior. The goal of this work is to identify from data, the local dynamics around the limit cycle using linear periodically parameter-varying models. Using a coordinate transformation onto transversal surfaces, the dynamics are decomposed into two parts: one along the limit cycle, and one on the transversal surfaces. Then, the model is identified from trajectory data using kernel-based methods with a periodic kernel design. The kernel-based model is extended to also account for variations in system parameters associated with different operating conditions. The performance of the proposed identification method is demonstrated on a benchmark nonlinear system and on a simplified airborne wind energy model. The method provides accurate model parameter estimation, compared to the analytical linearization, and good prediction capability. △ Less

Submitted 31 August, 2022; v1 submitted 30 March, 2022; originally announced March 2022.

Comments: Accepted for presentation at IEEE Conference on Decision and Control 2022

Journal ref: 2022 IEEE 61st Conference on Decision and Control (CDC), Cancun, Mexico, 2022, pp. 221-226

On the Regret of $\mathcal{H}_{\infty}$ Control

Authors: Aren Karapetyan, Andrea Iannelli, John Lygeros

Abstract: The $\mathcal{H}_{\infty}$ synthesis approach is a cornerstone robust control design technique, but is known to be conservative in some cases. The objective of this paper is to quantify the additional cost the controller incurs planning for the worst-case scenario, by adopting an approach inspired by regret from online learning. We define the \textit{disturbance-reality gap} as the difference betw… ▽ More The $\mathcal{H}_{\infty}$ synthesis approach is a cornerstone robust control design technique, but is known to be conservative in some cases. The objective of this paper is to quantify the additional cost the controller incurs planning for the worst-case scenario, by adopting an approach inspired by regret from online learning. We define the \textit{disturbance-reality gap} as the difference between the predicted worst-case disturbance signal and the actual realization. The regret is shown to scale with the norm of this \textit{gap}, which turns out to have a similar structure to that of the certainty equivalent controller with inaccurate predictions, obtained here in terms of the \textit{prediction error} norm. △ Less

Submitted 9 August, 2022; v1 submitted 30 March, 2022; originally announced March 2022.

Comments: Accepted to the 2022 IEEE Conference on Decision and Control (CDC)

Infinite-Dimensional Sparse Learning in Linear System Identification

Authors: Mingzhou Yin, Mehmet Tolga Akan, Andrea Iannelli, Roy S. Smith

Abstract: Regularized methods have been widely applied to system identification problems without known model structures. This paper proposes an infinite-dimensional sparse learning algorithm based on atomic norm regularization. Atomic norm regularization decomposes the transfer function into first-order atomic models and solves a group lasso problem that selects a sparse set of poles and identifies the corr… ▽ More Regularized methods have been widely applied to system identification problems without known model structures. This paper proposes an infinite-dimensional sparse learning algorithm based on atomic norm regularization. Atomic norm regularization decomposes the transfer function into first-order atomic models and solves a group lasso problem that selects a sparse set of poles and identifies the corresponding coefficients. The difficulty in solving the problem lies in the fact that there are an infinite number of possible atomic models. This work proposes a greedy algorithm that generates new candidate atomic models maximizing the violation of the optimality condition of the existing problem. This algorithm is able to solve the infinite-dimensional group lasso problem with high precision. The algorithm is further extended to reduce the bias and reject false positives in pole location estimation by iteratively reweighted adaptive group lasso and complementary pairs stability selection respectively. Numerical results demonstrate that the proposed algorithm performs better than benchmark parameterized and regularized methods in terms of both impulse response fitting and pole location estimation. △ Less

Submitted 31 August, 2022; v1 submitted 28 March, 2022; originally announced March 2022.

Comments: Accepted for presentation at IEEE Conference on Decision and Control 2022

Journal ref: 2022 IEEE 61st Conference on Decision and Control (CDC), Cancun, Mexico, 2022, pp. 850-855

An explicit dual control approach for constrained reference tracking of uncertain linear systems

Authors: Anilkumar Parsi, Andrea Iannelli, Roy S. Smith

Abstract: A finite horizon optimal tracking problem is considered for linear dynamical systems subject to parametric uncertainties in the state-space matrices and exogenous disturbances. A suboptimal solution is proposed using a model predictive control (MPC) based explicit dual control approach which enables active uncertainty learning. A novel algorithm for the design of robustly invariant online terminal… ▽ More A finite horizon optimal tracking problem is considered for linear dynamical systems subject to parametric uncertainties in the state-space matrices and exogenous disturbances. A suboptimal solution is proposed using a model predictive control (MPC) based explicit dual control approach which enables active uncertainty learning. A novel algorithm for the design of robustly invariant online terminal sets and terminal controllers is presented. Set membership identification is used to update the parameter uncertainty online. A predicted worst-case cost is used in the MPC optimization problem to model the dual effect of the control input. The cost-to-go is estimated using contractivity of the proposed terminal set and the remaining time horizon, so that the optimizer can estimate future benefits of exploration. The proposed dual control algorithm ensures robust constraint satisfaction and recursive feasibility, and navigates the exploration-exploitation trade-off using a robust performance metric. △ Less

Submitted 4 February, 2022; originally announced February 2022.

Comments: Submitted to IEEE Transactions on Automatic Control

Data-Driven Prediction with Stochastic Data: Confidence Regions and Minimum Mean-Squared Error Estimates

Authors: Mingzhou Yin, Andrea Iannelli, Roy S. Smith

Abstract: Recently, direct data-driven prediction has found important applications for controlling unknown systems, particularly in predictive control. Such an approach provides exact prediction using behavioral system theory when noise-free data are available. For stochastic data, although approximate predictors exist based on different statistical criteria, they fail to provide statistical guarantees of p… ▽ More Recently, direct data-driven prediction has found important applications for controlling unknown systems, particularly in predictive control. Such an approach provides exact prediction using behavioral system theory when noise-free data are available. For stochastic data, although approximate predictors exist based on different statistical criteria, they fail to provide statistical guarantees of prediction accuracy. In this paper, confidence regions are provided for these stochastic predictors based on the prediction error distribution. Leveraging this, an optimal predictor which achieves minimum mean-squared prediction error is also proposed to enhance prediction accuracy. These results depend on some true model parameters, but they can also be replaced with an approximate data-driven formulation in practice. Numerical results show that the derived confidence region is valid and smaller prediction errors are observed for the proposed minimum mean-squared error estimate, even with the approximate data-driven formulation. △ Less

Submitted 8 November, 2021; originally announced November 2021.

Journal ref: 2022 European Control Conference (ECC), London, United Kingdom, 2022, pp. 853-858

A distributed framework for linear adaptive MPC

Authors: Anilkumar Parsi, Ahmed Aboudonia, Andrea Iannelli, John Lygeros, Roy S. Smith

Abstract: Adaptive model predictive control (MPC) robustly ensures safety while reducing uncertainty during operation. In this paper, a distributed version is proposed to deal with network systems featuring multiple agents and limited communication. To solve the problem in a distributed manner, structure is imposed on the control design ingredients without sacrificing performance. Decentralized and distribu… ▽ More Adaptive model predictive control (MPC) robustly ensures safety while reducing uncertainty during operation. In this paper, a distributed version is proposed to deal with network systems featuring multiple agents and limited communication. To solve the problem in a distributed manner, structure is imposed on the control design ingredients without sacrificing performance. Decentralized and distributed adaptation schemes that allow for a reduction of the uncertainty online compatibly with the network topology are also proposed. The algorithm ensures robust constraint satisfaction, recursive feasibility and finite gain $\ell_2$ stability, and yields lower closed-loop cost compared to robust distributed MPC in simulations. △ Less

Submitted 16 April, 2024; v1 submitted 13 September, 2021; originally announced September 2021.

Comments: This work has been accepted to the 60th IEEE Conference on Decision and Control, 2021

Journal ref: Proc. 60th IEEE Conference on Decision and Control, Austin, TX, USA, 2021, pp. 460-465

Design of input for data-driven simulation with Hankel and Page matrices

Authors: Andrea Iannelli, Mingzhou Yin, Roy S. Smith

Abstract: The paper deals with the problem of designing informative input trajectories for data-driven simulation. First, the excitation requirements in the case of noise-free data are discussed and new weaker conditions, which assume the simulated input to be known in advance, are provided. Then, the case of noisy data trajectories is considered and an input design problem based on a recently proposed maxi… ▽ More The paper deals with the problem of designing informative input trajectories for data-driven simulation. First, the excitation requirements in the case of noise-free data are discussed and new weaker conditions, which assume the simulated input to be known in advance, are provided. Then, the case of noisy data trajectories is considered and an input design problem based on a recently proposed maximum likelihood estimator is formulated. A Bayesian interpretation is provided, and the implications of using Hankel and Page matrix representations are demonstrated. Numerical examples show the impact of the designed input on the predictive accuracy. △ Less

Submitted 13 September, 2021; v1 submitted 10 September, 2021; originally announced September 2021.

Comments: Accepted at the 2021 IEEE Conference on Decision and Control

The Balanced Mode Decomposition Algorithm for Data-Driven LPV Low-Order Models of Aeroservoelastic Systems

Authors: Andrea Iannelli, Urban Fasel, Roy S. Smith

Abstract: A novel approach to reduced-order modeling of high-dimensional time varying systems is proposed. It leverages the formalism of the Dynamic Mode Decomposition technique together with the concept of balanced realization. It is assumed that the only information available on the system comes from input, state, and output trajectories generated by numerical simulations or recorded and estimated during… ▽ More A novel approach to reduced-order modeling of high-dimensional time varying systems is proposed. It leverages the formalism of the Dynamic Mode Decomposition technique together with the concept of balanced realization. It is assumed that the only information available on the system comes from input, state, and output trajectories generated by numerical simulations or recorded and estimated during experiments, thus the approach is fully data-driven. The goal is to obtain an input-output low dimensional linear model which approximates the system across its operating range. Since the dynamics of aeroservoelastic systems markedly changes in operation (e.g. due to change in flight speed or altitude), time-varying features are retained in the constructed models. This is achieved by generating a Linear Parameter-Varying representation made of a collection of state-consistent linear time-invariant reduced-order models. The algorithm formulation hinges on the idea of replacing the orthogonal projection onto the Proper Orthogonal Decomposition modes, used in Dynamic Mode Decomposition-based approaches, with a balancing oblique projection constructed entirely from data. As a consequence, the input-output information captured in the lower-dimensional representation is increased compared to other projections onto subspaces of same or lower size. Moreover, a parameter-varying projection is possible while also achieving state-consistency. The validity of the proposed approach is demonstrated on a morphing wing for airborne wind energy applications by comparing the performance against two algorithms recently proposed in the literature. Comparisons cover both prediction accuracy and performance in model predictive control applications. △ Less

Submitted 30 May, 2021; v1 submitted 7 February, 2021; originally announced February 2021.

Comments: Accepted for publication in Aerospace Science and Technology (open-access version available)

Journal ref: Aerospace Science and Technology, Volume 115, August 2021

Experiment design for impulse response identification with signal matrix models

Authors: Andrea Iannelli, Mingzhou Yin, Roy S. Smith

Abstract: This paper formulates an input design approach for truncated infinite impulse response identification in the context of implicit model representations recently used as basis for data-driven simulation and control approaches. Precisely, the considered model consists of a linear combination of the columns of a data (or signal) matrix. An optimal combination for the case of noisy data was recently pr… ▽ More This paper formulates an input design approach for truncated infinite impulse response identification in the context of implicit model representations recently used as basis for data-driven simulation and control approaches. Precisely, the considered model consists of a linear combination of the columns of a data (or signal) matrix. An optimal combination for the case of noisy data was recently proposed using a maximum likelihood approach, and the objective here is to optimize the input entries of the data matrix such that the mean-square error matrix of the estimate is minimized. A least-norm problem is derived in terms of the optimality criteria typically considered in the experiment design literature. Numerical results showcase the improved estimation fit achieved with the optimized input. △ Less

Submitted 11 April, 2021; v1 submitted 15 December, 2020; originally announced December 2020.

Comments: Accepted at the 2021 IFAC Symposium on System Identification

Maximum Likelihood Signal Matrix Model for Data-Driven Predictive Control

Authors: Mingzhou Yin, Andrea Iannelli, Roy S. Smith

Abstract: The paper presents a data-driven predictive control framework based on an implicit input-output map** derived directly from the signal matrix of collected data. This signal matrix model is derived by maximum likelihood estimation with noise-corrupted data. By linearizing online, the implicit model can be used as a linear constraint to characterize possible trajectories of the system in receding… ▽ More The paper presents a data-driven predictive control framework based on an implicit input-output map** derived directly from the signal matrix of collected data. This signal matrix model is derived by maximum likelihood estimation with noise-corrupted data. By linearizing online, the implicit model can be used as a linear constraint to characterize possible trajectories of the system in receding horizon control. The signal matrix can also be updated online with new measurements. This algorithm can be applied to large datasets and slowly time-varying systems, possibly with high noise levels. An additional regularization term on the prediction error can be introduced to enhance the predictability and thus the control performance. Numerical results demonstrate that the proposed signal matrix model predictive control algorithm is effective in multiple applications and performs better than existing data-driven predictive control algorithm. △ Less

Submitted 8 November, 2021; v1 submitted 8 December, 2020; originally announced December 2020.

Journal ref: Proceedings of the 3rd Conference on Learning for Dynamics and Control, PMLR 144:1004-1014, 2021

Maximum Likelihood Estimation in Data-Driven Modeling and Control

Authors: Mingzhou Yin, Andrea Iannelli, Roy S. Smith

Abstract: Recently, various algorithms for data-driven simulation and control have been proposed based on the Willems' fundamental lemma. However, when collected data are noisy, these methods lead to ill-conditioned data-driven model structures. In this work, we present a maximum likelihood framework to obtain an optimal data-driven model, the signal matrix model, in the presence of output noise. Data compr… ▽ More Recently, various algorithms for data-driven simulation and control have been proposed based on the Willems' fundamental lemma. However, when collected data are noisy, these methods lead to ill-conditioned data-driven model structures. In this work, we present a maximum likelihood framework to obtain an optimal data-driven model, the signal matrix model, in the presence of output noise. Data compression and noise level estimation schemes are also proposed to apply the algorithm efficiently to large datasets and unknown noise level scenarios. Two approaches in system identification and receding horizon control are developed based on the derived optimal estimator. The first one identifies a finite impulse response model. This approach improves the least-squares estimator with less restrictive assumptions. The second one applies the signal matrix model as the predictor in predictive control. The control performance is shown to be better than existing data-driven predictive control algorithms, especially under high noise levels. Both approaches demonstrate that the derived estimator provides a promising framework to apply data-driven algorithms to noisy data. △ Less

Submitted 20 December, 2021; v1 submitted 2 November, 2020; originally announced November 2020.

Journal ref: IEEE Transactions on Automatic Control, vol. 68, no. 1, pp. 317-328, Jan. 2023

Learning Dynamical Systems using Local Stability Priors

Authors: Arash Mehrjou, Andrea Iannelli, Bernhard Schölkopf

Abstract: A coupled computational approach to simultaneously learn a vector field and the region of attraction of an equilibrium point from generated trajectories of the system is proposed. The nonlinear identification leverages the local stability information as a prior on the system, effectively endowing the estimate with this important structural property. In addition, the knowledge of the region of attr… ▽ More A coupled computational approach to simultaneously learn a vector field and the region of attraction of an equilibrium point from generated trajectories of the system is proposed. The nonlinear identification leverages the local stability information as a prior on the system, effectively endowing the estimate with this important structural property. In addition, the knowledge of the region of attraction plays an experiment design role by informing the selection of initial conditions from which trajectories are generated and by enabling the use of a Lyapunov function of the system as a regularization term. Numerical results show that the proposed method allows efficient sampling and provides an accurate estimate of the dynamics in an inner approximation of its region of attraction. △ Less

Submitted 23 August, 2020; originally announced August 2020.

Subspace Identification of Linear Time-Periodic Systems with Periodic Inputs

Authors: Mingzhou Yin, Andrea Iannelli, Roy S. Smith

Abstract: This paper proposes a new methodology for subspace identification of linear time-periodic (LTP) systems with periodic inputs. This method overcomes the issues related to the computation of frequency response of LTP systems by utilizing the frequency response of the time-lifted system with linear time-invariant structure instead. The response is estimated with an ensemble of input-output data with… ▽ More This paper proposes a new methodology for subspace identification of linear time-periodic (LTP) systems with periodic inputs. This method overcomes the issues related to the computation of frequency response of LTP systems by utilizing the frequency response of the time-lifted system with linear time-invariant structure instead. The response is estimated with an ensemble of input-output data with periodic inputs. This allows the frequency-domain subspace identification technique to be extended to LTP systems. The time-aliased periodic impulse response can then be estimated and the order-revealing decomposition of the block-Hankel matrix is formulated. The consistency of the proposed method is proved under mild noise assumptions. Numerical simulation shows that the proposed method performs better than multiple widely-used time-domain subspace identification methods when an ensemble of periodic data is available. △ Less

Submitted 6 June, 2020; originally announced June 2020.

Journal ref: IEEE Control Systems Letters, vol. 5, no. 1, pp. 145-150, Jan. 2021

Active exploration in adaptive model predictive control

Authors: Anilkumar Parsi, Andrea Iannelli, Roy S. Smith

Abstract: A dual adaptive model predictive control (MPC) algorithm is presented for linear, time-invariant systems subject to bounded disturbances and parametric uncertainty in the state-space matrices. Online set-membership identification is performed to reduce the uncertainty and thus control affects both the informativity of identification and the system's performance. The main contribution of the paper… ▽ More A dual adaptive model predictive control (MPC) algorithm is presented for linear, time-invariant systems subject to bounded disturbances and parametric uncertainty in the state-space matrices. Online set-membership identification is performed to reduce the uncertainty and thus control affects both the informativity of identification and the system's performance. The main contribution of the paper is to include this dual effect in the MPC optimization problem using a predicted worst-case cost in the objective function. This allows the controller to perform active exploration, that is, the control input reduces the uncertainty in the regions of the parameter space that have most influence on the performance. Additionally, the MPC algorithm ensures robust constraint satisfaction of state and input constraints. Advantages of the proposed algorithm are shown by comparing it to a passive adaptive MPC algorithm from the literature. △ Less

Submitted 21 February, 2021; v1 submitted 31 March, 2020; originally announced March 2020.

Comments: Presented at the 59th Conference on Decision and Control, 2020

Linear Time-Periodic System Identification with Grouped Atomic Norm Regularization

Authors: Mingzhou Yin, Andrea Iannelli, Mohammad Khosravi, Anilkumar Parsi, Roy S. Smith

Abstract: This paper proposes a new methodology in linear time-periodic (LTP) system identification. In contrast to previous methods that totally separate dynamics at different tag times for identification, the method focuses on imposing appropriate structural constraints on the linear time-invariant (LTI) reformulation of LTP systems. This method adopts a periodically-switched truncated infinite impulse re… ▽ More This paper proposes a new methodology in linear time-periodic (LTP) system identification. In contrast to previous methods that totally separate dynamics at different tag times for identification, the method focuses on imposing appropriate structural constraints on the linear time-invariant (LTI) reformulation of LTP systems. This method adopts a periodically-switched truncated infinite impulse response model for LTP systems, where the structural constraints are interpreted as the requirement to place the poles of the non-truncated models at the same locations for all sub-models. This constraint is imposed by combining the atomic norm regularization framework for LTI systems with the group lasso technique in regression. As a result, the estimated system is both uniform and low-order, which is hard to achieve with other existing estimators. Monte Carlo simulation shows that the grouped atomic norm method does not only show better results compared to other regularized methods, but also outperforms the subspace identification method under high noise levels in terms of model fitting. △ Less

Submitted 17 March, 2020; v1 submitted 14 March, 2020; originally announced March 2020.

Journal ref: IFAC-PapersOnLine, 53(2), 1237-1242, 2020

Robust Adaptive Model Predictive Control with Worst-Case Cost

Authors: Anilkumar Parsi, Andrea Iannelli, Mingzhou Yin, Mohammad Khosravi, Roy S. Smith

Abstract: A robust adaptive model predictive control (MPC) algorithm is presented for linear, time invariant systems with unknown dynamics and subject to bounded measurement noise. The system is characterized by an impulse response model, which is assumed to lie within a bounded set called the feasible system set. Online set-membership identification is used to reduce uncertainty in the impulse response. In… ▽ More A robust adaptive model predictive control (MPC) algorithm is presented for linear, time invariant systems with unknown dynamics and subject to bounded measurement noise. The system is characterized by an impulse response model, which is assumed to lie within a bounded set called the feasible system set. Online set-membership identification is used to reduce uncertainty in the impulse response. In the MPC scheme, robust constraints are enforced to ensure constraint satisfaction for all the models in the feasible set. The performance objective is formulated as a worst-case cost with respect to the modeling uncertainties. That is, at each time step an optimization problem is solved in which the control input is optimized for the worst-case plant in the uncertainty set. The performance of the proposed algorithm is compared to an adaptive MPC algorithm from the literature using Monte-Carlo simulations. △ Less

Submitted 19 November, 2019; originally announced November 2019.

Region of attraction analysis of nonlinear stochastic systems using Polynomial Chaos Expansion

Authors: Eva Ahbe, Andrea Iannelli, Roy S. Smith

Abstract: A method is presented to estimate the region of attraction (ROA) of stochastic systems with finite second moment and uncertainty-dependent equilibria. The approach employs Polynomial Chaos (PC) expansions to represent the stochastic system by a higher-dimensional set of deterministic equations. We first show how the equilibrium point of the deterministic formulation provides the stochastic moments… ▽ More A method is presented to estimate the region of attraction (ROA) of stochastic systems with finite second moment and uncertainty-dependent equilibria. The approach employs Polynomial Chaos (PC) expansions to represent the stochastic system by a higher-dimensional set of deterministic equations. We first show how the equilibrium point of the deterministic formulation provides the stochastic moments of an uncertainty-dependent equilibrium point of the stochastic system. A connection between the boundedness of the moments of the stochastic system and the Lyapunov stability of its PC expansion is then derived. Defining corresponding notions of a ROA for both system representations, we show how this connection can be leveraged to recover an estimate of the ROA of the stochastic system from the ROA of the PC expanded system. Two optimization programs, obtained from sum-of-squares programming techniques, are provided to compute inner estimates of the ROA. The first optimization program uses the Lyapunov stability arguments to return an estimate of the ROA of the PC expansion. Based on this result and user specifications on the moments for the initial conditions, the second one employs the shown connection to provide the corresponding ROA of the stochastic system. The method is demonstrated by two examples. △ Less

Submitted 1 November, 2019; originally announced November 2019.

Comments: 13 pages, 5 figures, submitted to Automatica

Structured exploration in the finite horizon linear quadratic dual control problem

Authors: Andrea Iannelli, Mohammad Khosravi, Roy S. Smith

Abstract: This paper presents a novel approach to synthesize dual controllers for unknown linear time-invariant systems with the tasks of optimizing a quadratic cost while reducing the uncertainty. To this end, a synthesis problem is defined where the feedback law has to simultaneously gain knowledge of the system and robustly optimize the cost. By framing the problem in a finite horizon setting, the trade-… ▽ More This paper presents a novel approach to synthesize dual controllers for unknown linear time-invariant systems with the tasks of optimizing a quadratic cost while reducing the uncertainty. To this end, a synthesis problem is defined where the feedback law has to simultaneously gain knowledge of the system and robustly optimize the cost. By framing the problem in a finite horizon setting, the trade-offs arising when the tasks include both identification and control are formally captured in the optimization problem. Results show that efficient exploration strategies are achieved when the structure of the problem is exploited. △ Less

Submitted 10 April, 2021; v1 submitted 31 October, 2019; originally announced October 2019.

Comments: Accepted at the 2020 IFAC World Congress