-
Emulation-based Stabilization for Networked Control Systems with Stochastic Channels
Authors:
Wei Ren,
Wei Wang,
Zhuo-Rui Pan,
Xi-Ming Sun,
Andrew R. Teel,
Dragan Nesic
Abstract:
This paper studies the stabilization problem of networked control systems (NCSs) with random packet dropouts caused by stochastic channels. To describe the effects of stochastic channels on the information transmission, the transmission times are assumed to be deterministic, whereas the packet transmission is assumed to be random. We first propose a stochastic scheduling protocol to model random p…
▽ More
This paper studies the stabilization problem of networked control systems (NCSs) with random packet dropouts caused by stochastic channels. To describe the effects of stochastic channels on the information transmission, the transmission times are assumed to be deterministic, whereas the packet transmission is assumed to be random. We first propose a stochastic scheduling protocol to model random packet dropouts, and address the properties of the proposed stochastic scheduling protocol. The proposed scheduling protocol provides a unified modelling framework for a general class of random packet dropouts due to different stochastic channels. Next, the proposed scheduling protocol is embedded into the closed-loop system, which leads to a stochastic hybrid model for NCSs with random packet dropouts. Based on this stochastic hybrid model, we follow the emulation approach to establish sufficient conditions to guarantee uniform global asymptotical stability in probability. In particular, an upper bound on the maximally allowable transmission interval is derived explicitly for all stochastic protocols satisfying Lyapunov conditions that guarantee uniform global asymptotic stability in probability. Finally, two numerical examples are presented to demonstrate the derived results.
△ Less
Submitted 21 January, 2024;
originally announced January 2024.
-
Concurrent learning in high-order tuners for parameter identification
Authors:
Justin H. Le,
Andrew R. Teel
Abstract:
High-order tuners are algorithms that show promise in achieving greater efficiency than classic gradient-based algorithms in identifying the parameters of parametric models and/or in facilitating the progress of a control or optimization algorithm whose adaptive behavior relies on such models. For high-order tuners, robust stability properties, namely uniform global asymptotic (and exponential) st…
▽ More
High-order tuners are algorithms that show promise in achieving greater efficiency than classic gradient-based algorithms in identifying the parameters of parametric models and/or in facilitating the progress of a control or optimization algorithm whose adaptive behavior relies on such models. For high-order tuners, robust stability properties, namely uniform global asymptotic (and exponential) stability, currently rely on a persistent excitation (PE) condition. In this work, we establish such stability properties with a novel analysis based on a Matrosov theorem and then show that the PE requirement can be relaxed via a concurrent learning technique driven by sampled data points that are sufficiently rich. We show numerically that concurrent learning may greatly improve efficiency. We incorporate reset methods that preserve the stability guarantees while providing additional improvements that may be relevant in applications that demand highly accurate parameter estimates at relatively low additional cost in computation.
△ Less
Submitted 4 April, 2022;
originally announced April 2022.
-
On Moment Matching for Stochastic Systems
Authors:
Giordano Scarciotti,
Andrew R. Teel
Abstract:
In this paper we study the problem of model reduction by moment matching for stochastic systems. We characterize the mathematical object which generalizes the notion of moment to stochastic differential equations and we find a class of models which achieve moment matching. However, differently from the deterministic case, these reduced-order models cannot be considered "simpler" because of the hig…
▽ More
In this paper we study the problem of model reduction by moment matching for stochastic systems. We characterize the mathematical object which generalizes the notion of moment to stochastic differential equations and we find a class of models which achieve moment matching. However, differently from the deterministic case, these reduced-order models cannot be considered "simpler" because of the high computational cost paid to determine the moment. To overcome this difficulty, we relax the moment matching problem in two different ways and we present two classes of reduced-order models which, approximately matching the stochastic moment, are computationally tractable.
△ Less
Submitted 4 May, 2021;
originally announced May 2021.
-
Passive soft-reset controllers for nonlinear systems
Authors:
Justin H. Le,
Andrew R. Teel
Abstract:
Soft-reset controllers are introduced as a way to approximate hard-reset controllers. The focus is on implementing reset controllers that are (strictly) passive and on analyzing their interconnection with passive plants. A passive hard-reset controller that has a strongly convex energy function can be approximated as a soft-reset controller. A hard-reset controller is a hybrid system whereas a sof…
▽ More
Soft-reset controllers are introduced as a way to approximate hard-reset controllers. The focus is on implementing reset controllers that are (strictly) passive and on analyzing their interconnection with passive plants. A passive hard-reset controller that has a strongly convex energy function can be approximated as a soft-reset controller. A hard-reset controller is a hybrid system whereas a soft-reset controller corresponds to a differential inclusion, living entirely in the continuous-time domain. This feature may make soft-reset controllers easier to understand and implement. A soft-reset controller contains a parameter that can be adjusted to better approximate the action of the hard-reset controller. Closed-loop asymptotic stability is established for the interconnection of a passive soft-reset controller with a passive plant, under appropriate detectability assumptions. Several examples are used to illustrate the efficacy of soft-reset controllers.
△ Less
Submitted 22 September, 2021; v1 submitted 23 April, 2021;
originally announced April 2021.
-
Analyzing the Effect of Persistent Asset Switches on a Class of Hybrid-Inspired Optimization Algorithms
Authors:
Matina Baradaran,
Justin H. Le,
Andrew R. Teel
Abstract:
Convex optimization challenges are currently pervasive in many science and engineering domains. In many applications of convex optimization, such as those involving multi-agent systems and resource allocation, the objective function can persistently switch during the execution of an optimization algorithm. Motivated by such applications, we analyze the effect of persistently switching objectives i…
▽ More
Convex optimization challenges are currently pervasive in many science and engineering domains. In many applications of convex optimization, such as those involving multi-agent systems and resource allocation, the objective function can persistently switch during the execution of an optimization algorithm. Motivated by such applications, we analyze the effect of persistently switching objectives in continuous-time optimization algorithms. In particular, we take advantage of existing robust stability results for switched systems with distinct equilibria and extend these results to systems described by differential inclusions, making the results applicable to recent optimization algorithms that employ differential inclusions for improving efficiency and/or robustness. Within the framework of hybrid systems theory, we provide an accurate characterization, in terms of Omega-limit sets, of the set to which the optimization dynamics converge. Finally, by considering the switching signal to be constrained in its average dwell time, we establish semi-global practical asymptotic stability of these sets with respect to the dwell-time parameter.
△ Less
Submitted 20 April, 2021;
originally announced April 2021.
-
Hybrid Heavy-Ball Systems: Reset Methods for Optimization with Uncertainty
Authors:
Justin H. Le,
Andrew R. Teel
Abstract:
Momentum methods for convex optimization often rely on precise choices of algorithmic parameters, based on knowledge of problem parameters, in order to achieve fast convergence, as well as to prevent oscillations that could severely restrict applications of these algorithms to cyber-physical systems. To address these issues, we propose two dynamical systems, named the Hybrid Heavy-Ball System and…
▽ More
Momentum methods for convex optimization often rely on precise choices of algorithmic parameters, based on knowledge of problem parameters, in order to achieve fast convergence, as well as to prevent oscillations that could severely restrict applications of these algorithms to cyber-physical systems. To address these issues, we propose two dynamical systems, named the Hybrid Heavy-Ball System and Hybrid-inspired Heavy-Ball System, which employ a feedback mechanism for driving the momentum state toward zero whenever it points in undesired directions. We describe the relationship between the proposed systems and their discrete-time counterparts, deriving conditions based on linear matrix inequalities for ensuring exponential rates in both continuous time and discrete time. We provide numerical LMI results to illustrate the effects of our reset mechanisms on convergence rates in a setting that simulates uncertainty of problem parameters. Finally, we numerically demonstrate the efficiency and avoidance of oscillations of the proposed systems when solving both strongly convex and non-strongly convex problems.
△ Less
Submitted 22 March, 2021; v1 submitted 29 September, 2020;
originally announced September 2020.
-
Further results on synergistic Lyapunov functions and hybrid feedback design through backstep**
Authors:
Christopher G. Mayhew,
Ricardo G. Sanfelice,
Andrew R. Teel
Abstract:
We extend results on backstep** hybrid feedbacks by exploiting synergistic Lyapunov function and feedback (SLFF) pairs in a generalized form. Compared to existing results, we delineate SLFF pairs that are ready-made and do not require extra dynamic variables for backstep**. From an (weak) SLFF pair for an affine control system, we construct an SLFF pair for an extended system where the control…
▽ More
We extend results on backstep** hybrid feedbacks by exploiting synergistic Lyapunov function and feedback (SLFF) pairs in a generalized form. Compared to existing results, we delineate SLFF pairs that are ready-made and do not require extra dynamic variables for backstep**. From an (weak) SLFF pair for an affine control system, we construct an SLFF pair for an extended system where the control input is produced through an integrator. The resulting hybrid feedback asymptotically stabilizes the extended system when the synergy gap for the original system is strictly positive. To highlight the versatility of SLFF pairs, we provide a result on the existence of a SLFF pair whenever a hybrid feedback stabilizer exists. The results are illustrated on the 3D pendulum.
△ Less
Submitted 8 September, 2020;
originally announced September 2020.
-
On reduction of differential inclusions and Lyapunov stability
Authors:
Rushikesh Kamalapurkar,
Warren E. Dixon,
Andrew R. Teel
Abstract:
In this paper, locally Lipschitz, regular functions are utilized to identify and remove infeasible directions from set-valued maps that define differential inclusions. The resulting reduced set-valued map is point-wise smaller (in the sense of set containment) than the original set-valued map. The corresponding reduced differential inclusion, defined by the reduced set-valued map, is utilized to d…
▽ More
In this paper, locally Lipschitz, regular functions are utilized to identify and remove infeasible directions from set-valued maps that define differential inclusions. The resulting reduced set-valued map is point-wise smaller (in the sense of set containment) than the original set-valued map. The corresponding reduced differential inclusion, defined by the reduced set-valued map, is utilized to develop a generalized notion of a derivative for locally Lipschitz candidate Lyapunov functions in the direction(s) of a set-valued map. The developed generalized derivative yields less conservative statements of Lyapunov stability theorems, invariance theorems, invariance-like results, and Matrosov theorems for differential inclusions. Included illustrative examples demonstrate the utility of the developed theory.
△ Less
Submitted 28 December, 2019; v1 submitted 21 March, 2017;
originally announced March 2017.
-
Global asymptotic stability of a PID control system with Coulomb friction
Authors:
Andrea Bisoffi,
Mauro Da Lio,
Andrew R. Teel,
Luca Zaccarian
Abstract:
We propose a model for representing a point mass subject to Coulomb friction in feedback with a PID controller, based on a differential inclusion comprising all the possible magnitudes of static friction during the stick phase. For this model we study the set of all equilibria and we establish its global asymptotic stability using a discontinuous Lyapunov-like function, and a suitable LaSalle's in…
▽ More
We propose a model for representing a point mass subject to Coulomb friction in feedback with a PID controller, based on a differential inclusion comprising all the possible magnitudes of static friction during the stick phase. For this model we study the set of all equilibria and we establish its global asymptotic stability using a discontinuous Lyapunov-like function, and a suitable LaSalle's invariance principle. We finally use well-posedness of the proposed model to establish useful robustness results, including an ISS property from a suitable input in a perturbed context. Simulation results are also given to illustrate our statements.
△ Less
Submitted 28 September, 2016;
originally announced September 2016.
-
Invariance-like results for Nonautonomous Switched Systems
Authors:
Rushikesh Kamalapurkar,
Joel A. Rosenfeld,
Anup Parikh,
Andrew R. Teel,
Warren E. Dixon
Abstract:
This paper generalizes the Lasalle-Yoshizawa Theorem to switched nonsmooth systems. Filippov and Krasovskii regularizations of a switched system are shown to be contained within the convex hull of the Filippov and Krasovskii regularizations of the subsystems, respectively. A candidate common Lyapunov function that has a negative semidefinite derivative along the trajectories of the subsystems is s…
▽ More
This paper generalizes the Lasalle-Yoshizawa Theorem to switched nonsmooth systems. Filippov and Krasovskii regularizations of a switched system are shown to be contained within the convex hull of the Filippov and Krasovskii regularizations of the subsystems, respectively. A candidate common Lyapunov function that has a negative semidefinite derivative along the trajectories of the subsystems is shown to be sufficient to establish LaSalle-Yoshizawa results for the switched system. Results for regular and non-regular candidate Lyapunov functions are presented using an appropriate generalization of the time derivative. The developed generalization is motivated by adaptive control of switched systems where the derivative of the candidate Lyapunov function is typically negative semidefinite.
△ Less
Submitted 29 August, 2017; v1 submitted 19 September, 2016;
originally announced September 2016.
-
Hybrid systems with memory: Existence and well-posedness of generalized solutions
Authors:
Jun Liu,
Andrew R. Teel
Abstract:
Hybrid systems with memory refer to dynamical systems exhibiting both hybrid and delay phenomena. While systems of this type are frequently encountered in many physical and engineering systems, particularly in control applications, various issues centered around the robustness of hybrid delay systems have not been adequately dealt with. In this paper, we establish some basic results on a framework…
▽ More
Hybrid systems with memory refer to dynamical systems exhibiting both hybrid and delay phenomena. While systems of this type are frequently encountered in many physical and engineering systems, particularly in control applications, various issues centered around the robustness of hybrid delay systems have not been adequately dealt with. In this paper, we establish some basic results on a framework that allows to study hybrid systems with memory through generalized concepts of solutions. In particular, we develop the basic existence of generalized solutions using regularity conditions on the hybrid data, which are formulated in a phase space of hybrid trajectories equipped with the graphical convergence topology. In contrast with the uniform convergence topology that has been often used, adopting the graphical convergence topology allows us to establish well-posedness of hybrid systems with memory. We then show that, as a consequence of well-posedness, pre-asymptotic stability of well-posed hybrid systems with memory is robust.
△ Less
Submitted 10 February, 2017; v1 submitted 20 July, 2015;
originally announced July 2015.
-
Lyapunov-based sufficient conditions for stability of hybrid systems with memory
Authors:
Jun Liu,
Andrew R. Teel
Abstract:
Hybrid systems with memory are dynamical systems exhibiting both hybrid and delay phenomena. In this note, we study the asymptotic stability of hybrid systems with memory using generalized concepts of solutions. These generalized solutions, motivated by studying robustness and well-posedness of such systems, are defined on hybrid time domains and parameterized by both continuous and discrete time.…
▽ More
Hybrid systems with memory are dynamical systems exhibiting both hybrid and delay phenomena. In this note, we study the asymptotic stability of hybrid systems with memory using generalized concepts of solutions. These generalized solutions, motivated by studying robustness and well-posedness of such systems, are defined on hybrid time domains and parameterized by both continuous and discrete time. We establish Lyapunov-based sufficient conditions for asymptotic stability using both Lyapunov-Razumikhin functions and Lyapunov-Krasovskii functionals. Examples are provided to illustrate these conditions.
△ Less
Submitted 20 July, 2015;
originally announced July 2015.
-
On generalized terminal state constraints for model predictive control
Authors:
Lorenzo Fagiano,
Andrew R. Teel
Abstract:
This manuscript contains technical results related to a particular approach for the design of Model Predictive Control (MPC) laws. The approach, named "generalized" terminal state constraint, induces the recursive feasibility of the underlying optimization problem and recursive satisfaction of state and input constraints, and it can be used for both tracking MPC (i.e. when the objective is to trac…
▽ More
This manuscript contains technical results related to a particular approach for the design of Model Predictive Control (MPC) laws. The approach, named "generalized" terminal state constraint, induces the recursive feasibility of the underlying optimization problem and recursive satisfaction of state and input constraints, and it can be used for both tracking MPC (i.e. when the objective is to track a given steady state) and economic MPC (i.e. when the objective is to minimize a cost function which does not necessarily attains its minimum at a steady state). It is shown that the proposed technique provides, in general, a larger feasibility set with respect to existing approaches, given the same computational complexity. Moreover, a new receding horizon strategy is introduced, exploiting the generalized terminal state constraint. Under mild assumptions, the new strategy is guaranteed to converge in finite time, with arbitrarily good accuracy, to an MPC law with an optimally-chosen terminal state constraint, while still enjoying a larger feasibility set. The features of the new technique are illustrated by three examples.
△ Less
Submitted 12 July, 2013; v1 submitted 3 July, 2012;
originally announced July 2012.
-
Matrosov's theorem using a family of auxiliary functions: an analysis tool to aid time-varying nonlinear control design
Authors:
Andrew R. Teel,
Antonio Loria,
Elena Panteley,
Dobrivoje Popovic
Abstract:
We present a new result on uniform attractivity of the origin for nonlinear time-varying systems. Our theorem generalizes Matrosov's theorem which extends, in a certain manner, Krasovskii-LaSalle invariance principle to the case of general nonlinear time-varying systems. We show the utility of our theorem by addressing a control problem of port interconnected driftless systems. The latter includ…
▽ More
We present a new result on uniform attractivity of the origin for nonlinear time-varying systems. Our theorem generalizes Matrosov's theorem which extends, in a certain manner, Krasovskii-LaSalle invariance principle to the case of general nonlinear time-varying systems. We show the utility of our theorem by addressing a control problem of port interconnected driftless systems. The latter includes as special case, the control of chained-form nonholonomic systems which has been extensively studied in the literature.
△ Less
Submitted 18 April, 2003;
originally announced April 2003.
-
Persistency of excitation for uniform convergence in nonlinear control systems
Authors:
Antonio Loria,
Elena Panteley,
Dobrivoje Popovic,
Andrew R. Teel
Abstract:
In previous papers we have introduced a sufficient condition for uniform attractivity of the origin for a class of nonlinear time-varying systems which is stated in terms of persistency of excitation (PE), a concept well known in the adaptive control and systems identification literature. The novelty of our condition, called uniform delta-PE, is that it is tailored for nonlinear functions of tim…
▽ More
In previous papers we have introduced a sufficient condition for uniform attractivity of the origin for a class of nonlinear time-varying systems which is stated in terms of persistency of excitation (PE), a concept well known in the adaptive control and systems identification literature. The novelty of our condition, called uniform delta-PE, is that it is tailored for nonlinear functions of time and state and it allows us to prove uniform asymptotic stability. In this paper we present a new definition of u-delta-PE which is conceptually similar to but technically different from its predecessors and give several useful characterizations. We make connections between this property and similar properties previously used in the literature. We also show when this condition is necessary and sufficient for uniform (global) asymptotic stability for a large class of nonlinear time-varying systems. Finally, we show the utility of our main results on some control applications regarding feedforward systems and systems with matching nonlinearities.
△ Less
Submitted 28 January, 2003;
originally announced January 2003.