-
Stability Properties of the Impulsive Goodwin's Oscillator in 1-cycle
Authors:
Anton V. Proskurnikov,
Alexander Medvedev
Abstract:
The Impulsive Goodwin's Oscillator (IGO) is a mathematical model of a hybrid closed-loop system. It arises by closing a special kind of continuous linear positive time-invariant system with impulsive feedback, which employs both amplitude and frequency pulse modulation. The structure of IGO precludes the existence of equilibria, and all its solutions are oscillatory. With its origin in mathematica…
▽ More
The Impulsive Goodwin's Oscillator (IGO) is a mathematical model of a hybrid closed-loop system. It arises by closing a special kind of continuous linear positive time-invariant system with impulsive feedback, which employs both amplitude and frequency pulse modulation. The structure of IGO precludes the existence of equilibria, and all its solutions are oscillatory. With its origin in mathematical biology, the IGO also presents a control paradigm useful in a wide range of applications, in particular dosing of chemicals and medicines. Since the pulse modulation feedback mechanism introduces significant nonlinearity and non-smoothness in the closedloop dynamics, conventional controller design methods fail to apply. However, the hybrid dynamics of IGO reduce to a nonlinear, time-invariant discrete-time system, exhibiting a one-to-one correspondence between periodic solutions of the original IGO and those of the discrete-time system. The paper proposes a design approach that leverages the linearization of the equivalent discrete-time dynamics in the vicinity of a fixed point. A simple and efficient local stability condition of the 1-cycle in terms of the characteristics of the amplitude and frequency modulation functions is obtained.
△ Less
Submitted 27 March, 2024;
originally announced March 2024.
-
Output corridor control via design of impulsive Goodwin's oscillator
Authors:
Alexander Medvedev,
Anton V. Proskurnikov,
Zhanybai T. Zhusubaliyev
Abstract:
In the Impulsive Goodwin's oscillator (IGO), a continuous positive linear time-invariant (LTI) plant is controlled by an amplitude- and frequency-modulated feedback into an oscillating solution. Self-sustained oscillations in the IGO model have been extensively used to portray periodic rhythms in endocrine systems, whereas the potential of the concept as a controller design approach still remains…
▽ More
In the Impulsive Goodwin's oscillator (IGO), a continuous positive linear time-invariant (LTI) plant is controlled by an amplitude- and frequency-modulated feedback into an oscillating solution. Self-sustained oscillations in the IGO model have been extensively used to portray periodic rhythms in endocrine systems, whereas the potential of the concept as a controller design approach still remains mainly unexplored. This paper proposes an algorithm to design the feedback of the IGO so that the output of the continuous plant is kept (at stationary conditions) within a pre-defined corridor, i.e. within a bounded interval of values. The presented framework covers single-input single-output LTI plants as well as positive Wiener and Hammerstein models that often appear in process and biomedical control. A potential application of the developed impulsive control approach to a minimal Wiener model of pharmacokinetics and pharmacodynamics of a muscle relaxant used in general anesthesia is discussed.
△ Less
Submitted 18 October, 2023;
originally announced October 2023.
-
Design of the Impulsive Goodwin's Oscillator: A Case Study
Authors:
Alexander Medvedev,
Anton V. Proskurnikov,
Zhanybai T. Zhusubaliyev
Abstract:
The impulsive Goodwin's oscillator (IGO) is a hybrid model composed of a third-order continuous linear part and a pulse-modulated feedback. This paper introduces a design problem of the IGO to admit a desired periodic solution. The dynamics of the continuous states represent the plant to be controlled, whereas the parameters of the impulsive feedback constitute design degrees of freedom. The desig…
▽ More
The impulsive Goodwin's oscillator (IGO) is a hybrid model composed of a third-order continuous linear part and a pulse-modulated feedback. This paper introduces a design problem of the IGO to admit a desired periodic solution. The dynamics of the continuous states represent the plant to be controlled, whereas the parameters of the impulsive feedback constitute design degrees of freedom. The design objective is to select the free parameters so that the IGO exhibits a stable 1-cycle with desired characteristics. The impulse-to-impulse map of the oscillator is demonstrated to always possess a positive fixed point that corresponds to the desired periodic solution; the closed-form expressions to evaluate this fixed point are provided. Necessary and sufficient conditions for orbital stability of the 1-cycle are presented in terms of the oscillator parameters and exhibit similarity to the problem of static output control. An IGO design procedure is proposed and validated by simulation. The nonlinear dynamics of the designed IGO are reviewed by means of bifurcation analysis. Applications of the design procedure to dosing problems in chemical industry and biomedicine are envisioned.
△ Less
Submitted 18 May, 2023;
originally announced May 2023.
-
Non-Euclidean Monotone Operator Theory and Applications
Authors:
Alexander Davydov,
Saber Jafarpour,
Anton V. Proskurnikov,
Francesco Bullo
Abstract:
While monotone operator theory is traditionally studied on Hilbert spaces, many interesting problems in data science and machine learning arise naturally in finite-dimensional vector spaces endowed with non-Euclidean norms, such as diagonally-weighted $\ell_1$ or $\ell_\infty$ norms. This paper provides a natural generalization of monotone operator theory to finite-dimensional non-Euclidean spaces…
▽ More
While monotone operator theory is traditionally studied on Hilbert spaces, many interesting problems in data science and machine learning arise naturally in finite-dimensional vector spaces endowed with non-Euclidean norms, such as diagonally-weighted $\ell_1$ or $\ell_\infty$ norms. This paper provides a natural generalization of monotone operator theory to finite-dimensional non-Euclidean spaces. The key tools are weak pairings and logarithmic norms. We show that the resolvent and reflected resolvent operators of non-Euclidean monotone map**s exhibit similar properties to their counterparts in Hilbert spaces. Furthermore, classical iterative methods and splitting methods for finding zeros of monotone operators are shown to converge in the non-Euclidean case. We apply our theory to equilibrium computation and Lipschitz constant estimation of recurrent neural networks, obtaining novel iterations and tighter upper bounds via forward-backward splitting.
△ Less
Submitted 20 March, 2023;
originally announced March 2023.
-
On the Benefit of Nonlinear Control for Robust Logarithmic Growth: Coin Flip** Games as a Demonstration Case
Authors:
Anton V. Proskurnikov,
B. Ross Barmish
Abstract:
The takeoff point for this paper is the voluminous body of literature addressing recursive betting games with expected logarithmic growth of wealth being the performance criterion. Whereas almost all existing papers involve use of linear feedback, the use of nonlinear control is conspicuously absent. This is epitomized by the large subset of this literature dealing with Kelly Betting. With this as…
▽ More
The takeoff point for this paper is the voluminous body of literature addressing recursive betting games with expected logarithmic growth of wealth being the performance criterion. Whereas almost all existing papers involve use of linear feedback, the use of nonlinear control is conspicuously absent. This is epitomized by the large subset of this literature dealing with Kelly Betting. With this as the high-level motivation, we study the potential for use of nonlinear control in this framework. To this end, we consider a ``demonstration case'' which is one of the simplest scenarios encountered in this line of research: repeated flips of a biased coin with probability of heads~$p$, and even-money payoff on each flip. First, we formulate a new robust nonlinear control problem which we believe is both simple to understand and apropos for dealing with concerns about distributional robustness; i.e., instead of assuming that~$p$ is perfectly known as in the case of the classical Kelly formulation, we begin with a bounding set ~${\cal P} \subseteq [0,1]$ for this probability. Then, we provide a theorem, our main result, which gives a closed-form description of the optimal robust nonlinear controller and a corollary which establishes that it robustly outperforms linear controllers such as those found in the literature. A second, less significant, contribution of this paper bears upon the computability of our solution. For an $n$-flip game, whereas an admissible controller has~$2^n-1$ parameters, at the optimum only~$O(n^2)$ of them turn out to be distinct. Finally, it is noted that the initial assumptions on payoffs and the use of the uniform distribution on~$p$ are made solely for simplicity of the exposition and compliance with length requirements for a Letter. Accordingly, the paper also includes a new section with a discussion indicating how these assumptions can be relaxed.
△ Less
Submitted 31 May, 2023; v1 submitted 18 March, 2023;
originally announced March 2023.
-
Cycles in Impulsive Goodwin's Oscillators of Arbitrary Order
Authors:
Anton V. Proskurnikov,
HÃ¥kan Runvik,
Alexander Medvedev
Abstract:
Existence of periodical solutions, i.e. cycles, in the Impulsive Goodwin's Oscillator (IGO) with the continuous part of an arbitrary order m is considered. The original IGO with a third-order continuous part is a hybrid model that portrays a chemical or biochemical system composed of three substances represented by their concentrations and arranged in a cascade. The first substance in the chain is…
▽ More
Existence of periodical solutions, i.e. cycles, in the Impulsive Goodwin's Oscillator (IGO) with the continuous part of an arbitrary order m is considered. The original IGO with a third-order continuous part is a hybrid model that portrays a chemical or biochemical system composed of three substances represented by their concentrations and arranged in a cascade. The first substance in the chain is introduced via an impulsive feedback where both the impulse frequency and weights are modulated by the measured output of the continuous part. It is shown that, under the standard assumptions on the IGO, a positive periodic solution with one firing of the pulse-modulated feedback in the least period also exists in models with any m >= 1. Furthermore, the uniqueness of this 1-cycle is proved for the IGO with m <= 10 whereas, for m > 10, the uniqueness can still be guaranteed under mild assumptions on the frequency modulation function.
△ Less
Submitted 2 February, 2023;
originally announced February 2023.
-
The Yakubovich S-Lemma Revisited: Stability and Contractivity in Non-Euclidean Norms
Authors:
Anton V. Proskurnikov,
Alexander Davydov,
Francesco Bullo
Abstract:
The celebrated S-Lemma was originally proposed to ensure the existence of a quadratic Lyapunov function in the Lur'e problem of absolute stability. A quadratic Lyapunov function is, however, nothing else than a squared Euclidean norm on the state space (that is, a norm induced by an inner product). A natural question arises as to whether squared non-Euclidean norms $V(x)=\|x\|^2$ may serve as Lyap…
▽ More
The celebrated S-Lemma was originally proposed to ensure the existence of a quadratic Lyapunov function in the Lur'e problem of absolute stability. A quadratic Lyapunov function is, however, nothing else than a squared Euclidean norm on the state space (that is, a norm induced by an inner product). A natural question arises as to whether squared non-Euclidean norms $V(x)=\|x\|^2$ may serve as Lyapunov functions in stability problems. This paper presents a novel non-polynomial S-Lemma that leads to constructive criteria for the existence of such functions defined by weighted $\ell_p$ norms. Our generalized S-Lemma leads to new absolute stability and absolute contractivity criteria for Lur'e-type systems, including, for example, a new simple proof of the Aizerman and Kalman conjectures for positive Lur'e systems.
△ Less
Submitted 2 February, 2023; v1 submitted 29 July, 2022;
originally announced July 2022.
-
Reaching optimal distributed estimation through myopic self-confidence adaptation
Authors:
Giacomo Como,
Fabio Fagnani,
Anton V. Proskurnikov
Abstract:
Consider discrete-time linear distributed averaging dynamics, whereby agents in a network start with uncorrelated and unbiased noisy measurements of a common underlying parameter (state of the world) and iteratively update their estimates following a non-Bayesian rule. Specifically, let every agent update her estimate to a convex combination of her own current estimate and those of her neighbors i…
▽ More
Consider discrete-time linear distributed averaging dynamics, whereby agents in a network start with uncorrelated and unbiased noisy measurements of a common underlying parameter (state of the world) and iteratively update their estimates following a non-Bayesian rule. Specifically, let every agent update her estimate to a convex combination of her own current estimate and those of her neighbors in the network. As a result of this iterative averaging, each agent obtains an asymptotic estimate of the state of the world, and the variance of this individual estimate depends on the matrix of weights the agents assign to self and to the others. We study a game-theoretic multi-objective optimization problem whereby every agent seeks to choose her self-weight in such a convex combination in a way to minimize the variance of her asymptotic estimate of the state of the unknown parameters. Assuming that the relative influence weights assigned by the agents to their neighbors in the network remain fixed and form an irreducible and aperiodic relative influence matrix, we characterize the Pareto frontier of the problem, as well as the set of Nash equilibria in the resulting game.
△ Less
Submitted 5 September, 2022; v1 submitted 4 July, 2022;
originally announced July 2022.
-
Control of Dynamic Financial Networks (The Extended Version)
Authors:
Giuseppe Calafiore,
Giulia Fracastoro,
Anton V. Proskurnikov
Abstract:
The current global financial system forms a highly interconnected network where a default in one of its nodes can propagate to many other nodes, causing a catastrophic avalanche effect. In this paper we consider the problem of reducing the financial contagion by introducing some targeted interventions that can mitigate the cascaded failure effects. We consider a multi-step dynamic model of clearin…
▽ More
The current global financial system forms a highly interconnected network where a default in one of its nodes can propagate to many other nodes, causing a catastrophic avalanche effect. In this paper we consider the problem of reducing the financial contagion by introducing some targeted interventions that can mitigate the cascaded failure effects. We consider a multi-step dynamic model of clearing payments and introduce an external control term that represents corrective cash injections made by a ruling authority. The proposed control model can be cast and efficiently solved as a linear program. We show via numerical examples that the proposed approach can significantly reduce the default propagation by applying small targeted cash injections.
△ Less
Submitted 18 May, 2022;
originally announced May 2022.
-
Non-Euclidean Monotone Operator Theory with Applications to Recurrent Neural Networks
Authors:
Alexander Davydov,
Saber Jafarpour,
Anton V. Proskurnikov,
Francesco Bullo
Abstract:
We provide a novel transcription of monotone operator theory to the non-Euclidean finite-dimensional spaces $\ell_1$ and $\ell_{\infty}$. We first establish properties of map**s which are monotone with respect to the non-Euclidean norms $\ell_1$ or $\ell_{\infty}$. In analogy with their Euclidean counterparts, map**s which are monotone with respect to a non-Euclidean norm are amenable to numer…
▽ More
We provide a novel transcription of monotone operator theory to the non-Euclidean finite-dimensional spaces $\ell_1$ and $\ell_{\infty}$. We first establish properties of map**s which are monotone with respect to the non-Euclidean norms $\ell_1$ or $\ell_{\infty}$. In analogy with their Euclidean counterparts, map**s which are monotone with respect to a non-Euclidean norm are amenable to numerous algorithms for computing their zeros. We demonstrate that several classic iterative methods for computing zeros of monotone operators are directly applicable in the non-Euclidean framework. We present a case-study in the equilibrium computation of recurrent neural networks and demonstrate that casting the computation as a suitable operator splitting problem improves convergence rates.
△ Less
Submitted 18 July, 2022; v1 submitted 4 April, 2022;
originally announced April 2022.
-
Clearing Payments in Dynamic Financial Networks
Authors:
Giuseppe C. Calafiore,
Giulia Fracastoro,
Anton V. Proskurnikov
Abstract:
This paper proposes a novel dynamical model for determining clearing payments in financial networks. We extend the classical Eisenberg-Noe model of financial contagion to multiple time periods, allowing financial operations to continue after possible initial pseudo defaults, thus permitting nodes to recover and eventually fulfil their liabilities. Optimal clearing payments in our model are compute…
▽ More
This paper proposes a novel dynamical model for determining clearing payments in financial networks. We extend the classical Eisenberg-Noe model of financial contagion to multiple time periods, allowing financial operations to continue after possible initial pseudo defaults, thus permitting nodes to recover and eventually fulfil their liabilities. Optimal clearing payments in our model are computed by solving a suitable linear program, both in the full matrix payments case and in the pro-rata constrained case. We prove that the proposed model obeys the \emph{priority of debt claims} requirement, that is, each node at every step either pays its liabilities in full, or it pays out all its balance. In the pro-rata case, the optimal dynamic clearing payments are unique, and can be determined via a time-decoupled sequential optimization approach.
△ Less
Submitted 17 May, 2022; v1 submitted 30 January, 2022;
originally announced January 2022.
-
Non-Euclidean Contraction Analysis of Continuous-Time Neural Networks
Authors:
Alexander Davydov,
Anton V. Proskurnikov,
Francesco Bullo
Abstract:
Critical questions in dynamical neuroscience and machine learning are related to the study of continuous-time neural networks and their stability, robustness, and computational efficiency. These properties can be simultaneously established via a contraction analysis. This paper develops a comprehensive non-Euclidean contraction theory for continuous-time neural networks. Specifically, we provide n…
▽ More
Critical questions in dynamical neuroscience and machine learning are related to the study of continuous-time neural networks and their stability, robustness, and computational efficiency. These properties can be simultaneously established via a contraction analysis. This paper develops a comprehensive non-Euclidean contraction theory for continuous-time neural networks. Specifically, we provide novel sufficient conditions for the contractivity of general classes of continuous-time neural networks including Hopfield, firing rate, Persidskii, Lur'e, and other neural networks with respect to the non-Euclidean $\ell_1/\ell_\infty$ norms. These sufficient conditions are based upon linear programming or, in some special cases, establishing the Hurwitzness of a particular Metzler matrix. To prove these sufficient conditions, we develop novel results on non-Euclidean logarithmic norms and a novel necessary and sufficient condition for contractivity of systems with locally Lipschitz dynamics. For each model, we apply our theoretical results to compute the optimal contraction rate and corresponding weighted non-Euclidean norm with respect to which the neural network is contracting.
△ Less
Submitted 29 June, 2024; v1 submitted 15 October, 2021;
originally announced October 2021.
-
Robust Implicit Networks via Non-Euclidean Contractions
Authors:
Saber Jafarpour,
Alexander Davydov,
Anton V. Proskurnikov,
Francesco Bullo
Abstract:
Implicit neural networks, a.k.a., deep equilibrium networks, are a class of implicit-depth learning models where function evaluation is performed by solving a fixed point equation. They generalize classic feedforward models and are equivalent to infinite-depth weight-tied feedforward networks. While implicit models show improved accuracy and significant reduction in memory consumption, they can su…
▽ More
Implicit neural networks, a.k.a., deep equilibrium networks, are a class of implicit-depth learning models where function evaluation is performed by solving a fixed point equation. They generalize classic feedforward models and are equivalent to infinite-depth weight-tied feedforward networks. While implicit models show improved accuracy and significant reduction in memory consumption, they can suffer from ill-posedness and convergence instability.
This paper provides a new framework, which we call Non-Euclidean Monotone Operator Network (NEMON), to design well-posed and robust implicit neural networks based upon contraction theory for the non-Euclidean norm $\ell_{\infty}$. Our framework includes (i) a novel condition for well-posedness based on one-sided Lipschitz constants, (ii) an average iteration for computing fixed-points, and (iii) explicit estimates on input-output Lipschitz constants. Additionally, we design a training problem with the well-posedness condition and the average iteration as constraints and, to achieve robust models, with the input-output Lipschitz constant as a regularizer. Our $\ell_{\infty}$ well-posedness condition leads to a larger polytopic training search space than existing conditions and our average iteration enjoys accelerated convergence. Finally, we evaluate our framework in image classification through the MNIST and the CIFAR-10 datasets. Our numerical results demonstrate improved accuracy and robustness of the implicit models with smaller input-output Lipschitz bounds. Code is available at https://github.com/davydovalexander/Non-Euclidean_Mon_Op_Net.
△ Less
Submitted 25 January, 2022; v1 submitted 6 June, 2021;
originally announced June 2021.
-
Delay Robustness of Consensus Algorithms: Beyond The Uniform Connectivity (Extended Version)
Authors:
Anton V. Proskurnikov,
Giuseppe Carlo Calafiore
Abstract:
Consensus of autonomous agents is a benchmark problem in multi-agent control. In this paper, we consider continuous-time averaging consensus policies (or Laplacian flows) and their discrete-time counterparts over time-varying graphs in presence of unknown but bounded communication delays. It is known that consensus is established (no matter how large the delays are) if the graph is periodically, o…
▽ More
Consensus of autonomous agents is a benchmark problem in multi-agent control. In this paper, we consider continuous-time averaging consensus policies (or Laplacian flows) and their discrete-time counterparts over time-varying graphs in presence of unknown but bounded communication delays. It is known that consensus is established (no matter how large the delays are) if the graph is periodically, or uniformly quasi-strongly connected (UQSC). The UQSC condition is often believed to be the weakest sufficient condition under which consensus can be proved. We show that the UQSC condition can actually be substantially relaxed and replaced by a condition that we call aperiodic quasi-strong connectivity (AQSC), which, in some sense, proves to be very close to the necessary condition of integral connectivity. Furthermore, in some special situations such as undirected or type-symmetric graph, we find a necessary and sufficient condition for consensus in presence of bounded delay; the relevant results have been previously proved only in the undelayed case. The consensus criteria established in this paper generalize a number of results known in the literature.
△ Less
Submitted 15 May, 2021;
originally announced May 2021.
-
Optimal Clearing Payments in a Financial Contagion Model
Authors:
Giuseppe Calafiore,
Giulia Fracastoro,
Anton V. Proskurnikov
Abstract:
Financial networks are characterized by complex structures of mutual obligations. These obligations are fulfilled entirely or in part (when defaults occur) via a mechanism called clearing, which determines a set of payments that settle the claims by respecting rules such as limited liability, absolute priority, and proportionality (pro-rated payments). In the presence of shocks on the financial sy…
▽ More
Financial networks are characterized by complex structures of mutual obligations. These obligations are fulfilled entirely or in part (when defaults occur) via a mechanism called clearing, which determines a set of payments that settle the claims by respecting rules such as limited liability, absolute priority, and proportionality (pro-rated payments). In the presence of shocks on the financial system, however, the clearing mechanism may lead to cascaded defaults and eventually to financial disaster. In this paper, we first study the clearing model under pro-rated payments of Eisenberg and Noe, and we derive novel necessary and sufficient conditions for the uniqueness of the clearing payments, valid for an arbitrary topology of the financial network. Then, we argue that the proportionality rule is one of the factors responsible for cascaded defaults, and that the overall system loss can be reduced if this rule is lifted. The proposed approach thus shifts the focus from the individual interest to the overall system's interest to control and contain adverse effects of cascaded failures, and we show that clearing payments in this setting can be computed by solving suitable convex optimization problems.
△ Less
Submitted 27 February, 2024; v1 submitted 19 March, 2021;
originally announced March 2021.
-
New Results on Delay Robustness of Consensus Algorithms
Authors:
Anton V. Proskurnikov,
Guiseppe Calafiore
Abstract:
Consensus of autonomous agents is a benchmark problem in cooperative control. In this paper, we consider standard continuous-time averaging consensus policies (or Laplacian flows) over time-varying graphs and focus on robustness of consensus against communication delays. Such a robustness has been proved under the assumption of uniform quasi-strong connectivity of the graph. It is known, however,…
▽ More
Consensus of autonomous agents is a benchmark problem in cooperative control. In this paper, we consider standard continuous-time averaging consensus policies (or Laplacian flows) over time-varying graphs and focus on robustness of consensus against communication delays. Such a robustness has been proved under the assumption of uniform quasi-strong connectivity of the graph. It is known, however, that the uniform connectivity is not necessary for consensus. For instance, in the case of undirected graph and undelayed communication consensus requires a much weaker condition of integral connectivity. In this paper, we show that the latter results remain valid in presence of unknown but bounded communication delays, furthermore, the condition of undirected graph can be substantially relaxed and replaced by the conditions of non-instantaneous type-symmetry. Furthermore, consensus can be proved for any feasible solution of the delay differential inequalities associated to the consensus algorithm. Such inequalities naturally arise in problems of containment control, distributed optimization and models of social dynamics.
△ Less
Submitted 6 September, 2020;
originally announced September 2020.
-
Robust Output Regulation: Optimization-Based Synthesis and Event-Triggered Implementation
Authors:
Mohammad Saeed Sarafraz,
Anton V. Proskurnikov,
Mohammad Saleh Tavazoei,
Peyman Mohajerin Esfahani
Abstract:
We investigate the problem of practical output regulation, i.e., to design a controller that brings the system output in the vicinity of a desired target value while kee** the other variables bounded. We consider uncertain systems that are possibly nonlinear and the uncertainty of their linear parts is modeled element-wise through a parametric family of matrix boxes. An optimization-based design…
▽ More
We investigate the problem of practical output regulation, i.e., to design a controller that brings the system output in the vicinity of a desired target value while kee** the other variables bounded. We consider uncertain systems that are possibly nonlinear and the uncertainty of their linear parts is modeled element-wise through a parametric family of matrix boxes. An optimization-based design procedure is proposed that delivers a continuous-time control and estimates the maximal regulation error. We also analyze an event-triggered emulation of this controller, which can be implemented on a digital platform, along with an explicit estimates of the regulation error.
△ Less
Submitted 18 June, 2021; v1 submitted 28 March, 2020;
originally announced March 2020.
-
Recurrent Averaging Inequalities in Multi-Agent Control and Social Dynamics Modeling
Authors:
Anton V. Proskurnikov,
Giuseppe Calafiore,
Ming Cao
Abstract:
Many multi-agent control algorithms and dynamic agent-based models arising in natural and social sciences are based on the principle of iterative averaging. Each agent is associated to a value of interest, which may represent, for instance, the opinion of an individual in a social group, the velocity vector of a mobile robot in a flock, or the measurement of a sensor within a sensor network. This…
▽ More
Many multi-agent control algorithms and dynamic agent-based models arising in natural and social sciences are based on the principle of iterative averaging. Each agent is associated to a value of interest, which may represent, for instance, the opinion of an individual in a social group, the velocity vector of a mobile robot in a flock, or the measurement of a sensor within a sensor network. This value is updated, at each iteration, to a weighted average of itself and of the values of the adjacent agents. It is well known that, under natural assumptions on the network's graph connectivity, this local averaging procedure eventually leads to global consensus, or synchronization of the values at all nodes. Applications of iterative averaging include, but are not limited to, algorithms for distributed optimization, for solution of linear and nonlinear equations, for multi-robot coordination and for opinion formation in social groups. Although these algorithms have similar structures, the mathematical techniques used for their analysis are diverse, and conditions for their convergence and differ from case to case. In this paper, we review many of these algorithms and we show that their properties can be analyzed in a unified way by using a novel tool based on recurrent averaging inequalities (RAIs). We develop a theory of RAIs and apply it to the analysis of several important multi-agent algorithms recently proposed in the literature.
△ Less
Submitted 13 May, 2020; v1 submitted 31 October, 2019;
originally announced October 2019.
-
Macroscopic Noisy Bounded Confidence Models with Distributed Radical Opinions
Authors:
M. A. S. Kolarijani,
A. V. Proskurnikov,
P. Mohajerin Esfahani
Abstract:
In this article, we study the nonlinear Fokker-Planck (FP) equation that arises as a mean-field (macroscopic) approximation of bounded confidence opinion dynamics, where opinions are influenced by environmental noises and opinions of radicals (stubborn individuals). The distribution of radical opinions serves as an infinite-dimensional exogenous input to the FP equation, visibly influencing the st…
▽ More
In this article, we study the nonlinear Fokker-Planck (FP) equation that arises as a mean-field (macroscopic) approximation of bounded confidence opinion dynamics, where opinions are influenced by environmental noises and opinions of radicals (stubborn individuals). The distribution of radical opinions serves as an infinite-dimensional exogenous input to the FP equation, visibly influencing the steady opinion profile. We establish mathematical properties of the FP equation. In particular, we (i) show the well-posedness of the dynamic equation, (ii) provide existence result accompanied by a quantitative global estimate for the corresponding stationary solution, and (iii) establish an explicit lower bound on the noise level that guarantees exponential convergence of the dynamics to stationary state. Combining the results in (ii) and (iii) readily yields the input-output stability of the system for sufficiently large noises. Next, using Fourier analysis, the structure of opinion clusters under the uniform initial distribution is examined. Specifically, two numerical schemes for identification of order-disorder transition and characterization of initial clustering behavior are provided. The results of analysis are validated through several numerical simulations of the continuum-agent model (partial differential equation) and the corresponding discrete-agent model (interacting stochastic differential equations) for a particular distribution of radicals.
△ Less
Submitted 13 January, 2020; v1 submitted 10 May, 2019;
originally announced May 2019.
-
Lyapunov Event-triggered Stabilization with a Known Convergence Rate
Authors:
Anton V. Proskurnikov,
Manuel Mazo Jr
Abstract:
A constructive tool of nonlinear control systems design, the method of Control Lyapunov Functions (CLF) has found numerous applications in stabilization problems for continuous time, discrete-time and hybrid systems. In this paper, we address the fundamental question: given a CLF, corresponding to the continuous-time controller with some predefined (e.g. exponential) convergence rate, can the same…
▽ More
A constructive tool of nonlinear control systems design, the method of Control Lyapunov Functions (CLF) has found numerous applications in stabilization problems for continuous time, discrete-time and hybrid systems. In this paper, we address the fundamental question: given a CLF, corresponding to the continuous-time controller with some predefined (e.g. exponential) convergence rate, can the same convergence rate be provided by an event-triggered controller? Under certain assumptions, we give an affirmative answer to this question and show that the corresponding event-based controllers provide positive dwelltimes between the consecutive events. Furthermore, we prove the existence of self-triggered and periodic event-triggered controllers, providing stabilization with a known convergence rate.
△ Less
Submitted 14 July, 2020; v1 submitted 23 March, 2018;
originally announced March 2018.
-
Lyapunov Design for Event-Triggered Exponential Stabilization
Authors:
Anton V. Proskurnikov,
Manuel Mazo Jr
Abstract:
Control Lyapunov Functions (CLF) method gives a constructive tool for stabilization of nonlinear systems. To find a CLF, many methods have been proposed in the literature, e.g. backstep** for cascaded systems and sum of squares (SOS) programming for polynomial systems. Dealing with continuous-time systems, the CLF-based controller is also continuous-time, whereas practical implementation on a di…
▽ More
Control Lyapunov Functions (CLF) method gives a constructive tool for stabilization of nonlinear systems. To find a CLF, many methods have been proposed in the literature, e.g. backstep** for cascaded systems and sum of squares (SOS) programming for polynomial systems. Dealing with continuous-time systems, the CLF-based controller is also continuous-time, whereas practical implementation on a digital platform requires sampled-time control. In this paper, we show that if the continuous-time controller provides exponential stabilization, then an exponentially stabilizing event-triggered control strategy exists with the convergence rate arbitrarily close to the rate of the continuous-time system.
△ Less
Submitted 3 February, 2018;
originally announced February 2018.
-
Optimal Universal Controllers for Roll Stabilization
Authors:
Yuri A. Kapitanyuk,
Anton V. Proskurnikov,
Ming Cao
Abstract:
Roll stabilization is an important problem of ship motion control. This problem becomes especially difficult if the same set of actuators (e.g. a single rudder) has to be used for roll stabilization and heading control of the vessel, so that the roll stabilizing system interferes with the ship autopilot. Finding the "trade-off" between the concurrent goals of accurate vessel steering and roll stab…
▽ More
Roll stabilization is an important problem of ship motion control. This problem becomes especially difficult if the same set of actuators (e.g. a single rudder) has to be used for roll stabilization and heading control of the vessel, so that the roll stabilizing system interferes with the ship autopilot. Finding the "trade-off" between the concurrent goals of accurate vessel steering and roll stabilization usually reduces to an optimization problem, which has to be solved in presence of an unknown wave disturbance. Standard approaches to this problem (loop-sha**, LQG, $H_{\infty}$-control etc.) require to know the spectral density of the disturbance, considered to be a \colored noise". In this paper, we propose a novel approach to optimal roll stabilization, approximating the disturbance by a polyharmonic signal with known frequencies yet uncertain amplitudes and phase shifts. Linear quadratic optimization problems in presence of polyharmonic disturbances can be solved by means of the theory of universal controllers developed by V.A. Yakubovich. An optimal universal controller delivers the optimal solution for any uncertain amplitudes and phases. Using Marine Systems Simulator (MSS) Toolbox that provides a realistic vessel's model, we compare our design method with classical approaches to optimal roll stabilization. Among three controllers providing the same quality of yaw steering, OUC stabilizes the roll motion most efficiently.
△ Less
Submitted 14 July, 2020; v1 submitted 23 July, 2017;
originally announced July 2017.
-
Opinion evolution in time-varying social influence networks with prejudiced agents
Authors:
Anton V. Proskurnikov,
Roberto Tempo,
Ming Cao,
Noah E. Friedkin
Abstract:
Investigation of social influence dynamics requires mathematical models that are "simple" enough to admit rigorous analysis, and yet sufficiently "rich" to capture salient features of social groups. Thus, the mechanism of iterative opinion pooling from (DeGroot, 1974), which can explain the generation of consensus, was elaborated in (Friedkin and Johnsen, 1999) to take into account individuals' on…
▽ More
Investigation of social influence dynamics requires mathematical models that are "simple" enough to admit rigorous analysis, and yet sufficiently "rich" to capture salient features of social groups. Thus, the mechanism of iterative opinion pooling from (DeGroot, 1974), which can explain the generation of consensus, was elaborated in (Friedkin and Johnsen, 1999) to take into account individuals' ongoing attachments to their initial opinions, or prejudices. The "anchorage" of individuals to their prejudices may disable reaching consensus and cause disagreement in a social influence network. Further elaboration of this model may be achieved by relaxing its restrictive assumption of a time-invariant influence network. During opinion dynamics on an issue, arcs of interpersonal influence may be added or subtracted from the network, and the influence weights assigned by an individual to his/her neighbors may alter. In this paper, we establish new important properties of the (Friedkin and Johnsen, 1999) opinion formation model, and also examine its extension to time-varying social influence networks.
△ Less
Submitted 23 April, 2017;
originally announced April 2017.
-
Modulus consensus in discrete-time signed networks and properties of special recurrent inequalities
Authors:
Anton V. Proskurnikov,
Ming Cao
Abstract:
Recently the dynamics of signed networks, where the ties among the agents can be both positive (attractive) or negative (repulsive) have attracted substantial attention of the research community. Examples of such networks are models of opinion dynamics over signed graphs, recently introduced by Altafini (2012,2013) and extended to discrete-time case by Meng et al. (2014). It has been shown that un…
▽ More
Recently the dynamics of signed networks, where the ties among the agents can be both positive (attractive) or negative (repulsive) have attracted substantial attention of the research community. Examples of such networks are models of opinion dynamics over signed graphs, recently introduced by Altafini (2012,2013) and extended to discrete-time case by Meng et al. (2014). It has been shown that under mild connectivity assumptions these protocols provide the convergence of opinions in absolute value, whereas their signs may differ. This "modulus consensus" may correspond to the polarization of the opinions (or bipartite consensus, including the usual consensus as a special case), or their convergence to zero. In this paper, we demonstrate that the phenomenon of modulus consensus in the discrete-time Altafini model is a manifestation of a more general and profound fact, regarding the solutions of a special recurrent inequality. Although such a recurrent inequality does not provide the uniqueness of a solution, it can be shown that, under some natural assumptions, each of its bounded solutions has a limit and, moreover, converges to consensus. A similar property has previously been established for special continuous-time differential inequalities (Proskurnikov, Cao, 2016). Besides analysis of signed networks, we link the consensus properties of recurrent inequalities to the convergence analysis of distributed optimization algorithms and the problems of Schur stability of substochastic matrices.
△ Less
Submitted 20 March, 2017;
originally announced March 2017.
-
Local and global analysis of endocrine regulation as a non-cyclic feedback system
Authors:
Hadi Taghvafard,
Anton V. Proskurnikov,
Ming Cao
Abstract:
To understand the sophisticated control mechanisms of the human's endocrine system is a challenging task that is a crucial step towards precise medical treatment of many disfunctions and diseases. Although mathematical models describing the endocrine system as a whole are still elusive, recently some substantial progress has been made in analyzing theoretically its subsystems (or axes) that regula…
▽ More
To understand the sophisticated control mechanisms of the human's endocrine system is a challenging task that is a crucial step towards precise medical treatment of many disfunctions and diseases. Although mathematical models describing the endocrine system as a whole are still elusive, recently some substantial progress has been made in analyzing theoretically its subsystems (or axes) that regulate production of specific hormones. Many of the relevant mathematical models are similar in structure to (or squarely based on) the celebrated Goodwin's oscillator. Such models are convenient to explain stable periodic oscillations at hormones' level by representing the corresponding endocrine regulation circuits as cyclic feedback systems. However, many real hormonal regulation mechanisms (in particular, testosterone regulation) are in fact known to have non-cyclic structures and involve multiple feedbacks; a Goodwin-type model thus represents only a part of such a complicated mechanism. In this paper, we examine a new mathematical model of hormonal regulation, obtained from the classical Goodwin's oscillator by introducing an additional negative feedback. Local stability properties of the proposed model are studied, and we show that the local instability of its unique equilibrium implies oscillatory behavior of almost all solutions. Furthermore, under additional restrictions we prove that almost all solutions converge to periodic ones.
△ Less
Submitted 13 October, 2017; v1 submitted 17 October, 2016;
originally announced October 2016.
-
A guiding vector field algorithm for path following control of nonholonomic mobile robots
Authors:
Yuri A. Kapitanyuk,
Anton V. Proskurnikov,
Ming Cao
Abstract:
In this paper we propose an algorithm for path following control of the nonholonomic mobile robot based on the idea of the guiding vector field (GVF). The desired path may be an arbitrary smooth curve in its implicit form, that is, a level set of a predefined smooth function. Using this function and the robot's kinematic model, we design a GVF, whose integral curves converge to the trajectory. A n…
▽ More
In this paper we propose an algorithm for path following control of the nonholonomic mobile robot based on the idea of the guiding vector field (GVF). The desired path may be an arbitrary smooth curve in its implicit form, that is, a level set of a predefined smooth function. Using this function and the robot's kinematic model, we design a GVF, whose integral curves converge to the trajectory. A nonlinear motion controller is then proposed which steers the robot along such an integral curve, bringing it to the desired path. We establish global convergence conditions for our algorithm and demonstrate its applicability and performance by experiments with real wheeled robots.
△ Less
Submitted 7 February, 2017; v1 submitted 14 October, 2016;
originally announced October 2016.
-
Differential Inequalities in Multi-Agent Coordination and Opinion Dynamics Modeling
Authors:
Anton V. Proskurnikov,
Ming Cao
Abstract:
Distributed algorithms of multi-agent coordination have attracted substantial attention from the research community; the simplest and most thoroughly studied of them are consensus protocols in the form of differential or difference equations over general time-varying weighted graphs. These graphs are usually characterized algebraically by their associated Laplacian matrices. Network algorithms wit…
▽ More
Distributed algorithms of multi-agent coordination have attracted substantial attention from the research community; the simplest and most thoroughly studied of them are consensus protocols in the form of differential or difference equations over general time-varying weighted graphs. These graphs are usually characterized algebraically by their associated Laplacian matrices. Network algorithms with similar algebraic graph theoretic structures, called being of Laplacian-type in this paper, also arise in other related multi-agent control problems, such as aggregation and containment control, target surrounding, distributed optimization and modeling of opinion evolution in social groups. In spite of their similarities, each of such algorithms has often been studied using separate mathematical techniques. In this paper, a novel approach is offered, allowing a unified and elegant way to examine many Laplacian-type algorithms for multi-agent coordination. This approach is based on the analysis of some differential or difference inequalities that have to be satisfied by the some "outputs" of the agents (e.g. the distances to the desired set in aggregation problems). Although such inequalities may have many unbounded solutions, under natural graphic connectivity conditions all their bounded solutions converge (and even reach consensus), entailing the convergence of the corresponding distributed algorithms. In the theory of differential equations the absence of bounded non-convergent solutions is referred to as the equation's dichotomy. In this paper, we establish the dichotomy criteria of Laplacian-type differential and difference inequalities and show that these criteria enable one to extend a number of recent results, concerned with Laplacian-type algorithms for multi-agent coordination and modeling opinion formation in social groups.
△ Less
Submitted 29 June, 2017; v1 submitted 11 October, 2016;
originally announced October 2016.
-
Synchronization of Pulse-Coupled Oscillators and Clocks under Minimal Connectivity Assumptions
Authors:
Anton V. Proskurnikov,
Ming Cao
Abstract:
Populations of flashing fireflies, claps of applauding audience, cells of cardiac and circadian pacemakers reach synchrony via event-triggered interactions, referred to as pulse couplings. Synchronization via pulse coupling is widely used in wireless sensor networks, providing clock synchronization with parsimonious packet exchanges. In spite of serious attention paid to networks of pulse coupled…
▽ More
Populations of flashing fireflies, claps of applauding audience, cells of cardiac and circadian pacemakers reach synchrony via event-triggered interactions, referred to as pulse couplings. Synchronization via pulse coupling is widely used in wireless sensor networks, providing clock synchronization with parsimonious packet exchanges. In spite of serious attention paid to networks of pulse coupled oscillators, there is a lack of mathematical results, addressing networks with general communication topologies and general phase-response curves of the oscillators. The most general results of this type (Wang et al., 2012, 2015) establish synchronization of oscillators with a delay-advance phase-response curve over strongly connected networks. In this paper we extend this result by relaxing the connectivity condition to the existence of a root node (or a directed spanning tree) in the graph. This condition is also necessary for synchronization.
△ Less
Submitted 20 December, 2016; v1 submitted 8 October, 2015;
originally announced October 2015.
-
Synchronization of Goodwin's oscillators under boundedness and nonnegativeness constraints for solutions
Authors:
Anton V. Proskurnikov,
Ming Cao
Abstract:
In the recent paper by Hamadeh et al. (2012) an elegant analytic criterion for incremental output feedback passivity (iOFP) of cyclic feedback systems (CFS) has been reported, assuming that the constituent subsystems are incrementally output strictly passive (iOSP). This criterion was used to prove that a network of identical CFS can be synchronized under sufficiently strong linear diffusive coupl…
▽ More
In the recent paper by Hamadeh et al. (2012) an elegant analytic criterion for incremental output feedback passivity (iOFP) of cyclic feedback systems (CFS) has been reported, assuming that the constituent subsystems are incrementally output strictly passive (iOSP). This criterion was used to prove that a network of identical CFS can be synchronized under sufficiently strong linear diffusive coupling. A very important class of CFS consists of biological oscillators, named after Brian Goodwin and describing self-regulated chains of enzymatic reactions, where the product of each reaction catalyzes the next reaction, while the last product inhibits the first reaction in the chain. Goodwin's oscillators are used, in particular, to model the dynamics of genetic circadian pacemakers, hormonal cycles and some metabolic pathways. In this paper we point out that for Goodwin's oscillators, where the individual reactions have nonlinear (e.g. Mikhaelis-Menten) kinetics, the synchronization criterion, obtained by Hamadeh et al., cannot be directly applied. This criterion relies on the implicit assumption of the solution boundedness, dictated also by the chemical feasibility (the state variables stand for the concentrations of chemicals). Furthermore, to test the synchronization condition one needs to know an explicit bound for a solution, which generally cannot be guaranteed under linear coupling. At the same time, we show that these restrictions can be avoided for a nonlinear synchronization protocol, where the control inputs are "saturated" by a special nonlinear function (belonging to a wide class), which guarantees nonnegativity of the solutions and allows to get explicit ultimate bounds for them. We prove that oscillators synchronize under such a protocol, provided that the couplings are sufficiently strong.
△ Less
Submitted 10 January, 2016; v1 submitted 20 August, 2015;
originally announced August 2015.
-
Opinion Dynamics in Social Networks with Hostile Camps: Consensus vs. Polarization
Authors:
Anton V. Proskurnikov,
Alexey Matveev,
Ming Cao
Abstract:
Most of the distributed protocols for multi-agent consensus assume that the agents are mutually cooperative and "trustful," and so the couplings among the agents bring the values of their states closer. Opinion dynamics in social groups, however, require beyond these conventional models due to ubiquitous competition and distrust between some pairs of agents, which are usually characterized by repu…
▽ More
Most of the distributed protocols for multi-agent consensus assume that the agents are mutually cooperative and "trustful," and so the couplings among the agents bring the values of their states closer. Opinion dynamics in social groups, however, require beyond these conventional models due to ubiquitous competition and distrust between some pairs of agents, which are usually characterized by repulsive couplings and may lead to clustering of the opinions. A simple yet insightful model of opinion dynamics with both attractive and repulsive couplings was proposed recently by C. Altafini, who examined first-order consensus algorithms over static signed graphs. This protocol establishes modulus consensus, where the opinions become the same in modulus but may differ in signs. In this paper, we extend the modulus consensus model to the case where the network topology is an arbitrary time-varying signed graph and prove reaching modulus consensus under mild sufficient conditions of uniform connectivity of the graph. For cut-balanced graphs, not only sufficient, but also necessary conditions for modulus consensus are given.
△ Less
Submitted 20 August, 2015;
originally announced August 2015.
-
Novel Multidimensional Models of Opinion Dynamics in Social Networks
Authors:
Sergey E. Parsegov,
Anton V. Proskurnikov,
Roberto Tempo,
Noah E. Friedkin
Abstract:
Unlike many complex networks studied in the literature, social networks rarely exhibit unanimous behavior, or consensus. This requires a development of mathematical models that are sufficiently simple to be examined and capture, at the same time, the complex behavior of real social groups, where opinions and actions related to them may form clusters of different size. One such model, proposed by F…
▽ More
Unlike many complex networks studied in the literature, social networks rarely exhibit unanimous behavior, or consensus. This requires a development of mathematical models that are sufficiently simple to be examined and capture, at the same time, the complex behavior of real social groups, where opinions and actions related to them may form clusters of different size. One such model, proposed by Friedkin and Johnsen, extends the idea of conventional consensus algorithm (also referred to as the iterative opinion pooling) to take into account the actors' prejudices, caused by some exogenous factors and leading to disagreement in the final opinions.
In this paper, we offer a novel multidimensional extension, describing the evolution of the agents' opinions on several topics. Unlike the existing models, these topics are interdependent, and hence the opinions being formed on these topics are also mutually dependent. We rigorous examine stability properties of the proposed model, in particular, convergence of the agents' opinions. Although our model assumes synchronous communication among the agents, we show that the same final opinions may be reached "on average" via asynchronous gossip-based protocols.
△ Less
Submitted 9 September, 2016; v1 submitted 19 May, 2015;
originally announced May 2015.