-
A Hybrid Observer for Estimating the State of a Distributed Linear System
Authors:
Lili Wang,
Ji Liu,
A. Stephen Morse
Abstract:
A hybrid observer is described for estimating the state of a system of the form dot x=Ax, y_i=C_ix, i=1,...,m. The system's state x is simultaneously estimated by m agents assuming agent i senses y_i and receives appropriately defined data from its neighbors. Neighbor relations are characterized by a time-varying directed graph N(t). Agent i updates its estimate x_i of x at event times t_{i1},t_{i…
▽ More
A hybrid observer is described for estimating the state of a system of the form dot x=Ax, y_i=C_ix, i=1,...,m. The system's state x is simultaneously estimated by m agents assuming agent i senses y_i and receives appropriately defined data from its neighbors. Neighbor relations are characterized by a time-varying directed graph N(t). Agent i updates its estimate x_i of x at event times t_{i1},t_{i2} ... using a local continuous-time linear observer and a local parameter estimator which iterates q times during each event time interval [t_{i(s-1)},t_{is}), s>=1, to obtain an estimate of x(t_{is}). Subject to the assumptions that N(t) is strongly connected, and the system is jointly observable, it is possible to design parameters so that x_i converges to x with a pre-assigned rate. This result holds when agents communicate asynchronously with the assumption that N(t) changes slowly. Exponential convergence is also assured if the event time sequence of the agents are slightly different, although only if the system being observed is exponentially stable; this limitation however, is a robustness issue shared by all open loop state estimators with small modeling errors. The result also holds facing abrupt changes in the number of vertices and arcs in the inter-agent communication graph upon which the algorithm depends.
△ Less
Submitted 10 August, 2022; v1 submitted 4 August, 2022;
originally announced August 2022.
-
Analysis of Difficulty Control in Bitcoin and Proof-of-Work Blockchains
Authors:
Daniel Fullmer,
A. S. Morse
Abstract:
This paper presents a stochastic model for block arrival times based on the difficulty retargeting rule used in Bitcoin, as well as other proof-of-work blockchains. Unlike some previous work, this paper explicitly models the difficulty target as a random variable which is a function of the previous block arrival times and affecting the block times in the next retargeting period. An explicit margin…
▽ More
This paper presents a stochastic model for block arrival times based on the difficulty retargeting rule used in Bitcoin, as well as other proof-of-work blockchains. Unlike some previous work, this paper explicitly models the difficulty target as a random variable which is a function of the previous block arrival times and affecting the block times in the next retargeting period. An explicit marginal distribution is derived for the time between successive blocks (the blocktime), while allowing for randomly changing difficulty. This paper also aims to serve as an introduction to Bitcoin and proof-of-work blockchains for the controls community, focusing on the difficulty retargeting procedure used in Bitcoin.
△ Less
Submitted 27 December, 2018;
originally announced December 2018.
-
The Power Allocation Game on A Network: Computation Issue
Authors:
Yuke Li,
Jiahua Yue,
Fengjiao Liu,
A. Stephen Morse
Abstract:
In this paper two algorithms with the goal of generating the equilibrium set of the power allocation game first developed in \cite{allocation} are proposed. Based on the first algorithm, the geometric property of the pure strategy Nash equilibrium set will be proven to be a collection of convex polytopes. The second, simulation-based, algorithm is developed to overcome the shortcoming of the first…
▽ More
In this paper two algorithms with the goal of generating the equilibrium set of the power allocation game first developed in \cite{allocation} are proposed. Based on the first algorithm, the geometric property of the pure strategy Nash equilibrium set will be proven to be a collection of convex polytopes. The second, simulation-based, algorithm is developed to overcome the shortcoming of the first algorithm in terms of generating the equilibrium set efficiently and then making policy-relevant predictions based on the set. The second algorithm will be usefully applied to a real-world case study, which draws on the current crisis between North Korea and certain key players including the US and China.
△ Less
Submitted 5 May, 2018;
originally announced May 2018.
-
A Generalized Discrete-Time Altafini Model
Authors:
L. Wang,
J. Liu,
A. S. Morse,
B. D. O. Anderson,
D. Fullmer
Abstract:
A discrete-time modulus consensus model is considered in which the interaction among a family of networked agents is described by a time-dependent gain graph whose vertices correspond to agents and whose arcs are assigned complex numbers from a cyclic group. Limiting behavior of the model is studied using a graphical approach. It is shown that, under appropriate connectedness, a certain type of cl…
▽ More
A discrete-time modulus consensus model is considered in which the interaction among a family of networked agents is described by a time-dependent gain graph whose vertices correspond to agents and whose arcs are assigned complex numbers from a cyclic group. Limiting behavior of the model is studied using a graphical approach. It is shown that, under appropriate connectedness, a certain type of clustering will be reached exponentially fast for almost all initial conditions if and only if the sequence of gain graphs is "repeatedly jointly structurally balanced" corresponding to that type of clustering, where the number of clusters is at most the order of a cyclic group. It is also shown that the model will reach a consensus asymptotically at zero if the sequence of gain graphs is repeatedly jointly strongly connected and structurally unbalanced. In the special case when the cyclic group is of order two, the model simplifies to the so-called Altafini model whose gain graph is simply a signed graph.
△ Less
Submitted 23 February, 2018;
originally announced February 2018.
-
The Power Allocation Game on A Network: A Paradox
Authors:
Yuke Li,
A. Stephen Morse
Abstract:
The well-known Braess paradox in congestion games states that adding an additional road to a transportation network may increase the total travel time, and consequently decrease the overall efficiency. Motivated by this, this paper presents a paradox in a similar spirit emerging from another distributed resource allocation game on networks, namely the power allocation game between countries develo…
▽ More
The well-known Braess paradox in congestion games states that adding an additional road to a transportation network may increase the total travel time, and consequently decrease the overall efficiency. Motivated by this, this paper presents a paradox in a similar spirit emerging from another distributed resource allocation game on networks, namely the power allocation game between countries developed in \cite{allocation}. The paradox is that by having additional friends may actually decrease a country's total welfare in equilibrium. Conditions for this paradox to occur as well as some price of anarchy results are also derived.
△ Less
Submitted 10 February, 2018;
originally announced February 2018.
-
The Power Allocation Game on Dynamic Networks: Subgame Perfection
Authors:
Yuke Li,
A. Stephen Morse
Abstract:
In the game theory literature, there appears to be little research on equilibrium selection for normal-form games with an infinite strategy space and discontinuous utility functions. Moreover, many existing selection methods are not applicable to games involving both cooperative and noncooperative scenarios (e.g., "games on signed graphs"). With the purpose of equilibrium selection, the power allo…
▽ More
In the game theory literature, there appears to be little research on equilibrium selection for normal-form games with an infinite strategy space and discontinuous utility functions. Moreover, many existing selection methods are not applicable to games involving both cooperative and noncooperative scenarios (e.g., "games on signed graphs"). With the purpose of equilibrium selection, the power allocation game developed in \cite{allocation}, which is a static, resource allocation game on signed graphs, will be reformulated into an extensive form. Results about the subgame perfect Nash equilibria in the extensive-form game will be given. This appears to be the first time that subgame perfection based on time-varying graphs is used for equilibrium selection in network games. This idea of subgame perfection proposed in the paper may be extrapolated to other network games, which will be illustrated with a simple example of congestion games.
△ Less
Submitted 21 September, 2018; v1 submitted 2 February, 2018;
originally announced February 2018.
-
The Power Allocation Game on A Network: Balanced Equilibrium
Authors:
Yuke Li,
A. Stephen Morse
Abstract:
This paper studies a special kind of equilibrium termed as "balanced equilibrium" which arises in the power allocation game defined in \cite{allocation}. In equilibrium, each country in antagonism has to use all of its own power to counteract received threats, and the "threats" made to each adversary just balance out the threats received from that adversary. This paper establishes conditions on di…
▽ More
This paper studies a special kind of equilibrium termed as "balanced equilibrium" which arises in the power allocation game defined in \cite{allocation}. In equilibrium, each country in antagonism has to use all of its own power to counteract received threats, and the "threats" made to each adversary just balance out the threats received from that adversary. This paper establishes conditions on different types of networked international environments in order for this equilibrium to exist. The paper also links the existence of this type of equilibrium on structurally balanced graphs to the Hall's Maximum Matching problem and the Max Flow problem.
△ Less
Submitted 10 March, 2018; v1 submitted 6 January, 2018;
originally announced January 2018.
-
A Distributed, Dynamical System View of Finite, Static Games
Authors:
Yuke Li,
Fengjiao Liu,
A. Stephen Morse
Abstract:
This paper contains a reformulation of any $n$-player finite, static game into a framework of distributed, dynamical system based on agents' payoff-based deviations. The reformulation generalizes the method employed in the second part of the study of countries' relation formation problem in Li and Morse (2017) to the case of any finite, static game. In the paper two deviation rules are provided an…
▽ More
This paper contains a reformulation of any $n$-player finite, static game into a framework of distributed, dynamical system based on agents' payoff-based deviations. The reformulation generalizes the method employed in the second part of the study of countries' relation formation problem in Li and Morse (2017) to the case of any finite, static game. In the paper two deviation rules are provided and possible applications of this framework are discussed.
△ Less
Submitted 9 October, 2017;
originally announced October 2017.
-
Countries' Survival in Networked International Environments
Authors:
Yuke Li,
A. Stephen Morse,
Ji Liu,
Tamer Başar
Abstract:
This paper applies a recently developed power allocation game in Li and Morse (2017) to study the countries' survival problem in networked international environments. In the game, countries strategically allocate their power to support the survival of themselves and their friends and to oppose that of their foes, where by a country's survival is meant when the country's total support equals or exc…
▽ More
This paper applies a recently developed power allocation game in Li and Morse (2017) to study the countries' survival problem in networked international environments. In the game, countries strategically allocate their power to support the survival of themselves and their friends and to oppose that of their foes, where by a country's survival is meant when the country's total support equals or exceeds its total threats. This paper establishes conditions that characterize different types of networked international environments in which a country may survive, such as when all the antagonism among countries makes up a complete or bipartite graph.
△ Less
Submitted 9 October, 2017;
originally announced October 2017.
-
The Countries' Relation Formation Problem: I and II
Authors:
Yuke Li,
A. Stephen Morse
Abstract:
This paper integrates the studies of various countries' behaviors, e.g., waging wars and entering into military alliances, into a general framework of \emph{countries' relation formation}, which consists of two components, i.e., a static game and a dynamical system. Aside from being a stand-alone framework itself, this paper can also be seen as a necessary extension of a recently developed \emph{c…
▽ More
This paper integrates the studies of various countries' behaviors, e.g., waging wars and entering into military alliances, into a general framework of \emph{countries' relation formation}, which consists of two components, i.e., a static game and a dynamical system. Aside from being a stand-alone framework itself, this paper can also be seen as a necessary extension of a recently developed \emph{countries' power allocation game} in \cite{allocation}. We establish certain theoretical results, such as pure strategy Nash equilibrium existence in the static game, and propose several applications of interest made possible by combining both frameworks of countries' power allocation and relation formation.
△ Less
Submitted 6 August, 2017;
originally announced August 2017.
-
A Hybrid Observer for a Distributed Linear System with a Changing Neighbor Graph
Authors:
L. Wang,
A. S. Morse,
D. Fullmer,
J. Liu
Abstract:
A hybrid observer is described for estimating the state of an $m>0$ channel, $n$-dimensional, continuous-time, distributed linear system of the form $\dot{x} = Ax,\;y_i = C_ix,\;i\in\{1,2,\ldots, m\}$. The system's state $x$ is simultaneously estimated by $m$ agents assuming each agent $i$ senses $y_i$ and receives appropriately defined data from each of its current neighbors. Neighbor relations a…
▽ More
A hybrid observer is described for estimating the state of an $m>0$ channel, $n$-dimensional, continuous-time, distributed linear system of the form $\dot{x} = Ax,\;y_i = C_ix,\;i\in\{1,2,\ldots, m\}$. The system's state $x$ is simultaneously estimated by $m$ agents assuming each agent $i$ senses $y_i$ and receives appropriately defined data from each of its current neighbors. Neighbor relations are characterized by a time-varying directed graph $\mathbb{N}(t)$ whose vertices correspond to agents and whose arcs depict neighbor relations. Agent $i$ updates its estimate $x_i$ of $x$ at "event times" $t_1,t_2,\ldots $ using a local observer and a local parameter estimator. The local observer is a continuous time linear system whose input is $y_i$ and whose output $w_i$ is an asymptotically correct estimate of $L_ix$ where $L_i$ a matrix with kernel equaling the unobservable space of $(C_i,A)$. The local parameter estimator is a recursive algorithm designed to estimate, prior to each event time $t_j$, a constant parameter $p_j$ which satisfies the linear equations $w_k(t_j-τ) = L_kp_j+μ_k(t_j-τ),\;k\in\{1,2,\ldots,m\}$, where $τ$ is a small positive constant and $μ_k$ is the state estimation error of local observer $k$. Agent $i$ accomplishes this by iterating its parameter estimator state $z_i$, $q$ times within the interval $[t_j-τ, t_j)$, and by making use of the state of each of its neighbors' parameter estimators at each iteration. The updated value of $x_i$ at event time $t_j$ is then $x_i(t_j) = e^{Aτ}z_i(q)$. Subject to the assumptions that (i) the neighbor graph $\mathbb{N}(t)$ is strongly connected for all time, (ii) the system whose state is to be estimated is jointly observable, (iii) $q$ is sufficiently large, it is shown that each estimate $x_i$ converges to $x$ exponentially fast as $t\rightarrow \infty$ at a rate which can be controlled.
△ Less
Submitted 13 June, 2017;
originally announced June 2017.
-
A Distributed Algorithm for Computing a Common Fixed Point of a Finite Family of Paracontractions
Authors:
Daniel Fullmer,
A. Stephen Morse
Abstract:
A distributed algorithm is described for finding a common fixed point of a family of m>1 nonlinear maps M_i : R^n -> R^n assuming that each map is a paracontraction and that at least one such common fixed point exists. The common fixed point is simultaneously computed by m agents assuming each agent i knows only M_i, the current estimates of the fixed point generated by its neighbors, and nothing…
▽ More
A distributed algorithm is described for finding a common fixed point of a family of m>1 nonlinear maps M_i : R^n -> R^n assuming that each map is a paracontraction and that at least one such common fixed point exists. The common fixed point is simultaneously computed by m agents assuming each agent i knows only M_i, the current estimates of the fixed point generated by its neighbors, and nothing more. Each agent recursively updates its estimate of a fixed point by utilizing the current estimates generated by each of its neighbors. Neighbor relations are characterized by a time-varying directed graph N(t). It is shown under suitably general conditions on N(t), that the algorithm causes all agents estimates to converge to the same common fixed point of the m nonlinear maps.
△ Less
Submitted 15 March, 2017;
originally announced March 2017.
-
Request-Based Gossi** without Deadlocks
Authors:
Ji Liu,
Shaoshuai Mou,
A. Stephen Morse,
Brian D. O. Anderson,
Changbin Yu
Abstract:
By the distributed averaging problem is meant the problem of computing the average value of a set of numbers possessed by the agents in a distributed network using only communication between neighboring agents. Gossi** is a well-known approach to the problem which seeks to iteratively arrive at a solution by allowing each agent to interchange information with at most one neighbor at each iterati…
▽ More
By the distributed averaging problem is meant the problem of computing the average value of a set of numbers possessed by the agents in a distributed network using only communication between neighboring agents. Gossi** is a well-known approach to the problem which seeks to iteratively arrive at a solution by allowing each agent to interchange information with at most one neighbor at each iterative step. Crafting a gossi** protocol which accomplishes this is challenging because gossi** is an inherently collaborative process which can lead to deadlocks unless careful precautions are taken to ensure that it does not. Many gossi** protocols are request-based which means simply that a gossip between two agents will occur whenever one of the two agents accepts a request to gossip placed by the other. In this paper, we present three deterministic request-based protocols. We show by example that the first can deadlock. The second is guaranteed to avoid deadlocks and requires fewer transmissions per iteration than standard broadcast-based distributed averaging protocols by exploiting the idea of local ordering together with the notion of an agent's neighbor queue; the protocol requires the simplest queue updates, which provides an in-depth understanding of how local ordering and queue updates avoid deadlocks. It is shown that a third protocol which uses a slightly more complicated queue update rule can lead to significantly faster convergence; a worst case bound on convergence rate is provided.
△ Less
Submitted 26 December, 2016;
originally announced December 2016.
-
Game of Power Allocation on Networks
Authors:
Yuke Li,
A. S Morse
Abstract:
This paper develops a distributed resource allocation game to study countries' pursuit of targets such as self-survival in the networked international environment. The contributions are two. First, the game formalizes countries' power allocation behaviors which fall into the broad category of humans resource allocation behaviors. Second, the game presents a new technical problem, and establishes p…
▽ More
This paper develops a distributed resource allocation game to study countries' pursuit of targets such as self-survival in the networked international environment. The contributions are two. First, the game formalizes countries' power allocation behaviors which fall into the broad category of humans resource allocation behaviors. Second, the game presents a new technical problem, and establishes pure strategy Nash equilibrium existence.
△ Less
Submitted 24 February, 2017; v1 submitted 3 October, 2016;
originally announced October 2016.
-
A Distributed Algorithm for Computing a Common Fixed Point of a Family of Paracontractions
Authors:
Daniel Fullmer,
Lili Wang,
A. Stephen Morse
Abstract:
A distributed algorithm is described for finding a common fixed point of a family of $m>1$ nonlinear maps $M_i : \mathbb{R}^n \rightarrow \mathbb{R}^n$ assuming that each map is a paracontraction and that such a common fixed point exists. The common fixed point is simultaneously computed by $m$ agents assuming each agent $i$ knows only $M_i$, the current estimates of the fixed point generated by i…
▽ More
A distributed algorithm is described for finding a common fixed point of a family of $m>1$ nonlinear maps $M_i : \mathbb{R}^n \rightarrow \mathbb{R}^n$ assuming that each map is a paracontraction and that such a common fixed point exists. The common fixed point is simultaneously computed by $m$ agents assuming each agent $i$ knows only $M_i$, the current estimates of the fixed point generated by its neighbors, and nothing more. Each agent recursively updates its estimate of the fixed point by utilizing the current estimates generated by each of its neighbors. Neighbor relations are characterized by a time-dependent directed graph $\mathbb{N}(t)$ whose vertices correspond to agents and whose arcs depict neighbor relations. It is shown that for any family of paracontractions $M_i, i \in \{1,2,\ldots,m\}$ which has at least one common fixed point, and any sequence of strongly connected neighbor graphs $\mathbb{N}(t)$, $t=1,2,\ldots$, the algorithm causes all agent estimates to converge to a common fixed point.
△ Less
Submitted 25 May, 2016; v1 submitted 3 February, 2016;
originally announced February 2016.
-
Decentralized gradient algorithm for solution of a linear equation
Authors:
Brian D. O. Anderson,
Shaoshuai Mou,
A. Stephen Morse,
Uwe Helmke
Abstract:
The paper develops a technique for solving a linear equation $Ax=b$ with a square and nonsingular matrix $A$, using a decentralized gradient algorithm. In the language of control theory, there are $n$ agents, each storing at time $t$ an $n$-vector, call it $x_i(t)$, and a graphical structure associating with each agent a vertex of a fixed, undirected and connected but otherwise arbitrary graph…
▽ More
The paper develops a technique for solving a linear equation $Ax=b$ with a square and nonsingular matrix $A$, using a decentralized gradient algorithm. In the language of control theory, there are $n$ agents, each storing at time $t$ an $n$-vector, call it $x_i(t)$, and a graphical structure associating with each agent a vertex of a fixed, undirected and connected but otherwise arbitrary graph $\mathcal G$ with vertex set and edge set $\mathcal V$ and $\mathcal E$ respectively. We provide differential equation update laws for the $x_i$ with the property that each $x_i$ converges to the solution of the linear equation exponentially fast. The equation for $x_i$ includes additive terms weighting those $x_j$ for which vertices in $\mathcal G$ corresponding to the $i$-th and $j$-th agents are adjacent. The results are extended to the case where $A$ is not square but has full row rank, and bounds are given on the convergence rate.
△ Less
Submitted 15 September, 2015;
originally announced September 2015.
-
Undirected Rigid Formations are Problematic
Authors:
Shaoshuai Mou,
A. Stephen Morse,
Mohamed Ali Belabbas,
Zhiyong Sun,
Brian D. O. Anderson
Abstract:
By an undirected rigid formation of mobile autonomous agents is meant a formation based on graph rigidity in which each pair of "neighboring" agents is responsible for maintaining a prescribed target distance between them. In a recent paper a systematic method was proposed for devising gradient control laws for asymptotically stabilizing a large class of rigid, undirected formations in two dimensi…
▽ More
By an undirected rigid formation of mobile autonomous agents is meant a formation based on graph rigidity in which each pair of "neighboring" agents is responsible for maintaining a prescribed target distance between them. In a recent paper a systematic method was proposed for devising gradient control laws for asymptotically stabilizing a large class of rigid, undirected formations in two dimensional space assuming all agents are described by kinematic point models. The aim of this paper is to explain what happens to such formations if neighboring agents have slightly different understandings of what the desired distance between them is supposed to be or equivalently if neighboring agents have differing estimates of what the actual distance between them is. In either case, what one would expect would be a gradual distortion of the formation from its target shape as discrepancies in desired or sensed distances increase. While this is observed for the gradient laws in question, something else quite unexpected happens at the same time. It is shown that for any rigidity-based, undirected formation of this type which is comprised of three or more agents, that if some neighboring agents have slightly different understandings of what the desired distances between them are suppose to be, then almost for certain, the trajectory of the resulting distorted but rigid formation will converge exponentially fast to a closed circular orbit in two-dimensional space which is traversed periodically at a constant angular speed.
△ Less
Submitted 2 March, 2015;
originally announced March 2015.
-
A Distributed Algorithm for Solving a Linear Algebraic Equation
Authors:
Shaoshuai Mou,
Ji Liu,
A. Stephen Morse
Abstract:
A distributed algorithm is described for solving a linear algebraic equation of the form $Ax=b$ assuming the equation has at least one solution. The equation is simultaneously solved by $m$ agents assuming each agent knows only a subset of the rows of the partitioned matrix $(A,b)$, the current estimates of the equation's solution generated by its neighbors, and nothing more. Each agent recursivel…
▽ More
A distributed algorithm is described for solving a linear algebraic equation of the form $Ax=b$ assuming the equation has at least one solution. The equation is simultaneously solved by $m$ agents assuming each agent knows only a subset of the rows of the partitioned matrix $(A,b)$, the current estimates of the equation's solution generated by its neighbors, and nothing more. Each agent recursively updates its estimate by utilizing the current estimates generated by each of its neighbors. Neighbor relations are characterized by a time-dependent directed graph $\mathbb{N}(t)$ whose vertices correspond to agents and whose arcs depict neighbor relations. It is shown that for any matrix $A$ for which the equation has a solution and any sequence of "repeatedly jointly strongly connected graphs" $\mathbb{N}(t)$, $t=1,2,\ldots$, the algorithm causes all agents' estimates to converge exponentially fast to the same solution to $Ax=b$. It is also shown that the neighbor graph sequence must actually be repeatedly jointly strongly connected if exponential convergence is to be assured. A worst case convergence rate bound is derived for the case when $Ax=b$ has a unique solution. It is demonstrated that with minor modification, the algorithm can track the solution to $Ax = b$, even if $A$ and $b$ are changing with time, provided the rates of change of $A$ and $b$ are sufficiently small. It is also shown that in the absence of communication delays, exponential convergence to a solution occurs even if the times at which each agent updates its estimates are not synchronized with the update times of its neighbors. A modification of the algorithm is outlined which enables it to obtain a least squares solution to $Ax=b$ in a distributed manner, even if $Ax=b$ does not have a solution.
△ Less
Submitted 2 March, 2015;
originally announced March 2015.
