-
Gradient Dynamics in Linear Quadratic Network Games with Time-Varying Connectivity and Population Fluctuation
Authors:
Feras Al Taha,
Kiran Rokade,
Francesca Parise
Abstract:
In this paper, we consider a learning problem among non-cooperative agents interacting in a time-varying system. Specifically, we focus on repeated linear quadratic network games, in which the network of interactions changes with time and agents may not be present at each iteration. To get tractability, we assume that at each iteration, the network of interactions is sampled from an underlying ran…
▽ More
In this paper, we consider a learning problem among non-cooperative agents interacting in a time-varying system. Specifically, we focus on repeated linear quadratic network games, in which the network of interactions changes with time and agents may not be present at each iteration. To get tractability, we assume that at each iteration, the network of interactions is sampled from an underlying random network model and agents participate at random with a given probability. Under these assumptions, we consider a gradient-based learning algorithm and establish almost sure convergence of the agents' strategies to the Nash equilibrium of the game played over the expected network. Additionally, we prove, in the large population regime, that the learned strategy is an $ε$-Nash equilibrium for each stage game with high probability. We validate our results over an online market application.
△ Less
Submitted 20 October, 2023; v1 submitted 14 September, 2023;
originally announced September 2023.
-
Distributed Estimation over Directed Graphs Resilient to Sensor Spoofing
Authors:
Shamik Bhattacharyya,
Kiran Rokade,
Rachel Kalpana Kalaimani
Abstract:
This paper addresses the problem of distributed estimation of an unknown dynamic parameter by a multi-agent system over a directed communication network in the presence of an adversarial attack on the agents' sensors. The mode of attack of the adversaries is to corrupt the sensor measurements of some of the agents, while the communication and information processing capabilities of those agents rem…
▽ More
This paper addresses the problem of distributed estimation of an unknown dynamic parameter by a multi-agent system over a directed communication network in the presence of an adversarial attack on the agents' sensors. The mode of attack of the adversaries is to corrupt the sensor measurements of some of the agents, while the communication and information processing capabilities of those agents remain unaffected. To ensure that all the agents, both normal as well as those under attack, are able to correctly estimate the parameter value, the Resilient Estimation through Weight Balancing (REWB) algorithm is introduced. The only condition required for the REWB algorithm to guarantee resilient estimation is that at any given point in time, less than half of the total number of agents are under attack. The paper discusses the development of the REWB algorithm using the concepts of weight balancing of directed graphs, and the consensus+innovations approach for linear estimation. Numerical simulations are presented to illustrate the performance of our algorithm over directed graphs under different conditions of adversarial attacks.
△ Less
Submitted 9 January, 2023; v1 submitted 10 April, 2021;
originally announced April 2021.
-
Distributed ADMM with linear updates over directed networks
Authors:
Kiran Rokade,
Rachel Kalpana Kalaimani
Abstract:
We propose a distributed version of the Alternating Direction Method of Multipliers (ADMM) with linear updates for directed networks. We show that if the objective function of the minimization problem is smooth and strongly convex, our distributed ADMM algorithm achieves a geometric rate of convergence to the optimal point. Our algorithm exploits the robustness inherent to ADMM by not enforcing ac…
▽ More
We propose a distributed version of the Alternating Direction Method of Multipliers (ADMM) with linear updates for directed networks. We show that if the objective function of the minimization problem is smooth and strongly convex, our distributed ADMM algorithm achieves a geometric rate of convergence to the optimal point. Our algorithm exploits the robustness inherent to ADMM by not enforcing accurate consensus, thereby significantly improving the convergence rate. We illustrate this by numerical examples, where we compare the performance of our algorithm with that of state-of-the-art ADMM methods over directed graphs.
△ Less
Submitted 19 September, 2023; v1 submitted 20 October, 2020;
originally announced October 2020.
-
Distributed computation of fast consensus weights using ADMM
Authors:
Kiran Rokade,
Rachel Kalpana Kalaimani
Abstract:
We consider the problem of achieving average consensus among multiple agents, where the inter-agent communication network is depicted by a graph. We consider the discrete-time consensus protocol where each agent updates its value as a weighted average of its own value and those of its neighbours. Given a graph, it is known that there exists a set of 'optimal weights' such that the agents reach ave…
▽ More
We consider the problem of achieving average consensus among multiple agents, where the inter-agent communication network is depicted by a graph. We consider the discrete-time consensus protocol where each agent updates its value as a weighted average of its own value and those of its neighbours. Given a graph, it is known that there exists a set of 'optimal weights' such that the agents reach average consensus asymptotically with an optimal rate of convergence. However, existing methods require the knowledge of the entire graph to compute these optimal weights. We propose a method for each agent to compute its set of optimal weights locally, i.e., each agent only has to know who are its neighbours. The method is derived by solving a matrix norm minimization problem subject to linear constraints in a distributed manner using the Alternating Direction Method of Multipliers (ADMM). We illustrate our results using numerical examples and compare our method with an existing method called the Metropolis weights, which are also computed locally.
△ Less
Submitted 28 November, 2021; v1 submitted 19 February, 2020;
originally announced February 2020.
