Showing 1–49 of 49 results for author: Grammatico, S

Estimation Network Design framework for efficient distributed optimization

Authors: Mattia Bianchi, Sergio Grammatico

Abstract: Distributed decision problems features a group of agents that can only communicate over a peer-to-peer network, without a central memory. In applications such as network control and data ranking, each agent is only affected by a small portion of the decision vector: this sparsity is typically ignored in distributed algorithms, while it could be leveraged to improve efficiency and scalability. To a… ▽ More Distributed decision problems features a group of agents that can only communicate over a peer-to-peer network, without a central memory. In applications such as network control and data ranking, each agent is only affected by a small portion of the decision vector: this sparsity is typically ignored in distributed algorithms, while it could be leveraged to improve efficiency and scalability. To address this issue, our recent paper introduces Estimation Network Design (END), a graph theoretical language for the analysis and design of distributed iterations. END algorithms can be tuned to exploit the sparsity of specific problem instances, reducing communication overhead and minimizing redundancy, yet without requiring case-by-case convergence analysis. In this paper, we showcase the flexility of END in the context of distributed optimization. In particular, we study the sparsity-aware version of many established methods, including ADMM, AugDGM and Push-Sum DGD. Simulations on an estimation problem in sensor networks demonstrate that END algorithms can boost convergence speed and greatly reduce the communication and memory cost. △ Less

Submitted 23 April, 2024; originally announced April 2024.

Comments: 8 pages, 4 figures. arXiv admin note: substantial text overlap with arXiv:2208.11377

An Efficient Risk-aware Branch MPC for Automated Driving that is Robust to Uncertain Vehicle Behaviors

Authors: Luyao Zhang, George Pantazis, Shaohang Han, Sergio Grammatico

Abstract: One of the critical challenges in automated driving is ensuring safety of automated vehicles despite the unknown behavior of the other vehicles. Although motion prediction modules are able to generate a probability distribution associated with various behavior modes, their probabilistic estimates are often inaccurate, thus leading to a possibly unsafe trajectory. To overcome this challenge, we pro… ▽ More One of the critical challenges in automated driving is ensuring safety of automated vehicles despite the unknown behavior of the other vehicles. Although motion prediction modules are able to generate a probability distribution associated with various behavior modes, their probabilistic estimates are often inaccurate, thus leading to a possibly unsafe trajectory. To overcome this challenge, we propose a risk-aware motion planning framework that appropriately accounts for the ambiguity in the estimated probability distribution. We formulate the risk-aware motion planning problem as a min-max optimization problem and develop an efficient iterative method by incorporating a regularization term in the probability update step. Via extensive numerical studies, we validate the convergence of our method and demonstrate its advantages compared to the state-of-the-art approaches. △ Less

Submitted 27 March, 2024; originally announced March 2024.

Probably approximately correct stability of allocations in uncertain coalitional games with private sampling

Authors: George Pantazis, Filiberto Fele, Filippo Fabiani, Sergio Grammatico, Kostas Margellos

Abstract: We study coalitional games with exogenous uncertainty in the coalition value, in which each agent is allowed to have private samples of the uncertainty. As a consequence, the agents may have a different perception of stability of the grand coalition. In this context, we propose a novel methodology to study the out-of-sample coalitional rationality of allocations in the set of stable allocations (i… ▽ More We study coalitional games with exogenous uncertainty in the coalition value, in which each agent is allowed to have private samples of the uncertainty. As a consequence, the agents may have a different perception of stability of the grand coalition. In this context, we propose a novel methodology to study the out-of-sample coalitional rationality of allocations in the set of stable allocations (i.e., the core). Our analysis builds on the framework of probably approximately correct learning. Initially, we state a priori and a posteriori guarantees for the entire core. Furthermore, we provide a distributed algorithm to compute a compression set that determines the generalization properties of the a posteriori statements. We then refine our probabilistic robustness bounds by specialising the analysis to a single payoff allocation, taking, also in this case, both a priori and a posteriori approaches. Finally, we consider a relaxed $ζ$-core to include nearby allocations and also address the case of empty core. For this case, probabilistic statements are given on the eventual stability of allocations in the $ζ$-core. △ Less

Submitted 13 December, 2023; originally announced December 2023.

Automated Lane Merging via Game Theory and Branch Model Predictive Control

Authors: Luyao Zhang, Shaohang Han, Sergio Grammatico

Abstract: We propose an integrated behavior and motion planning framework for the automated lane-merging problem. The behavior planner combines search-based planning with game theory to model the interaction between vehicles and select multi-vehicle trajectories. Inspired by human drivers, we model the lane-merging problem as a gap selection process. To overcome the challenge of multi-modal driving behavior… ▽ More We propose an integrated behavior and motion planning framework for the automated lane-merging problem. The behavior planner combines search-based planning with game theory to model the interaction between vehicles and select multi-vehicle trajectories. Inspired by human drivers, we model the lane-merging problem as a gap selection process. To overcome the challenge of multi-modal driving behavior exhibited by the surrounding vehicles, we formulate the trajectory selection as a matrix game and compute some equilibrium solutions. In practice, however, the surrounding vehicles might deviate from the computed equilibrium trajectories. Thus, we introduce a branch model predictive control (BMPC) framework to account for the uncertain behavior modes of the surrounding vehicles. A tailored numerical solver is developed to enhance computational efficiency by leveraging the tree structure inherent in BMPC. Finally, we validate our proposed integrated planner using real traffic data and demonstrate its effectiveness in handling interactions in dense traffic scenarios. △ Less

Submitted 8 March, 2024; v1 submitted 24 November, 2023; originally announced November 2023.

Linear convergence in time-varying generalized Nash equilibrium problems

Authors: Mattia Bianchi, Emilio Benenati, Sergio Grammatico

Abstract: We study generalized games with full row rank equality constraints and we provide a strikingly simple proof of strong monotonicity of the associated KKT operator. This allows us to show linear convergence to a variational equilibrium of the resulting primal-dual pseudo-gradient dynamics. Then, we propose a fully-distributed algorithm with linear convergence guarantee for aggregative games under pa… ▽ More We study generalized games with full row rank equality constraints and we provide a strikingly simple proof of strong monotonicity of the associated KKT operator. This allows us to show linear convergence to a variational equilibrium of the resulting primal-dual pseudo-gradient dynamics. Then, we propose a fully-distributed algorithm with linear convergence guarantee for aggregative games under partial-decision information. Based on these results, we establish stability properties for online GNE seeking in games with time-varying cost functions and constraints. Finally, we illustrate our findings numerically on an economic dispatch problem for peer-to-peer energy markets. △ Less

Submitted 19 April, 2023; originally announced April 2023.

Online coalitional games for real-time payoff distribution with applications to energy markets

Authors: Aitazaz Ali Raja, Sergio Grammatico

Abstract: Motivated by the markets operating on fast time scales, we present a framework for online coalitional games with time-varying coalitional values and propose real-time payoff distribution mechanisms. Specifically, we design two online distributed algorithms to track the Shapley value and the core, the two most widely studied payoff distribution criteria in coalitional game theory. We show that the… ▽ More Motivated by the markets operating on fast time scales, we present a framework for online coalitional games with time-varying coalitional values and propose real-time payoff distribution mechanisms. Specifically, we design two online distributed algorithms to track the Shapley value and the core, the two most widely studied payoff distribution criteria in coalitional game theory. We show that the payoff distribution trajectory resulting from our proposed algorithms converges to a neighborhood of the time-varying solutions. We adopt an operator-theoretic perspective to show the convergence of our algorithms. Numerical simulations of a real-time local electricity market and cooperative energy forecasting market illustrate the performance of our algorithms: {the difference between online payoffs and static payoffs (Shapley and the core) to the participants is little; online algorithms considerably improve the scalability of the mechanism with respect to the number of market participants. △ Less

Submitted 28 January, 2023; originally announced January 2023.

Bilateral Peer-to-Peer Energy Trading via Coalitional Games

Authors: Aitazaz Ali Raja, Sergio Grammatico

Abstract: In this paper, we propose a bilateral peer-to-peer (P2P) energy trading scheme under single-contract and multi-contract market setups, both as an assignment game, and a special class of coalitional games. {The proposed market formulation allows for efficient computation of a market equilibrium while kee** the desired economic properties offered by the coalitional games. Furthermore, our market m… ▽ More In this paper, we propose a bilateral peer-to-peer (P2P) energy trading scheme under single-contract and multi-contract market setups, both as an assignment game, and a special class of coalitional games. {The proposed market formulation allows for efficient computation of a market equilibrium while kee** the desired economic properties offered by the coalitional games. Furthermore, our market model allows buyers to have heterogeneous preferences (product differentiation) over the energy sellers, which can be economic, social, or environmental. To address the problem of scalability in coalitional games, we design a novel distributed negotiation mechanism that utilizes the geometric structure of the equilibrium solution to improve the convergence speed. Our algorithm enables market participants (prosumers) to reach a consensus on a set of ``stable" and ``fair" bilateral contracts which encourages prosumer participation.} The negotiation process is executed with virtually minimal information requirements on a time-varying communication network that in turn preserves privacy. We use operator-theoretic tools to rigorously prove its convergence. Numerical simulations illustrate the benefits of our negotiation protocol and show that the average execution time of a negotiation step is much faster than the benchmark. △ Less

Submitted 28 January, 2023; originally announced January 2023.

The END: Estimation Network Design for games under partial-decision information

Authors: Mattia Bianchi, Sergio Grammatico

Abstract: Multi-agent decision problems are typically solved via distributed iterative algorithms, where the agents only communicate between themselves on a peer-to-peer network. Each agent usually maintains a copy of each decision variable, while agreement among the local copies is enforced via consensus protocols. Yet, each agent is often directly influenced by a small portion of the decision variables on… ▽ More Multi-agent decision problems are typically solved via distributed iterative algorithms, where the agents only communicate between themselves on a peer-to-peer network. Each agent usually maintains a copy of each decision variable, while agreement among the local copies is enforced via consensus protocols. Yet, each agent is often directly influenced by a small portion of the decision variables only: neglecting this sparsity results in redundancy, poor scalability with the network size, communication and memory overhead. To address these challenges, we develop Estimation Network Design (END), a framework for the design and analysis of distributed algorithms, generalizing several recent approaches. END algorithms can be tuned to exploit problem-specific sparsity structures, by optimally allocating copies of each variable only to a subset of agents, to improve efficiency and minimize redundancy. We illustrate the END's potential by designing new algorithms for generalised Nash equilibrium (GNE) seeking under partial-decision information, that can leverage the sparsity in cost functions, constraints and aggregation values. Finally, we test numerically our methods on a unicast rate allocation problem, revealing greatly reduced communication and memory costs. △ Less

Submitted 29 November, 2023; v1 submitted 24 August, 2022; originally announced August 2022.

Comments: 12 pages, 3 figures

Nash equilibrium seeking under partial decision information: Monotonicity, smoothness and proximal-point algorithms

Authors: Mattia Bianchi, Sergio Grammatico

Abstract: We address Nash equilibrium problems in a partial-decision information scenario, where each agent can only exchange information with some neighbors, while its cost function possibly depends on the strategies of all agents. We characterize the relation between several monotonicity and smoothness conditions postulated in the literature. Furthermore, we prove convergence of a preconditioned proximal… ▽ More We address Nash equilibrium problems in a partial-decision information scenario, where each agent can only exchange information with some neighbors, while its cost function possibly depends on the strategies of all agents. We characterize the relation between several monotonicity and smoothness conditions postulated in the literature. Furthermore, we prove convergence of a preconditioned proximal point algorithm, under a restricted monotonicity property that allows for a non-Lipschitz, non-continuous game map**. △ Less

Submitted 23 June, 2022; originally announced June 2022.

Game-theoretical trajectory planning enhances social acceptability for humans

Authors: Giada Galati, Stefano Primatesta, Sergio Grammatico, Simone Macrì, Alessandro Rizzo

Abstract: Since humans and robots are increasingly sharing portions of their operational spaces, experimental evidence is needed to ascertain the safety and social acceptability of robots in human-populated environments. Although several studies have aimed at devising strategies for robot trajectory planning to perform \emph{safe} motion in populated environments, a few efforts have \emph{measured} to what… ▽ More Since humans and robots are increasingly sharing portions of their operational spaces, experimental evidence is needed to ascertain the safety and social acceptability of robots in human-populated environments. Although several studies have aimed at devising strategies for robot trajectory planning to perform \emph{safe} motion in populated environments, a few efforts have \emph{measured} to what extent a robot trajectory is \emph{accepted} by humans. Here, we present a navigation system for autonomous robotics that ensures safety and social acceptability of robotic trajectories. We overcome the typical reactive nature of state-of-the-art trajectory planners by leveraging non-cooperative game theory to design a planner that encapsulates human-like features of preservation of a vital space, recognition of groups, sequential and strategized decision making, and smooth obstacle avoidance. Social acceptability is measured through a variation of the Turing test administered in the form of a survey questionnaire to a pool of 691 participants. Comparison terms for our tests are a state-of-the-art navigation algorithm (Enhanced Vector Field Histogram, VFH) and purely human trajectories. While all participants easily recognized the non-human nature of VFH-generated trajectories, the distinction between game-theoretical trajectories and human ones were hardly revealed. These results mark a strong milestone toward the full integration of robots in social environments. △ Less

Submitted 29 March, 2022; originally announced March 2022.

Convergence of sequences: a survey

Authors: Barbara Franci, Sergio Grammatico

Abstract: Convergent sequences of real numbers play a fundamental role in many different problems in system theory, e.g., in Lyapunov stability analysis, as well as in optimization theory and computational game theory. In this survey, we provide an overview of the literature on convergence theorems and their connection with Fejer monotonicity in the deterministic and stochastic settings, and we show how to… ▽ More Convergent sequences of real numbers play a fundamental role in many different problems in system theory, e.g., in Lyapunov stability analysis, as well as in optimization theory and computational game theory. In this survey, we provide an overview of the literature on convergence theorems and their connection with Fejer monotonicity in the deterministic and stochastic settings, and we show how to exploit these results. △ Less

Submitted 22 November, 2021; originally announced November 2021.

Operationally-Safe Peer-to-Peer Energy Trading in Distribution Grids: A Game-Theoretic Market-Clearing Mechanism

Authors: Giuseppe Belgioioso, Wicak Ananduta, Sergio Grammatico, Carlos Ocampo-Martinez

Abstract: In future distribution grids, prosumers (i.e., energy consumers with storage and/or production capabilities) will trade energy with each other and with the main grid. To ensure an efficient and safe operation of energy trading, in this paper, we formulate a peer-to-peer energy market of prosumers as a generalized aggregative game, in which a network operator is only responsible for the operational… ▽ More In future distribution grids, prosumers (i.e., energy consumers with storage and/or production capabilities) will trade energy with each other and with the main grid. To ensure an efficient and safe operation of energy trading, in this paper, we formulate a peer-to-peer energy market of prosumers as a generalized aggregative game, in which a network operator is only responsible for the operational constraints of the system. We design a distributed market-clearing mechanism with convergence guarantee to an economically-efficient and operationally-safe configuration (i.e., a variational generalized Nash equilibrium). Numerical studies on the IEEE 37-bus testcase show the scalability of the proposed approach and suggest that active participation in the market is beneficial for both prosumers and the network operator. △ Less

Submitted 25 March, 2022; v1 submitted 28 July, 2021; originally announced July 2021.

Comments: 11 pages, 8 figures. Published in IEEE Transactions on Smart Grid, 2022

Bregman algorithms for mixed-strategy generalized Nash equilibrium seeking in a class of mixed-integer games

Authors: Wicak Ananduta, Sergio Grammatico

Abstract: We consider the problem of computing a mixed-strategy generalized Nash equilibrium (MS-GNE) for a class of games where each agent has both continuous and integer decision variables. Specifically, we propose a novel Bregman forward-reflected-backward splitting and design distributed algorithms that exploit the problem structure. Technically, we prove convergence to a variational MS-GNE under mere m… ▽ More We consider the problem of computing a mixed-strategy generalized Nash equilibrium (MS-GNE) for a class of games where each agent has both continuous and integer decision variables. Specifically, we propose a novel Bregman forward-reflected-backward splitting and design distributed algorithms that exploit the problem structure. Technically, we prove convergence to a variational MS-GNE under mere monotonicity and Lipschitz continuity assumptions, which are typical of continuous GNE problems. Finally, we show the performance of our algorithms via numerical experiments. △ Less

Submitted 13 June, 2022; v1 submitted 12 May, 2021; originally announced May 2021.

MSC Class: 47N10; 65K10

The distributed dual ascent algorithm is robust to asynchrony

Authors: Mattia Bianchi, Wicak Ananduta, Sergio Grammatico

Abstract: The distributed dual ascent is an established algorithm to solve strongly convex multi-agent optimization problems with separable cost functions, in the presence of coupling constraints. In this paper, we study its asynchronous counterpart. Specifically, we assume that each agent only relies on the outdated information received from some neighbors. Differently from the existing randomized and dual… ▽ More The distributed dual ascent is an established algorithm to solve strongly convex multi-agent optimization problems with separable cost functions, in the presence of coupling constraints. In this paper, we study its asynchronous counterpart. Specifically, we assume that each agent only relies on the outdated information received from some neighbors. Differently from the existing randomized and dual block-coordinate schemes, we show convergence under heterogeneous delays, communication and update frequencies. Consequently, our asynchronous dual ascent algorithm can be implemented without requiring any coordination between the agents. △ Less

Submitted 4 May, 2021; originally announced May 2021.

A relaxed-inertial forward-backward-forward algorithm for Stochastic Generalized Nash equilibrium seeking

Authors: Shisheng Cui, Barbara Franci, Sergio Grammatico, Uday V. Shanbhag, Mathias Staudigl

Abstract: In this paper we propose a new operator splitting algorithm for distributed Nash equilibrium seeking under stochastic uncertainty, featuring relaxation and inertial effects. Our work is inspired by recent deterministic operator splitting methods, designed for solving structured monotone inclusion problems. The algorithm is derived from a forward-backward-forward scheme for solving structured monot… ▽ More In this paper we propose a new operator splitting algorithm for distributed Nash equilibrium seeking under stochastic uncertainty, featuring relaxation and inertial effects. Our work is inspired by recent deterministic operator splitting methods, designed for solving structured monotone inclusion problems. The algorithm is derived from a forward-backward-forward scheme for solving structured monotone inclusion problems featuring a Lipschitz continuous and monotone game operator. To the best of our knowledge, this is the first distributed (generalized) Nash equilibrium seeking algorithm featuring acceleration techniques in stochastic Nash games without assuming cocoercivity. Numerical examples illustrate the effect of inertia and relaxation on the performance of our proposed algorithm. △ Less

Submitted 24 March, 2021; originally announced March 2021.

Highway Traffic Control via Smart e-Mobility -- Part II: Dutch A13 Case Study

Authors: Carlo Cenedese, Michele Cucuzzella, Jacquelien M. A. Scherpen, Sergio Grammatico, Ming Cao

Abstract: In this paper, we study how to alleviate highway traffic congestions by encouraging plug-in electric and hybrid vehicles to stop at charging stations around peak congestion times. Specifically, we focus on a case study and simulate the adoption of a dynamic charging price depending on the traffic congestion. We use real traffic data of the A13 highway stretch between The Hague and Rotterdam, in Th… ▽ More In this paper, we study how to alleviate highway traffic congestions by encouraging plug-in electric and hybrid vehicles to stop at charging stations around peak congestion times. Specifically, we focus on a case study and simulate the adoption of a dynamic charging price depending on the traffic congestion. We use real traffic data of the A13 highway stretch between The Hague and Rotterdam, in The Netherlands, to identify the Cell Transmission Model. Then, we apply the algorithm proposed in (Part I: Theory) to different scenarios, validating the theoretical results and showing the benefits of our strategy in terms of traffic congestion alleviation. Finally, we carry out a sensitivity analysis of the proposed algorithm and discuss how to optimize its performance. △ Less

Submitted 23 February, 2021; v1 submitted 18 February, 2021; originally announced February 2021.

Comments: 10 pages, 14 figures, 3 tables

Highway Traffic Control via Smart e-Mobility -- Part I: Theory

Authors: Carlo Cenedese, Michele Cucuzzella, Jacquelien M. A. Scherpen, Sergio Grammatico, Ming Cao

Abstract: In this paper, we study how to alleviate highway traffic congestion by encouraging plug-in hybrid and electric vehicles to stop at a charging station around peak congestion times. Specifically, we design a pricing policy to make the charging price dynamic and dependent on the traffic congestion, predicted via the cell transmission model, and the availability of charging spots. Furthermore, we deve… ▽ More In this paper, we study how to alleviate highway traffic congestion by encouraging plug-in hybrid and electric vehicles to stop at a charging station around peak congestion times. Specifically, we design a pricing policy to make the charging price dynamic and dependent on the traffic congestion, predicted via the cell transmission model, and the availability of charging spots. Furthermore, we develop a novel framework to model how this policy affects the drivers' decisions by formulating a mixed-integer potential game. Technically, we introduce the concept of "road-to-station" (r2s) and "station-to-road" (s2r) flows, and show that the selfish actions of the drivers converge to charging schedules that are individually optimal in the sense of Nash. In the second part of this work, submitted as a separate paper (Part II: Case Study), we validate the proposed strategy on a simulated highway stretch between The Hague and Rotterdam, in The Netherlands. △ Less

Submitted 23 February, 2021; v1 submitted 18 February, 2021; originally announced February 2021.

Comments: 10 pages, 2 figures

Stochastic generalized Nash equilibrium seeking under partial-decision information

Authors: Barbara Franci, Sergio Grammatico

Abstract: We consider for the first time a stochastic generalized Nash equilibrium problem, i.e., with expected-value cost functions and joint feasibility constraints, under partial-decision information, meaning that the agents communicate only with some trusted neighbours. We propose several distributed algorithms for network games and aggregative games that we show being special instances of a preconditio… ▽ More We consider for the first time a stochastic generalized Nash equilibrium problem, i.e., with expected-value cost functions and joint feasibility constraints, under partial-decision information, meaning that the agents communicate only with some trusted neighbours. We propose several distributed algorithms for network games and aggregative games that we show being special instances of a preconditioned forward-backward splitting method. We prove that the algorithms converge to a generalized Nash equilibrium when the forward operator is restricted cocoercive by using the stochastic approximation scheme with variance reduction to estimate the expected value of the pseudogradient. △ Less

Submitted 31 May, 2021; v1 submitted 10 November, 2020; originally announced November 2020.

Training Generative Adversarial Networks via stochastic Nash games

Authors: Barbara Franci, Sergio Grammatico

Abstract: Generative adversarial networks (GANs) are a class of generative models with two antagonistic neural networks: a generator and a discriminator. These two neural networks compete against each other through an adversarial process that can be modeled as a stochastic Nash equilibrium problem. Since the associated training process is challenging, it is fundamental to design reliable algorithms to compu… ▽ More Generative adversarial networks (GANs) are a class of generative models with two antagonistic neural networks: a generator and a discriminator. These two neural networks compete against each other through an adversarial process that can be modeled as a stochastic Nash equilibrium problem. Since the associated training process is challenging, it is fundamental to design reliable algorithms to compute an equilibrium. In this paper, we propose a stochastic relaxed forward-backward (SRFB) algorithm for GANs and we show convergence to an exact solution when an increasing number of data is available. We also show convergence of an averaged variant of the SRFB algorithm to a neighborhood of the solution when only few samples are available. In both cases, convergence is guaranteed when the pseudogradient map** of the game is monotone. This assumption is among the weakest known in the literature. Moreover, we apply our algorithm to the image generation problem. △ Less

Submitted 21 May, 2021; v1 submitted 17 October, 2020; originally announced October 2020.

Comments: arXiv admin note: text overlap with arXiv:2003.13637

Nash equilibrium seeking under partial-decision information over directed communication networks

Authors: Mattia Bianchi, Sergio Grammatico

Abstract: We consider the Nash equilibrium problem in a partial-decision information scenario. Specifically, each agent can only receive information from some neighbors via a communication network, while its cost function depends on the strategies of possibly all agents. In particular, while the existing methods assume undirected or balanced communication, in this paper we allow for non-balanced, directed g… ▽ More We consider the Nash equilibrium problem in a partial-decision information scenario. Specifically, each agent can only receive information from some neighbors via a communication network, while its cost function depends on the strategies of possibly all agents. In particular, while the existing methods assume undirected or balanced communication, in this paper we allow for non-balanced, directed graphs. We propose a fully-distributed pseudo-gradient scheme, which is guaranteed to converge with linear rate to a Nash equilibrium, under strong monotonicity and Lipschitz continuity of the game map**. Our algorithm requires global knowledge of the communication structure, namely of the Perron-Frobenius eigenvector of the adjacency matrix and of a certain constant related to the graph connectivity. Therefore, we adapt the procedure to setups where the network is not known in advance, by computing the eigenvector online and by means of vanishing step sizes. △ Less

Submitted 10 September, 2020; originally announced September 2020.

Comments: To appear in the 59th Conference on Decision and Control (CDC 2020)

Local Stackelberg equilibrium seeking in generalized aggregative games

Authors: Filippo Fabiani, Mohammad Amin Tajeddini, Hamed Kebriaei, Sergio Grammatico

Abstract: We propose a two-layer, semi-decentralized algorithm to compute a local solution to the Stackelberg equilibrium problem in aggregative games with coupling constraints. Specifically, we focus on a single-leader, multiple-follower problem, and after equivalently recasting the Stackelberg game as a mathematical program with complementarity constraints (MPCC), we iteratively convexify a regularized ve… ▽ More We propose a two-layer, semi-decentralized algorithm to compute a local solution to the Stackelberg equilibrium problem in aggregative games with coupling constraints. Specifically, we focus on a single-leader, multiple-follower problem, and after equivalently recasting the Stackelberg game as a mathematical program with complementarity constraints (MPCC), we iteratively convexify a regularized version of the MPCC as inner problem, whose solution generates a sequence of feasible descent directions for the original MPCC. Thus, by pursuing a descent direction at every outer iteration, we establish convergence to a local Stackelberg equilibrium. Finally, the proposed algorithm is tested on a numerical case study involving a hierarchical instance of the charging coordination of Plug-in Electric Vehicles (PEVs). △ Less

Submitted 6 June, 2020; originally announced June 2020.

An asynchronous distributed and scalable generalized Nash equilibrium seeking algorithm for strongly monotone games

Authors: Carlo Cenedese, Giuseppe Belgioioso, Sergio Grammatico, Ming Cao

Abstract: In this paper, we present three distributed algorithms to solve a class of generalized Nash equilibrium (GNE) seeking problems in strongly monotone games. The first one (SD-GENO) is based on synchronous updates of the agents, while the second and the third (AD-GEED and AD-GENO) represent asynchronous solutions that are robust to communication delays. AD-GENO can be seen as a refinement of AD-GEED,… ▽ More In this paper, we present three distributed algorithms to solve a class of generalized Nash equilibrium (GNE) seeking problems in strongly monotone games. The first one (SD-GENO) is based on synchronous updates of the agents, while the second and the third (AD-GEED and AD-GENO) represent asynchronous solutions that are robust to communication delays. AD-GENO can be seen as a refinement of AD-GEED, since it only requires node auxiliary variables, enhancing the scalability of the algorithm. Our main contribution is to prove converge to a variational GNE of the game via an operator-theoretic approach. Finally, we apply the algorithms to network Cournot games and show how different activation sequences and delays affect convergence. We also compare the proposed algorithms to the only other in the literature (ADAGNES), and observe that AD-GENO outperforms the alternative. △ Less

Submitted 6 May, 2020; originally announced May 2020.

Comments: Submitted to the European Journal of Control (EJC). arXiv admin note: text overlap with arXiv:1901.04279

A game-theoretic approach for Generative Adversarial Networks

Authors: Barbara Franci, Sergio Grammatico

Abstract: Generative adversarial networks (GANs) are a class of generative models, known for producing accurate samples. The key feature of GANs is that there are two antagonistic neural networks: the generator and the discriminator. The main bottleneck for their implementation is that the neural networks are very hard to train. One way to improve their performance is to design reliable algorithms for the a… ▽ More Generative adversarial networks (GANs) are a class of generative models, known for producing accurate samples. The key feature of GANs is that there are two antagonistic neural networks: the generator and the discriminator. The main bottleneck for their implementation is that the neural networks are very hard to train. One way to improve their performance is to design reliable algorithms for the adversarial process. Since the training can be cast as a stochastic Nash equilibrium problem, we rewrite it as a variational inequality and introduce an algorithm to compute an approximate solution. Specifically, we propose a stochastic relaxed forward-backward algorithm for GANs. We prove that when the pseudogradient map** of the game is monotone, we have convergence to an exact solution or in a neighbourhood of it. △ Less

Submitted 14 September, 2020; v1 submitted 30 March, 2020; originally announced March 2020.

Fully distributed Nash equilibrium seeking over time-varying communication networks with linear convergence rate

Authors: Mattia Bianchi, Sergio Grammatico

Abstract: We design a distributed algorithm for learning Nash equilibria over time-varying communication networks in a partial-decision information scenario, where each agent can access its own cost function and local feasible set, but can only observe the actions of some neighbors. Our algorithm is based on projected pseudo-gradient dynamics, augmented with consensual terms. Under strong monotonicity and L… ▽ More We design a distributed algorithm for learning Nash equilibria over time-varying communication networks in a partial-decision information scenario, where each agent can access its own cost function and local feasible set, but can only observe the actions of some neighbors. Our algorithm is based on projected pseudo-gradient dynamics, augmented with consensual terms. Under strong monotonicity and Lipschitz continuity of the game map**, we provide a very simple proof of linear convergence, based on a contractivity property of the iterates. Compared to similar solutions proposed in literature, we also allow for a time-varying communication and derive tighter bounds on the step sizes that ensure convergence. In fact, in our numerical simulations, our algorithm outperforms the existing gradient-based methods, when the step sizes are set to their theoretical upper bounds. Finally, to relax the assumptions on the network structure, we propose a different pseudo-gradient algorithm, which is guaranteed to converge on time-varying balanced directed graphs. △ Less

Submitted 10 September, 2020; v1 submitted 22 March, 2020; originally announced March 2020.

Journal ref: IEEE Control Systems Letters, Volume: 5, Issue: 2, April 2021

Distributed projected-reflected-gradient algorithms for stochastic generalized Nash equilibrium problems

Authors: Barbara Franci, Sergio Grammatico

Abstract: We consider the stochastic generalized Nash equilibrium problem (SGNEP) with joint feasibility constraints and expected-value cost functions. We propose a distributed stochastic projected reflected gradient algorithm and show its almost sure convergence when the pseudogradient map** is monotone and the solution is unique. The algorithm is based on monotone operator splitting methods tailored for… ▽ More We consider the stochastic generalized Nash equilibrium problem (SGNEP) with joint feasibility constraints and expected-value cost functions. We propose a distributed stochastic projected reflected gradient algorithm and show its almost sure convergence when the pseudogradient map** is monotone and the solution is unique. The algorithm is based on monotone operator splitting methods tailored for SGNEPs when the expected-value pseudogradient map** is approximated at each iteration via an increasing number of samples of the random variable. Finally, we show that a preconditioned variant of our proposed algorithm has convergence guarantees when the pseudogradient map** is cocoercive. △ Less

Submitted 19 March, 2021; v1 submitted 20 March, 2020; originally announced March 2020.

Comments: arXiv admin note: text overlap with arXiv:1910.11776

Fast generalized Nash equilibrium seeking under partial-decision information

Authors: Mattia Bianchi, Giuseppe Belgioioso, Sergio Grammatico

Abstract: We address the generalized Nash equilibrium seeking problem in a partial-decision information scenario, where each agent can only exchange information with some neighbors, although its cost function possibly depends on the strategies of all agents. The few existing methods build on projected pseudo-gradient dynamics, and require either double-layer iterations or conservative conditions on the step… ▽ More We address the generalized Nash equilibrium seeking problem in a partial-decision information scenario, where each agent can only exchange information with some neighbors, although its cost function possibly depends on the strategies of all agents. The few existing methods build on projected pseudo-gradient dynamics, and require either double-layer iterations or conservative conditions on the step sizes. To overcome both these flaws and improve efficiency, we design the first fully-distributed single-layer algorithms based on proximal best-response. Our schemes are fixed-step and allow for inexact updates, which is crucial for reducing the computational complexity. Under standard assumptions on the game primitives, we establish convergence to a variational equilibrium (with linear rate for games without coupling constraints) by recasting our algorithms as proximal-point methods, opportunely preconditioned to distribute the computation among the agents. Since our analysis hinges on a restricted monotonicity property, we also provide new general results that significantly extend the domain of applicability of proximal-point methods. Besides, the operator-theoretic approach favors the implementation of provably correct acceleration schemes that can further improve the convergence speed. Finally, the potential of our algorithms is demonstrated numerically, revealing much faster convergence with respect to projected pseudo-gradient methods and validating our theoretical findings. △ Less

Submitted 11 December, 2021; v1 submitted 20 March, 2020; originally announced March 2020.

Comments: 13 pages, 6 figures, published in Automatica,

Journal ref: Automatica, Volume 136, 2022, 110080, ISSN 0005-1098,

Stochastic generalized Nash equilibrium seeking in merely monotone games

Authors: Barbara Franci, Sergio Grammatico

Abstract: We solve the stochastic generalized Nash equilibrium (SGNE) problem in merely monotone games with expected value cost functions. Specifically, we present the first distributed SGNE seeking algorithm for monotone games that requires one proximal computation (e.g., one projection step) and one pseudogradient evaluation per iteration. Our main contribution is to extend the relaxed forward-backward op… ▽ More We solve the stochastic generalized Nash equilibrium (SGNE) problem in merely monotone games with expected value cost functions. Specifically, we present the first distributed SGNE seeking algorithm for monotone games that requires one proximal computation (e.g., one projection step) and one pseudogradient evaluation per iteration. Our main contribution is to extend the relaxed forward-backward operator splitting by Malitsky (Mathematical Programming, 2019) to the stochastic case and in turn to show almost sure convergence to a SGNE when the expected value of the pseudogradient is approximated by the average over a number of random samples. △ Less

Submitted 14 July, 2021; v1 submitted 18 February, 2020; originally announced February 2020.

Comments: arXiv admin note: text overlap with arXiv:1912.04165

Distributed Forward-Backward algorithms for stochastic generalized Nash equilibrium seeking

Authors: Barbara Franci, Sergio Grammatico

Abstract: We consider the stochastic generalized Nash equilibrium problem (SGNEP) with expected-value cost functions. Inspired by Yi and Pavel (Automatica, 2019), we propose a distributed GNE seeking algorithm based on the preconditioned forward-backward operator splitting for SGNEP, where, at each iteration, the expected value of the pseudogradient is approximated via a number of random samples. As main co… ▽ More We consider the stochastic generalized Nash equilibrium problem (SGNEP) with expected-value cost functions. Inspired by Yi and Pavel (Automatica, 2019), we propose a distributed GNE seeking algorithm based on the preconditioned forward-backward operator splitting for SGNEP, where, at each iteration, the expected value of the pseudogradient is approximated via a number of random samples. As main contribution, we show almost sure convergence of our proposed algorithm if the pseudogradient map** is restricted (monotone and) cocoercive. For non-generalized SNEPs, we show almost sure convergence also if the pseudogradient map** is restricted strictly monotone. Numerical simulations show that the proposed forward-backward algorithm seems faster that other available algorithms. △ Less

Submitted 21 February, 2020; v1 submitted 9 December, 2019; originally announced December 2019.

Distributed payoff allocation in coalitional games via time varying paracontractions

Authors: Aitazaz Ali Raja, Sergio Grammatico

Abstract: We present a partial operator-theoretic characterization of approachability principle and based on this characterization, we interpret a particular distributed payoff allocation algorithm to be a sequence of time-varying paracontractions. Further, we also propose a distributed algorithm, under the context of coalitional game, on time-varying communication networks. The state in the proposed algori… ▽ More We present a partial operator-theoretic characterization of approachability principle and based on this characterization, we interpret a particular distributed payoff allocation algorithm to be a sequence of time-varying paracontractions. Further, we also propose a distributed algorithm, under the context of coalitional game, on time-varying communication networks. The state in the proposed algorithm converges to a consensus within, the predefined, desired set. For convergence analysis, we rely on the operator-theoretic property of paracontraction. △ Less

Submitted 28 November, 2019; originally announced November 2019.

Continuous-time fully distributed generalized Nash equilibrium seeking for multi-integrator agents

Authors: Mattia Bianchi, Sergio Grammatico

Abstract: We consider strongly monotone games with convex separable coupling constraints, played by dynamical agents, in a partial-decision information scenario. We start by designing continuous-time fully distributed feedback controllers, based on consensus and primal-dual gradient dynamics, to seek a generalized Nash equilibrium in networks of single-integrator agents. Our first solution adopts a fixed ga… ▽ More We consider strongly monotone games with convex separable coupling constraints, played by dynamical agents, in a partial-decision information scenario. We start by designing continuous-time fully distributed feedback controllers, based on consensus and primal-dual gradient dynamics, to seek a generalized Nash equilibrium in networks of single-integrator agents. Our first solution adopts a fixed gain, whose choice requires the knowledge of some global parameters of the game. To relax this requirement, we conceive a controller that can be tuned in a completely decentralized fashion, thanks to the use of uncoordinated integral adaptive weights. We further introduce algorithms specifically devised for generalized aggregative games. Finally, we adapt all our control schemes to deal with heterogeneous multi-integrator agents and, in turn, with nonlinear feedback-linearizable dynamical systems. For all the proposed dynamics, we show convergence to a variational equilibrium, by leveraging monotonicity properties and stability theory for projected dynamical systems. △ Less

Submitted 19 March, 2021; v1 submitted 26 November, 2019; originally announced November 2019.

Comments: Accepted in Automatica

Journal ref: Automatica, Volume 129, July 2021

Time-varying constrained proximal type dynamics in multi-agent network games

Authors: Carlo Cenedese, Giuseppe Belgioioso, Sergio Grammatico, Ming Cao

Abstract: In this paper, we study multi-agent network games subject to affine time-varying coupling constraints and a time-varying communication network. We focus on the class of games adopting proximal dynamics and study their convergence to a persistent equilibrium. The assumptions considered to solve the problem are discussed and motivated. We develop an iterative equilibrium seeking algorithm, using onl… ▽ More In this paper, we study multi-agent network games subject to affine time-varying coupling constraints and a time-varying communication network. We focus on the class of games adopting proximal dynamics and study their convergence to a persistent equilibrium. The assumptions considered to solve the problem are discussed and motivated. We develop an iterative equilibrium seeking algorithm, using only local information, that converges to a special class of game equilibria. Its derivation is motivated by several examples, showing that the original game dynamics fail to converge. Finally, we apply the designed algorithm to solve a constrained consensus problem, validating the theoretical results. △ Less

Submitted 19 November, 2019; originally announced November 2019.

Comments: This paper has been submitted to 2020 European Control Conference (ECC)

A preconditioned Forward-Backward method for partially separable SemiDefinite Programs

Authors: Filippo Fabiani, Sergio Grammatico

Abstract: We present semi-decentralized and distributed algorithms, designed via a preconditioned forward-backward operator splitting, for solving large-scale, decomposable semidefinite programs (SDPs). We exploit a chordal aggregate sparsity pattern assumption on the original SDP to obtain a set of mutually coupled SDPs defined on positive semidefinite (PSD) cones of reduced dimensions. We show that the pr… ▽ More We present semi-decentralized and distributed algorithms, designed via a preconditioned forward-backward operator splitting, for solving large-scale, decomposable semidefinite programs (SDPs). We exploit a chordal aggregate sparsity pattern assumption on the original SDP to obtain a set of mutually coupled SDPs defined on positive semidefinite (PSD) cones of reduced dimensions. We show that the proposed algorithms converge to a solution of the original SDP via iterations of reasonable computational cost. Finally, we compare the performances of the two proposed algorithms with respect to others available in the literature. △ Less

Submitted 17 November, 2019; originally announced November 2019.

Distributed forward-backward (half) forward algorithms for generalized Nash equilibrium seeking

Authors: Barbara Franci, Mathias Staudigl, Sergio Grammatico

Abstract: We present two distributed algorithms for the computation of a generalized Nash equilibrium in monotone games. The first algorithm follows from a forward-backward-forward operator splitting, while the second, which requires the pseudo-gradient map** of the game to be cocoercive, follows from the forward-backward-half-forward operator splitting. Finally, we compare them with the distributed, prec… ▽ More We present two distributed algorithms for the computation of a generalized Nash equilibrium in monotone games. The first algorithm follows from a forward-backward-forward operator splitting, while the second, which requires the pseudo-gradient map** of the game to be cocoercive, follows from the forward-backward-half-forward operator splitting. Finally, we compare them with the distributed, preconditioned, forward-backward algorithm via numerical experiments. △ Less

Submitted 14 February, 2020; v1 submitted 30 October, 2019; originally announced October 2019.

A damped forward-backward algorithm for stochastic generalized Nash equilibrium seeking

Authors: Barbara Franci, Sergio Grammatico

Abstract: We consider a stochastic generalized Nash equilibrium problem (GNEP) with expected-value cost functions. Inspired by Yi and Pavel (Automatica, 2019), we propose a distributed GNE seeking algorithm by exploiting the forward-backward operator splitting and a suitable preconditioning matrix. Specifically, we apply this method to the stochastic GNEP, where, at each iteration, the expected value of the… ▽ More We consider a stochastic generalized Nash equilibrium problem (GNEP) with expected-value cost functions. Inspired by Yi and Pavel (Automatica, 2019), we propose a distributed GNE seeking algorithm by exploiting the forward-backward operator splitting and a suitable preconditioning matrix. Specifically, we apply this method to the stochastic GNEP, where, at each iteration, the expected value of the pseudo-gradient is approximated via a number of random samples. Our main contribution is to show almost sure convergence of our proposed algorithm if the sample size grows large enough. △ Less

Submitted 14 February, 2020; v1 submitted 25 October, 2019; originally announced October 2019.

A fully-distributed proximal-point algorithm for Nash equilibrium seeking with linear convergence rate

Authors: Mattia Bianchi, Giuseppe Belgioioso, Sergio Grammatico

Abstract: We address the Nash equilibrium problem in a partial-decision information scenario, where each agent can only observe the actions of some neighbors, while its cost possibly depends on the strategies of other agents. Our main contribution is the design of a fully-distributed, single-layer, fixed-step algorithm, based on a proximal best-response augmented with consensus terms. To derive our algorith… ▽ More We address the Nash equilibrium problem in a partial-decision information scenario, where each agent can only observe the actions of some neighbors, while its cost possibly depends on the strategies of other agents. Our main contribution is the design of a fully-distributed, single-layer, fixed-step algorithm, based on a proximal best-response augmented with consensus terms. To derive our algorithm, we follow an operator-theoretic approach. First, we recast the Nash equilibrium problem as that of finding a zero of a monotone operator. Then, we demonstrate that the resulting inclusion can be solved in a fully-distributed way via a proximal-point method, thanks to the use of a novel preconditioning matrix. Under strong monotonicity and Lipschitz continuity of the game map**, We prove linear convergence of our algorithm to a Nash equilibrium. Furthermore, we show that our method outperforms the fastest known gradient-based schemes, both in terms of guaranteed convergence rate, via theoretical analysis, and in practice, via numerical simulations. △ Less

Submitted 10 September, 2020; v1 submitted 25 October, 2019; originally announced October 2019.

Comments: To appear in the 59th Conference on Decision and Control (CDC 2020)

A continuous-time distributed generalized Nash equilibrium seeking algorithm over networks for double-integrator agents

Authors: Mattia Bianchi, Sergio Grammatico

Abstract: We consider a system of single- or double integrator agents playing a generalized Nash game over a network, in a partial-information scenario. We address the generalized Nash equilibrium seeking problem by designing a fully-distributed dynamic controller, based on continuous-time consensus and primal-dual gradient dynamics. Our main technical contribution is to show convergence of the closed-loop… ▽ More We consider a system of single- or double integrator agents playing a generalized Nash game over a network, in a partial-information scenario. We address the generalized Nash equilibrium seeking problem by designing a fully-distributed dynamic controller, based on continuous-time consensus and primal-dual gradient dynamics. Our main technical contribution is to show convergence of the closed-loop system to a variational equilibrium, under strong monotonicity and Lipschitz continuity of the game map**, by leveraging monotonicity properties and stability theory for projected dynamical systems. △ Less

Submitted 2 March, 2020; v1 submitted 25 October, 2019; originally announced October 2019.

Comments: Accepted to the ECC2020

Charging plug-in electric vehicles as a mixed-integer aggregative game

Authors: Carlo Cenedese, Filippo Fabiani, Michele Cucuzzella, Jacquelien M. A. Scherpen, Ming Cao, Sergio Grammatico

Abstract: We consider the charge scheduling coordination of a fleet of plug-in electric vehicles, develo** a hybrid decision-making framework for efficient and profitable usage of the distribution grid. Each charging dynamics, affected by the aggregate behavior of the whole fleet, is modelled as an inter-dependent, mixed-logical-dynamical system. The coordination problem is formalized as a generalized mix… ▽ More We consider the charge scheduling coordination of a fleet of plug-in electric vehicles, develo** a hybrid decision-making framework for efficient and profitable usage of the distribution grid. Each charging dynamics, affected by the aggregate behavior of the whole fleet, is modelled as an inter-dependent, mixed-logical-dynamical system. The coordination problem is formalized as a generalized mixed-integer aggregative potential game, and solved via semi-decentralized implementation of a sequential best-response algorithm that leads to an approximated equilibrium of the game. △ Less

Submitted 22 October, 2019; originally announced October 2019.

Comments: Accepted to the 58th IEEE Conference on Decision and Control 2019 Nice

Asynchronous and time-varying proximal type dynamics multi-agent network games

Authors: Carlo Cenedese, Giuseppe Belgioioso, Yu Kawano, Sergio Grammatico, Ming Cao

Abstract: In this paper, we study proximal type dynamics in the context of noncooperative multi-agent network games. These dynamics arise in different applications, since they describe distributed decision making in multi-agent networks, e.g., in opinion dynamics, distributed model fitting and network information fusion, where the goal of each agent is to seek an equilibrium using local information only. We… ▽ More In this paper, we study proximal type dynamics in the context of noncooperative multi-agent network games. These dynamics arise in different applications, since they describe distributed decision making in multi-agent networks, e.g., in opinion dynamics, distributed model fitting and network information fusion, where the goal of each agent is to seek an equilibrium using local information only. We analyse several conjugations of this class of games, providing convergence results, or designing equilibrium seeking algorithms when the original dynamics fail to converge. For the games subject only to local constraints we look into both synchronous/asynchronous dynamics and time-varying communication networks. For games subject in addition to coupling constraints, we design an equilibrium seeking algorithm converging to a special class of game equilibria. Finally, we validate the theoretical results via numerical simulations on opinion dynamics and distributed model fitting. △ Less

Submitted 24 September, 2019; originally announced September 2019.

Comments: This paper is currently under review on IEEE Transaction on Automatic Control (TAC)

An asynchronous, forward-backward, distributed generalized Nash equilibrium seeking algorithm

Authors: Carlo Cenedese, Giuseppe Belgioioso, Sergio Grammatico, Ming Cao

Abstract: In this paper, we propose an asynchronous distributed algorithm for the computation of generalized Nash equilibria in noncooperative games, where the players interact via an undirected communication graph. Specifically, we extend the paper "Asynchronous distributed algorithm for seeking generalized Nash equilibria" by Yi and Pavel: we redesign the asynchronous update rule using auxiliary variables… ▽ More In this paper, we propose an asynchronous distributed algorithm for the computation of generalized Nash equilibria in noncooperative games, where the players interact via an undirected communication graph. Specifically, we extend the paper "Asynchronous distributed algorithm for seeking generalized Nash equilibria" by Yi and Pavel: we redesign the asynchronous update rule using auxiliary variables over the nodes rather than over the edges. This key modification renders the algorithm scalable for highly interconnected games. The derived asynchronous algorithm is robust against delays in the communication and it eliminates the idle times between computations, hence modeling a more realistic interaction between players with different update frequencies. We address the problem from an operator-theoretic perspective and design the algorithm via a preconditioned forward-backward splitting. Finally, we numerically simulate the algorithm for the Cournot competition in networked markets. △ Less

Submitted 14 January, 2019; originally announced January 2019.

Comments: Submitted to European Control Conference 2019 (under review)

Towards time-varying proximal dynamics in Multi-Agent Network Games

Authors: Carlo Cenedese, Yu Kawano, Sergio Grammatico, Ming Cao

Abstract: Distributed decision making in multi-agent networks has recently attracted significant research attention thanks to its wide applicability, e.g. in the management and optimization of computer networks, power systems, robotic teams, sensor networks and consumer markets. Distributed decision-making problems can be modeled as inter-dependent optimization problems, i.e., multi-agent game-equilibrium s… ▽ More Distributed decision making in multi-agent networks has recently attracted significant research attention thanks to its wide applicability, e.g. in the management and optimization of computer networks, power systems, robotic teams, sensor networks and consumer markets. Distributed decision-making problems can be modeled as inter-dependent optimization problems, i.e., multi-agent game-equilibrium seeking problems, where noncooperative agents seek an equilibrium by communicating over a network. To achieve a network equilibrium, the agents may decide to update their decision variables via proximal dynamics, driven by the decision variables of the neighboring agents. In this paper, we provide an operator-theoretic characterization of convergence with a time-invariant communication network. For the time-varying case, we consider adjacency matrices that may switch subject to a dwell time. We illustrate our investigations using a distributed robotic exploration example. △ Less

Submitted 11 November, 2018; originally announced November 2018.

Comments: 6 pages, 3 figures

Continuous-time integral dynamics for monotone aggregative games with coupling constraints

Authors: Claudio De Persis, Sergio Grammatico

Abstract: We consider continuous-time equilibrium seeking in monotone aggregative games with coupling constraints. We propose semi-decentralized integral dynamics and prove their global convergence to a variational generalized aggregative or Nash equilibrium. The proof is based on Lyapunov arguments and invariance techniques for differential inclusions. We consider continuous-time equilibrium seeking in monotone aggregative games with coupling constraints. We propose semi-decentralized integral dynamics and prove their global convergence to a variational generalized aggregative or Nash equilibrium. The proof is based on Lyapunov arguments and invariance techniques for differential inclusions. △ Less

Submitted 8 May, 2018; originally announced May 2018.

A Mixed-Logical-Dynamical model for Automated Driving on highways

Authors: Filippo Fabiani, Sergio Grammatico

Abstract: We propose a hybrid decision-making framework for safe and efficient autonomous driving of selfish vehicles on highways. Specifically, we model the dynamics of each vehicle as a Mixed-Logical-Dynamical system and propose simple driving rules to prevent potential sources of conflict among neighboring vehicles. We formalize the coordination problem as a generalized mixed-integer potential game, wher… ▽ More We propose a hybrid decision-making framework for safe and efficient autonomous driving of selfish vehicles on highways. Specifically, we model the dynamics of each vehicle as a Mixed-Logical-Dynamical system and propose simple driving rules to prevent potential sources of conflict among neighboring vehicles. We formalize the coordination problem as a generalized mixed-integer potential game, where an equilibrium solution generates a sequence of mixed-integer decisions for the vehicles that trade off individual optimality and overall safety. △ Less

Submitted 28 March, 2018; originally announced March 2018.

A Douglas-Rachford splitting for semi-decentralized equilibrium seeking in generalized aggregative games

Authors: Giuseppe Belgioioso, Sergio Grammatico

Abstract: We address the generalized aggregative equilibrium seeking problem for noncooperative agents playing average aggregative games with affine coupling constraints. First, we use operator theory to characterize the generalized aggregative equilibria of the game as the zeros of a monotone set-valued operator. Then, we massage the Douglas-Rachford splitting to solve the monotone inclusion problem and de… ▽ More We address the generalized aggregative equilibrium seeking problem for noncooperative agents playing average aggregative games with affine coupling constraints. First, we use operator theory to characterize the generalized aggregative equilibria of the game as the zeros of a monotone set-valued operator. Then, we massage the Douglas-Rachford splitting to solve the monotone inclusion problem and derive a single layer, semi-decentralized algorithm whose global convergence is guaranteed under mild assumptions. The potential of the proposed Douglas-Rachford algorithm is shown on a simplified resource allocation game, where we observe faster convergence with respect to forward-backward algorithms. △ Less

Submitted 30 September, 2018; v1 submitted 28 March, 2018; originally announced March 2018.

Comments: arXiv admin note: text overlap with arXiv:1803.10441

On the convergence of discrete-time linear systems: A linear time-varying Mann iteration converges iff the operator is strictly pseudocontractive

Authors: Giuseppe Belgioioso, Filippo Fabiani, Franco Blanchini, Sergio Grammatico

Abstract: We adopt an operator-theoretic perspective to study convergence of linear fixed-point iterations and discrete- time linear systems. We mainly focus on the so-called Krasnoselskij-Mann iteration x(k+1) = ( 1 - α(k) ) x(k) + α(k) A x(k), which is relevant for distributed computation in optimization and game theory, when A is not available in a centralized way. We show that convergence to a vector in… ▽ More We adopt an operator-theoretic perspective to study convergence of linear fixed-point iterations and discrete- time linear systems. We mainly focus on the so-called Krasnoselskij-Mann iteration x(k+1) = ( 1 - α(k) ) x(k) + α(k) A x(k), which is relevant for distributed computation in optimization and game theory, when A is not available in a centralized way. We show that convergence to a vector in the kernel of (I-A) is equivalent to strict pseudocontractiveness of the linear operator x -> Ax. We also characterize some relevant operator-theoretic properties of linear operators via eigenvalue location and linear matrix inequalities. We apply the convergence conditions to multi-agent linear systems with vanishing step sizes, in particular, to linear consensus dynamics and equilibrium seeking in monotone linear-quadratic games. △ Less

Submitted 28 March, 2018; originally announced March 2018.

Continuous-time integral dynamics for Aggregative Game equilibrium seeking

Authors: Claudio De Persis, Sergio Grammatico

Abstract: In this paper, we consider continuous-time semi-decentralized dynamics for the equilibrium computation in a class of aggregative games. Specifically, we propose a scheme where decentralized projected-gradient dynamics are driven by an integral control law. To prove global exponential convergence of the proposed dynamics to an aggregative equilibrium, we adopt a quadratic Lyapunov function argument… ▽ More In this paper, we consider continuous-time semi-decentralized dynamics for the equilibrium computation in a class of aggregative games. Specifically, we propose a scheme where decentralized projected-gradient dynamics are driven by an integral control law. To prove global exponential convergence of the proposed dynamics to an aggregative equilibrium, we adopt a quadratic Lyapunov function argument. We derive a sufficient condition for global convergence that we position within the recent literature on aggregative games, and in particular we show that it improves on established results. △ Less

Submitted 28 March, 2018; originally announced March 2018.

Projected-gradient algorithms for generalized equilibrium seeking in Aggregative Games are preconditioned Forward-Backward methods

Authors: Giuseppe Belgioioso, Sergio Grammatico

Abstract: We show that projected-gradient methods for the distributed computation of generalized Nash equilibria in aggregative games are preconditioned forward-backward splitting methods applied to the KKT operator of the game. Specifically, we adopt the preconditioned forward-backward design, recently conceived by Yi and Pavel in the manuscript "A distributed primal-dual algorithm for computation of gener… ▽ More We show that projected-gradient methods for the distributed computation of generalized Nash equilibria in aggregative games are preconditioned forward-backward splitting methods applied to the KKT operator of the game. Specifically, we adopt the preconditioned forward-backward design, recently conceived by Yi and Pavel in the manuscript "A distributed primal-dual algorithm for computation of generalized Nash equilibria via operator splitting methods" for generalized Nash equilibrium seeking in aggregative games. Consequently, we notice that two projected-gradient methods recently proposed in the literature are preconditioned forward-backward methods. More generally, we provide a unifying operator-theoretic ground to design projected-gradient methods for generalized equilibrium seeking in aggregative games. △ Less

Submitted 28 March, 2018; originally announced March 2018.

Dynamic control of agents playing aggregative games with coupling constraints

Authors: Sergio Grammatico

Abstract: We address the problem to control a population of noncooperative heterogeneous agents, each with convex cost function depending on the average population state, and all sharing a convex constraint, towards an aggregative equilibrium. We assume an information structure through which a central coordinator has access to the average population state and can broadcast control signals for steering the d… ▽ More We address the problem to control a population of noncooperative heterogeneous agents, each with convex cost function depending on the average population state, and all sharing a convex constraint, towards an aggregative equilibrium. We assume an information structure through which a central coordinator has access to the average population state and can broadcast control signals for steering the decentralized optimal responses of the agents. We design a dynamic control law that, based on operator theoretic arguments, ensures global convergence to an equilibrium independently on the problem data, that are the cost functions and the constraints, local and global, of the agents. We illustrate the proposed method in two application domains: network congestion control and demand side management. △ Less

Submitted 11 March, 2017; v1 submitted 28 September, 2016; originally announced September 2016.

Comments: IEEE Trans. on Automatic Control

Network Aggregative Games and Distributed Mean Field Control via Consensus Theory

Authors: Francesca Parise, Sergio Grammatico, Basilio Gentile, John Lygeros

Abstract: We consider network aggregative games to model and study multi-agent populations in which each rational agent is influenced by the aggregate behavior of its neighbors, as specified by an underlying network. Specifically, we examine systems where each agent minimizes a quadratic cost function, that depends on its own strategy and on a convex combination of the strategies of its neighbors, and is su… ▽ More We consider network aggregative games to model and study multi-agent populations in which each rational agent is influenced by the aggregate behavior of its neighbors, as specified by an underlying network. Specifically, we examine systems where each agent minimizes a quadratic cost function, that depends on its own strategy and on a convex combination of the strategies of its neighbors, and is subject to personalized convex constraints. We analyze the best response dynamics and we propose alternative distributed algorithms to steer the strategies of the rational agents to a Nash equilibrium configuration. The convergence of these schemes is guaranteed under different sufficient conditions, depending on the matrices defining the cost and on the network. Additionally, we propose an extension to the network aggregative game setting that allows for multiple rounds of communications among the agents, and we illustrate how it can be combined with consensus theory to recover a solution to the mean field control problem in a distributed fashion, that is, without requiring the presence of a central coordinator. Finally, we apply our theoretical findings to study a novel multi-dimensional, convex-constrained model of opinion dynamics and a hierarchical demand-response scheme for energy management in smart buildings, extending literature results. △ Less

Submitted 25 June, 2015; originally announced June 2015.

Decentralized Convergence to Nash Equilibria in Constrained Deterministic Mean Field Control

Authors: Sergio Grammatico, Francesca Parise, Marcello Colombino, John Lygeros

Abstract: This paper considers decentralized control and optimization methodologies for large populations of systems, consisting of several agents with different individual behaviors, constraints and interests, and affected by the aggregate behavior of the overall population. For such large-scale systems, the theory of aggregative and mean field games has been established and successfully applied in various… ▽ More This paper considers decentralized control and optimization methodologies for large populations of systems, consisting of several agents with different individual behaviors, constraints and interests, and affected by the aggregate behavior of the overall population. For such large-scale systems, the theory of aggregative and mean field games has been established and successfully applied in various scientific disciplines. While the existing literature addresses the case of unconstrained agents, we formulate deterministic mean field control problems in the presence of heterogeneous convex constraints for the individual agents, for instance arising from agents with linear dynamics subject to convex state and control constraints. We propose several model-free feedback iterations to compute in a decentralized fashion a mean field Nash equilibrium in the limit of infinite population size. We apply our methods to the constrained linear quadratic deterministic mean field control problem and to the constrained mean field charging control problem for large populations of plug-in electric vehicles. △ Less

Submitted 17 May, 2015; v1 submitted 16 October, 2014; originally announced October 2014.

Comments: IEEE Trans. on Automatic Control (cond. accepted)