Steering game dynamics towards desired outcomes
Authors:
Ilayda Canyakmaz,
Iosif Sakos,
Wayne Lin,
Antonios Varvitsiotis,
Georgios Piliouras
Abstract:
The dynamic behavior of agents in games, which captures how their strategies evolve over time based on past interactions, can lead to a spectrum of undesirable behaviors, ranging from non-convergence to Nash equilibria to the emergence of limit cycles and chaos. To mitigate the effects of selfish behavior, central planners can use dynamic payments to guide strategic multi-agent systems toward stab…
▽ More
The dynamic behavior of agents in games, which captures how their strategies evolve over time based on past interactions, can lead to a spectrum of undesirable behaviors, ranging from non-convergence to Nash equilibria to the emergence of limit cycles and chaos. To mitigate the effects of selfish behavior, central planners can use dynamic payments to guide strategic multi-agent systems toward stability and socially optimal outcomes. However, the effectiveness of such interventions critically relies on accurately predicting agents' responses to incentives and dynamically adjusting payments so that the system is guided towards the desired outcomes. These challenges are further amplified in real-time applications where the dynamics are unknown and only scarce data is available. To tackle this challenge, in this work we introduce the SIAR-MPC method, combining the recently introduced Side Information Assisted Regression (SIAR) method for system identification with Model Predictive Control (MPC). SIAR utilizes side-information constraints inherent to game theoretic applications to model agent responses to payments from scarce data, while MPC uses this model to facilitate dynamic payment adjustments. Our experiments demonstrate the efficiency of SIAR-MPC in guiding the system towards socially optimal equilibria, stabilizing chaotic behaviors, and avoiding specified regions of the state space. Comparative analyses in data-scarce settings show SIAR-MPC's superior performance over pairing MPC with Physics Informed Neural Networks (PINNs), a powerful system identification method that finds models satisfying specific constraints.
△ Less
Submitted 1 April, 2024;
originally announced April 2024.
Consensus of Homogeneous Agents with General Linear Dynamics under Switching Communication Networks
Authors:
Chong ** Ong,
Ilayda Canyakmaz
Abstract:
This work addresses the synchronization/consensus problem of identical multi-agent system (MAS) where the agents' dynamics are linear and the communication network is arbitrarily switching among connected topologies. The approach uses a gain matrix of a special structure in a dynamic compensator for each agent. Under reasonable conditions, the approach ensures that consensus is reached when the ga…
▽ More
This work addresses the synchronization/consensus problem of identical multi-agent system (MAS) where the agents' dynamics are linear and the communication network is arbitrarily switching among connected topologies. The approach uses a gain matrix of a special structure in a dynamic compensator for each agent. Under reasonable conditions, the approach ensures that consensus is reached when the gain is sufficiently large. This result holds for general linear systems including the case where agents have repeated unstable eigenvalues. The proposed controller structure can be seen as a special case of the existing MAS controller structures but offers consensus conditions that are simpler than existing results, especially for the case when the network is switching among connected graphs. The works shows its application to three communication settings: fixed graph, switching among undirected and connected graphs and switching among directed and connected graphs. An example is provided to illustrate the results.
△ Less
Submitted 23 November, 2022; v1 submitted 19 January, 2022;
originally announced January 2022.
