Showing 1–2 of 2 results for author: Artiglio, G
-
Ro** in Uncertainty: Robustness and Regularization in Markov Games
Authors:
Jeremy McMahan,
Giovanni Artiglio,
Qiaomin Xie
Abstract:
We study robust Markov games (RMG) with $s$-rectangular uncertainty. We show a general equivalence between computing a robust Nash equilibrium (RNE) of a $s$-rectangular RMG and computing a Nash equilibrium (NE) of an appropriately constructed regularized MG. The equivalence result yields a planning algorithm for solving $s$-rectangular RMGs, as well as provable robustness guarantees for policies…
▽ More
We study robust Markov games (RMG) with $s$-rectangular uncertainty. We show a general equivalence between computing a robust Nash equilibrium (RNE) of a $s$-rectangular RMG and computing a Nash equilibrium (NE) of an appropriately constructed regularized MG. The equivalence result yields a planning algorithm for solving $s$-rectangular RMGs, as well as provable robustness guarantees for policies computed using regularized methods. However, we show that even for just reward-uncertain two-player zero-sum matrix games, computing an RNE is PPAD-hard. Consequently, we derive a special uncertainty structure called efficient player-decomposability and show that RNE for two-player zero-sum RMG in this class can be provably solved in polynomial time. This class includes commonly used uncertainty sets such as $L_1$ and $L_\infty$ ball uncertainty sets.
△ Less
Submitted 13 June, 2024;
originally announced June 2024.
-
The Emergence of League and Sub-League Structure in the Population Lotto Game
Authors:
Giovanni Artiglio,
Aiden Youkhana,
Joel Nishimura
Abstract:
In order to understand if and how strategic resource allocation can constrain the structure of pair-wise competition outcomes in competitive human competitions we introduce a new multiplayer resource allocation game, the Population Lotto Game. This new game allows agents to allocate their resources across a continuum of possible specializations. While this game allows non-transitive cycles between…
▽ More
In order to understand if and how strategic resource allocation can constrain the structure of pair-wise competition outcomes in competitive human competitions we introduce a new multiplayer resource allocation game, the Population Lotto Game. This new game allows agents to allocate their resources across a continuum of possible specializations. While this game allows non-transitive cycles between players, we show that the Nash equilibrium of the game also forms a hierarchical structure between discrete `leagues' based on their different resource budgets, with potential sub-league structure and/or non-transitive cycles inside individual leagues. We provide an algorithm that can find a particular Nash equilibrium for any finite set of discrete sub-population sizes and budgets. Further, our algorithm finds the unique Nash equilibrium that remains stable for the subset of players with budgets below any threshold.
△ Less
Submitted 31 August, 2022;
originally announced September 2022.