-
Recurrent Neural Network ODE Output for Classification Problems Follows the Replicator Dynamics
Authors:
Julian Barreiro-Gomez,
Jorge I. Poveda
Abstract:
This letter establishes a novel relationship between a class of recurrent neural networks and certain evolutionary dynamics that emerge in the context of population games. Specifically, it is shown that the output of a recurrent neural network, in the context of classification problems, coincides with the evolution of the population state in a population game. This connection is established with d…
▽ More
This letter establishes a novel relationship between a class of recurrent neural networks and certain evolutionary dynamics that emerge in the context of population games. Specifically, it is shown that the output of a recurrent neural network, in the context of classification problems, coincides with the evolution of the population state in a population game. This connection is established with dynamic payoffs and under replicator evolutionary dynamics. The connection provides insights into the neural network's behavior from both dynamical systems and game-theoretical perspectives, aligning with recent literature that suggests that neural network outputs may resemble the Nash equilibria of suitable games. It also uncovers potential connections between the neural network classification problem and mechanism design. To illustrate our results, we present different numerical experiments in the context of classification problems.
△ Less
Submitted 6 December, 2023; v1 submitted 6 December, 2023;
originally announced December 2023.
-
Stability Via Adversarial Training of Neural Network Stochastic Control of Mean-Field Type
Authors:
Julian Barreiro-Gomez,
Salah Eddine Choutri,
Boualem Djehiche
Abstract:
In this paper, we present an approach to neural network mean-field-type control and its stochastic stability analysis by means of adversarial inputs (aka adversarial attacks). This is a class of data-driven mean-field-type control where the distribution of the variables such as the system states and control inputs are incorporated into the problem. Besides, we present a methodology to validate the…
▽ More
In this paper, we present an approach to neural network mean-field-type control and its stochastic stability analysis by means of adversarial inputs (aka adversarial attacks). This is a class of data-driven mean-field-type control where the distribution of the variables such as the system states and control inputs are incorporated into the problem. Besides, we present a methodology to validate the feasibility of the approximations of the solutions via neural networks and evaluate their stability. Moreover, we enhance the stability by enlarging the training set with adversarial inputs to obtain a more robust neural network. Finally, a worked-out example based on the linear-quadratic mean-field type control problem (LQ-MTC) is presented to illustrate our methodology.
△ Less
Submitted 27 September, 2022;
originally announced October 2022.
-
Matrix-Valued Mean-Field-Type Games: Risk-Sensitive, Adversarial, and Risk-Neutral Linear-Quadratic Case
Authors:
Julian Barreiro-Gomez,
Tyrone E. Duncan,
Hamidou Tembine
Abstract:
In this paper we study a class of matrix-valued linear-quadratic mean-field-type games for both the risk-neutral, risk-sensitive and robust cases. Non-cooperation, full cooperation and adversarial between teams are treated. We provide a semi-explicit solution for both problems by means of a direct method. The state dynamics is described by a matrix-valued linear jump-diffusion-regime switching sys…
▽ More
In this paper we study a class of matrix-valued linear-quadratic mean-field-type games for both the risk-neutral, risk-sensitive and robust cases. Non-cooperation, full cooperation and adversarial between teams are treated. We provide a semi-explicit solution for both problems by means of a direct method. The state dynamics is described by a matrix-valued linear jump-diffusion-regime switching system of conditional mean-field type where the conditioning is with respect to common noise which is a regime switching process. The optimal strategies are in a state-and-conditional mean-field feedback form. Semi-explicit solutions of equilibrium costs and strategies are also provided for the full cooperative, adversarial teams, risk-sensitive full cooperative and risk-sensitive adversarial team cases. It is shown that full cooperation increases the well-posedness domain under risk-sensitive decision-makers by means of population risk-sharing. Finally, relationship between risk-sensitivity and robustness are established in the mean-field type context.
△ Less
Submitted 5 June, 2019; v1 submitted 23 April, 2019;
originally announced April 2019.
-
Semi-Explicit Solutions to some Non-Linear Non-Quadratic Mean-Field-Type Games: A Direct Method
Authors:
Julian Barreiro-Gomez,
Tyrone E. Duncan,
Bozenna Pasik-Duncan,
Hamidou Tembine
Abstract:
This article examines mean-field-type game problems by means of a direct method. We provide various solvable examples beyond the classical linear-quadratic game problems. These include quadratic-quadratic games and games with power, logarithmic, sine square, hyperbolic sine square payoffs. Non-linear state dynamics such as log-state, control-dependent regime switching, quadratic state, cotangent s…
▽ More
This article examines mean-field-type game problems by means of a direct method. We provide various solvable examples beyond the classical linear-quadratic game problems. These include quadratic-quadratic games and games with power, logarithmic, sine square, hyperbolic sine square payoffs. Non-linear state dynamics such as log-state, control-dependent regime switching, quadratic state, cotangent state and hyperbolic cotangent state are considered. We identify equilibrium strategies and equilibrium payoffs in state-and-conditional mean-field type feedback form. It is shown that a simple direct method can be used to solve broader classes of non-quadratic mean-field-type games under jump-diffusion-regime switching Gauss-Volterra processes which include fractional Brownian motions and multi-fractional Brownian motions. We provide semi-explicit solutions to the fully cooperative, noncooperative nonzero-sum, and adversarial game problems.
△ Less
Submitted 21 April, 2019; v1 submitted 17 December, 2018;
originally announced December 2018.
