-
Closed-loop Equilibria for Mean-Field Games in Randomly Switching Environments with General Discounting Costs
Authors:
Hongwei Mei,
Son Luu Nguyen,
George Yin
Abstract:
This work is devoted to finding the closed-loop equilibria for a class of mean-field games (MFGs) with infinitely many symmetric players in a common switching environment when the cost functional is under general discount in time. There are two key challenges in the application of the well-known Hamilton-Jacobi-Bellman and Fokker-Planck (HJB-FP) approach to our problems: the path-dependence due to…
▽ More
This work is devoted to finding the closed-loop equilibria for a class of mean-field games (MFGs) with infinitely many symmetric players in a common switching environment when the cost functional is under general discount in time. There are two key challenges in the application of the well-known Hamilton-Jacobi-Bellman and Fokker-Planck (HJB-FP) approach to our problems: the path-dependence due to the conditional mean-field interaction and the time-inconsistency due to the general discounting cost. To overcome the difficulties, a theory for a class of systems of path-dependent equilibrium Hamilton-Jacobi-Bellman equations (HJBs) is developed. Then closed-loop equilibrium strategies can be identified through a two-step verification procedure. It should be noted that the closed-loop equilibrium strategies obtained satisfy a new form of local optimality in the Nash sense. The theory obtained extends the HJB-FP approach for classical MFGs to more general conditional MFGs with general discounting costs.
△ Less
Submitted 29 February, 2024;
originally announced March 2024.
-
Linear-Quadratic Mean Field Social Optimization with a Major Player
Authors:
Minyi Huang,
Son Luu Nguyen
Abstract:
This paper considers a linear-quadratic (LQ) mean field control problem involving a major player and a large number of minor players, where the dynamics and costs depend on random parameters. The objective is to optimize a social cost as a weighted sum of the individual costs under decentralized information. We apply the person-by-person optimality principle in team decision theory to the finite p…
▽ More
This paper considers a linear-quadratic (LQ) mean field control problem involving a major player and a large number of minor players, where the dynamics and costs depend on random parameters. The objective is to optimize a social cost as a weighted sum of the individual costs under decentralized information. We apply the person-by-person optimality principle in team decision theory to the finite population model to construct two limiting variational problems whose solutions, subject to the requirement of consistent mean field approximations, yield a system of forward-backward stochastic differential equations (FBSDEs). We show the existence and uniqueness of a solution to the FBSDEs and obtain decentralized strategies nearly achieving social optimality in the original large but finite population model.
△ Less
Submitted 5 April, 2019;
originally announced April 2019.
-
On Laws of Large Numbers for Systems with Mean-Field Interactions and Markovian Switching
Authors:
Son L. Nguyen,
George Yin,
Tuan A. Hoang
Abstract:
Focusing on stochastic systems arising in mean-field models, the systems under consideration belong to the class of switching diffusions, in which continuous dynamics and discrete events coexist and interact. The discrete events are modeled by a continuous-time Markov chain. Different from the usual switching diffusions, the systems include mean-field interactions. Our effort is devoted to obtaini…
▽ More
Focusing on stochastic systems arising in mean-field models, the systems under consideration belong to the class of switching diffusions, in which continuous dynamics and discrete events coexist and interact. The discrete events are modeled by a continuous-time Markov chain. Different from the usual switching diffusions, the systems include mean-field interactions. Our effort is devoted to obtaining laws of large numbers for the underlying systems. One of the distinct features of the paper is the limit of the empirical measures is not deterministic but a random measure depending on the history of the Markovian switching process. A main difficulty is that the standard martingale approach cannot be used to characterize the limit because of the coupling due to the random switching process. In this paper, in contrast to the classical approach, the limit is characterized as the conditional distribution (given the history of the switching process) of the solution to a stochastic McKean-Vlasov differential equation with Markovian switching.
△ Less
Submitted 17 January, 2019;
originally announced January 2019.
-
Numerical Methods for Linear Diffusion Equations in the Presence of an Interface
Authors:
V. A. Bokil,
N. L. Gibson,
S. L. Nguyen,
E. A. Thomann,
E. Waymire
Abstract:
We consider numerical methods for linear parabolic equations in one spatial dimension having piecewise constant diffusion coefficients defined by a one parameter family of interface conditions at the discontinuity. We construct immersed interface finite element methods for an alternative formulation of the original deterministic diffusion problem in which the interface condition is recast as a nat…
▽ More
We consider numerical methods for linear parabolic equations in one spatial dimension having piecewise constant diffusion coefficients defined by a one parameter family of interface conditions at the discontinuity. We construct immersed interface finite element methods for an alternative formulation of the original deterministic diffusion problem in which the interface condition is recast as a natural condition on the interfacial flux for which the given operator is self adjoint. An Euler-Maruyama method is developed for the stochastic differential equation corresponding to the alternative divergence formulation of the equation having a discontinuous coefficient and a one-parameter family of interface conditions. We then prove convergence estimates for the Euler scheme. The main goal is to develop numerical schemes that can accommodate specification of any one of the possible interface conditions, and to illustrate the implementation for each of the deterministic and stochastic formulations, respectively. The issues pertaining to speed-ups of the numerical schemes are left to future work.
△ Less
Submitted 30 October, 2013;
originally announced October 2013.