-
Graphon Mean Field Games with a Representative Player: Analysis and Learning Algorithm
Authors:
Fuzhong Zhou,
Chenyu Zhang,
Xu Chen,
Xuan Di
Abstract:
We propose a discrete time graphon game formulation on continuous state and action spaces using a representative player to study stochastic games with heterogeneous interaction among agents. This formulation admits both philosophical and mathematical advantages, compared to a widely adopted formulation using a continuum of players. We prove the existence and uniqueness of the graphon equilibrium w…
▽ More
We propose a discrete time graphon game formulation on continuous state and action spaces using a representative player to study stochastic games with heterogeneous interaction among agents. This formulation admits both philosophical and mathematical advantages, compared to a widely adopted formulation using a continuum of players. We prove the existence and uniqueness of the graphon equilibrium with mild assumptions, and show that this equilibrium can be used to construct an approximate solution for finite player game on networks, which is challenging to analyze and solve due to curse of dimensionality. An online oracle-free learning algorithm is developed to solve the equilibrium numerically, and sample complexity analysis is provided for its convergence.
△ Less
Submitted 4 June, 2024; v1 submitted 8 May, 2024;
originally announced May 2024.
-
Dynamic driving and routing games for autonomous vehicles on networks: A mean field game approach
Authors:
Kuang Huang,
Xu Chen,
Xuan Di,
Qiang Du
Abstract:
This paper aims to answer the research question as to optimal design of decision-making processes for autonomous vehicles (AVs), including dynamical selection of driving velocity and route choices on a transportation network. Dynamic traffic assignment (DTA) has been widely used to model travelers's route choice or/and departure-time choice and predict dynamic traffic flow evolution in the short t…
▽ More
This paper aims to answer the research question as to optimal design of decision-making processes for autonomous vehicles (AVs), including dynamical selection of driving velocity and route choices on a transportation network. Dynamic traffic assignment (DTA) has been widely used to model travelers's route choice or/and departure-time choice and predict dynamic traffic flow evolution in the short term. However, the existing DTA models do not explicitly describe one's selection of driving velocity on a road link. Driving velocity choice may not be crucial for modeling the movement of human drivers but it is a must-have control to maneuver AVs. In this paper, we aim to develop a game-theoretic model to solve for AVs's optimal driving strategies of velocity control in the interior of a road link and route choice at a junction node. To this end, we will first reinterpret the DTA problem as an N-car differential game and show that this game can be tackled with a general mean field game-theoretic framework. The developed mean field game is challenging to solve because of the forward and backward structure for velocity control and the complementarity conditions for route choice. An efficient algorithm is developed to address these challenges. The model and the algorithm are illustrated on the Braess network and the OW network with a single destination. On the Braess network, we first compare the LWR based DTA model with the proposed game and find that the driving and routing control navigates AVs with overall lower costs. We then compare the total travel cost without and with the middle link and find that the Braess paradox may still arise under certain conditions. We also test our proposed model and solution algorithm on the OW network.
△ Less
Submitted 15 June, 2021; v1 submitted 15 December, 2020;
originally announced December 2020.
-
Stabilizing Traffic via Autonomous Vehicles: A Continuum Mean Field Game Approach
Authors:
Kuang Huang,
Xuan Di,
Qiang Du,
Xi Chen
Abstract:
This paper presents scalable traffic stability analysis for both pure autonomous vehicle (AV) traffic and mixed traffic based on continuum traffic flow models. Human vehicles are modeled by a non-equilibrium traffic flow model, i.e., Aw-Rascle-Zhang (ARZ), which is unstable. AVs are modeled by the mean field game which assumes AVs are rational agents with anticipation capacities. It is shown from…
▽ More
This paper presents scalable traffic stability analysis for both pure autonomous vehicle (AV) traffic and mixed traffic based on continuum traffic flow models. Human vehicles are modeled by a non-equilibrium traffic flow model, i.e., Aw-Rascle-Zhang (ARZ), which is unstable. AVs are modeled by the mean field game which assumes AVs are rational agents with anticipation capacities. It is shown from linear stability analysis and numerical experiments that AVs help stabilize the traffic. Further, we quantify the impact of AV's penetration rate and controller design on the traffic stability. The results may provide insights for AV manufacturers and city planners.
△ Less
Submitted 22 January, 2020; v1 submitted 4 June, 2019;
originally announced June 2019.
-
A Game-Theoretic Framework for Autonomous Vehicles Velocity Control: Bridging Microscopic Differential Games and Macroscopic Mean Field Games
Authors:
Kuang Huang,
Xuan Di,
Qiang Du,
Xi Chen
Abstract:
This paper proposes an efficient computational framework for longitudinal velocity control of a large number of autonomous vehicles (AVs) and develops a traffic flow theory for AVs. Instead of hypothesizing explicitly how AVs drive, our goal is to design future AVs as rational, utility-optimizing agents that continuously select optimal velocity over a period of planning horizon. With a large numbe…
▽ More
This paper proposes an efficient computational framework for longitudinal velocity control of a large number of autonomous vehicles (AVs) and develops a traffic flow theory for AVs. Instead of hypothesizing explicitly how AVs drive, our goal is to design future AVs as rational, utility-optimizing agents that continuously select optimal velocity over a period of planning horizon. With a large number of interacting AVs, this design problem can become computationally intractable. This paper aims to tackle such a challenge by employing mean field approximation and deriving a mean field game (MFG) as the limiting differential game with an infinite number of agents. The proposed micro-macro model allows one to define individuals on a microscopic level as utility-optimizing agents while translating rich microscopic behaviors to macroscopic models. Different from existing studies on the application of MFG to traffic flow models, the present study offers a systematic framework to apply MFG to autonomous vehicle velocity control. The MFG-based AV controller is shown to mitigate traffic jam faster than the LWR-based controller. MFG also embodies classical traffic flow models with behavioral interpretation, thereby providing a new traffic flow theory for AVs.
△ Less
Submitted 10 December, 2020; v1 submitted 14 March, 2019;
originally announced March 2019.
-
Correlations between zeros of a random polynomial
Authors:
Pavel Bleher,
Xiaojun Di
Abstract:
We obtain exact analytical expressions for correlations between real zeros of the Kac random polynomial. We show that the zeros in the interval $(-1,1)$ are asymptotically independent of the zeros outside of this interval, and that the straightened zeros have the same limit translation invariant correlations. Then we calculate the correlations between the straightened zeros of the SO(2) random p…
▽ More
We obtain exact analytical expressions for correlations between real zeros of the Kac random polynomial. We show that the zeros in the interval $(-1,1)$ are asymptotically independent of the zeros outside of this interval, and that the straightened zeros have the same limit translation invariant correlations. Then we calculate the correlations between the straightened zeros of the SO(2) random polynomial.
△ Less
Submitted 7 January, 2002; v1 submitted 4 January, 2002;
originally announced January 2002.