-
Maximum-Entropy Multi-Agent Dynamic Games: Forward and Inverse Solutions
Authors:
Negar Mehr,
Mingyu Wang,
Mac Schwager
Abstract:
In this paper, we study the problem of multiple stochastic agents interacting in a dynamic game scenario with continuous state and action spaces. We define a new notion of stochastic Nash equilibrium for boundedly rational agents, which we call the Entropic Cost Equilibrium (ECE). We show that ECE is a natural extension to multiple agents of Maximum Entropy optimality for single agents. We solve b…
▽ More
In this paper, we study the problem of multiple stochastic agents interacting in a dynamic game scenario with continuous state and action spaces. We define a new notion of stochastic Nash equilibrium for boundedly rational agents, which we call the Entropic Cost Equilibrium (ECE). We show that ECE is a natural extension to multiple agents of Maximum Entropy optimality for single agents. We solve both the "forward" and "inverse" problems for the multi-agent ECE game. For the forward problem, we provide a Riccati algorithm to compute closed-form ECE feedback policies for the agents, which are exact in the Linear-Quadratic-Gaussian case. We give an iterative variant to find locally ECE feedback policies for the nonlinear case. For the inverse problem, we present an algorithm to infer the cost functions of the multiple interacting agents given noisy, boundedly rational input and state trajectory examples from agents acting in an ECE. The effectiveness of our algorithms is demonstrated in a simulated multi-agent collision avoidance scenario, and with data from the INTERACTION traffic dataset. In both cases, we show that, by taking into account the agents' game theoretic interactions using our algorithm, a more accurate model of agents' costs can be learned, compared with standard inverse optimal control methods.
△ Less
Submitted 3 October, 2021;
originally announced October 2021.
-
Congestion-aware Bi-modal Delivery Systems Utilizing Drones
Authors:
Mark Beliaev,
Negar Mehr,
Ramtin Pedarsani
Abstract:
Bi-modal delivery systems are a promising solution to the challenges posed by the increasing demand of e-commerce. Due to the potential benefit drones can have on logistics networks such as delivery systems, some countries have taken steps towards integrating drones into their airspace. In this paper we aim to quantify this potential by develo** a mathematical model for a Bi-modal delivery syste…
▽ More
Bi-modal delivery systems are a promising solution to the challenges posed by the increasing demand of e-commerce. Due to the potential benefit drones can have on logistics networks such as delivery systems, some countries have taken steps towards integrating drones into their airspace. In this paper we aim to quantify this potential by develo** a mathematical model for a Bi-modal delivery system composed of trucks and drones. We propose an optimization formulation that can be efficiently solved in order to design socially-optimal routing and allocation policies. We incorporate both societal cost in terms of road congestion and parcel delivery latency in our formulation. Our model is able to quantify the effect drones have on mitigating road congestion, and can solve for the path routing needed to minimize the chosen objective. To accurately capture the effect of stop** trucks on road latency, we model it using SUMO by simulating roads shared by trucks and cars. Based on this, we show that the proposed framework is computationally feasible to scale due to its reliance on convex quadratic optimization techniques.
△ Less
Submitted 9 June, 2022; v1 submitted 9 April, 2021;
originally announced April 2021.
-
Pricing Traffic Networks with Mixed Vehicle Autonomy
Authors:
Negar Mehr,
Roberto Horowitz
Abstract:
In a traffic network, vehicles normally select their routes selfishly. Consequently, traffic networks normally operate at an equilibrium characterized by Wardrop conditions. However, it is well known that equilibria are inefficient in general. In addition to the intrinsic inefficiency of equilibria, the authors recently showed that, in mixed-autonomy networks in which autonomous vehicles maintain…
▽ More
In a traffic network, vehicles normally select their routes selfishly. Consequently, traffic networks normally operate at an equilibrium characterized by Wardrop conditions. However, it is well known that equilibria are inefficient in general. In addition to the intrinsic inefficiency of equilibria, the authors recently showed that, in mixed-autonomy networks in which autonomous vehicles maintain a shorter headway than human-driven cars, increasing the fraction of autonomous vehicles in the network may increase the inefficiency of equilibria. In this work, we study the possibility of obviating the inefficiency of equilibria in mixed-autonomy traffic networks via pricing mechanisms. In particular, we study assigning prices to network links such that the overall or social delay of the resulting equilibria is minimum. First, we study the possibility of inducing such optimal equilibria by imposing a set of undifferentiated prices, i.e. a set of prices that treat both human-driven and autonomous vehicles similarly at each link. We provide an example which demonstrates that undifferentiated pricing is not sufficient for achieving minimum social delay. Then, we study differentiated pricing where the price of traversing each link may depend on whether vehicles are human-driven or autonomous. Under differentiated pricing, we prove that link prices obtained from the marginal cost taxation of links will induce equilibria with minimum social delay if the degree of road capacity asymmetry (i.e. the ratio between the road capacity when all vehicles are human-driven and the road capacity when all vehicles are autonomous) is homogeneous among network links.
△ Less
Submitted 2 April, 2019;
originally announced April 2019.
-
How Will the Presence of Autonomous Vehicles Affect the Equilibrium State of Traffic Networks?
Authors:
Negar Mehr,
Roberto Horowitz
Abstract:
It is known that connected and autonomous vehicles are capable of maintaining shorter headways and distances when they form platoons of vehicles. Thus, such technologies can result in increases in the capacities of traffic networks. Consequently, it is envisioned that their deployment will boost the network mobility. In this paper, we verify the validity of this impact under selfish routing behavi…
▽ More
It is known that connected and autonomous vehicles are capable of maintaining shorter headways and distances when they form platoons of vehicles. Thus, such technologies can result in increases in the capacities of traffic networks. Consequently, it is envisioned that their deployment will boost the network mobility. In this paper, we verify the validity of this impact under selfish routing behavior of drivers in traffic networks with mixed autonomy, i.e. traffic networks with both regular and autonomous vehicles. We consider a nonatomic routing game on a network with inelastic (fixed) demands for the set of network O/D pairs, and study how replacing a fraction of regular vehicles by autonomous vehicles will affect the mobility of the network. Using the well known US bureau of public roads (BPR) traffic delay models, we show that the resulting Wardrop equilibrium is not necessarily unique even in its weak sense for networks with mixed autonomy. We state the conditions under which the total network delay is guaranteed not to increase as a result of autonomy increase. However, we show that when these conditions do not hold, counter intuitive behaviors may occur: the total delay can grow by increasing the network autonomy. In particular, we prove that for networks with a single O/D pair, if the road degrees of asymmetry are homogeneous, the total delay is 1) unique, and 2) a nonincreasing continuous function of network autonomy fraction. We show that for heterogeneous degrees of asymmetry, the total delay is not unique, and it can further grow with autonomy increase. We demonstrate that similar behaviors may be observed in networks with multiple O/D pairs. We further bound such performance degradations due to the introduction of autonomy in homogeneous networks.
△ Less
Submitted 16 January, 2019;
originally announced January 2019.
-
A Game Theoretic Macroscopic Model of Bypassing at Traffic Diverges with Applications to Mixed Autonomy Networks
Authors:
Negar Mehr,
Ruolin Li,
Roberto Horowitz
Abstract:
Vehicle bypassing is known to negatively affect delays at traffic diverges. However, due to the complexities of this phenomenon, accurate and yet simple models of such lane change maneuvers are hard to develop. In this work, we present a macroscopic model for predicting the number of vehicles that bypass at a traffic diverge. We take into account the selfishness of vehicles in selecting their lane…
▽ More
Vehicle bypassing is known to negatively affect delays at traffic diverges. However, due to the complexities of this phenomenon, accurate and yet simple models of such lane change maneuvers are hard to develop. In this work, we present a macroscopic model for predicting the number of vehicles that bypass at a traffic diverge. We take into account the selfishness of vehicles in selecting their lanes; every vehicle selects lanes such that its own cost is minimized. We discuss how we model the costs experienced by the vehicles. Then, taking into account the selfish behavior of the vehicles, we model the lane choice of vehicles at a traffic diverge as a Wardrop equilibrium. We state and prove the properties of Wardrop equilibrium in our model. We show that there always exists an equilibrium for our model. Moreover, unlike most nonlinear asymmetrical routing games, we prove that the equilibrium is unique under mild assumptions. We discuss how our model can be easily calibrated by running a simple optimization problem. Using our calibrated model, we validate it through simulation studies and demonstrate that our model successfully predicts the aggregate lane change maneuvers that are performed by vehicles for bypassing at a traffic diverge. We further discuss how our model can be employed to obtain the optimal lane choice behavior of the vehicles, where the social or total cost of vehicles is minimized. Finally, we demonstrate how our model can be utilized in scenarios where a central authority can dictate the lane choice and trajectory of certain vehicles so as to increase the overall vehicle mobility at a traffic diverge. Examples of such scenarios include the case when both human driven and autonomous vehicles coexist in the network. We show how certain decisions of the central authority can affect the total delays in such scenarios via an example.
△ Less
Submitted 8 September, 2018;
originally announced September 2018.
