-
Adaptive Road Configurations for Improved Autonomous Vehicle-Pedestrian Interactions using Reinforcement Learning
Authors:
Qiming Ye,
Yuxiang Feng,
Jose Javier Escribano Macias,
Marc Stettler,
Panagiotis Angeloudis
Abstract:
The deployment of Autonomous Vehicles (AVs) poses considerable challenges and unique opportunities for the design and management of future urban road infrastructure. In light of this disruptive transformation, the Right-Of-Way (ROW) composition of road space has the potential to be renewed. Design approaches and intelligent control models have been proposed to address this problem, but we lack an…
▽ More
The deployment of Autonomous Vehicles (AVs) poses considerable challenges and unique opportunities for the design and management of future urban road infrastructure. In light of this disruptive transformation, the Right-Of-Way (ROW) composition of road space has the potential to be renewed. Design approaches and intelligent control models have been proposed to address this problem, but we lack an operational framework that can dynamically generate ROW plans for AVs and pedestrians in response to real-time demand. Based on microscopic traffic simulation, this study explores Reinforcement Learning (RL) methods for evolving ROW compositions. We implement a centralised paradigm and a distributive learning paradigm to separately perform the dynamic control on several road network configurations. Experimental results indicate that the algorithms have the potential to improve traffic flow efficiency and allocate more space for pedestrians. Furthermore, the distributive learning algorithm outperforms its centralised counterpart regarding computational cost (49.55\%), benchmark rewards (25.35\%), best cumulative rewards (24.58\%), optimal actions (13.49\%) and rate of convergence. This novel road management technique could potentially contribute to the flow-adaptive and active mobility-friendly streets in the AVs era.
△ Less
Submitted 21 March, 2023;
originally announced March 2023.
-
Identifying Critical Fleet Sizes Using a Novel Agent-Based Modelling Framework for Autonomous Ride-Sourcing
Authors:
Renos Karamanis,
He-in Cheong,
Simon Hu,
Marc Stettler,
Panagiotis Angeloudis
Abstract:
Ride-sourcing platforms enable an on-demand shared transport service by solving decision problems often related to customer matching, pricing and vehicle routing. These problems have been frequently represented using aggregated mathematical models and solved via algorithmic approaches designed by researchers. The increasing complexity of ride-sourcing environments compromises the accuracy of aggre…
▽ More
Ride-sourcing platforms enable an on-demand shared transport service by solving decision problems often related to customer matching, pricing and vehicle routing. These problems have been frequently represented using aggregated mathematical models and solved via algorithmic approaches designed by researchers. The increasing complexity of ride-sourcing environments compromises the accuracy of aggregated methods. It, therefore, signals the need for alternative practices such as agent-based models which capture the level of complex dynamics in ride-sourcing systems. The use of these agent-based models to simulate ride-sourcing fleets has been a focal point of many studies; however, this occurred in the absence of a prescribed approach on how to build the models to mimic fleet operations realistically. To bridge this research gap, we provide a framework for building bespoke agent-based models for ride-sourcing fleets, derived from the fundamentals of agent-based modelling theory. We also introduce a model building sequence of the different modules necessary to structure a simulator based on our framework. To showcase the strength of our framework, we use it to tackle the highly non-linear problem of minimum fleet size estimation for autonomous ride-sourcing fleets. We do so by investigating the relationship of system parameters based on queuing theory principles and by deriving and validating a novel model for pickup wait times. By modelling the ride-sourcing fleet function in the urban areas of Manhattan, San Francisco, Paris and Barcelona, we find that ride-sourcing fleets operate queues with zero assignment times above the critical fleet size. We also show that pickup wait times have a pivotal role in the estimation of the minimum fleet size in ride-sourcing operations, with agent-based modelling to be a more reliable route for their identification given the system parameters.
△ Less
Submitted 22 November, 2020;
originally announced November 2020.
-
Vehicle Redistribution in Ride-Sourcing Markets using Convex Minimum Cost Flows
Authors:
Renos Karamanis,
Eleftherios Anastasiadis,
Marc Stettler,
Panagiotis Angeloudis
Abstract:
Ride-sourcing platforms often face imbalances in the demand and supply of rides across areas in their operating road-networks. As such, dynamic pricing methods have been used to mediate these demand asymmetries through surge price multipliers, thus incentivising higher driver participation in the market. However, the anticipated commercialisation of autonomous vehicles could transform the current…
▽ More
Ride-sourcing platforms often face imbalances in the demand and supply of rides across areas in their operating road-networks. As such, dynamic pricing methods have been used to mediate these demand asymmetries through surge price multipliers, thus incentivising higher driver participation in the market. However, the anticipated commercialisation of autonomous vehicles could transform the current ride-sourcing platforms to fleet operators. The absence of human drivers fosters the need for empty vehicle management to address any vehicle supply deficiencies. Proactive redistribution using integer programming and demand predictive models have been proposed in research to address this problem. A shortcoming of existing models, however, is that they ignore the market structure and underlying customer choice behaviour. As such, current models do not capture the real value of redistribution. To resolve this, we formulate the vehicle redistribution problem as a non-linear minimum cost flow problem which accounts for the relationship of supply and demand of rides, by assuming a customer discrete choice model and a market structure. We demonstrate that this model can have a convex domain, and we introduce an edge splitting algorithm to solve a transformed convex minimum cost flow problem for vehicle redistribution. By testing our model using simulation, we show that our redistribution algorithm can decrease wait times by more than 50%, increase profit up to 10% with less than 20% increase in vehicle mileage. Our findings outline that the value of redistribution is contingent on localised market structure and customer behaviour.
△ Less
Submitted 11 December, 2020; v1 submitted 14 June, 2020;
originally announced June 2020.
