-
A Better Match for Drivers and Riders: Reinforcement Learning at Lyft
Authors:
Xabi Azagirre,
Akshay Balwally,
Guillaume Candeli,
Nicholas Chamandy,
Benjamin Han,
Alona King,
Hyungjun Lee,
Martin Loncaric,
Sebastien Martin,
Vijay Narasiman,
Zhiwei,
Qin,
Baptiste Richard,
Sara Smoot,
Sean Taylor,
Garrett van Ryzin,
Di Wu,
Fei Yu,
Alex Zamoshchin
Abstract:
To better match drivers to riders in our ridesharing application, we revised Lyft's core matching algorithm. We use a novel online reinforcement learning approach that estimates the future earnings of drivers in real time and use this information to find more efficient matches. This change was the first documented implementation of a ridesharing matching algorithm that can learn and improve in rea…
▽ More
To better match drivers to riders in our ridesharing application, we revised Lyft's core matching algorithm. We use a novel online reinforcement learning approach that estimates the future earnings of drivers in real time and use this information to find more efficient matches. This change was the first documented implementation of a ridesharing matching algorithm that can learn and improve in real time. We evaluated the new approach during weeks of switchback experimentation in most Lyft markets, and estimated how it benefited drivers, riders, and the platform. In particular, it enabled our drivers to serve millions of additional riders each year, leading to more than $30 million per year in incremental revenue. Lyft rolled out the algorithm globally in 2021.
△ Less
Submitted 13 November, 2023; v1 submitted 20 October, 2023;
originally announced October 2023.
-
A situated agent-based model to reveal irrigators' options behind their actions under institutional arrangements in Southern France
Authors:
Bastien Richard,
Bruno Bonté,
Olivier Barreteau,
Isabelle Braud
Abstract:
There has been little exploration of the explicit simulation of the set of options of actors in agent-based models and its evolution over time. This study proposes to use affordances as intermediate entities between agents' environment and agent actions. We illustrated the approach on a typical gravity-fed network in the South-East of France to explore how the abandonment of traditional sharing of…
▽ More
There has been little exploration of the explicit simulation of the set of options of actors in agent-based models and its evolution over time. This study proposes to use affordances as intermediate entities between agents' environment and agent actions. We illustrated the approach on a typical gravity-fed network in the South-East of France to explore how the abandonment of traditional sharing of water changes the irrigators' options to irrigate. We simulated a typical dry year irrigation season under two institutional arrangements (i.e. traditional coordination through daily slots and its abandonment). Simulation results are consistent with field surveys, and reveal an increase in the number of internal conflicts among irrigators as the counterpart of the abandonment of traditional sharing of water. They also highlight the consequences of the heterogeneity of the irrigators' interests within the collective institution. The sensitivity analysis of the model allowed identification of optimal modalities of coordination, and a potential compromise between past and current institutional arrangements. The key benefits of using affordances in ABM lie in the study of their population dynamics for characterizing the interaction situations between actors and their environment and for better understanding the model dynamics.
△ Less
Submitted 14 October, 2022;
originally announced November 2022.
-
An optical neural network using less than 1 photon per multiplication
Authors:
Tianyu Wang,
Shi-Yuan Ma,
Logan G. Wright,
Tatsuhiro Onodera,
Brian Richard,
Peter L. McMahon
Abstract:
Deep learning has rapidly become a widespread tool in both scientific and commercial endeavors. Milestones of deep learning exceeding human performance have been achieved for a growing number of tasks over the past several years, across areas as diverse as game-playing, natural-language translation, and medical-image analysis. However, continued progress is increasingly hampered by the high energy…
▽ More
Deep learning has rapidly become a widespread tool in both scientific and commercial endeavors. Milestones of deep learning exceeding human performance have been achieved for a growing number of tasks over the past several years, across areas as diverse as game-playing, natural-language translation, and medical-image analysis. However, continued progress is increasingly hampered by the high energy costs associated with training and running deep neural networks on electronic processors. Optical neural networks have attracted attention as an alternative physical platform for deep learning, as it has been theoretically predicted that they can fundamentally achieve higher energy efficiency than neural networks deployed on conventional digital computers. Here, we experimentally demonstrate an optical neural network achieving 99% accuracy on handwritten-digit classification using ~3.2 detected photons per weight multiplication and ~90% accuracy using ~0.64 photons (~$2.4 \times 10^{-19}$ J of optical energy) per weight multiplication. This performance was achieved using a custom free-space optical processor that executes matrix-vector multiplications in a massively parallel fashion, with up to ~0.5 million scalar (weight) multiplications performed at the same time. Using commercially available optical components and standard neural-network training methods, we demonstrated that optical neural networks can operate near the standard quantum limit with extremely low optical powers and still achieve high accuracy. Our results provide a proof-of-principle for low-optical-power operation, and with careful system design including the surrounding electronics used for data storage and control, open up a path to realizing optical processors that require only $10^{-16}$ J total energy per scalar multiplication -- which is orders of magnitude more efficient than current digital processors.
△ Less
Submitted 27 April, 2021;
originally announced April 2021.
-
BESS Optimal Sizing Methodology -Degree of Impact of Several Influencing Factors
Authors:
Benoît Richard,
Xavier Le Pivert,
Yves-Marie Bourien
Abstract:
Battery Energy Storage Systems (BESS) are more and more competitive due to their increasing performances and decreasing costs. Although certain battery storage technologies may be mature and reliable from a technological perspective, with further cost reductions expected, the economic concern of battery systems is still a major barrier to be overcome before BESS can be fully utilized as a mainstre…
▽ More
Battery Energy Storage Systems (BESS) are more and more competitive due to their increasing performances and decreasing costs. Although certain battery storage technologies may be mature and reliable from a technological perspective, with further cost reductions expected, the economic concern of battery systems is still a major barrier to be overcome before BESS can be fully utilized as a mainstream storage solution in the energy sector. Since the investment costs for deploying BESS are significant, one of the most crucial issues is to optimally size the battery system to balance the trade-off between using BESS to improve energy system performance and to achieve profitable investment. Determining the optimal BESS size for a specific application is a complex task because it relies on many factors, depending on the application itself, on the technical characteristics of the battery system and on the business model framework. This paper describes a generic simulation-based analytical method which has been developed to determine the BESS optimal size by taking into account both the application and the storage performance over its lifetime. Its implementation and the associated results are presented for two different BESS use cases: A smoothing and peak shaving application for PV injection and an off-grid hybrid microgrid case. In order to provide a better understanding of the most influencing drivers to consider during a BESS sizing procedure, several sensitivity analyses have been carried out on these two illustrative cases. The use of comparative scenarios led to quantify the degree of impact on optimal sizing results of several factors among the following topics: control strategy, forecast quality, degradation of battery performance due to ageing, precision of technical modelling.
△ Less
Submitted 13 November, 2020;
originally announced November 2020.
