-
On countering adversarial perturbations in graphs using error correcting codes
Authors:
Saif Eddin Jabari
Abstract:
We consider the problem of a graph subjected to adversarial perturbations, such as those arising from cyber-attacks, where edges are covertly added or removed. The adversarial perturbations occur during the transmission of the graph between a sender and a receiver. To counteract potential perturbations, we explore a repetition coding scheme with sender-assigned binary noise and majority voting on…
▽ More
We consider the problem of a graph subjected to adversarial perturbations, such as those arising from cyber-attacks, where edges are covertly added or removed. The adversarial perturbations occur during the transmission of the graph between a sender and a receiver. To counteract potential perturbations, we explore a repetition coding scheme with sender-assigned binary noise and majority voting on the receiver's end to rectify the graph's structure. Our approach operates without prior knowledge of the attack's characteristics. We provide an analytical derivation of a bound on the number of repetitions needed to satisfy probabilistic constraints on the quality of the reconstructed graph. We show that the method can accurately decode graphs that were subjected to non-random edge removal, namely, those connected to vertices with the highest eigenvector centrality, in addition to random addition and removal of edges by the attacker.
△ Less
Submitted 20 June, 2024;
originally announced June 2024.
-
Fourier neural operator for learning solutions to macroscopic traffic flow models: Application to the forward and inverse problems
Authors:
Bilal Thonnam Thodi,
Sai Venkata Ramana Ambadipudi,
Saif Eddin Jabari
Abstract:
Deep learning methods are emerging as popular computational tools for solving forward and inverse problems in traffic flow. In this paper, we study a neural operator framework for learning solutions to nonlinear hyperbolic partial differential equations with applications in macroscopic traffic flow models. In this framework, an operator is trained to map heterogeneous and sparse traffic input data…
▽ More
Deep learning methods are emerging as popular computational tools for solving forward and inverse problems in traffic flow. In this paper, we study a neural operator framework for learning solutions to nonlinear hyperbolic partial differential equations with applications in macroscopic traffic flow models. In this framework, an operator is trained to map heterogeneous and sparse traffic input data to the complete macroscopic traffic state in a supervised learning setting. We chose a physics-informed Fourier neural operator ($π$-FNO) as the operator, where an additional physics loss based on a discrete conservation law regularizes the problem during training to improve the shock predictions. We also propose to use training data generated from random piecewise constant input data to systematically capture the shock and rarefied solutions. From experiments using the LWR traffic flow model, we found superior accuracy in predicting the density dynamics of a ring-road network and urban signalized road. We also found that the operator can be trained using simple traffic density dynamics, e.g., consisting of $2-3$ vehicle queues and $1-2$ traffic signal cycles, and it can predict density dynamics for heterogeneous vehicle queue distributions and multiple traffic signal cycles $(\geq 2)$ with an acceptable error. The extrapolation error grew sub-linearly with input complexity for a proper choice of the model architecture and training data. Adding a physics regularizer aided in learning long-term traffic density dynamics, especially for problems with periodic boundary data.
△ Less
Submitted 8 December, 2023; v1 submitted 14 August, 2023;
originally announced August 2023.
-
Optimal Smoothing Distribution Exploration for Backdoor Neutralization in Deep Learning-based Traffic Systems
Authors:
Yue Wang,
Wending Li,
Michail Maniatakos,
Saif Eddin Jabari
Abstract:
Deep Reinforcement Learning (DRL) enhances the efficiency of Autonomous Vehicles (AV), but also makes them susceptible to backdoor attacks that can result in traffic congestion or collisions. Backdoor functionality is typically incorporated by contaminating training datasets with covert malicious data to maintain high precision on genuine inputs while inducing the desired (malicious) outputs for s…
▽ More
Deep Reinforcement Learning (DRL) enhances the efficiency of Autonomous Vehicles (AV), but also makes them susceptible to backdoor attacks that can result in traffic congestion or collisions. Backdoor functionality is typically incorporated by contaminating training datasets with covert malicious data to maintain high precision on genuine inputs while inducing the desired (malicious) outputs for specific inputs chosen by adversaries. Current defenses against backdoors mainly focus on image classification using image-based features, which cannot be readily transferred to the regression task of DRL-based AV controllers since the inputs are continuous sensor data, i.e., the combinations of velocity and distance of AV and its surrounding vehicles. Our proposed method adds well-designed noise to the input to neutralize backdoors. The approach involves learning an optimal smoothing (noise) distribution to preserve the normal functionality of genuine inputs while neutralizing backdoors. By doing so, the resulting model is expected to be more resilient against backdoor attacks while maintaining high accuracy on genuine inputs. The effectiveness of the proposed method is verified on a simulated traffic system based on a microscopic traffic simulator, where experimental results showcase that the smoothed traffic controller can neutralize all trigger samples and maintain the performance of relieving traffic congestion
△ Less
Submitted 24 March, 2023;
originally announced March 2023.
-
Physical Backdoor Trigger Activation of Autonomous Vehicle using Reachability Analysis
Authors:
Wenqing Li,
Yue Wang,
Muhammad Shafique,
Saif Eddin Jabari
Abstract:
Recent studies reveal that Autonomous Vehicles (AVs) can be manipulated by hidden backdoors, causing them to perform harmful actions when activated by physical triggers. However, it is still unclear how these triggers can be activated while adhering to traffic principles. Understanding this vulnerability in a dynamic traffic environment is crucial. This work addresses this gap by presenting physic…
▽ More
Recent studies reveal that Autonomous Vehicles (AVs) can be manipulated by hidden backdoors, causing them to perform harmful actions when activated by physical triggers. However, it is still unclear how these triggers can be activated while adhering to traffic principles. Understanding this vulnerability in a dynamic traffic environment is crucial. This work addresses this gap by presenting physical trigger activation as a reachability problem of controlled dynamic system. Our technique identifies security-critical areas in traffic systems where trigger conditions for accidents can be reached, and provides intended trajectories for how those conditions can be reached. Testing on typical traffic scenarios showed the system can be successfully driven to trigger conditions with near 100% activation rate. Our method benefits from identifying AV vulnerability and enabling effective safety strategies.
△ Less
Submitted 27 March, 2023; v1 submitted 24 March, 2023;
originally announced March 2023.
-
Learning-based solutions to nonlinear hyperbolic PDEs: Empirical insights on generalization errors
Authors:
Bilal Thonnam Thodi,
Sai Venkata Ramana Ambadipudi,
Saif Eddin Jabari
Abstract:
We study learning weak solutions to nonlinear hyperbolic partial differential equations (H-PDE), which have been difficult to learn due to discontinuities in their solutions. We use a physics-informed variant of the Fourier Neural Operator ($π$-FNO) to learn the weak solutions. We empirically quantify the generalization/out-of-sample error of the $π$-FNO solver as a function of input complexity, i…
▽ More
We study learning weak solutions to nonlinear hyperbolic partial differential equations (H-PDE), which have been difficult to learn due to discontinuities in their solutions. We use a physics-informed variant of the Fourier Neural Operator ($π$-FNO) to learn the weak solutions. We empirically quantify the generalization/out-of-sample error of the $π$-FNO solver as a function of input complexity, i.e., the distributions of initial and boundary conditions. Our testing results show that $π$-FNO generalizes well to unseen initial and boundary conditions. We find that the generalization error grows linearly with input complexity. Further, adding a physics-informed regularizer improved the prediction of discontinuities in the solution. We use the Lighthill-Witham-Richards (LWR) traffic flow model as a guiding example to illustrate the results.
△ Less
Submitted 16 February, 2023;
originally announced February 2023.
-
Generalized adaptive smoothing based neural network architecture for traffic state estimation
Authors:
Chuhan Yang,
Sai Venkata Ramana Ambadipudi,
Saif Eddin Jabari
Abstract:
The adaptive smoothing method (ASM) is a standard data-driven technique used in traffic state estimation. The ASM has free parameters which, in practice, are chosen to be some generally acceptable values based on intuition. However, we note that the heuristically chosen values often result in un-physical predictions by the ASM. In this work, we propose a neural network based on the ASM which tunes…
▽ More
The adaptive smoothing method (ASM) is a standard data-driven technique used in traffic state estimation. The ASM has free parameters which, in practice, are chosen to be some generally acceptable values based on intuition. However, we note that the heuristically chosen values often result in un-physical predictions by the ASM. In this work, we propose a neural network based on the ASM which tunes those parameters automatically by learning from sparse data from road sensors. We refer to it as the adaptive smoothing neural network (ASNN). We also propose a modified ASNN (MASNN), which makes it a strong learner by using ensemble averaging. The ASNN and MASNN are trained and tested two real-world datasets. Our experiments reveal that the ASNN and the MASNN outperform the conventional ASM.
△ Less
Submitted 9 January, 2023;
originally announced January 2023.
-
Stationary states in two lane traffic: insights from kinetic theory
Authors:
A. Sai Venkata Ramana,
Saif Eddin Jabari
Abstract:
Kinetics of dilute heterogeneous traffic on a two lane road is formulated in the framework of the Ben-Naim Krapivsky model and stationary state properties are analytically derived in the asymptotic limit. The heterogeneity is introduced as a quenched disorder in desired speeds of vehicles. The model assumes that each vehicle/platoon in a lane moves ballistically until it approaches a slow moving v…
▽ More
Kinetics of dilute heterogeneous traffic on a two lane road is formulated in the framework of the Ben-Naim Krapivsky model and stationary state properties are analytically derived in the asymptotic limit. The heterogeneity is introduced as a quenched disorder in desired speeds of vehicles. The model assumes that each vehicle/platoon in a lane moves ballistically until it approaches a slow moving vehicle/platoon and then joins it. Vehicles in a platoon are assumed to escape the platoon at a constant rate by changing lanes. Each lane is assumed to have a different escape rate. As the stationary state is approached, the platoon density in the two lanes become equal, whereas the vehicle densities and fluxes are higher in the lane with lower escape rate. A majority of the vehicles enjoy a free-flow if the harmonic mean of the escape rates of the lanes is comparable to average initial flux on the road. The average platoon size is close to unity in the free-flow regime. If the harmonic mean is lower than the average initial flux, then vehicles with desired speeds lower than a characteristic speed $v^*$ still enjoy free-flow while those vehicles with desired speeds that are greater than $v^*$ experience congestion and form platoons behind the slower vehicles. The characteristic speed depends on the mean of escape times $(R=(R_1+R_{-1})/2)$ of the two lanes (represented by 1 and -1) as $v^* \sim R^{-\frac{1}{μ+2}}$, where $μ$ is the exponent of the quenched disorder distribution for desired speed in the small speed limit. The average platoon size in a lane, when $v^* \ll 1$, is proportional to $R^{\frac{μ+1}{μ+2}}$ plus a lane dependent correction. Equations for the kinetics of platoon size distribution for two-lane traffic are also studied. It is shown that a stationary state with platoons as large as road length can occur only if the mean escape rate is independent of platoon size.
△ Less
Submitted 7 June, 2022;
originally announced June 2022.
-
Generalized Adaptive Smoothing Using Matrix Completion for Traffic State Estimation
Authors:
Chuhan Yang,
Bilal Thonnam Thodi,
Saif Eddin Jabari
Abstract:
The Adaptive Smoothing Method (ASM) is a data-driven approach for traffic state estimation. It interpolates unobserved traffic quantities by smoothing measurements along spatio-temporal directions defined by characteristic traffic wave speeds. The standard ASM consists of a superposition of two a priori estimates weighted by a heuristic weight factor. In this paper, we propose a systematic procedu…
▽ More
The Adaptive Smoothing Method (ASM) is a data-driven approach for traffic state estimation. It interpolates unobserved traffic quantities by smoothing measurements along spatio-temporal directions defined by characteristic traffic wave speeds. The standard ASM consists of a superposition of two a priori estimates weighted by a heuristic weight factor. In this paper, we propose a systematic procedure to calculate the optimal weight factors. We formulate the a priori weights calculation as a constrained matrix completion problem, and efficiently solve it using the Alternating Direction Method of Multipliers (ADMM) algorithm. Our framework allows one to further improve the conventional ASM, which is limited by utilizing only one pair of congested and free flow wave speeds, by considering multiple wave speeds. Our proposed algorithm does not require any field-dependent traffic parameters, thus bypassing frequent field calibrations as required by the conventional ASM. Experiments using NGSIM data show that the proposed ADMM-based estimation incurs lower error than the ASM estimation.
△ Less
Submitted 3 June, 2022;
originally announced June 2022.
-
PiDAn: A Coherence Optimization Approach for Backdoor Attack Detection and Mitigation in Deep Neural Networks
Authors:
Yue Wang,
Wenqing Li,
Esha Sarkar,
Muhammad Shafique,
Michail Maniatakos,
Saif Eddin Jabari
Abstract:
Backdoor attacks impose a new threat in Deep Neural Networks (DNNs), where a backdoor is inserted into the neural network by poisoning the training dataset, misclassifying inputs that contain the adversary trigger. The major challenge for defending against these attacks is that only the attacker knows the secret trigger and the target class. The problem is further exacerbated by the recent introdu…
▽ More
Backdoor attacks impose a new threat in Deep Neural Networks (DNNs), where a backdoor is inserted into the neural network by poisoning the training dataset, misclassifying inputs that contain the adversary trigger. The major challenge for defending against these attacks is that only the attacker knows the secret trigger and the target class. The problem is further exacerbated by the recent introduction of "Hidden Triggers", where the triggers are carefully fused into the input, bypassing detection by human inspection and causing backdoor identification through anomaly detection to fail. To defend against such imperceptible attacks, in this work we systematically analyze how representations, i.e., the set of neuron activations for a given DNN when using the training data as inputs, are affected by backdoor attacks. We propose PiDAn, an algorithm based on coherence optimization purifying the poisoned data. Our analysis shows that representations of poisoned data and authentic data in the target class are still embedded in different linear subspaces, which implies that they show different coherence with some latent spaces. Based on this observation, the proposed PiDAn algorithm learns a sample-wise weight vector to maximize the projected coherence of weighted samples, where we demonstrate that the learned weight vector has a natural "grou** effect" and is distinguishable between authentic data and poisoned data. This enables the systematic detection and mitigation of backdoor attacks. Based on our theoretical analysis and experimental results, we demonstrate the effectiveness of PiDAn in defending against backdoor attacks that use different settings of poisoned samples on GTSRB and ILSVRC2012 datasets. Our PiDAn algorithm can detect more than 90% infected classes and identify 95% poisoned samples.
△ Less
Submitted 26 March, 2022; v1 submitted 17 March, 2022;
originally announced March 2022.
-
Learning Traffic Speed Dynamics from Visualizations
Authors:
Bilal Thonnam Thodi,
Zaid Saeed Khan,
Saif Eddin Jabari,
Monica Menendez
Abstract:
Space-time visualizations of macroscopic or microscopic traffic variables is a qualitative tool used by traffic engineers to understand and analyze different aspects of road traffic dynamics. We present a deep learning method to learn the macroscopic traffic speed dynamics from these space-time visualizations, and demonstrate its application in the framework of traffic state estimation. Compared t…
▽ More
Space-time visualizations of macroscopic or microscopic traffic variables is a qualitative tool used by traffic engineers to understand and analyze different aspects of road traffic dynamics. We present a deep learning method to learn the macroscopic traffic speed dynamics from these space-time visualizations, and demonstrate its application in the framework of traffic state estimation. Compared to existing estimation approaches, our approach allows a finer estimation resolution, eliminates the dependence on the initial conditions, and is agnostic to external factors such as traffic demand, road inhomogeneities and driving behaviors. Our model respects causality in traffic dynamics, which improves the robustness of estimation. We present the high-resolution traffic speed fields estimated for several freeway sections using the data obtained from the Next Generation Simulation Program (NGSIM) and German Highway (HighD) datasets. We further demonstrate the quality and utility of the estimation by inferring vehicle trajectories from the estimated speed fields, and discuss the benefits of deep neural network models in approximating the traffic dynamics.
△ Less
Submitted 4 May, 2021;
originally announced May 2021.
-
Incorporating Kinematic Wave Theory into a Deep Learning Method for High-Resolution Traffic Speed Estimation
Authors:
Bilal Thonnam Thodi,
Zaid Saeed Khan,
Saif Eddin Jabari,
Monica Menendez
Abstract:
We propose a kinematic wave-based Deep Convolutional Neural Network (Deep CNN) to estimate high-resolution traffic speed fields from sparse probe vehicle trajectories. We introduce two key approaches that allow us to incorporate kinematic wave theory principles to improve the robustness of existing learning-based estimation methods. First, we propose an anisotropic traffic kernel for the Deep CNN.…
▽ More
We propose a kinematic wave-based Deep Convolutional Neural Network (Deep CNN) to estimate high-resolution traffic speed fields from sparse probe vehicle trajectories. We introduce two key approaches that allow us to incorporate kinematic wave theory principles to improve the robustness of existing learning-based estimation methods. First, we propose an anisotropic traffic kernel for the Deep CNN. The anisotropic kernel explicitly accounts for space-time correlations in macroscopic traffic and effectively reduces the number of trainable parameters in the Deep CNN model. Second, we propose to use simulated data for training the Deep CNN. Using a targeted simulated data for training provides an implicit way to impose desirable traffic physical features on the learning model. In the experiments, we highlight the benefits of using anisotropic kernels and evaluate the transferability of the trained model to real-world traffic using the Next Generation Simulation (NGSIM) and the German Highway Drone (HighD) datasets. The results demonstrate that anisotropic kernels significantly reduce model complexity and model over-fitting, and improve the physical correctness of the estimated speed fields. We find that model complexity scales linearly with problem size for anisotropic kernels compared to quadratic scaling for isotropic kernels. Furthermore, evaluation on real-world datasets shows acceptable performance, which establishes that simulation-based training is a viable surrogate to learning from real-world data. Finally, a comparison with standard estimation techniques shows the superior estimation accuracy of the proposed method.
△ Less
Submitted 12 February, 2022; v1 submitted 4 February, 2021;
originally announced February 2021.
-
Power laws and phase transitions in heterogenous car following with reaction times
Authors:
A. Sai Venkata Ramana,
Saif Eddin Jabari
Abstract:
We study the effect of reaction times on the kinetics of relaxation to stationary states and on congestion transitions in heterogeneous traffic. Heterogeneity is modeled as quenched disorders in the parameters of the car following model and in the reaction times of the drivers. We observed that at low densities, the relaxation to stationary state from a homogeneous initial state is governed by the…
▽ More
We study the effect of reaction times on the kinetics of relaxation to stationary states and on congestion transitions in heterogeneous traffic. Heterogeneity is modeled as quenched disorders in the parameters of the car following model and in the reaction times of the drivers. We observed that at low densities, the relaxation to stationary state from a homogeneous initial state is governed by the same power laws as derived by E. Ben-Naim et al., Kinetics of clustering in traffic flow, Phys. Rev. E 50, 822 (1994). The stationary state, at low densities, is a single giant platoon of vehicles with the slowest vehicle being the leader. We observed formation of spontaneous jams inside the giant platoon which move upstream as stop-go waves and dissipate at its tail. The transition happens when the head of the giant platoon interacts with its tail, stable stop-go waves form, which circulate in the ring without dissipating. We observed that the system behaves differently when the transition density is approached from above that it does when approached from below. When the transition density is approached from below, the gap distribution behind the leader has a double peak and is fat-tailed but has a bounded support and thus the maximum gap in the system and the variance of the gap distribution tend to size-independent values. When the transition density is approached from above, the gap distribution becomes a power law and, consequently, the maximum gap in the system and the variance in the gaps diverge as a power law, thereby creating a discontinuity at the transition. Thus, we observe a phase transition of unusual kind in which both a discontinuity and a power law are observed at the transition density. These unusual features vanish in the absence of reaction time (e.g., automated driving).
△ Less
Submitted 27 February, 2021; v1 submitted 3 February, 2021;
originally announced February 2021.
-
A Real-Time Dispatching Strategy for Shared Automated Electric Vehicles with Performance Guarantees
Authors:
Li Li,
Theodoros Pantelidis,
Joseph Y. J. Chow,
Saif Eddin Jabari
Abstract:
Real-time vehicle dispatching operations in traditional car-sharing systems is an already computationally challenging scheduling problem. Electrification only exacerbates the computational difficulties as charge level constraints come into play. To overcome this complexity, we employ an online minimum drift plus penalty (MDPP) approach for SAEV systems that (i) does not require a priori knowledge…
▽ More
Real-time vehicle dispatching operations in traditional car-sharing systems is an already computationally challenging scheduling problem. Electrification only exacerbates the computational difficulties as charge level constraints come into play. To overcome this complexity, we employ an online minimum drift plus penalty (MDPP) approach for SAEV systems that (i) does not require a priori knowledge of customer arrival rates to the different parts of the system (i.e. it is practical from a real-world deployment perspective), (ii) ensures the stability of customer waiting times, (iii) ensures that the deviation of dispatch costs from a desirable dispatch cost can be controlled, and (iv) has a computational time-complexity that allows for real-time implementation. Using an agent-based simulator developed for SAEV systems, we test the MDPP approach under two scenarios with real-world calibrated demand and charger distributions: 1) a low-demand scenario with long trips, and 2) a high-demand scenario with short trips. The comparisons with other algorithms under both scenarios show that the proposed online MDPP outperforms all other algorithms in terms of both reduced customer waiting times and vehicle dispatching costs.
△ Less
Submitted 8 June, 2021; v1 submitted 28 June, 2020;
originally announced June 2020.
-
Backpressure Control with Estimated Queue Lengths for Urban Network Traffic
Authors:
Li Li,
Victor Okoth,
Saif Eddin Jabari
Abstract:
Backpressure (BP) control was originally used for packet routing in communications networks. Since its first application to network traffic control, it has undergone different modifications to tailor it to traffic problems with promising results. Most of these BP variants are based on an assumption of perfect knowledge of traffic conditions throughout the network at all times, specifically the que…
▽ More
Backpressure (BP) control was originally used for packet routing in communications networks. Since its first application to network traffic control, it has undergone different modifications to tailor it to traffic problems with promising results. Most of these BP variants are based on an assumption of perfect knowledge of traffic conditions throughout the network at all times, specifically the queue lengths (more accurately, the traffic volumes). However, it has been well established that accurate queue length information at signalized intersections is never available except in fully connected environments. Although connected vehicle technologies are develo** quickly, we are still far from a fully connected environment in the real world. This paper test the effectiveness of BP control when incomplete or imperfect knowledge about traffic conditions is available. We combine BP control with a speed/density field estimation module suitable for a partially connected environment. We refer to the proposed system as a BP with estimated queue lengths (BP-EQ). We test the robustness of BP-EQ to varying levels of connected vehicle penetration, and we compared BP-EQ with the original BP (i.e., assuming accurate knowledge of traffic conditions), a real-world adaptive signal controller, and optimized fixed timing control using microscopic traffic simulation with field calibrated data. Our results show that with a connected vehicle penetration rate as little as 10%, BP-EQ can outperform the adaptive controller and the fixed timing controller in terms of average delay, throughput, and maximum stopped queue lengths under high demand scenarios.
△ Less
Submitted 18 November, 2020; v1 submitted 28 June, 2020;
originally announced June 2020.
-
Short-Term Traffic Forecasting Using High-Resolution Traffic Data
Authors:
Wenqing Li,
Chuhan Yang,
Saif Eddin Jabari
Abstract:
This paper develops a data-driven toolkit for traffic forecasting using high-resolution (a.k.a. event-based) traffic data. This is the raw data obtained from fixed sensors in urban roads. Time series of such raw data exhibit heavy fluctuations from one time step to the next (typically on the order of 0.1-1 second). Short-term forecasts (10-30 seconds into the future) of traffic conditions are crit…
▽ More
This paper develops a data-driven toolkit for traffic forecasting using high-resolution (a.k.a. event-based) traffic data. This is the raw data obtained from fixed sensors in urban roads. Time series of such raw data exhibit heavy fluctuations from one time step to the next (typically on the order of 0.1-1 second). Short-term forecasts (10-30 seconds into the future) of traffic conditions are critical for traffic operations applications (e.g., adaptive signal control). But traffic forecasting tools in the literature deal predominantly with 3-5 minute aggregated data, where the typical signal cycle is on the order of 2 minutes. This renders such forecasts useless at the operations level. To this end, we model the traffic forecasting problem as a matrix completion problem, where the forecasting inputs are mapped to a higher dimensional space using kernels. The formulation allows us to capture both nonlinear dependencies between forecasting inputs and outputs but also allows us to capture dependencies among the inputs. These dependencies correspond to correlations between different locations in the network. We further employ adaptive boosting to enhance the training accuracy and capture historical patterns in the data. The performance of the proposed methods is verified using high-resolution data obtained from a real-world traffic network in Abu Dhabi, UAE. Our experimental results show that the proposed method outperforms other state-of-the-art algorithms.
△ Less
Submitted 22 June, 2020;
originally announced June 2020.
-
Comparative Analysis of Economic Instruments in Intersection Operation: A User-Based Perspective
Authors:
DianChao Lin,
Saif Eddin Jabari
Abstract:
Focusing on different economic instruments implemented in intersection operations under a connected environment, this paper analyzes their advantages and disadvantages from the travelers' perspective. Travelers' concerns revolve around whether a new instrument is easy to learn and operate, whether it can save time or money, and whether it can reduce the rich-poor gap. After a comparative analysis,…
▽ More
Focusing on different economic instruments implemented in intersection operations under a connected environment, this paper analyzes their advantages and disadvantages from the travelers' perspective. Travelers' concerns revolve around whether a new instrument is easy to learn and operate, whether it can save time or money, and whether it can reduce the rich-poor gap. After a comparative analysis, we found that both credit and free-market schemes can benefit users. Second-price auctions can only benefit high VOT vehicles. From the perspective of technology deployment and adoption, a credit scheme is not easy to learn and operate for travelers.
△ Less
Submitted 15 June, 2020;
originally announced June 2020.
-
A User-Based Charge and Subsidy Scheme for Single O-D Network Mobility Management
Authors:
Li Li,
Dianchao Lin,
Saif Eddin Jabari
Abstract:
We propose a path guidance system with a user-based charge and subsidy (UBCS) scheme for single O-D network mobility management. Users who are willing to join the scheme (subscribers) can submit travel requests along with their VOTs to the system before traveling. Those who are not willing to join (outsiders) only need to submit travel requests to the system. Our system will give all users path gu…
▽ More
We propose a path guidance system with a user-based charge and subsidy (UBCS) scheme for single O-D network mobility management. Users who are willing to join the scheme (subscribers) can submit travel requests along with their VOTs to the system before traveling. Those who are not willing to join (outsiders) only need to submit travel requests to the system. Our system will give all users path guidance from their origins to their destinations, and collect a \emph{path payment} from the UBCS subscribers. Subscribers will be charged or subsided in a way that renders the UBCS strategy-proof, revenue-neutral, and Pareto-improving. A numerical example shows that the UBCS scheme is equitable and progressive.
△ Less
Submitted 15 June, 2020;
originally announced June 2020.
-
Stop-and-Go: Exploring Backdoor Attacks on Deep Reinforcement Learning-based Traffic Congestion Control Systems
Authors:
Yue Wang,
Esha Sarkar,
Wenqing Li,
Michail Maniatakos,
Saif Eddin Jabari
Abstract:
Recent work has shown that the introduction of autonomous vehicles (AVs) in traffic could help reduce traffic jams. Deep reinforcement learning methods demonstrate good performance in complex control problems, including autonomous vehicle control, and have been used in state-of-the-art AV controllers. However, deep neural networks (DNNs) render automated driving vulnerable to machine learning-base…
▽ More
Recent work has shown that the introduction of autonomous vehicles (AVs) in traffic could help reduce traffic jams. Deep reinforcement learning methods demonstrate good performance in complex control problems, including autonomous vehicle control, and have been used in state-of-the-art AV controllers. However, deep neural networks (DNNs) render automated driving vulnerable to machine learning-based attacks. In this work, we explore the backdooring/trojanning of DRL-based AV controllers. We develop a trigger design methodology that is based on well-established principles of traffic physics. The malicious actions include vehicle deceleration and acceleration to cause stop-and-go traffic waves to emerge (congestion attacks) or AV acceleration resulting in the AV crashing into the vehicle in front (insurance attack). We test our attack on single-lane and two-lane circuits. Our experimental results show that the backdoored model does not compromise normal operation performance, with the maximum decrease in cumulative rewards being 1%. Still, it can be maliciously activated to cause a crash or congestion when the corresponding triggers appear.
△ Less
Submitted 26 August, 2021; v1 submitted 17 March, 2020;
originally announced March 2020.
-
Traffic flow with multiple quenched disorders
Authors:
A. Sai Venkata Ramana,
Saif Eddin Jabari
Abstract:
We study heterogeneous traffic dynamics by introducing quenched disorders in all the parameters of Newell's car-following model. Specifically, we consider randomness in the free-flow speed, the jam density, and the backward wave speed. The quenched disorders are modeled using beta distributions. It is observed that, at low densities, the average platoon size and the average speed of vehicles evolv…
▽ More
We study heterogeneous traffic dynamics by introducing quenched disorders in all the parameters of Newell's car-following model. Specifically, we consider randomness in the free-flow speed, the jam density, and the backward wave speed. The quenched disorders are modeled using beta distributions. It is observed that, at low densities, the average platoon size and the average speed of vehicles evolve as power-laws in time as derived by Ben-Naim, Krapivsky, and Redner (BKR). No power-law behavior has been observed in the time evolution of the second moment of density and density distribution function indicating no equivalence between the present system and the sticky gas. As opposed to a totally asymmetric simple exclusion process (TASEP), we found no power-law behavior in the stationary gap distribution and the transition from the platoon forming phase to the laminar phase coincides with the free-flow to congestion transition and is always of first-order, independent of the quenched disorder in the free-flow speed. Using mean-field theory, we derived the gap distribution of vehicles and showed that the phase transition is always of first-order, independent of the quenched disorder in the free-flow speed corroborating the simulation results. We also showed that the transition density is the reciprocal of the average gap of vehicles in the platoon in the thermodynamic limit.
△ Less
Submitted 17 May, 2020; v1 submitted 15 March, 2020;
originally announced March 2020.
-
Traffic Data Imputation using Deep Convolutional Neural Networks
Authors:
Ouafa Benkraouda,
Bilal Thonnam Thodi,
Hwasoo Yeo,
Monica Menendez,
Saif Eddin Jabari
Abstract:
We propose a statistical learning-based traffic speed estimation method that uses sparse vehicle trajectory information. Using a convolutional encoder-decoder based architecture, we show that a well trained neural network can learn spatio-temporal traffic speed dynamics from time-space diagrams. We demonstrate this for a homogeneous road section using simulated vehicle trajectories and then valida…
▽ More
We propose a statistical learning-based traffic speed estimation method that uses sparse vehicle trajectory information. Using a convolutional encoder-decoder based architecture, we show that a well trained neural network can learn spatio-temporal traffic speed dynamics from time-space diagrams. We demonstrate this for a homogeneous road section using simulated vehicle trajectories and then validate it using real-world data from NGSIM. Our results show that with probe vehicle penetration levels as low as 5\%, the proposed estimation method can provide a sound reconstruction of macroscopic traffic speeds and reproduce realistic shockwave patterns, implying applicability in a variety of traffic conditions. We further discuss the model's reconstruction mechanisms and confirm its ability to differentiate various traffic behaviors such as congested and free-flow traffic states, transition dynamics, and shockwave propagation.
△ Less
Submitted 21 January, 2020;
originally announced February 2020.
-
Noticeability Versus Impact in Traffic Signal Tampering
Authors:
Bilal Thonnam Thodi,
Timothy Mulumba,
Saif Eddin Jabari
Abstract:
This paper investigates the vulnerability of urban traffic networks to cyber-attacks on traffic lights. We model traffic signal tampering as a bi-objective optimization problem that simultaneously seeks to reduce vehicular throughput in the network over time (maximize impact) while introducing minimal changes to network signal timings (minimize noticeability). We represent the Spatio-temporal traf…
▽ More
This paper investigates the vulnerability of urban traffic networks to cyber-attacks on traffic lights. We model traffic signal tampering as a bi-objective optimization problem that simultaneously seeks to reduce vehicular throughput in the network over time (maximize impact) while introducing minimal changes to network signal timings (minimize noticeability). We represent the Spatio-temporal traffic dynamics as a static network flow problem on a time-expanded graph. This allows us to reduce the (non-convex) attack problem to a tractable form, which can be solved using traditional techniques used to solve linear network programming problems. We show that minor but objective adjustments in the signal timings over time can severely impact traffic conditions at the network level. We investigate network vulnerability by examining the concavity of the Pareto-optimal frontier obtained by solving the bi-objective attack problem. Numerical experiments are carried to illustrate the types of insights that can be extracted from the Pareto-optimal frontier. For instance, our experiments suggest that the vulnerability of a traffic network to signal tampering is independent of the demand levels.
△ Less
Submitted 8 February, 2020;
originally announced February 2020.
-
A node-charge graph-based online carshare rebalancing policy with capacitated electric charging
Authors:
Theodoros P. Pantelidis,
Li Li,
Tai-Yu Ma,
Joseph Y. J. Chow,
Saif Eddin G. Jabari
Abstract:
Viability of electric car-sharing operations depends on rebalancing algorithms. Earlier methods in the literature suggest a trend toward non-myopic algorithms using queueing principles. We propose a new rebalancing policy using cost function approximation. The cost function is modeled as a p-median relocation problem with minimum cost flow conservation and path-based charging station capacities on…
▽ More
Viability of electric car-sharing operations depends on rebalancing algorithms. Earlier methods in the literature suggest a trend toward non-myopic algorithms using queueing principles. We propose a new rebalancing policy using cost function approximation. The cost function is modeled as a p-median relocation problem with minimum cost flow conservation and path-based charging station capacities on a static node-charge graph structure. The cost function is NP-complete, so a heuristic is proposed that ensures feasible solutions that can be solved in an online system. The algorithm is validated in a case study of electric carshare in Brooklyn, New York, with demand data shared from BMW ReachNow operations in September 2017 (262 vehicle fleet, 231 pickups per day, 303 traffic analysis zones (TAZs)) and charging station location data (18 charging stations with 4 port capacities). The proposed non-myopic rebalancing heuristic reduces the cost increase compared to myopic rebalancing by 38%. Other managerial insights are further discussed.
△ Less
Submitted 14 March, 2021; v1 submitted 20 January, 2020;
originally announced January 2020.
-
Nonlinear Traffic Prediction as a Matrix Completion Problem with Ensemble Learning
Authors:
Wenqing Li,
Chuhan Yang,
Saif Eddin Jabari
Abstract:
This paper addresses the problem of short-term traffic prediction for signalized traffic operations management. Specifically, we focus on predicting sensor states in high-resolution (second-by-second). This contrasts with traditional traffic forecasting problems, which have focused on predicting aggregated traffic variables, typically over intervals that are no shorter than 5 minutes. Our contribu…
▽ More
This paper addresses the problem of short-term traffic prediction for signalized traffic operations management. Specifically, we focus on predicting sensor states in high-resolution (second-by-second). This contrasts with traditional traffic forecasting problems, which have focused on predicting aggregated traffic variables, typically over intervals that are no shorter than 5 minutes. Our contributions can be summarized as offering three insights: first, we show how the prediction problem can be modeled as a matrix completion problem. Second, we employ a block-coordinate descent algorithm and demonstrate that the algorithm converges in sub-linear time to a block coordinate-wise optimizer. This allows us to capitalize on the "bigness" of high-resolution data in a computationally feasible way. Third, we develop an ensemble learning (or adaptive boosting) approach to reduce the training error to within any arbitrary error threshold. The latter utilizes past days so that the boosting can be interpreted as capturing periodic patterns in the data. The performance of the proposed method is analyzed theoretically and tested empirically using both simulated data and a real-world high-resolution traffic dataset from Abu Dhabi, UAE. Our experimental results show that the proposed method outperforms other state-of-the-art algorithms.
△ Less
Submitted 10 July, 2021; v1 submitted 8 January, 2020;
originally announced January 2020.
-
Pay for Intersection Priority: A Free Market Mechanism for Connected Vehicles
Authors:
DianChao Lin,
Saif Eddin Jabari
Abstract:
The rapid development and deployment of vehicle technologies offer opportunities to re-think the way traffic is managed. This paper capitalizes on vehicle connectivity and proposes an economic instrument and corresponding cooperative framework for allocating priority at intersections. The framework is compatible with a variety of existing intersection control approaches. Similar to free markets, o…
▽ More
The rapid development and deployment of vehicle technologies offer opportunities to re-think the way traffic is managed. This paper capitalizes on vehicle connectivity and proposes an economic instrument and corresponding cooperative framework for allocating priority at intersections. The framework is compatible with a variety of existing intersection control approaches. Similar to free markets, our framework allows vehicles to trade their time based on their (disclosed) value of time. We design the framework based on transferable utility games, where winners (time buyers) pay losers (time sellers) in each game. We conduct simulation experiments of both isolated intersections and an arterial setting. The results show that the proposed approach benefits the majority of users when compared to other mechanisms both ones that employ an economic instrument and ones that do not. We also show that it drives travelers to estimate their value of time correctly, and it naturally dissuades travelers from attempting to cheat.
△ Less
Submitted 29 December, 2020; v1 submitted 6 January, 2020;
originally announced January 2020.
-
On Equilibrium Metropolis Simulations on Self-Organized Urban Street Networks
Authors:
Jerome Benoit,
Saif Eddin Jabari
Abstract:
Urban street networks of unplanned or self-organized cities typically exhibit astonishing scale-free patterns. This scale-freeness can be shown, within the maximum entropy formalism (MaxEnt), as the manifestation of a fluctuating system that preserves on average some amount of information. Monte Carlo methods that can further this perspective are cruelly missing. Here we adapt to self-organized ur…
▽ More
Urban street networks of unplanned or self-organized cities typically exhibit astonishing scale-free patterns. This scale-freeness can be shown, within the maximum entropy formalism (MaxEnt), as the manifestation of a fluctuating system that preserves on average some amount of information. Monte Carlo methods that can further this perspective are cruelly missing. Here we adapt to self-organized urban street networks the Metropolis algorithm. The "coming to equilibrium" distribution is established with MaxEnt by taking scale-freeness as prior hypothesis along with symmetry-conservation arguments. The equilibrium parameter is the scaling; its concomitant extensive quantity is, assuming our lack of knowledge, an amount of information. To design an ergodic dynamics, we disentangle the state-of-the-art street generating paradigms based on nonoverlap** walks into layout-at-junction dynamics. Our adaptation reminisces the single-spin-flip Metropolis algorithm for Ising models. We thus expect Metropolis simulations to reveal that self-organized urban street networks, besides sustaining scale-freeness over a wide range of scalings, undergo a crossover as scaling varies -- literature argues for a small-world crossover. Simulations for Central London are consistent against the state-of-the-art outputs over a realistic range of scaling exponents. Our illustrative Watts-Strogatz phase diagram with scaling as rewiring parameter demonstrates a small-world crossover curving within the realistic window 2-3; it also shows that the state-of-the-art outputs underlie relatively large worlds. Our Metropolis adaptation to self-organized urban street networks thusly appears as a scaling variant of the Watts-Strogatz model. Such insights may ultimately allow the urban profession to anticipate self-organization or unplanned evolution of urban street networks.
△ Less
Submitted 30 April, 2021; v1 submitted 18 November, 2019;
originally announced November 2019.
-
On the Metropolis Algorithm for Urban Street Networks
Authors:
Jerome Benoit,
Saif Eddin Jabari
Abstract:
The complexity of urban street networks is well accepted to reside in the information space where roads map to nodes and junctions to links between nodes. Assuming that information networks preserve their amount of surprisal on average leads us to adapt the single-flip Metropolis algorithm to compute information networks with minimal amounts of surprisal.
The complexity of urban street networks is well accepted to reside in the information space where roads map to nodes and junctions to links between nodes. Assuming that information networks preserve their amount of surprisal on average leads us to adapt the single-flip Metropolis algorithm to compute information networks with minimal amounts of surprisal.
△ Less
Submitted 4 December, 2019; v1 submitted 16 September, 2019;
originally announced September 2019.
-
On the Perturbation of Self-Organized Urban Street Networks
Authors:
Jerome Benoit,
Saif Eddin Jabari
Abstract:
We investigate urban street networks as a whole within the frameworks of information physics and statistical physics. Urban street networks are envisaged as evolving social systems subject to a Boltzmann-mesoscopic entropy conservation. For self-organized urban street networks, our paradigm has already allowed us to recover the effectively observed scale-free distribution of roads and to foresee t…
▽ More
We investigate urban street networks as a whole within the frameworks of information physics and statistical physics. Urban street networks are envisaged as evolving social systems subject to a Boltzmann-mesoscopic entropy conservation. For self-organized urban street networks, our paradigm has already allowed us to recover the effectively observed scale-free distribution of roads and to foresee the distribution of junctions. The entropy conservation is interpreted as the conservation of the surprisal of the city-dwellers for their urban street network. In view to extend our investigations to other urban street networks, we consider to perturb our model for self-organized urban street networks by adding an external surprisal drift. We obtain the statistics for slightly drifted self-organized urban street networks. Besides being practical and manageable, this statistics separates the macroscopic evolution scale parameter from the mesoscopic social parameters. This opens the door to observational investigations on the universality of the evolution scale parameter. Ultimately, we argue that the strength of the external surprisal drift might be an indicator for the disengagement of the city-dwellers for their city.
△ Less
Submitted 7 May, 2019; v1 submitted 13 March, 2019;
originally announced March 2019.
-
Pay to change lanes: A cooperative lane-changing strategy for connected/automated driving
Authors:
DianChao Lin,
Li Li,
Saif Eddin Jabari
Abstract:
This paper proposes a cooperative lane changing strategy using a transferable utility games framework. This allows vehicles to engage in transactions where gaps in traffic are created in exchange for monetary compensation. The proposed approach is best suited to discretionary lane change maneuvers. We formulate gains in travel time, referred to as time differences, that result from achieving highe…
▽ More
This paper proposes a cooperative lane changing strategy using a transferable utility games framework. This allows vehicles to engage in transactions where gaps in traffic are created in exchange for monetary compensation. The proposed approach is best suited to discretionary lane change maneuvers. We formulate gains in travel time, referred to as time differences, that result from achieving higher speeds. These time differences, coupled with value of time, are used to formulate a utility function, where utility is transferable. We also allow for games between connected vehicles that do not involve transfer of utility. We apply Nash bargaining theory to solve the latter. A cellular automaton is developed and utilized to perform simulation experiments that explore the impact of such transactions on traffic conditions (travel-time savings, resulting speed-density relations and shock wave formation) and the benefit to vehicles. The results show that lane changing with transferable utility between drivers can help achieve win-win results, improve both individual and social benefits without resulting in any adverse effects on traffic characteristics in general and, in fact, result in slight improvement at traffic densities outside of free-flow and (bumper-to-bumper) jammed traffic.
△ Less
Submitted 17 June, 2019; v1 submitted 11 March, 2019;
originally announced March 2019.
-
Structure Entropy, Self-Organization, and Power Laws in Urban Street Networks: Evidence for Alexander's Ideas
Authors:
Jerome Benoit,
Saif Eddin Jabari
Abstract:
Easy and intuitive navigability is of central importance in cities. The actual scale-free networking of urban street networks in their topological space, where navigation information is encoded by map** roads to nodes and junctions to links between nodes, has still no simple explanation. Emphasizing the road-junction hierarchy in a holistic and systematic way leads us to envisage urban street ne…
▽ More
Easy and intuitive navigability is of central importance in cities. The actual scale-free networking of urban street networks in their topological space, where navigation information is encoded by map** roads to nodes and junctions to links between nodes, has still no simple explanation. Emphasizing the road-junction hierarchy in a holistic and systematic way leads us to envisage urban street networks as evolving social systems subject to a Boltzmann-mesoscopic entropy conservation. This conservation, which we may interpret in terms of surprisal, ensures the passage from the road-junction hierarchy to a scale-free coherence. To wit, we recover the actual scale-free probability distribution for natural roads in self-organized cities. We obtain this passage by invoking Jaynes's Maximum Entropy principle (statistical physics), while we capitalize on modern ideas of quantification (information physics) and well known results on structuration (lattice theory) to measure the information network entropy. The emerging paradigm, which applies to systems with more intricate hierarchies as actual cities, appears to reflect well the influential ideas on cities of the urbanist Christopher Alexander.
△ Less
Submitted 2 October, 2019; v1 submitted 8 January, 2019;
originally announced February 2019.
-
Position weighted backpressure intersection control for urban networks
Authors:
Li Li,
Saif Eddin Jabari
Abstract:
Decentralized intersection control techniques have received attention in the literature as tools that address scalability issues of network intersection control. Chief among these techniques are backpressure (BP) control algorithms, which were originally developed of for large wireless networks. In addition to being light-weight computationally, they come with guarantees of performance at the netw…
▽ More
Decentralized intersection control techniques have received attention in the literature as tools that address scalability issues of network intersection control. Chief among these techniques are backpressure (BP) control algorithms, which were originally developed of for large wireless networks. In addition to being light-weight computationally, they come with guarantees of performance at the network level, specifically network-wide stability. The dynamics in backpressure control are represented using networks of point queues and this also applies to all of the applications to traffic control. As such, BP in traffic fail to capture the spatial distribution of vehicles along the intersection links and, consequently, spill-back dynamics. This paper derives a position weighted backpressure (PWBP) control policy for network traffic applying continuum modeling principles of traffic dynamics and thus capture the spatial distribution of vehicles along network roads and spill-back dynamics. PWBP inherits the computational advantages of traditional BP. To prove stability of PWBP, (i) a Lyapunov functional that captures the spatial distribution of vehicles is developed; (ii) the capacity region of the network is formally defined in the context of macroscopic network traffic; and (iii) it is proved, when exogenous arrival rates are within the capacity region, that PWBP control is network stabilizing. We conduct comparisons against a real-world adaptive control implementation for an isolated intersection. Comparisons are also performed against other BP approaches in addition to optimized fixed timing control at the network level. These experiments demonstrate the superiority of PWBP over the other control policies in terms of capacity region, network-wide delay, congestion propagation speed, recoverability from heavy congestion (outside of the capacity region), and response to incidents.
△ Less
Submitted 22 June, 2019; v1 submitted 26 October, 2018;
originally announced October 2018.
-
On the Statistics of Urban Street Networks
Authors:
Jerome Benoit,
Saif Eddin Jabari
Abstract:
We investigate urban street networks as a whole within the frameworks of information physics and statistical physics. Urban street networks are envisaged as evolving social systems subject to a logarithmical entropic equilibrium.
We investigate urban street networks as a whole within the frameworks of information physics and statistical physics. Urban street networks are envisaged as evolving social systems subject to a logarithmical entropic equilibrium.
△ Less
Submitted 9 October, 2018;
originally announced October 2018.
-
Learning Traffic Flow Dynamics using Random Fields
Authors:
Saif Eddin Jabari,
Deepthi Mary Dilip,
DianChao Lin,
Bilal Thonnam Thodi
Abstract:
This paper presents a mesoscopic traffic flow model that explicitly describes the spatio-temporal evolution of the probability distributions of vehicle trajectories. The dynamics are represented by a sequence of factor graphs, which enable learning of traffic dynamics from limited Lagrangian measurements using an efficient message passing technique. The approach ensures that estimated speeds and t…
▽ More
This paper presents a mesoscopic traffic flow model that explicitly describes the spatio-temporal evolution of the probability distributions of vehicle trajectories. The dynamics are represented by a sequence of factor graphs, which enable learning of traffic dynamics from limited Lagrangian measurements using an efficient message passing technique. The approach ensures that estimated speeds and traffic densities are non-negative with probability one. The estimation technique is tested using vehicle trajectory datasets generated using an independent microscopic traffic simulator and is shown to efficiently reproduce traffic conditions with probe vehicle penetration levels as little as 10\%. The proposed algorithm is also compared with state-of-the-art traffic state estimation techniques developed for the same purpose and it is shown that the proposed approach can outperform the state-of-the-art techniques in terms reconstruction accuracy.
△ Less
Submitted 10 September, 2019; v1 submitted 22 June, 2018;
originally announced June 2018.
-
Traffic state estimation using stochastic Lagrangian dynamics
Authors:
Fangfang Zheng,
Saif Eddin Jabari,
Henry X. Liu,
DianChao Lin
Abstract:
This paper proposes a new stochastic model of traffic dynamics in Lagrangian coordinates. The source of uncertainty is heterogeneity in driving behavior, captured using driver-specific speed-spacing relations, i.e., parametric uncertainty. It also results in smooth vehicle trajectories in a stochastic context, which is in agreement with real-world traffic dynamics and, thereby, overcoming issues w…
▽ More
This paper proposes a new stochastic model of traffic dynamics in Lagrangian coordinates. The source of uncertainty is heterogeneity in driving behavior, captured using driver-specific speed-spacing relations, i.e., parametric uncertainty. It also results in smooth vehicle trajectories in a stochastic context, which is in agreement with real-world traffic dynamics and, thereby, overcoming issues with aggressive oscillation typically observed in sample paths of stochastic traffic flow models. We utilize ensemble filtering techniques for data assimilation (traffic state estimation), but derive the mean and covariance dynamics as the ensemble sizes go to infinity, thereby bypassing the need to sample from the parameter distributions while estimating the traffic states. As a result, the estimation algorithm is just a standard Kalman-Bucy algorithm, which renders the proposed approach amenable to real-time applications using recursive data. Data assimilation examples are performed and our results indicate good agreement with out-of-sample data.
△ Less
Submitted 31 May, 2018;
originally announced June 2018.
-
Sparse Travel Time Estimation from Streaming Data
Authors:
Saif Eddin Jabari,
Nikolaos M. Freris,
Deepthi Mary Dilip
Abstract:
We address two shortcomings in online travel time estimation methods for congested urban traffic. The first shortcoming is related to the determination of the number of mixture modes, which can change dynamically, within day and from day to day. The second shortcoming is the wide-spread use of Gaussian probability densities as mixture components. Gaussian densities fail to capture the positive ske…
▽ More
We address two shortcomings in online travel time estimation methods for congested urban traffic. The first shortcoming is related to the determination of the number of mixture modes, which can change dynamically, within day and from day to day. The second shortcoming is the wide-spread use of Gaussian probability densities as mixture components. Gaussian densities fail to capture the positive skew in travel time distributions and, consequently, large numbers of mixture components are needed for reasonable fitting accuracy when applied as mixture components. They also assign positive probabilities to negative travel times. To address these issues, this paper derives a mixture distribution with Gamma component densities, which are asymmetric and supported on the positive numbers. We use sparse estimation techniques to ensure parsimonious models and propose a generalization of Gamma mixture densities using Mittag-Leffler functions, which provides enhanced fitting flexibility and improved parsimony. In order to accommodate within-day variability and allow for online implementation of the proposed methodology (i.e., fast computations on streaming travel time data), we introduce a recursive algorithm which efficiently updates the fitted distribution whenever new data become available. Experimental results using real-world travel time data illustrate the efficacy of the proposed methods.
△ Less
Submitted 13 May, 2019; v1 submitted 22 April, 2018;
originally announced April 2018.