-
Antifragile Perimeter Control: Anticipating and Gaining from Disruptions with Reinforcement Learning
Authors:
Linghang Sun,
Michail A. Makridis,
Alexander Genser,
Cristian Axenie,
Margherita Grossi,
Anastasios Kouvelas
Abstract:
The optimal operation of transportation networks is often susceptible to unexpected disruptions, such as traffic incidents and social events. Many established control strategies rely on mathematical models that struggle to cope with real-world uncertainties, leading to a significant decline in effectiveness when faced with substantial disruptions. While previous research works have dedicated effor…
▽ More
The optimal operation of transportation networks is often susceptible to unexpected disruptions, such as traffic incidents and social events. Many established control strategies rely on mathematical models that struggle to cope with real-world uncertainties, leading to a significant decline in effectiveness when faced with substantial disruptions. While previous research works have dedicated efforts to improving the robustness or resilience of transportation systems against disruptions, this paper applies the cutting-edge concept of antifragility to better design a traffic control strategy for urban road networks. Antifragility sets itself apart from robustness and resilience as it represents a system's ability to not only withstand stressors, shocks, and volatility but also thrive and enhance performance in the presence of such adversarial events. Hence, modern transportation systems call for solutions that are antifragile. In this work, we propose a model-free deep Reinforcement Learning (RL) scheme to control a two-region urban traffic perimeter network. The system exploits the learning capability of RL under disruptions to achieve antifragility. By monitoring the change rate and curvature of the traffic state with the RL framework, the proposed algorithm anticipates imminent disruptions. An additional term is also integrated into the RL algorithm as redundancy to improve the performance under disruption scenarios. When compared to a state-of-the-art model predictive control approach and a state-of-the-art RL algorithm, our proposed method demonstrates two antifragility-related properties: (a) gradual performance improvement under disruptions of constant magnitude; and (b) increasingly superior performance under growing disruptions.
△ Less
Submitted 19 February, 2024;
originally announced February 2024.
-
Time-to-Green predictions for fully-actuated signal control systems with supervised learning
Authors:
Alexander Genser,
Michail A. Makridis,
Kaidi Yang,
Lukas Ambühl,
Monica Menendez,
Anastasios Kouvelas
Abstract:
Recently, efforts have been made to standardize signal phase and timing (SPaT) messages. These messages contain signal phase timings of all signalized intersection approaches. This information can thus be used for efficient motion planning, resulting in more homogeneous traffic flows and uniform speed profiles. Despite efforts to provide robust predictions for semi-actuated signal control systems,…
▽ More
Recently, efforts have been made to standardize signal phase and timing (SPaT) messages. These messages contain signal phase timings of all signalized intersection approaches. This information can thus be used for efficient motion planning, resulting in more homogeneous traffic flows and uniform speed profiles. Despite efforts to provide robust predictions for semi-actuated signal control systems, predicting signal phase timings for fully-actuated controls remains challenging. This paper proposes a time series prediction framework using aggregated traffic signal and loop detector data. We utilize state-of-the-art machine learning models to predict future signal phases' duration. The performance of a Linear Regression (LR), a Random Forest (RF), and a Long-Short-Term-Memory (LSTM) neural network are assessed against a naive baseline model. Results based on an empirical data set from a fully-actuated signal control system in Zurich, Switzerland, show that machine learning models outperform conventional prediction methods. Furthermore, tree-based decision models such as the RF perform best with an accuracy that meets requirements for practical applications.
△ Less
Submitted 24 August, 2022;
originally announced August 2022.
-
Epitaxial growth of crystalline CaF$_2$ on silicene
Authors:
Daniele Nazzari,
Jakob A. Genser,
Viktoria Ritter,
Ole Bethge,
Emmerich Bertagnolli,
Tibor Grasser,
Walter M. Weber,
Alois Lugstein
Abstract:
Silicene is one of the most promising 2D materials for the realization of next-generation electronic devices, owing to its high carrier mobility and bandgap tunability through the imposition of an external electric field. To exploit this fundamental characteristic, it is necessary to engineer an insulating layer that can be interfaced directly to silicene without perturbing its bidimensional natur…
▽ More
Silicene is one of the most promising 2D materials for the realization of next-generation electronic devices, owing to its high carrier mobility and bandgap tunability through the imposition of an external electric field. To exploit this fundamental characteristic, it is necessary to engineer an insulating layer that can be interfaced directly to silicene without perturbing its bidimensional nature. At the same time, this insulating layer should exhibit low leakage currents even when highly scaled, to fully exploit the advantages of using a 2D material at the core of the device. CaF$_2$ is known to form a quasi van der Waals interface with 2D materials, as well as to maintain its insulating properties even at ultrathin scales. Here we investigate the growth of CaF$_2$ layers on silicene by molecular beam epitaxy: diffraction images show that CaF$_2$ grows epitaxially on silicene/Ag(111), with its domains fully aligned to the 2D silicon lattice. In-situ XPS analysis evidences that no changes in the chemical state of the silicon atoms can be detected upon CaF$_2$ deposition, excluding the formation of covalent bonds between Ca, F and Si. Polarized Raman analysis shows that silicene undergoes a structural change upon interaction with CaF$_2$, however retaining a bidimensional character and without transitioning to a sp3-hybridized, bulk-like silicon.
△ Less
Submitted 6 December, 2021; v1 submitted 30 August, 2021;
originally announced August 2021.
-
An Experimental Urban Case Study with Various Data Sources and a Model for Traffic Estimation
Authors:
Alexander Genser,
Noel Hautle,
Michail Makridis,
Anastasios Kouvelas
Abstract:
Accurate estimation of the traffic state over a network is essential since it is the starting point for designing and implementing any traffic management strategy. Hence, traffic operators and users of a transportation network can make reliable decisions such as influence/change route or mode choice. However, the problem of traffic state estimation from various sensors within an urban environment…
▽ More
Accurate estimation of the traffic state over a network is essential since it is the starting point for designing and implementing any traffic management strategy. Hence, traffic operators and users of a transportation network can make reliable decisions such as influence/change route or mode choice. However, the problem of traffic state estimation from various sensors within an urban environment is very complex for several different reasons, such as availability of sensors, different noise levels, different output quantities, sensor accuracy, heterogeneous data fusion, and many more. To provide a better understanding of this problem, we organized an experimental campaign with video measurement in an area within the urban network of Zurich, Switzerland. We focus on capturing the traffic state in terms of traffic flow and travel times by ensuring measurements from established thermal cameras by the city's authorities, processed video data, and the Google Distance Matrix. We assess the different data sources, and we propose a simple yet efficient Multiple Linear Regression (MLR) model to estimate travel times with fusion of various data sources. Comparative results with ground-truth data (derived from video measurements) show the efficiency and robustness of the proposed methodology.
△ Less
Submitted 2 August, 2021;
originally announced August 2021.
-
Critical ride comfort detection for automated vehicles
Authors:
Alexander Genser,
Roland Spielhofer,
Philippe Nitsche,
Anastasios Kouvelas
Abstract:
In a future connected vehicle environment, an optimized route and motion planning should not only fulfill efficiency and safety constraints but also minimize vehicle motions and oscillations, causing poor ride comfort perceived by passengers. This work provides a framework for a large-scale and cost-efficient evaluation to address AV's ride comfort and allow the comparison of different comfort ass…
▽ More
In a future connected vehicle environment, an optimized route and motion planning should not only fulfill efficiency and safety constraints but also minimize vehicle motions and oscillations, causing poor ride comfort perceived by passengers. This work provides a framework for a large-scale and cost-efficient evaluation to address AV's ride comfort and allow the comparison of different comfort assessment strategies. The proposed tool also gives insights to comfort data, allowing for the development of novel algorithms, guidelines, or motion planning systems incorporating passenger comfort. A vehicle-road simulation framework utilizable to assess the most common ride comfort determination strategies based on vehicle dynamics data is presented. The developed methodology encompasses a road surface model, a non-linear vehicle model optimization, and Monte Carlo simulations to allow for an accurate and cost-efficient generation of virtual chassis acceleration data. Ride comfort is determined by applying a commonly used threshold method and an analysis based on ISO 2631. The two methods are compared against comfort classifications based on empirical measurements of the International Roughness Index (IRI). A case study with three road sites in Austria demonstrates the framework's practical application with real data and achieves high-resolution ride comfort classifications. The results highlight that ISO 2631 comfort estimates are most similar to IRI classifications and that the thresholding procedure detects preventable situations but also over- or underestimates ride comfort. Hence, the work shows the potential risk of negative ride comfort of AVs using simple threshold values and stresses the importance of a robust comfort evaluation method for enhancing AVs' path and motion planning with maximal ride comfort.
△ Less
Submitted 27 July, 2021;
originally announced July 2021.
-
Dynamic optimal congestion pricing in multi-region urban networks by application of a Multi-Layer-Neural network
Authors:
Alexander Genser,
Anastasios Kouvelas
Abstract:
Traffic management by applying congestion pricing is a measure for mitigating congestion in protected city corridors. As a promising tool, pricing improves the level of service in a network and reduces travel delays. However, real-world implementations are restricted to static pricing, i.e., the price is fixed and not responsive to the prevailing regional traffic conditions. Dynamic pricing overco…
▽ More
Traffic management by applying congestion pricing is a measure for mitigating congestion in protected city corridors. As a promising tool, pricing improves the level of service in a network and reduces travel delays. However, real-world implementations are restricted to static pricing, i.e., the price is fixed and not responsive to the prevailing regional traffic conditions. Dynamic pricing overcomes these limitations but also affects the users route choices. This work uses dynamic pricing's influence and predicts pricing functions to aim for a system optimal traffic distribution. The framework models a large-scale network where every region is considered homogeneous, allowing for the Macroscopic Fundamental Diagram (MFD) application. We compute Dynamic System Optimum (DSO) and a Quasi Dynamic User Equilibrium (QDUE) of the macroscopic model by formulating a linear optimization problem and utilizing the Dijkstra algorithm and a Multinomial Logit model (MNL), respectively. The equilibria allow us to find an optimal pricing methodology by training Multi-Layer-Neural (MLN) network models. We test our framework on a case study in Zurich, Switzerland, and showcase that (a) our neural network model learns the complex user behavior and (b) allows predicting optimal pricing functions. Results show a significant performance improvement when operating a transportation network in the DSO and highlight how dynamic pricing influences the user's route choice behavior towards the system optimal equilibrium.
△ Less
Submitted 27 July, 2021;
originally announced July 2021.
