-
Adaptive Road Configurations for Improved Autonomous Vehicle-Pedestrian Interactions using Reinforcement Learning
Authors:
Qiming Ye,
Yuxiang Feng,
Jose Javier Escribano Macias,
Marc Stettler,
Panagiotis Angeloudis
Abstract:
The deployment of Autonomous Vehicles (AVs) poses considerable challenges and unique opportunities for the design and management of future urban road infrastructure. In light of this disruptive transformation, the Right-Of-Way (ROW) composition of road space has the potential to be renewed. Design approaches and intelligent control models have been proposed to address this problem, but we lack an…
▽ More
The deployment of Autonomous Vehicles (AVs) poses considerable challenges and unique opportunities for the design and management of future urban road infrastructure. In light of this disruptive transformation, the Right-Of-Way (ROW) composition of road space has the potential to be renewed. Design approaches and intelligent control models have been proposed to address this problem, but we lack an operational framework that can dynamically generate ROW plans for AVs and pedestrians in response to real-time demand. Based on microscopic traffic simulation, this study explores Reinforcement Learning (RL) methods for evolving ROW compositions. We implement a centralised paradigm and a distributive learning paradigm to separately perform the dynamic control on several road network configurations. Experimental results indicate that the algorithms have the potential to improve traffic flow efficiency and allocate more space for pedestrians. Furthermore, the distributive learning algorithm outperforms its centralised counterpart regarding computational cost (49.55\%), benchmark rewards (25.35\%), best cumulative rewards (24.58\%), optimal actions (13.49\%) and rate of convergence. This novel road management technique could potentially contribute to the flow-adaptive and active mobility-friendly streets in the AVs era.
△ Less
Submitted 21 March, 2023;
originally announced March 2023.
-
Enabling Dynamic and Intelligent Workflows for HPC, Data Analytics, and AI Convergence
Authors:
Jorge Ejarque,
Rosa M. Badia,
Loïc Albertin,
Giovanni Aloisio,
Enrico Baglione,
Yolanda Becerra,
Stefan Boschert,
Julian R. Berlin,
Alessandro D'Anca,
Donatello Elia,
François Exertier,
Sandro Fiore,
José Flich,
Arnau Folch,
Steven J Gibbons,
Nikolay Koldunov,
Francesc Lordan,
Stefano Lorito,
Finn Løvholt,
Jorge Macías,
Fabrizio Marozzo,
Alberto Michelini,
Marisol Monterrubio-Velasco,
Marta Pienkowska,
Josep de la Puente
, et al. (12 additional authors not shown)
Abstract:
The evolution of High-Performance Computing (HPC) platforms enables the design and execution of progressively larger and more complex workflow applications in these systems. The complexity comes not only from the number of elements that compose the workflows but also from the type of computations they perform. While traditional HPC workflows target simulations and modelling of physical phenomena,…
▽ More
The evolution of High-Performance Computing (HPC) platforms enables the design and execution of progressively larger and more complex workflow applications in these systems. The complexity comes not only from the number of elements that compose the workflows but also from the type of computations they perform. While traditional HPC workflows target simulations and modelling of physical phenomena, current needs require in addition data analytics (DA) and artificial intelligence (AI) tasks. However, the development of these workflows is hampered by the lack of proper programming models and environments that support the integration of HPC, DA, and AI, as well as the lack of tools to easily deploy and execute the workflows in HPC systems. To progress in this direction, this paper presents use cases where complex workflows are required and investigates the main issues to be addressed for the HPC/DA/AI convergence. Based on this study, the paper identifies the challenges of a new workflow platform to manage complex workflows. Finally, it proposes a development approach for such a workflow platform addressing these challenges in two directions: first, by defining a software stack that provides the functionalities to manage these complex workflows; and second, by proposing the HPC Workflow as a Service (HPCWaaS) paradigm, which leverages the software stack to facilitate the reusability of complex workflows in federated HPC infrastructures. Proposals presented in this work are subject to study and development as part of the EuroHPC eFlows4HPC project.
△ Less
Submitted 13 May, 2022; v1 submitted 20 April, 2022;
originally announced April 2022.
-
A Decentralised Multi-Agent Reinforcement Learning Approach for the Same-Day Delivery Problem
Authors:
Elvin Ngu,
Leandro Parada,
Jose Javier Escribano Macias,
Panagiotis Angeloudis
Abstract:
Same-Day Delivery services are becoming increasingly popular in recent years. These have been usually modelled by previous studies as a certain class of Dynamic Vehicle Routing Problem (DVRP) where goods must be delivered from a depot to a set of customers in the same day that the orders were placed. Adaptive exact solution methods for DVRPs can become intractable even for small problem instances.…
▽ More
Same-Day Delivery services are becoming increasingly popular in recent years. These have been usually modelled by previous studies as a certain class of Dynamic Vehicle Routing Problem (DVRP) where goods must be delivered from a depot to a set of customers in the same day that the orders were placed. Adaptive exact solution methods for DVRPs can become intractable even for small problem instances. In this paper, we formulate the SDDP as a Markov Decision Process (MDP) and solve it using a parameter-sharing Deep Q-Network, which corresponds to a decentralised Multi-Agent Reinforcement Learning (MARL) approach. For this, we create a multi-agent grid-based SDD environment, consisting of multiple vehicles, a central depot and dynamic order generation. In addition, we introduce zone-specific order generation and reward probabilities. We compare the performance of our proposed MARL approach against a Mixed Inter Programming (MIP) solution. Results show that our proposed MARL framework performs on par with MIP-based policy when the number of orders is relatively low. For problem instances with higher order arrival rates, computational results show that the MARL approach underperforms the MIP by up to 30%. The performance gap between both methods becomes smaller when zone-specific parameters are employed. The gap is reduced from 30% to 3% for a 5x5 grid scenario with 30 orders. Execution time results indicate that the MARL approach is, on average, 65 times faster than the MIP-based policy, and therefore may be more advantageous for real-time control, at least for small-sized instances.
△ Less
Submitted 22 March, 2022;
originally announced March 2022.
-
Internet of things: a multiprotocol gateway as solution of the interoperability problem
Authors:
Wilder Castellanos,
Jose Macias,
Harold Pinilla,
Jose David Alvarado
Abstract:
One of the main challenges of the Internet of Things is the interoperability of highly heterogeneous devices, mainly in terms of the communication capabilities and network protocols used. As consequence, the interconnection model of the different devices involves an intermediary device, known as gateway. This gateway is a centralized element for the management of the devices that make up an IoT ap…
▽ More
One of the main challenges of the Internet of Things is the interoperability of highly heterogeneous devices, mainly in terms of the communication capabilities and network protocols used. As consequence, the interconnection model of the different devices involves an intermediary device, known as gateway. This gateway is a centralized element for the management of the devices that make up an IoT application. In addition, it is essential for the transmission of information to the Internet, especially when many IoT devices are not IP-based. This chapter describes a proposed model for an IoT gateway that allows the exchange of data through different wireless technologies and forwarding of such data to the Internet.
The proposed gateway has important advantages such as: supporting for multiprotocol interconnectivity, the remote configuration of wireless nodes for sensor and actuators management; a flexible algorithm totranslate the data obtained by sensors into a uniform format for transmission to a cloud server; low energy consumption due to efficient data transfer over MQTT protocol.
In order to demonstrate the usefulness of the developed gateway, a proof of concept test was implemented. The implemented scenario consists of 2 wireless nodes responsible for sensing environmental variables and transmitting data to the gateway node through different communication protocols. The obtained results show the feasibility for simultaneous data transmission from the remote wireless nodes to the gateway. Metrics on energy consumption in the devices are also presented.
△ Less
Submitted 30 July, 2021;
originally announced August 2021.
-
Environmental Variable Monitoring with IoT Technology
Authors:
Harold Pinilla,
Jose Macias,
Emmanuel Lescano,
Jose David Alvarado,
Wilder Castellanos
Abstract:
This article describes the design of a flexible and low-cost platform for monitoring environmental variables applied to agriculture. For the construction of this platform, technologies based on the communication protocol, Wi-Fi, Bluetooth, and Zigbee were used, using the embedded Raspberry pi 3 b + system and sensors to quantify different environmental variables, using different open source hardwa…
▽ More
This article describes the design of a flexible and low-cost platform for monitoring environmental variables applied to agriculture. For the construction of this platform, technologies based on the communication protocol, Wi-Fi, Bluetooth, and Zigbee were used, using the embedded Raspberry pi 3 b + system and sensors to quantify different environmental variables, using different open source hardware and software tools. The network is made up of a central node (gateway), implemented on Samsung's Artik 1020 card, and two nodes where the sensors for reading environmental variables are connected. Finally, the data is collected by the gateway, which will be in charge of processing and storing it in a database so that the user in the future can access the information in real time from anywhere.
△ Less
Submitted 14 January, 2021;
originally announced January 2021.
-
Design and Implementation of a Multiprotocol IoT Gateway
Authors:
Jose Macias,
Harold Pinilla,
Wilder Castellanos,
Jose Alvarado,
Andres Sánchez
Abstract:
In the coming years, the interconnection of a large number of devices is expected, which will lead to a new form of interaction between the real and the virtual world. In this promising scenario, known as the Internet of Things, it is expected that different objects, such as sensors, industrial robots, cars, appliances, will be connected to the Internet. One of the main challenges of the Internet…
▽ More
In the coming years, the interconnection of a large number of devices is expected, which will lead to a new form of interaction between the real and the virtual world. In this promising scenario, known as the Internet of Things, it is expected that different objects, such as sensors, industrial robots, cars, appliances, will be connected to the Internet. One of the main challenges of the Internet of Things is the interoperability of highly heterogeneous devices, mainly in terms of the communication capabilities and network protocols used. As consequence, the interconnection model of the different devices involves an intermediary device, known as gateway. This gateway is a centralized element for the management of the devices that make up an IoT application. In addition, it is essential for the transmission of information to the Internet, especially when many IoT devices are not IP-based. This paper describes the implementation of an IoT gateway that allows the exchange of data through different wireless technologies and forwarding of such data to the Internet. The proposed gateway has important advantages such as: supporting for multiprotocol interconnectivity; remote configuration of wireless nodes for sensor and actuators management; a flexible algorithm to translate the data obtained by sensors into a uniform format for transmission to a cloud server; low energy consumption due to efficient data transfer over the MQTT protocol. In order to demonstrate the usefulness of the developed gateway, a proof-of-concept test was implemented. The implemented scenario consists of 2 wireless nodes responsible for sensing environmental variables and transmitting data to the gateway node through different communication protocols. The obtained results show the feasibility for simultaneous data transmission from the remote wireless nodes to the gateway.
△ Less
Submitted 11 January, 2020;
originally announced January 2020.
-
Context-Dependent Functions: Narrowing the Realm of Turing's Halting Problem
Authors:
Nicholas J. Macias
Abstract:
This paper describes Turing's Halting Problem (HP), and reviews the classic proof that no function exists that can solve HP. The concept of a "Context-Dependent Function" (CDF), whose behavior varies based on seemingly irrelevant changes to a program calling that function, is introduced, and the proof of HP's undecidability is re-examined in light of CDFs. The existence of CDFs is established via…
▽ More
This paper describes Turing's Halting Problem (HP), and reviews the classic proof that no function exists that can solve HP. The concept of a "Context-Dependent Function" (CDF), whose behavior varies based on seemingly irrelevant changes to a program calling that function, is introduced, and the proof of HP's undecidability is re-examined in light of CDFs. The existence of CDFs is established via a pair of examples of such functions. The conclusion of the proof of HP's undecidability is thus shown to be overly strong, as it doesn't show that no solution to HP exists, but rather that a solution must be a CDF. A higher-level analysis of this work is given, followed by conclusions and comments on future work.
△ Less
Submitted 13 January, 2015;
originally announced January 2015.
