-
Roadside Units Assisted Localized Automated Vehicle Maneuvering: An Offline Reinforcement Learning Approach
Authors:
Kui Wang,
Changyang She,
Zongdian Li,
Tao Yu,
Yonghui Li,
Kei Sakaguchi
Abstract:
Traffic intersections present significant challenges for the safe and efficient maneuvering of connected and automated vehicles (CAVs). This research proposes an innovative roadside unit (RSU)-assisted cooperative maneuvering system aimed at enhancing road safety and traveling efficiency at intersections for CAVs. We utilize RSUs for real-time traffic data acquisition and train an offline reinforc…
▽ More
Traffic intersections present significant challenges for the safe and efficient maneuvering of connected and automated vehicles (CAVs). This research proposes an innovative roadside unit (RSU)-assisted cooperative maneuvering system aimed at enhancing road safety and traveling efficiency at intersections for CAVs. We utilize RSUs for real-time traffic data acquisition and train an offline reinforcement learning (RL) algorithm based on human driving data. Evaluation results obtained from hardware-in-loop autonomous driving simulations show that our approach employing the twin delayed deep deterministic policy gradient and behavior cloning (TD3+BC), achieves performance comparable to state-of-the-art autonomous driving systems in terms of safety measures while significantly enhancing travel efficiency by up to 17.38% in intersection areas. This paper makes a pivotal contribution to the field of intelligent transportation systems, presenting a breakthrough solution for improving urban traffic flow and safety at intersections.
△ Less
Submitted 6 May, 2024;
originally announced May 2024.
-
Smart Mobility Digital Twin Based Automated Vehicle Navigation System: A Proof of Concept
Authors:
Kui Wang,
Zongdian Li,
Kazuma Nonomura,
Tao Yu,
Kei Sakaguchi,
Omar Hashash,
Walid Saad
Abstract:
Digital twins (DTs) have driven major advancements across various industrial domains over the past two decades. With the rapid advancements in autonomous driving and vehicle-to-everything (V2X) technologies, integrating DTs into vehicular platforms is anticipated to further revolutionize smart mobility systems. In this paper, a new smart mobility DT (SMDT) platform is proposed for the control of c…
▽ More
Digital twins (DTs) have driven major advancements across various industrial domains over the past two decades. With the rapid advancements in autonomous driving and vehicle-to-everything (V2X) technologies, integrating DTs into vehicular platforms is anticipated to further revolutionize smart mobility systems. In this paper, a new smart mobility DT (SMDT) platform is proposed for the control of connected and automated vehicles (CAVs) over next-generation wireless networks. In particular, the proposed platform enables cloud services to leverage the abilities of DTs to promote the autonomous driving experience. To enhance traffic efficiency and road safety measures, a novel navigation system that exploits available DT information is designed. The SMDT platform and navigation system are implemented with state-of-the-art products, e.g., CAVs and roadside units (RSUs), and emerging technologies, e.g., cloud and cellular V2X (C-V2X). In addition, proof-of-concept (PoC) experiments are conducted to validate system performance. The performance of SMDT is evaluated from two standpoints: (i) the rewards of the proposed navigation system on traffic efficiency and safety and, (ii) the latency and reliability of the SMDT platform. Our experimental results using SUMO-based large-scale traffic simulations show that the proposed SMDT can reduce the average travel time and the blocking probability due to unexpected traffic incidents. Furthermore, the results record a peak overall latency for DT modeling and route planning services to be 155.15 ms and 810.59 ms, respectively, which validates that our proposed design aligns with the 3GPP requirements for emerging V2X use cases and fulfills the targets of the proposed design. Our demonstration video can be found at https://youtu.be/3waQwlaHQkk.
△ Less
Submitted 19 February, 2024;
originally announced February 2024.
-
Smart Mobility Digital Twin for Automated Driving: Design and Proof-of-Concept
Authors:
Kui Wang,
Zongdian Li,
Tao Yu,
Kei Sakaguchi
Abstract:
During the past decade, smart mobility and intelligent vehicles have attracted increasing attention, because they promise to create a highly efficient and safe transportation system in the future. Meanwhile, digital twin, as an emerging technology, will play an important role in automated driving and intelligent transportation systems. This technology is applied in this paper to design a platform…
▽ More
During the past decade, smart mobility and intelligent vehicles have attracted increasing attention, because they promise to create a highly efficient and safe transportation system in the future. Meanwhile, digital twin, as an emerging technology, will play an important role in automated driving and intelligent transportation systems. This technology is applied in this paper to design a platform for smart mobility, providing large-scale route planning services. Utilizing sensing technologies and cloud/edge computing, we build a digital twin system model that reflects the static and dynamic objects from the real world in real time. With the smart mobility platform, we realize traffic monitoring and route planning through cooperative environment perception to help automated vehicles circumvent jams. A proof-of-concept test with a real vehicle in real traffic is conducted to validate the functions and the delay performance of the proposed platform.
△ Less
Submitted 24 December, 2023;
originally announced January 2024.
-
UAV-Aided Lifelong Learning for AoI and Energy Optimization in Non-Stationary IoT Networks
Authors:
Zhenzhen Gong,
Omar Hashash,
Yingze Wang,
Qimei Cui,
Wei Ni,
Walid Saad,
Kei Sakaguchi
Abstract:
In this paper, a novel joint energy and age of information (AoI) optimization framework for IoT devices in a non-stationary environment is presented. In particular, IoT devices that are distributed in the real-world are required to efficiently utilize their computing resources so as to balance the freshness of their data and their energy consumption. To optimize the performance of IoT devices in s…
▽ More
In this paper, a novel joint energy and age of information (AoI) optimization framework for IoT devices in a non-stationary environment is presented. In particular, IoT devices that are distributed in the real-world are required to efficiently utilize their computing resources so as to balance the freshness of their data and their energy consumption. To optimize the performance of IoT devices in such a dynamic setting, a novel lifelong reinforcement learning (RL) solution that enables IoT devices to continuously adapt their policies to each newly encountered environment is proposed. Given that IoT devices have limited energy and computing resources, an unmanned aerial vehicle (UAV) is leveraged to visit the IoT devices and update the policy of each device sequentially. As such, the UAV is exploited as a mobile learning agent that can learn a shared knowledge base with a feature base in its training phase, and feature sets of a zero-shot learning method in its testing phase, to generalize between the environments. To optimize the trajectory and flying velocity of the UAV, an actor-critic network is leveraged so as to minimize the UAV energy consumption. Simulation results show that the proposed lifelong RL solution can outperform the state-of-art benchmarks by enhancing the balanced cost of IoT devices by $8.3\%$ when incorporating warm-start policies for unseen environments. In addition, our solution achieves up to $49.38\%$ reduction in terms of energy consumption by the UAV in comparison to the random flying strategy.
△ Less
Submitted 30 November, 2023;
originally announced December 2023.
-
Towards mmWave V2X in 5G and Beyond to Support Automated Driving
Authors:
Kei Sakaguchi,
Ryuichi Fukatsu,
Tao Yu,
Eisuke Fukuda,
Kim Mahler,
Robert Heath,
Takeo Fujii,
Kazuaki Takahashi,
Alexey Khoryaev,
Satoshi Nagata,
Takayuki Shimizu
Abstract:
Millimeter wave provides high data rates for Vehicle-to-Everything (V2X) communications. This paper motivates millimeter wave to support automated driving and begins by explaining V2X use cases that support automated driving with references to several standardi-zation bodies. The paper gives a classification of existing V2X stand-ards: IEEE802.11p and LTE V2X, along with the status of their com-me…
▽ More
Millimeter wave provides high data rates for Vehicle-to-Everything (V2X) communications. This paper motivates millimeter wave to support automated driving and begins by explaining V2X use cases that support automated driving with references to several standardi-zation bodies. The paper gives a classification of existing V2X stand-ards: IEEE802.11p and LTE V2X, along with the status of their com-mercial deployment. Then, the paper provides a detailed assessment on how millimeter wave V2X enables the use case of cooperative perception. The explanations provide detailed rate calculations for this use case and show that millimeter wave is the only technology able to achieve the requirements. Furthermore, specific challenges related to millimeter wave for V2X are described, including cover-age enhancement and beam alignment. The paper concludes with some results from three studies, i.e. IEEE802.11ad (WiGig) based V2X, extension of 5G NR (New Radio) toward mmWave V2X, and prototypes of intelligent street with mmWave V2X.
△ Less
Submitted 18 November, 2020;
originally announced November 2020.
-
Proof-of-Concept of Uncompressed 4K Video Transmission from Drone through mmWave
Authors:
Yoshitaka Takaku,
Yohei Kaieda,
Tao Yu,
Kei Sakaguchi
Abstract:
Drones are attracting increasing attention in varieties of research fields because of their flexibility and are expected to be applied to a wide range of potential applications, among which the super-high-resolution video surveillance system using drones especially gains the authors research attention. Surveillance systems using cameras with fixed locations always suffer the blind spots due to the…
▽ More
Drones are attracting increasing attention in varieties of research fields because of their flexibility and are expected to be applied to a wide range of potential applications, among which the super-high-resolution video surveillance system using drones especially gains the authors research attention. Surveillance systems using cameras with fixed locations always suffer the blind spots due to the blockage or inappropriate deployments. Instead, by using the drones equipped with cameras, the surveillance performance can be drastically improved due to their high mobilities. The video quality is also a key factor of the surveillance performance. In face recognition, one of the most important surveillance applications, the uncompressed video can greatly improve the detection accuracy, but it is difficult to transmit uncompressed video in real time due to the huge data sizes. To address the issue, we propose to use the ultra-high speed mmWave communication for the video transmission from drones. Moreover, due to the limited battery energy and computing power in drones, we introduce the edge computing and propose to offload all the computation from the drones to the ground station. In addition, a proof-of-concept prototype hardware of the proposed uncompressed 4K video transmission system from drones through mmWave is developed, and the experiments results are consistent with the system design expectations.
△ Less
Submitted 22 February, 2020;
originally announced February 2020.
-
A Guide of Fingerprint Based Radio Emitter Localization using Multiple Sensors
Authors:
Tao Yu,
Azril Haniz,
Kentaro Sano,
Ryosuke Iwata,
Ryouta Kosaka,
Yusuke Kuki,
Gia Khanh Tran,
Jun-Ichi Takada,
Kei Sakaguchi
Abstract:
Location information is essential to varieties of applications. It is one of the most important context to be detected by wireless distributed sensors, which is a key technology in Internet-of-Things. Fingerprint-based methods, which compare location unique fingerprints collected beforehand with the fingerprint measured from the target, have attracted much attention recently in both of academia an…
▽ More
Location information is essential to varieties of applications. It is one of the most important context to be detected by wireless distributed sensors, which is a key technology in Internet-of-Things. Fingerprint-based methods, which compare location unique fingerprints collected beforehand with the fingerprint measured from the target, have attracted much attention recently in both of academia and industry. They have been successfully used for many location-based applications.From the viewpoint of practical applications, in this paper, four different typical approaches of fingerprint-based radio emitter localization system are introduced with four different representative applications: localization of LTE smart phone used for anti-cheating in exams, indoor localization of Wi-Fi terminals, localized light control in BEMS using location information of occupants, and illegal radio localization in outdoor environments. Based on the different practical application scenarios, different solutions, which are designed to enhance the localization performance, are discussed in detail. To the best of the authors' knowledge, this is the first paper to give a guideline for readers about fingerprint-based localization system in terms of fingerprint selection, hardware architecture design and algorithm enhancement
△ Less
Submitted 5 April, 2018;
originally announced April 2018.
-
Design and implementation of lighting control system using battery-less wireless human detection sensor networks
Authors:
Tao Yu,
Yusuke Kuki,
Gento Matsushita,
Daiki Maehara,
Seiichi Sampei,
Kei Sakaguchi
Abstract:
Artificial lighting is responsible for a large portion of total energy consumption and has great potential for energy saving. This paper designs an LED light control algorithm based on users' localization using multiple battery-less binary human detection sensors. The proposed lighting control system focuses on reducing office lighting energy consumption and satisfying users' illumination requirem…
▽ More
Artificial lighting is responsible for a large portion of total energy consumption and has great potential for energy saving. This paper designs an LED light control algorithm based on users' localization using multiple battery-less binary human detection sensors. The proposed lighting control system focuses on reducing office lighting energy consumption and satisfying users' illumination requirement. Most current lighting control systems use infrared human detection sensors, but the poor detection probability, especially for a static user, makes it difficult to realize comfortable and effective lighting control. To improve the detection probability of each sensor, we proposed to locate sensors as close to each user as possible by using a battery-less wireless sensor network, in which all sensors can be placed freely in the space with high energy stability. We also proposed to use a multi-sensor-based user localization algorithm to capture user's position more accurately and realize fine lighting control which works even with static users. The system is actually implemented in an indoor office environment in a pilot project. A verification experiment is conducted by measuring the practical illumination and power consumption. The performance agrees with design expectations. It shows that the proposed LED lighting control system reduces the energy consumption significantly, 57% compared to the batch control scheme, and satisfies user's illumination requirement with 100% probability.
△ Less
Submitted 16 April, 2017;
originally announced April 2017.
-
Distributed Power Control Network and Green Building Test-bed for Demand Response in Smart Grid
Authors:
Kei Sakaguchi,
Van Ky Nguyen,
Yu Tao,
Gia Khanh Tran,
Kiyomichi Araki
Abstract:
It is known that demand and supply power balancing is an essential method to operate power delivery system and prevent blackouts caused by power shortage. In this paper, we focus on the implementation of demand response strategy to save power during peak hours by using Smart Grid. It is obviously impractical with centralized power control network to realize the real-time control performance, where…
▽ More
It is known that demand and supply power balancing is an essential method to operate power delivery system and prevent blackouts caused by power shortage. In this paper, we focus on the implementation of demand response strategy to save power during peak hours by using Smart Grid. It is obviously impractical with centralized power control network to realize the real-time control performance, where a single central controller measures the huge metering data and sends control command back to all customers. For that purpose, we propose a new architecture of hierarchical distributed power control network which is scalable regardless of the network size. The sub-controllers are introduced to partition the large system into smaller distributed clusters where low-latency local feedback power control loops are conducted to guarantee control stability. Furthermore, sub-controllers are stacked up in an hierarchical manner such that data are fed back layer-by-layer in the inbound while in the outbound control responses are decentralized in each local sub-controller for realizing the global objectives. Numerical simulations in a realistic scenario of up to 5000 consumers show the effectiveness of the proposed scheme to achieve a desired 10% peak power saving by using off-the-shelf wireless devices with IEEE802.15.4g standard. In addition, a small scale power control system for green building test-bed is implemented to demonstrate the potential use of the proposed scheme for power saving in real life.
△ Less
Submitted 22 May, 2013;
originally announced May 2013.
