-
Deep Learning-Driven State Correction: A Hybrid Architecture for Radar-Based Dynamic Occupancy Grid Map**
Authors:
Max Peter Ronecker,
Xavier Diaz,
Michael Karner,
Daniel Watzenig
Abstract:
This paper introduces a novel hybrid architecture that enhances radar-based Dynamic Occupancy Grid Map** (DOGM) for autonomous vehicles, integrating deep learning for state-classification. Traditional radar-based DOGM often faces challenges in accurately distinguishing between static and dynamic objects. Our approach addresses this limitation by introducing a neural network-based DOGM state corr…
▽ More
This paper introduces a novel hybrid architecture that enhances radar-based Dynamic Occupancy Grid Map** (DOGM) for autonomous vehicles, integrating deep learning for state-classification. Traditional radar-based DOGM often faces challenges in accurately distinguishing between static and dynamic objects. Our approach addresses this limitation by introducing a neural network-based DOGM state correction mechanism, designed as a semantic segmentation task, to refine the accuracy of the occupancy grid. Additionally a heuristic fusion approach is proposed which allows to enhance performance without compromising on safety. We extensively evaluate this hybrid architecture on the NuScenes Dataset, focusing on its ability to improve dynamic object detection as well grid quality. The results show clear improvements in the detection capabilities of dynamic objects, highlighting the effectiveness of the deep learning-enhanced state correction in radar-based DOGM.
△ Less
Submitted 21 May, 2024;
originally announced May 2024.
-
Random Network Distillation Based Deep Reinforcement Learning for AGV Path Planning
Authors:
Huilin Yin,
Shengkai Su,
Yinjia Lin,
Pengju Zhen,
Karin Festl,
Daniel Watzenig
Abstract:
With the flourishing development of intelligent warehousing systems, the technology of Automated Guided Vehicle (AGV) has experienced rapid growth. Within intelligent warehousing environments, AGV is required to safely and rapidly plan an optimal path in complex and dynamic environments. Most research has studied deep reinforcement learning to address this challenge. However, in the environments w…
▽ More
With the flourishing development of intelligent warehousing systems, the technology of Automated Guided Vehicle (AGV) has experienced rapid growth. Within intelligent warehousing environments, AGV is required to safely and rapidly plan an optimal path in complex and dynamic environments. Most research has studied deep reinforcement learning to address this challenge. However, in the environments with sparse extrinsic rewards, these algorithms often converge slowly, learn inefficiently or fail to reach the target. Random Network Distillation (RND), as an exploration enhancement, can effectively improve the performance of proximal policy optimization, especially enhancing the additional intrinsic rewards of the AGV agent which is in sparse reward environments. Moreover, most of the current research continues to use 2D grid mazes as experimental environments. These environments have insufficient complexity and limited action sets. To solve this limitation, we present simulation environments of AGV path planning with continuous actions and positions for AGVs, so that it can be close to realistic physical scenarios. Based on our experiments and comprehensive analysis of the proposed method, the results demonstrate that our proposed method enables AGV to more rapidly complete path planning tasks with continuous actions in our environments. A video of part of our experiments can be found at https://youtu.be/lwrY9YesGmw.
△ Less
Submitted 18 April, 2024;
originally announced April 2024.
-
Dynamic Occupancy Grids for Object Detection: A Radar-Centric Approach
Authors:
Max Peter Ronecker,
Markus Schratter,
Lukas Kuschnig,
Daniel Watzenig
Abstract:
Dynamic Occupancy Grid Map** is a technique used to generate a local map of the environment containing both static and dynamic information. Typically, these maps are primarily generated using lidar measurements. However, with improvements in radar sensing, resulting in better accuracy and higher resolution, radar is emerging as a viable alternative to lidar as the primary sensor for map**. In…
▽ More
Dynamic Occupancy Grid Map** is a technique used to generate a local map of the environment containing both static and dynamic information. Typically, these maps are primarily generated using lidar measurements. However, with improvements in radar sensing, resulting in better accuracy and higher resolution, radar is emerging as a viable alternative to lidar as the primary sensor for map**. In this paper, we propose a radar-centric dynamic occupancy grid map** algorithm with adaptations to the state computation, inverse sensor model, and field-of-view computation tailored to the specifics of radar measurements. We extensively evaluate our approach using real data to demonstrate its effectiveness and establish the first benchmark for radar-based dynamic occupancy grid map** using the publicly available Radarscenes dataset.
△ Less
Submitted 21 May, 2024; v1 submitted 2 February, 2024;
originally announced February 2024.
-
Multi-objective path tracking control for car-like vehicles with differentially bounded n-smooth output
Authors:
Karin Festl,
Michael Stolz,
Daniel Watzenig
Abstract:
When designing path tracking controllers for car-like vehicles, two main aspects are the tracking performance and the characteristics of the actuation signal. Our work bases on an existing variable structure controller that was designed with the geometrically optimal solution of a Dubins car, but with chattering on the output. In this contribution, we extend this approach to achieve an actuation s…
▽ More
When designing path tracking controllers for car-like vehicles, two main aspects are the tracking performance and the characteristics of the actuation signal. Our work bases on an existing variable structure controller that was designed with the geometrically optimal solution of a Dubins car, but with chattering on the output. In this contribution, we extend this approach to achieve an actuation signal that is n-smooth and differentially bounded. While the global stability under matched disturbances is maintained, the finite time reaching behavior is exchanged for asymptotic convergence. With the $n$-smooth output, n new parameters are introduced, weighing the control characteristics between the tracking performance and the magnitude of the steering angles derivatives. The controller is also evaluated in simulation, demonstrating the tuning capabilities, as well as the reaching and tracking behavior. The main contribution of this work is a control law designed to produce a smooth steering angle with implicit satisfaction of bounds on its derivatives.
△ Less
Submitted 15 June, 2023;
originally announced June 2023.
-
Performance of Graph Database Management Systems as route planning solutions for different data and usage characteristics
Authors:
Karin Festl,
Patrick Promitzer,
Daniel Watzenig,
Huilin Yin
Abstract:
Graph databases have grown in popularity in recent years as they are able to efficiently store and query complex relationships between data. Incidentally, navigation data and road networks can be processed, sampled or modified efficiently when stored as a graph. As a result, graph databases are a solution for solving route planning tasks that comes more and more to the attention of developers of a…
▽ More
Graph databases have grown in popularity in recent years as they are able to efficiently store and query complex relationships between data. Incidentally, navigation data and road networks can be processed, sampled or modified efficiently when stored as a graph. As a result, graph databases are a solution for solving route planning tasks that comes more and more to the attention of developers of autonomous vehicles. To achieve a computational performance that enables the realization of route planning on large road networks or for a great number of agents concurrently, several aspects need to be considered in the design of the solution. Based on a concrete use case for centralized route planning, we discuss the characteristics and properties of a use case that can significantly influence the computational effort or efficiency of the database management system. Subsequently we evaluate the performance of both Neo4j and ArangoDB depending on these properties. With these results, it is not only possible to choose the most suitable database system but also to improve the resulting performance by addressing relevant aspects in the design of the application.
△ Less
Submitted 12 June, 2023;
originally announced June 2023.
-
Dual-Weight Particle Filter for Radar-Based Dynamic Bayesian Grid Maps
Authors:
Max Peter Ronecker,
Michael Stolz,
Daniel Watzenig
Abstract:
Through constant improvements in recent years radar sensors have become a viable alternative to lidar as the main distancing sensor of an autonomous vehicle. Although robust and with the possibility to directly measure the radial velocity, it brings it's own set of challenges, for which existing algorithms need to be adapted. One core algorithm of a perception system is dynamic occupancy grid mapp…
▽ More
Through constant improvements in recent years radar sensors have become a viable alternative to lidar as the main distancing sensor of an autonomous vehicle. Although robust and with the possibility to directly measure the radial velocity, it brings it's own set of challenges, for which existing algorithms need to be adapted. One core algorithm of a perception system is dynamic occupancy grid map**, which has traditionally relied on lidar. In this paper we present a dual-weight particle filter as an extension for a Bayesian occupancy grid map** framework to allow to operate it with radar as its main sensors. It uses two separate particle weights that are computed differently to compensate that a radial velocity measurement in many situations is not able to capture the actual velocity of an object. We evaluate the method extensively with simulated data and show the advantages over existing single weight solutions.
△ Less
Submitted 20 March, 2023;
originally announced March 2023.
-
An Inverse Optimal Control Approach for Trajectory Prediction of Autonomous Race Cars
Authors:
Rudolf Reiter,
Florian Messerer,
Markus Schratter,
Daniel Watzenig,
Moritz Diehl
Abstract:
This paper proposes an optimization-based approach to predict trajectories of autonomous race cars. We assume that the observed trajectory is the result of an optimization problem that trades off path progress against acceleration and jerk smoothness, and which is restricted by constraints. The algorithm predicts a trajectory by solving a parameterized nonlinear program (NLP) which contains path p…
▽ More
This paper proposes an optimization-based approach to predict trajectories of autonomous race cars. We assume that the observed trajectory is the result of an optimization problem that trades off path progress against acceleration and jerk smoothness, and which is restricted by constraints. The algorithm predicts a trajectory by solving a parameterized nonlinear program (NLP) which contains path progress and smoothness in cost terms. By observing the actual motion of a vehicle, the parameters of prediction are updated by means of solving an inverse optimal control problem that contains the parameters of the predicting NLP as optimization variables. The algorithm therefore learns to predict the observed vehicle trajectory in a least-squares relation to measurement data and to the presumed structure of the predicting NLP. This work contributes with an algorithm that allows for accurate and interpretable predictions with sparse data. The algorithm is implemented on embedded hardware in an autonomous real-world race car that is competing in the challenge Roborace and analyzed with respect to recorded data.
△ Less
Submitted 4 April, 2022;
originally announced April 2022.
-
Extraction and Assessment of Naturalistic Human Driving Trajectories from Infrastructure Camera and Radar Sensors
Authors:
Dominik Notz,
Felix Becker,
Thomas Kühbeck,
Daniel Watzenig
Abstract:
Collecting realistic driving trajectories is crucial for training machine learning models that imitate human driving behavior. Most of today's autonomous driving datasets contain only a few trajectories per location and are recorded with test vehicles that are cautiously driven by trained drivers. In particular in interactive scenarios such as highway merges, the test driver's behavior significant…
▽ More
Collecting realistic driving trajectories is crucial for training machine learning models that imitate human driving behavior. Most of today's autonomous driving datasets contain only a few trajectories per location and are recorded with test vehicles that are cautiously driven by trained drivers. In particular in interactive scenarios such as highway merges, the test driver's behavior significantly influences other vehicles. This influence prevents recording the whole traffic space of human driving behavior. In this work, we present a novel methodology to extract trajectories of traffic objects using infrastructure sensors. Infrastructure sensors allow us to record a lot of data for one location and take the test drivers out of the loop. We develop both a hardware setup consisting of a camera and a traffic surveillance radar and a trajectory extraction algorithm. Our vision pipeline accurately detects objects, fuses camera and radar detections and tracks them over time. We improve a state-of-the-art object tracker by combining the tracking in image coordinates with a Kalman filter in road coordinates. We show that our sensor fusion approach successfully combines the advantages of camera and radar detections and outperforms either single sensor. Finally, we also evaluate the accuracy of our trajectory extraction pipeline. For that, we equip our test vehicle with a differential GPS sensor and use it to collect ground truth trajectories. With this data we compute the measurement errors. While we use the mean error to de-bias the trajectories, the error standard deviation is in the magnitude of the ground truth data inaccuracy. Hence, the extracted trajectories are not only naturalistic but also highly accurate and prove the potential of using infrastructure sensors to extract real-world trajectories.
△ Less
Submitted 2 April, 2020;
originally announced April 2020.
-
Pedestrian Collision Avoidance System for Scenarios with Occlusions
Authors:
Markus Schratter,
Maxime Bouton,
Mykel J. Kochenderfer,
Daniel Watzenig
Abstract:
Safe autonomous driving in urban areas requires robust algorithms to avoid collisions with other traffic participants with limited perception ability. Current deployed approaches relying on Autonomous Emergency Braking (AEB) systems are often overly conservative. In this work, we formulate the problem as a partially observable Markov decision process (POMDP), to derive a policy robust to uncertain…
▽ More
Safe autonomous driving in urban areas requires robust algorithms to avoid collisions with other traffic participants with limited perception ability. Current deployed approaches relying on Autonomous Emergency Braking (AEB) systems are often overly conservative. In this work, we formulate the problem as a partially observable Markov decision process (POMDP), to derive a policy robust to uncertainty in the pedestrian location. We investigate how to integrate such a policy with an AEB system that operates only when a collision is unavoidable. In addition, we propose a rigorous evaluation methodology on a set of well defined scenarios. We show that combining the two approaches provides a robust autonomous braking system that reduces unnecessary braking caused by using the AEB system on its own.
△ Less
Submitted 25 April, 2019;
originally announced April 2019.
-
Safe learning-based optimal motion planning for automated driving
Authors:
Zlatan Ajanovic,
Bakir Lacevic,
Georg Stettinger,
Daniel Watzenig,
Martin Horn
Abstract:
This paper presents preliminary work on learning the search heuristic for the optimal motion planning for automated driving in urban traffic. Previous work considered search-based optimal motion planning framework (SBOMP) that utilized numerical or model-based heuristics that did not consider dynamic obstacles. Optimal solution was still guaranteed since dynamic obstacles can only increase the cos…
▽ More
This paper presents preliminary work on learning the search heuristic for the optimal motion planning for automated driving in urban traffic. Previous work considered search-based optimal motion planning framework (SBOMP) that utilized numerical or model-based heuristics that did not consider dynamic obstacles. Optimal solution was still guaranteed since dynamic obstacles can only increase the cost. However, significant variations in the search efficiency are observed depending whether dynamic obstacles are present or not. This paper introduces machine learning (ML) based heuristic that takes into account dynamic obstacles, thus adding to the performance consistency for achieving real-time implementation.
△ Less
Submitted 13 June, 2018; v1 submitted 25 May, 2018;
originally announced May 2018.
