-
Providentia -- A Large-Scale Sensor System for the Assistance of Autonomous Vehicles and Its Evaluation
Authors:
Annkathrin Krämmer,
Christoph Schöller,
Dhiraj Gulati,
Venkatnarayanan Lakshminarasimhan,
Franz Kurz,
Dominik Rosenbaum,
Claus Lenz,
Alois Knoll
Abstract:
The environmental perception of an autonomous vehicle is limited by its physical sensor ranges and algorithmic performance, as well as by occlusions that degrade its understanding of an ongoing traffic situation. This not only poses a significant threat to safety and limits driving speeds, but it can also lead to inconvenient maneuvers. Intelligent Infrastructure Systems can help to alleviate thes…
▽ More
The environmental perception of an autonomous vehicle is limited by its physical sensor ranges and algorithmic performance, as well as by occlusions that degrade its understanding of an ongoing traffic situation. This not only poses a significant threat to safety and limits driving speeds, but it can also lead to inconvenient maneuvers. Intelligent Infrastructure Systems can help to alleviate these problems. An Intelligent Infrastructure System can fill in the gaps in a vehicle's perception and extend its field of view by providing additional detailed information about its surroundings, in the form of a digital model of the current traffic situation, i.e. a digital twin. However, detailed descriptions of such systems and working prototypes demonstrating their feasibility are scarce. In this paper, we propose a hardware and software architecture that enables such a reliable Intelligent Infrastructure System to be built. We have implemented this system in the real world and demonstrate its ability to create an accurate digital twin of an extended highway stretch, thus enhancing an autonomous vehicle's perception beyond the limits of its on-board sensors. Furthermore, we evaluate the accuracy and reliability of the digital twin by using aerial images and earth observation methods for generating ground truth data.
△ Less
Submitted 8 December, 2021; v1 submitted 16 June, 2019;
originally announced June 2019.
-
Reconfigurable radiofrequency electronic functions designed with 3D Smith Charts in Metal-Insulator-Transition Materials
Authors:
Andrei Muller,
Alin Moldoveanu,
Victor Asavei,
Riyaz Khadar,
Esther Sanabria Codesal,
Anna Krammer,
Montserrat Fernandez-Bolaños,
Matteo Cavalleri,
Junrui Zhang,
Emanuele Casu,
Andreas Schuler,
Adrian Mihai Ionescu
Abstract:
Recently, the field of Metal-Insulator-Transition (MIT) materials has emerged as an unconventional solution for novel energy efficient electronic functions, such as steep slope subthermionic switches, neuromorphic hardware, reconfigurable radiofrequency functions, new types of sensors, teraherz and optoelectronic devices. Designing radiofrequency (RF) electronic circuits with a MIT material like v…
▽ More
Recently, the field of Metal-Insulator-Transition (MIT) materials has emerged as an unconventional solution for novel energy efficient electronic functions, such as steep slope subthermionic switches, neuromorphic hardware, reconfigurable radiofrequency functions, new types of sensors, teraherz and optoelectronic devices. Designing radiofrequency (RF) electronic circuits with a MIT material like vanadium dioxide, VO2, requires the understanding of its physics and appropriate models and tools, with predictive capability over large range of frequency (1-100GHz). Here, we develop 3D Smith charts for devices and circuits having complex frequency dependences, like the ones resulting by the use of MIT materials. The novel foundation of a 3D Smith chart involves here the geometrical fundamental notions of oriented curvature and variable homothety in order to clarify first theoretical inconsistencies in Foster and Non Foster circuits, where the driving point impedances exhibit mixed clockwise and counter-clockwise frequency dependent paths on the Smith chart as frequency increases. We show here the unique visualization capability of a 3D Smith chart, which allows to quantify orientation over variable frequency. The new 3D Smith chart is applied as a 3D multi-parameter modelling and design environment for the complex case of Metal-Insulator-Transition (MIT) materials where their permittivity is dependent on the frequency. In this work, we apply 3D Smith charts to on Vanadium Dioxide (VO2) reconfigurable Peano inductors. We report fabricated inductors with record quality factors using VO2 phase transition to program multiple tuning states, operating in the range 4 GHz to 10 GHz. Finally, we fabricate new Peano curves filters used to extract the frequency-dependent dielectric constant of VO2 within 1 GHz-50 GHz for the accurate design of RF electronic applications with phase change materials
△ Less
Submitted 23 May, 2019;
originally announced May 2019.
-
Targetless Rotational Auto-Calibration of Radar and Camera for Intelligent Transportation Systems
Authors:
Christoph Schöller,
Maximilian Schnettler,
Annkathrin Krämmer,
Gereon Hinz,
Maida Bakovic,
Müge Güzet,
Alois Knoll
Abstract:
Most intelligent transportation systems use a combination of radar sensors and cameras for robust vehicle perception. The calibration of these heterogeneous sensor types in an automatic fashion during system operation is challenging due to differing physical measurement principles and the high sparsity of traffic radars. We propose - to the best of our knowledge - the first data-driven method for…
▽ More
Most intelligent transportation systems use a combination of radar sensors and cameras for robust vehicle perception. The calibration of these heterogeneous sensor types in an automatic fashion during system operation is challenging due to differing physical measurement principles and the high sparsity of traffic radars. We propose - to the best of our knowledge - the first data-driven method for automatic rotational radar-camera calibration without dedicated calibration targets. Our approach is based on a coarse and a fine convolutional neural network. We employ a boosting-inspired training algorithm, where we train the fine network on the residual error of the coarse network. Due to the unavailability of public datasets combining radar and camera measurements, we recorded our own real-world data. We demonstrate that our method is able to reach precise and robust sensor registration and show its generalization capabilities to different sensor alignments and perspectives.
△ Less
Submitted 28 July, 2019; v1 submitted 18 April, 2019;
originally announced April 2019.
-
Cloud Detection Algorithm for Remote Sensing Images Using Fully Convolutional Neural Networks
Authors:
Sorour Mohajerani,
Thomas A. Krammer,
Parvaneh Saeedi
Abstract:
This paper presents a deep-learning based framework for addressing the problem of accurate cloud detection in remote sensing images. This framework benefits from a Fully Convolutional Neural Network (FCN), which is capable of pixel-level labeling of cloud regions in a Landsat 8 image. Also, a gradient-based identification approach is proposed to identify and exclude regions of snow/ice in the grou…
▽ More
This paper presents a deep-learning based framework for addressing the problem of accurate cloud detection in remote sensing images. This framework benefits from a Fully Convolutional Neural Network (FCN), which is capable of pixel-level labeling of cloud regions in a Landsat 8 image. Also, a gradient-based identification approach is proposed to identify and exclude regions of snow/ice in the ground truths of the training set. We show that using the hybrid of the two methods (threshold-based and deep-learning) improves the performance of the cloud identification process without the need to manually correct automatically generated ground truths. In average the Jaccard index and recall measure are improved by 4.36% and 3.62%, respectively.
△ Less
Submitted 12 October, 2018;
originally announced October 2018.
