-
Real-Time Intensity-Image Reconstruction for Event Cameras Using Manifold Regularisation
Authors:
Christian Reinbacher,
Gottfried Graber,
Thomas Pock
Abstract:
Event cameras or neuromorphic cameras mimic the human perception system as they measure the per-pixel intensity change rather than the actual intensity level. In contrast to traditional cameras, such cameras capture new information about the scene at MHz frequency in the form of sparse events. The high temporal resolution comes at the cost of losing the familiar per-pixel intensity information. In…
▽ More
Event cameras or neuromorphic cameras mimic the human perception system as they measure the per-pixel intensity change rather than the actual intensity level. In contrast to traditional cameras, such cameras capture new information about the scene at MHz frequency in the form of sparse events. The high temporal resolution comes at the cost of losing the familiar per-pixel intensity information. In this work we propose a variational model that accurately models the behaviour of event cameras, enabling reconstruction of intensity images with arbitrary frame rate in real-time. Our method is formulated on a per-event-basis, where we explicitly incorporate information about the asynchronous nature of events via an event manifold induced by the relative timestamps of events. In our experiments we verify that solving the variational model on the manifold produces high-quality images without explicitly estimating optical flow.
△ Less
Submitted 4 August, 2016; v1 submitted 21 July, 2016;
originally announced July 2016.
-
Solving Dense Image Matching in Real-Time using Discrete-Continuous Optimization
Authors:
Alexander Shekhovtsov,
Christian Reinbacher,
Gottfried Graber,
Thomas Pock
Abstract:
Dense image matching is a fundamental low-level problem in Computer Vision, which has received tremendous attention from both discrete and continuous optimization communities. The goal of this paper is to combine the advantages of discrete and continuous optimization in a coherent framework. We devise a model based on energy minimization, to be optimized by both discrete and continuous algorithms…
▽ More
Dense image matching is a fundamental low-level problem in Computer Vision, which has received tremendous attention from both discrete and continuous optimization communities. The goal of this paper is to combine the advantages of discrete and continuous optimization in a coherent framework. We devise a model based on energy minimization, to be optimized by both discrete and continuous algorithms in a consistent way. In the discrete setting, we propose a novel optimization algorithm that can be massively parallelized. In the continuous setting we tackle the problem of non-convex regularizers by a formulation based on differences of convex functions. The resulting hybrid discrete-continuous algorithm can be efficiently accelerated by modern GPUs and we demonstrate its real-time performance for the applications of dense stereo matching and optical flow.
△ Less
Submitted 23 January, 2016;
originally announced January 2016.
-
Performance Evaluation of Vision-Based Algorithms for MAVs
Authors:
T. Holzmann,
R. Prettenthaler,
J. Pestana,
D. Muschick,
G. Graber,
C. Mostegel,
F. Fraundorfer,
H. Bischof
Abstract:
An important focus of current research in the field of Micro Aerial Vehicles (MAVs) is to increase the safety of their operation in general unstructured environments. Especially indoors, where GPS cannot be used for localization, reliable algorithms for localization and map** of the environment are necessary in order to keep an MAV airborne safely. In this paper, we compare vision-based real-tim…
▽ More
An important focus of current research in the field of Micro Aerial Vehicles (MAVs) is to increase the safety of their operation in general unstructured environments. Especially indoors, where GPS cannot be used for localization, reliable algorithms for localization and map** of the environment are necessary in order to keep an MAV airborne safely. In this paper, we compare vision-based real-time capable methods for localization and map** and point out their strengths and weaknesses. Additionally, we describe algorithms for state estimation, control and navigation, which use the localization and map** results of our vision-based algorithms as input.
△ Less
Submitted 9 May, 2015;
originally announced May 2015.
