-
A New Framework for Registration of Semantic Point Clouds from Stereo and RGB-D Cameras
Authors:
Ray Zhang,
Tzu-Yuan Lin,
Chien Erh Lin,
Steven A. Parkison,
William Clark,
Jessy W. Grizzle,
Ryan M. Eustice,
Maani Ghaffari
Abstract:
This paper reports on a novel nonparametric rigid point cloud registration framework that jointly integrates geometric and semantic measurements such as color or semantic labels into the alignment process and does not require explicit data association. The point clouds are represented as nonparametric functions in a reproducible kernel Hilbert space. The alignment problem is formulated as maximizi…
▽ More
This paper reports on a novel nonparametric rigid point cloud registration framework that jointly integrates geometric and semantic measurements such as color or semantic labels into the alignment process and does not require explicit data association. The point clouds are represented as nonparametric functions in a reproducible kernel Hilbert space. The alignment problem is formulated as maximizing the inner product between two functions, essentially a sum of weighted kernels, each of which exploits the local geometric and semantic features. As a result of the continuous models, analytical gradients can be computed, and a local solution can be obtained by optimization over the rigid body transformation group. Besides, we present a new point cloud alignment metric that is intrinsic to the proposed framework and takes into account geometric and semantic information. The evaluations using publicly available stereo and RGB-D datasets show that the proposed method outperforms state-of-the-art outdoor and indoor frame-to-frame registration methods. An open-source GPU implementation is also provided.
△ Less
Submitted 10 November, 2020;
originally announced December 2020.
-
Sparse Bayesian Inference for Dense Semantic Map**
Authors:
Lu Gan,
Maani Ghaffari Jadidi,
Steven A. Parkison,
Ryan M. Eustice
Abstract:
Despite impressive advances in simultaneous localization and map**, dense robotic map** remains challenging due to its inherent nature of being a high-dimensional inference problem. In this paper, we propose a dense semantic robotic map** technique that exploits sparse Bayesian models, in particular, the relevance vector machine, for high-dimensional sequential inference. The technique is ba…
▽ More
Despite impressive advances in simultaneous localization and map**, dense robotic map** remains challenging due to its inherent nature of being a high-dimensional inference problem. In this paper, we propose a dense semantic robotic map** technique that exploits sparse Bayesian models, in particular, the relevance vector machine, for high-dimensional sequential inference. The technique is based on the principle of automatic relevance determination and produces sparse models that use a small subset of the original dense training set as the dominant basis. The resulting map posterior is continuous, and queries can be made efficiently at any resolution. Moreover, the technique has probabilistic outputs per semantic class through Bayesian inference. We evaluate the proposed relevance vector semantic map using publicly available benchmark datasets, NYU Depth V2 and KITTI; and the results show promising improvements over the state-of-the-art techniques.
△ Less
Submitted 22 September, 2017;
originally announced September 2017.
-
Gaussian Processes Semantic Map Representation
Authors:
Maani Ghaffari Jadidi,
Lu Gan,
Steven A. Parkison,
Jie Li,
Ryan M. Eustice
Abstract:
In this paper, we develop a high-dimensional map building technique that incorporates raw pixelated semantic measurements into the map representation. The proposed technique uses Gaussian Processes (GPs) multi-class classification for map inference and is the natural extension of GP occupancy maps from binary to multi-class form. The technique exploits the continuous property of GPs and, as a resu…
▽ More
In this paper, we develop a high-dimensional map building technique that incorporates raw pixelated semantic measurements into the map representation. The proposed technique uses Gaussian Processes (GPs) multi-class classification for map inference and is the natural extension of GP occupancy maps from binary to multi-class form. The technique exploits the continuous property of GPs and, as a result, the map can be inferred with any resolution. In addition, the proposed GP Semantic Map (GPSM) learns the structural and semantic correlation from measurements rather than resorting to assumptions, and can flexibly learn the spatial correlation as well as any additional non-spatial correlation between map points. We extend the OctoMap to Semantic OctoMap representation and compare with the GPSM map** performance using NYU Depth V2 dataset. Evaluations of the proposed technique on multiple partially labeled RGBD scans and labels from noisy image segmentation show that the GP semantic map can handle sparse measurements, missing labels in the point cloud, as well as noise corrupted labels.
△ Less
Submitted 5 July, 2017;
originally announced July 2017.
