Exploring Object-Aware Attention Guided Frame Association for RGB-D SLAM
Authors:
Ali Caglayan,
Nevrez Imamoglu,
Oguzhan Guclu,
Ali Osman Serhatoglu,
Weimin Wang,
Ahmet Burak Can,
Ryosuke Nakamura
Abstract:
Deep learning models as an emerging topic have shown great progress in various fields. Especially, visualization tools such as class activation map** methods provided visual explanation on the reasoning of convolutional neural networks (CNNs). By using the gradients of the network layers, it is possible to demonstrate where the networks pay attention during a specific image recognition task. Mor…
▽ More
Deep learning models as an emerging topic have shown great progress in various fields. Especially, visualization tools such as class activation map** methods provided visual explanation on the reasoning of convolutional neural networks (CNNs). By using the gradients of the network layers, it is possible to demonstrate where the networks pay attention during a specific image recognition task. Moreover, these gradients can be integrated with CNN features for localizing more generalized task dependent attentive (salient) objects in scenes. Despite this progress, there is not much explicit usage of this gradient (network attention) information to integrate with CNN representations for object semantics. This can be very useful for visual tasks such as simultaneous localization and map** (SLAM) where CNN representations of spatially attentive object locations may lead to improved performance. Therefore, in this work, we propose the use of task specific network attention for RGB-D indoor SLAM. To do so, we integrate layer-wise object attention information (layer gradients) with CNN layer representations to improve frame association performance in an RGB-D indoor SLAM method. Experiments show promising results with improved performance over the baseline.
△ Less
Submitted 13 March, 2023; v1 submitted 28 January, 2022;
originally announced January 2022.
