-
NR-SLAM: Non-Rigid Monocular SLAM
Authors:
Juan J. Gomez Rodriguez,
J. M. M Montiel,
Juan D. Tardos
Abstract:
In this paper we present NR-SLAM, a novel non-rigid monocular SLAM system founded on the combination of a Dynamic Deformation Graph with a Visco-Elastic deformation model. The former enables our system to represent the dynamics of the deforming environment as the camera explores, while the later allows us to model general deformations in a simple way. The presented system is able to automatically…
▽ More
In this paper we present NR-SLAM, a novel non-rigid monocular SLAM system founded on the combination of a Dynamic Deformation Graph with a Visco-Elastic deformation model. The former enables our system to represent the dynamics of the deforming environment as the camera explores, while the later allows us to model general deformations in a simple way. The presented system is able to automatically initialize and extend a map modeled by a sparse point cloud in deforming environments, that is refined with a sliding-window Deformable Bundle Adjustment. This map serves as base for the estimation of the camera motion and deformation and enables us to represent arbitrary surface topologies, overcoming the limitations of previous methods. To assess the performance of our system in challenging deforming scenarios, we evaluate it in several representative medical datasets. In our experiments, NR-SLAM outperforms previous deformable SLAM systems, achieving millimeter reconstruction accuracy and bringing automated medical intervention closer. For the benefit of the community, we make the source code public.
△ Less
Submitted 1 August, 2023;
originally announced August 2023.
-
ExplORB-SLAM: Active Visual SLAM Exploiting the Pose-graph Topology
Authors:
Julio A. Placed,
Juan J. Gómez Rodríguez,
Juan D. Tardós,
José A. Castellanos
Abstract:
Deploying autonomous robots capable of exploring unknown environments has long been a topic of great relevance to the robotics community. In this work, we take a further step in that direction by presenting an open-source active visual SLAM framework that leverages the accuracy of a state-of-the-art graph-SLAM system and takes advantage of the fast utility computation that exploiting the structure…
▽ More
Deploying autonomous robots capable of exploring unknown environments has long been a topic of great relevance to the robotics community. In this work, we take a further step in that direction by presenting an open-source active visual SLAM framework that leverages the accuracy of a state-of-the-art graph-SLAM system and takes advantage of the fast utility computation that exploiting the structure of the underlying pose-graph offers. Through careful estimation of a posteriori weighted pose-graphs, D-optimal decision-making is achieved online with the objective of improving localization and map** uncertainties as exploration occurs.
△ Less
Submitted 8 September, 2022;
originally announced September 2022.
-
Tracking monocular camera pose and deformation for SLAM inside the human body
Authors:
Juan J. Gomez Rodriguez,
J. M. M Montiel,
Juan D. Tardos
Abstract:
Monocular SLAM in deformable scenes will open the way to multiple medical applications like computer-assisted navigation in endoscopy, automatic drug delivery or autonomous robotic surgery. In this paper we propose a novel method to simultaneously track the camera pose and the 3D scene deformation, without any assumption about environment topology or shape. The method uses an illumination-invarian…
▽ More
Monocular SLAM in deformable scenes will open the way to multiple medical applications like computer-assisted navigation in endoscopy, automatic drug delivery or autonomous robotic surgery. In this paper we propose a novel method to simultaneously track the camera pose and the 3D scene deformation, without any assumption about environment topology or shape. The method uses an illumination-invariant photometric method to track image features and estimates camera motion and deformation combining reprojection error with spatial and temporal regularization of deformations. Our results in simulated colonoscopies show the method's accuracy and robustness in complex scenes under increasing levels of deformation. Our qualitative results in human colonoscopies from Endomapper dataset show that the method is able to successfully cope with the challenges of real endoscopies: deformations, low texture and strong illumination changes. We also compare with previous tracking methods in simpler scenarios from Hamlyn dataset where we obtain competitive performance, without needing any topological assumption.
△ Less
Submitted 18 April, 2022;
originally announced April 2022.
-
Direct and Sparse Deformable Tracking
Authors:
Jose Lamarca,
Juan J. Gomez Rodriguez,
Juan D. Tardos,
J. M. M. Montiel
Abstract:
Deformable Monocular SLAM algorithms recover the localization of a camera in an unknown deformable environment. Current approaches use a template-based deformable tracking to recover the camera pose and the deformation of the map. These template-based methods use an underlying global deformation model. In this paper, we introduce a novel deformable camera tracking method with a local deformation m…
▽ More
Deformable Monocular SLAM algorithms recover the localization of a camera in an unknown deformable environment. Current approaches use a template-based deformable tracking to recover the camera pose and the deformation of the map. These template-based methods use an underlying global deformation model. In this paper, we introduce a novel deformable camera tracking method with a local deformation model for each point. Each map point is defined as a single textured surfel that moves independently of the other map points. Thanks to a direct photometric error cost function, we can track the position and orientation of the surfel without an explicit global deformation model. In our experiments, we validate the proposed system and observe that our local deformation model estimates more accurately and robustly the targeted deformations of the map in both laboratory-controlled experiments and in-body scenarios undergoing non-isometric deformations, with changing topology or discontinuities.
△ Less
Submitted 15 September, 2021;
originally announced September 2021.
-
SD-DefSLAM: Semi-Direct Monocular SLAM for Deformable and Intracorporeal Scenes
Authors:
Juan J. Gómez Rodríguez,
José Lamarca,
Javier Morlana,
Juan D. Tardós,
José M. M. Montiel
Abstract:
Conventional SLAM techniques strongly rely on scene rigidity to solve data association, ignoring dynamic parts of the scene. In this work we present Semi-Direct DefSLAM (SD-DefSLAM), a novel monocular deformable SLAM method able to map highly deforming environments, built on top of DefSLAM. To robustly solve data association in challenging deforming scenes, SD-DefSLAM combines direct and indirect…
▽ More
Conventional SLAM techniques strongly rely on scene rigidity to solve data association, ignoring dynamic parts of the scene. In this work we present Semi-Direct DefSLAM (SD-DefSLAM), a novel monocular deformable SLAM method able to map highly deforming environments, built on top of DefSLAM. To robustly solve data association in challenging deforming scenes, SD-DefSLAM combines direct and indirect methods: an enhanced illumination-invariant Lucas-Kanade tracker for data association, geometric Bundle Adjustment for pose and deformable map estimation, and bag-of-words based on feature descriptors for camera relocation. Dynamic objects are detected and segmented-out using a CNN trained for the specific application domain. We thoroughly evaluate our system in two public datasets. The mandala dataset is a SLAM benchmark with increasingly aggressive deformations. The Hamlyn dataset contains intracorporeal sequences that pose serious real-life challenges beyond deformation like weak texture, specular reflections, surgical tools and occlusions. Our results show that SD-DefSLAM outperforms DefSLAM in point tracking, reconstruction accuracy and scale drift thanks to the improvement in all the data association steps, being the first system able to robustly perform SLAM inside the human body.
△ Less
Submitted 19 October, 2020;
originally announced October 2020.
-
ORB-SLAM3: An Accurate Open-Source Library for Visual, Visual-Inertial and Multi-Map SLAM
Authors:
Carlos Campos,
Richard Elvira,
Juan J. Gómez Rodríguez,
José M. M. Montiel,
Juan D. Tardós
Abstract:
This paper presents ORB-SLAM3, the first system able to perform visual, visual-inertial and multi-map SLAM with monocular, stereo and RGB-D cameras, using pin-hole and fisheye lens models. The first main novelty is a feature-based tightly-integrated visual-inertial SLAM system that fully relies on Maximum-a-Posteriori (MAP) estimation, even during the IMU initialization phase. The result is a syst…
▽ More
This paper presents ORB-SLAM3, the first system able to perform visual, visual-inertial and multi-map SLAM with monocular, stereo and RGB-D cameras, using pin-hole and fisheye lens models. The first main novelty is a feature-based tightly-integrated visual-inertial SLAM system that fully relies on Maximum-a-Posteriori (MAP) estimation, even during the IMU initialization phase. The result is a system that operates robustly in real-time, in small and large, indoor and outdoor environments, and is 2 to 5 times more accurate than previous approaches. The second main novelty is a multiple map system that relies on a new place recognition method with improved recall. Thanks to it, ORB-SLAM3 is able to survive to long periods of poor visual information: when it gets lost, it starts a new map that will be seamlessly merged with previous maps when revisiting mapped areas. Compared with visual odometry systems that only use information from the last few seconds, ORB-SLAM3 is the first system able to reuse in all the algorithm stages all previous information. This allows to include in bundle adjustment co-visible keyframes, that provide high parallax observations boosting accuracy, even if they are widely separated in time or if they come from a previous map** session. Our experiments show that, in all sensor configurations, ORB-SLAM3 is as robust as the best systems available in the literature, and significantly more accurate. Notably, our stereo-inertial SLAM achieves an average accuracy of 3.6 cm on the EuRoC drone and 9 mm under quick hand-held motions in the room of TUM-VI dataset, a setting representative of AR/VR scenarios. For the benefit of the community we make public the source code.
△ Less
Submitted 23 April, 2021; v1 submitted 23 July, 2020;
originally announced July 2020.
-
Performance of a Front End prototype ASIC for picosecond precision time measurements with LGAD sensors
Authors:
C. Agapopoulou,
S. Blin,
A. Blot,
L. Castillo Garcia,
M. Chmeissani,
S. Conforti di Lorenzo,
C. de La Taille,
P. Dinaucourt,
A. Fallou,
J. Garcia Rodriguez,
V. Gkougkousis,
C. Grieco,
S. Grinstein,
S. Guindon,
N. Makovec,
G. Martin-Chassard,
G. Pellegrini,
A. Rummler,
S. Sacerdoti,
N. Seguin Moreau,
L. Serin,
A. Tricoli
Abstract:
For the High-Luminosity phase of LHC, the ATLAS experiment is proposing the addition of a High Granularity Timing Detector (HGTD) in the forward region to mitigate the effects of the increased pile-up. The chosen detection technology is Low Gain Avalanche Detector (LGAD) silicon sensors that can provide an excellent timing resolution below 50 ps. The front-end read-out ASIC must maintain the perfo…
▽ More
For the High-Luminosity phase of LHC, the ATLAS experiment is proposing the addition of a High Granularity Timing Detector (HGTD) in the forward region to mitigate the effects of the increased pile-up. The chosen detection technology is Low Gain Avalanche Detector (LGAD) silicon sensors that can provide an excellent timing resolution below 50 ps. The front-end read-out ASIC must maintain the performance of the sensor, while kee** low power consumption. This paper presents the results on the first prototype of a front-end ASIC, named ALTIROC0, which contains the analog stages (preamplifier and discriminator) of the read-out chip. The ASIC was characterised both alone and as part of a module with a 2$\times$2 LGAD array of 1.1$\times$1.1 mm$^2$ pads bump-bonded to it. The various contributions of the electronics to the time resolution were investigated in test-bench measurements with a calibration setup. Both when the ASIC is alone or with a bump-bonded sensor, the jitter of the ASIC is better than 20 ps for an injected charge of 10 fC. The time walk effect that arises from the different response of the preamplifier for various injected charges can be corrected up to 10 ps using a Time Over Threshold measurement. The combined performance of the ASIC and the LGAD sensor, which was measured during a beam test campaign in October 2018 with pions of 120 GeV energy at the CERN SPS, is around 40 ps for all measured modules. All tested modules show good efficiency and time resolution uniformity.
△ Less
Submitted 7 July, 2020; v1 submitted 14 February, 2020;
originally announced February 2020.
-
Some Baumslag-Solitar groups are two bridges virtual knots
Authors:
J. G. Rodríguez,
O. P. Salazar-Díaz,
J. J. Mira
Abstract:
In this paper we give necessary conditions on group presentations, with two generators and one relator, in order to be the group of a virtual knot diagram. Although those conditions are not enough, we use them to determine, completely, whether or not a Baumslag-Solitar group is the group of a $2$-bridge virtual knot. Moreover, we present a combinatorial proof of the fact that these groups are not…
▽ More
In this paper we give necessary conditions on group presentations, with two generators and one relator, in order to be the group of a virtual knot diagram. Although those conditions are not enough, we use them to determine, completely, whether or not a Baumslag-Solitar group is the group of a $2$-bridge virtual knot. Moreover, we present a combinatorial proof of the fact that these groups are not $2$-bridge classical knot groups.
△ Less
Submitted 10 November, 2015;
originally announced November 2015.
-
An Educational Fuzzy-based Control platform using LEGO Robots
Authors:
Daniel Zaldivar,
Erik Cuevas,
Marco A. Perez,
Juan H. Sossa,
Jose G. Rodriguez,
Edgar O. Palafox
Abstract:
Fuzzy controllers have gained popularity in the past few decades with successful implementations in many fields that have enabled designers to control complex systems through linguistic-based rules in contrast to traditional methods. This paper presents an educational platform based on LEGO\c{opyright} NXT to assist the learning of fuzzy logic control principles at undergraduate level by providing…
▽ More
Fuzzy controllers have gained popularity in the past few decades with successful implementations in many fields that have enabled designers to control complex systems through linguistic-based rules in contrast to traditional methods. This paper presents an educational platform based on LEGO\c{opyright} NXT to assist the learning of fuzzy logic control principles at undergraduate level by providing a simple and easy-to-follow teaching setup. The proposed fuzzy control study aims to accompany students to the learning of fuzzy control fundamentals by building hands-on robotic experiments. The proposed educational platform has been successfully applied to several undergraduate courses within the Electronics Department in the University of Guadalajara. The description of robotic experiments and the evaluation of their impact in the student performance are both provided in the paper.
△ Less
Submitted 13 June, 2014;
originally announced June 2014.
