-
Towards Long Term SLAM on Thermal Imagery
Authors:
Colin Keil,
Aniket Gupta,
Pushyami Kaveti,
Hanumant Singh
Abstract:
Visual SLAM with thermal imagery, and other low contrast visually degraded environments such as underwater, or in areas dominated by snow and ice, remain a difficult problem for many state of the art (SOTA) algorithms. In addition to challenging front-end data association, thermal imagery presents an additional difficulty for long term relocalization and map reuse. The relative temperatures of obj…
▽ More
Visual SLAM with thermal imagery, and other low contrast visually degraded environments such as underwater, or in areas dominated by snow and ice, remain a difficult problem for many state of the art (SOTA) algorithms. In addition to challenging front-end data association, thermal imagery presents an additional difficulty for long term relocalization and map reuse. The relative temperatures of objects in thermal imagery change dramatically from day to night. Feature descriptors typically used for relocalization in SLAM are unable to maintain consistency over these diurnal changes. We show that learned feature descriptors can be used within existing Bag of Word based localization schemes to dramatically improve place recognition across large temporal gaps in thermal imagery. In order to demonstrate the effectiveness of our trained vocabulary, we have developed a baseline SLAM system, integrating learned features and matching into a classical SLAM algorithm. Our system demonstrates good local tracking on challenging thermal imagery, and relocalization that overcomes dramatic day to night thermal appearance changes. Our code and datasets are available here: https://github.com/neufieldrobotics/IRSLAM_Baseline
△ Less
Submitted 28 March, 2024;
originally announced March 2024.
-
Challenges of Indoor SLAM: A multi-modal multi-floor dataset for SLAM evaluation
Authors:
Pushyami Kaveti,
Aniket Gupta,
Dennis Giaya,
Madeline Karp,
Colin Keil,
Jagatpreet Nir,
Zhiyong Zhang,
Hanumant Singh
Abstract:
Robustness in Simultaneous Localization and Map** (SLAM) remains one of the key challenges for the real-world deployment of autonomous systems. SLAM research has seen significant progress in the last two and a half decades, yet many state-of-the-art (SOTA) algorithms still struggle to perform reliably in real-world environments. There is a general consensus in the research community that we need…
▽ More
Robustness in Simultaneous Localization and Map** (SLAM) remains one of the key challenges for the real-world deployment of autonomous systems. SLAM research has seen significant progress in the last two and a half decades, yet many state-of-the-art (SOTA) algorithms still struggle to perform reliably in real-world environments. There is a general consensus in the research community that we need challenging real-world scenarios which bring out different failure modes in sensing modalities. In this paper, we present a novel multi-modal indoor SLAM dataset covering challenging common scenarios that a robot will encounter and should be robust to. Our data was collected with a mobile robotics platform across multiple floors at Northeastern University's ISEC building. Such a multi-floor sequence is typical of commercial office spaces characterized by symmetry across floors and, thus, is prone to perceptual aliasing due to similar floor layouts. The sensor suite comprises seven global shutter cameras, a high-grade MEMS inertial measurement unit (IMU), a ZED stereo camera, and a 128-channel high-resolution lidar. Along with the dataset, we benchmark several SLAM algorithms and highlight the problems faced during the runs, such as perceptual aliasing, visual degradation, and trajectory drift. The benchmarking results indicate that parts of the dataset work well with some algorithms, while other data sections are challenging for even the best SOTA algorithms. The dataset is available at https://github.com/neufieldrobotics/NUFR-M3F.
△ Less
Submitted 14 June, 2023;
originally announced June 2023.
-
Team Northeastern's Approach to ANA XPRIZE Avatar Final Testing: A Holistic Approach to Telepresence and Lessons Learned
Authors:
Rui Luo,
Chunpeng Wang,
Colin Keil,
David Nguyen,
Henry Mayne,
Stephen Alt,
Eric Schwarm,
Evelyn Mendoza,
Taşkın Padır,
John Peter Whitney
Abstract:
This paper reports on Team Northeastern's Avatar system for telepresence, and our holistic approach to meet the ANA Avatar XPRIZE Final testing task requirements. The system features a dual-arm configuration with hydraulically actuated glove-gripper pair for haptic force feedback. Our proposed Avatar system was evaluated in the ANA Avatar XPRIZE Finals and completed all 10 tasks, scored 14.5 point…
▽ More
This paper reports on Team Northeastern's Avatar system for telepresence, and our holistic approach to meet the ANA Avatar XPRIZE Final testing task requirements. The system features a dual-arm configuration with hydraulically actuated glove-gripper pair for haptic force feedback. Our proposed Avatar system was evaluated in the ANA Avatar XPRIZE Finals and completed all 10 tasks, scored 14.5 points out of 15.0, and received the 3rd Place Award. We provide the details of improvements over our first generation Avatar, covering manipulation, perception, locomotion, power, network, and controller design. We also extensively discuss the major lessons learned during our participation in the competition.
△ Less
Submitted 8 March, 2023;
originally announced March 2023.
-
Efficient and Accurate Candidate Generation for Grasp Pose Detection in SE(3)
Authors:
Andreas ten Pas,
Colin Keil,
Robert Platt
Abstract:
Grasp detection of novel objects in unstructured environments is a key capability in robotic manipulation. For 2D grasp detection problems where grasps are assumed to lie in the plane, it is common to design a fully convolutional neural network that predicts grasps over an entire image in one step. However, this is not possible for grasp pose detection where grasp poses are assumed to exist in SE(…
▽ More
Grasp detection of novel objects in unstructured environments is a key capability in robotic manipulation. For 2D grasp detection problems where grasps are assumed to lie in the plane, it is common to design a fully convolutional neural network that predicts grasps over an entire image in one step. However, this is not possible for grasp pose detection where grasp poses are assumed to exist in SE(3). In this case, it is common to approach the problem in two steps: grasp candidate generation and candidate classification. Since grasp candidate classification is typically expensive, the problem becomes one of efficiently identifying high quality candidate grasps. This paper proposes a new grasp candidate generation method that significantly outperforms major 3D grasp detection baselines. Supplementary material is available at https://atenpas.github.io/psn/.
△ Less
Submitted 3 April, 2022;
originally announced April 2022.
-
Learning Bayes Filter Models for Tactile Localization
Authors:
Tarik Kelestemur,
Colin Keil,
John P. Whitney,
Robert Platt,
Taskin Padir
Abstract:
Localizing and tracking the pose of robotic grippers are necessary skills for manipulation tasks. However, the manipulators with imprecise kinematic models (e.g. low-cost arms) or manipulators with unknown world coordinates (e.g. poor camera-arm calibration) cannot locate the gripper with respect to the world. In these circumstances, we can leverage tactile feedback between the gripper and the env…
▽ More
Localizing and tracking the pose of robotic grippers are necessary skills for manipulation tasks. However, the manipulators with imprecise kinematic models (e.g. low-cost arms) or manipulators with unknown world coordinates (e.g. poor camera-arm calibration) cannot locate the gripper with respect to the world. In these circumstances, we can leverage tactile feedback between the gripper and the environment. In this paper, we present learnable Bayes filter models that can localize robotic grippers using tactile feedback. We propose a novel observation model that conditions the tactile feedback on visual maps of the environment along with a motion model to recursively estimate the gripper's location. Our models are trained in simulation with self-supervision and transferred to the real world. Our method is evaluated on a tabletop localization task in which the gripper interacts with objects. We report results in simulation and on a real robot, generalizing over different sizes, shapes, and configurations of the objects.
△ Less
Submitted 11 November, 2020;
originally announced November 2020.
-
A Survey on Honeypot Software and Data Analysis
Authors:
Marcin Nawrocki,
Matthias Wählisch,
Thomas C. Schmidt,
Christian Keil,
Jochen Schönfelder
Abstract:
In this survey, we give an extensive overview on honeypots. This includes not only honeypot software but also methodologies to analyse honeypot data.
In this survey, we give an extensive overview on honeypots. This includes not only honeypot software but also methodologies to analyse honeypot data.
△ Less
Submitted 22 August, 2016;
originally announced August 2016.
-
Design, Implementation, and Operation of a Mobile Honeypot
Authors:
Matthias Wählisch,
André Vorbach,
Christian Keil,
Jochen Schönfelder,
Thomas C. Schmidt,
Jochen H. Schiller
Abstract:
Mobile nodes, in particular smartphones are one of the most relevant devices in the current Internet in terms of quantity and economic impact. There is the common believe that those devices are of special interest for attackers due to their limited resources and the serious data they store. On the other hand, the mobile regime is a very lively network environment, which misses the (limited) ground…
▽ More
Mobile nodes, in particular smartphones are one of the most relevant devices in the current Internet in terms of quantity and economic impact. There is the common believe that those devices are of special interest for attackers due to their limited resources and the serious data they store. On the other hand, the mobile regime is a very lively network environment, which misses the (limited) ground truth we have in commonly connected Internet nodes. In this paper we argue for a simple long-term measurement infrastructure that allows for (1) the analysis of unsolicited traffic to and from mobile devices and (2) fair comparison with wired Internet access. We introduce the design and implementation of a mobile honeypot, which is deployed on standard hardware for more than 1.5 years. Two independent groups developed the same concept for the system. We also present preliminary measurement results.
△ Less
Submitted 30 January, 2013;
originally announced January 2013.
-
Baryon Interactions in Nuclear and Hypernuclear Matter
Authors:
H. Lenske,
C. Keil,
R. Shyam
Abstract:
The production and structure of Λ hypernuclei are investigated in field theoretical models. The production in coherent p+A reactions is investigated by means of a resonance model. Results of exploratory calculations for associated strangeness production are presented for proton reactions on 40Ca. The target single particle wave functions are obtained from DDRH theory with density dependent…
▽ More
The production and structure of Λ hypernuclei are investigated in field theoretical models. The production in coherent p+A reactions is investigated by means of a resonance model. Results of exploratory calculations for associated strangeness production are presented for proton reactions on 40Ca. The target single particle wave functions are obtained from DDRH theory with density dependent Dirac-Brueckner meson-baryon vertices. The dependence of the in-medium vertices on density is discussed.
△ Less
Submitted 8 November, 2003;
originally announced November 2003.
-
Baryon-baryon interactions in free space and baryonic medium
Authors:
C. Keil,
H. Lenske
Abstract:
We study the interactions of the octet baryons in a relativistic meson exchange approach connecting free-space and in-medium interactions with those in finite (hyper)nuclei. A short sketch of the model including the relativistic T- and G-matrix and the map** of the G-matrix onto density dependent vertex functionals in the density dependent relativistic hadron field theory (DDRH) is given. From…
▽ More
We study the interactions of the octet baryons in a relativistic meson exchange approach connecting free-space and in-medium interactions with those in finite (hyper)nuclei. A short sketch of the model including the relativistic T- and G-matrix and the map** of the G-matrix onto density dependent vertex functionals in the density dependent relativistic hadron field theory (DDRH) is given. From new spectroscopic data on medium mass hypernuclei we extract the single particle spectrum including spin-orbit splitting. An extraction of the $Λω$ vector- and tensor vertex as well as the $Λσ$-vertex shows a strong breaking of SU(3) symmetry.
△ Less
Submitted 13 February, 2003;
originally announced February 2003.
-
The hypernuclear Auger effect within the density dependent relativistic hadron field theory
Authors:
C. Keil,
H. Lenske
Abstract:
The hypernuclear Auger effect, given by the de-excitation of a Lambda hypernucleus by means of the transition of a Lambda hyperon from an initial to a lower lying final single particle state in conjunction with neutron emission from the core nucleus is studied in relativistic DDRH field theory. Baryonic interactions are obtained from the Bonn NN potential by Dirac-Brueckner theory and theoretica…
▽ More
The hypernuclear Auger effect, given by the de-excitation of a Lambda hypernucleus by means of the transition of a Lambda hyperon from an initial to a lower lying final single particle state in conjunction with neutron emission from the core nucleus is studied in relativistic DDRH field theory. Baryonic interactions are obtained from the Bonn NN potential by Dirac-Brueckner theory and theoretically derived scaling laws for the meson-hyperon vertices. The model is applied to the ^{209}_Lambda Pb hypernucleus. Lambda and nucleon bound states as well as scattering states are calculated self-consistently in mean-field approximation. The Auger spectra of the emitted neutrons are of complex structure due to a huge combinatorial number of possible hypernuclear transitions. The sensitivity of the neutron Auger spectra to changes in the Lambda sigma and Lambda omega vertices are investigated. The theoretical results show that experimental applications of the hypernuclear Auger effect will require special efforts, e.g. by tagging on the energy of the initially created hyperon.
△ Less
Submitted 25 September, 2002; v1 submitted 29 July, 2002;
originally announced July 2002.
-
In-Medium Baryon Interactions and Hypernuclear Structure
Authors:
C. Keil,
H. Lenske,
C. Greiner
Abstract:
We introduce a microscopic and relativistic theory describing free scattering and finite nuclei for the octet baryons in a consistent quantum field theoretical framework based on Dirac-Brueckner theory and nuclear mean-field. In a first quantitative approach - yet still heuristic for dealing with the $Λ$ hyperon - the quality of the description of finite (hyper)nuclei based on free meson exchang…
▽ More
We introduce a microscopic and relativistic theory describing free scattering and finite nuclei for the octet baryons in a consistent quantum field theoretical framework based on Dirac-Brueckner theory and nuclear mean-field. In a first quantitative approach - yet still heuristic for dealing with the $Λ$ hyperon - the quality of the description of finite (hyper)nuclei based on free meson exchange potentials is competitive with those from purely phenomenological relativistic mean-field calculations. In contrast to the latter our approach has the advantage of having a microscopic link to free interactions and complete control on which classes of diagrams are included. As a complementary way for determining hyperon-hyperon and hyperon-nucleon interactions the use of Hanbury-Brown-Twiss interferometry is discussed.
△ Less
Submitted 14 December, 2001;
originally announced December 2001.
-
Single particle properties of Lambda hypernuclei in the density dependent relativistic hadron field theory
Authors:
C. Keil,
H. Lenske
Abstract:
The density dependent relativistic hadron field theory is used to describe single particle properties of Lambda hypernuclei. The discussion focuses on the spin-orbit systematics in the relativistic mean-field formalism by discussing general effects of the Lambda continuum threshold and the delocalization of the Lambda wave function. Theoretical predictions for the hypernuclear Auger effect are p…
▽ More
The density dependent relativistic hadron field theory is used to describe single particle properties of Lambda hypernuclei. The discussion focuses on the spin-orbit systematics in the relativistic mean-field formalism by discussing general effects of the Lambda continuum threshold and the delocalization of the Lambda wave function. Theoretical predictions for the hypernuclear Auger effect are presented.
△ Less
Submitted 26 July, 2001;
originally announced July 2001.
-
Many-body Theory at Extreme Isospin
Authors:
H. Lenske,
C. M. Keil,
F. Hofmann
Abstract:
The structure of nuclei far off beta-stability is investigated by nuclear many-body theory. In-medium interactions for asymmetric nuclear matter are obtained by (Dirac-) Brueckner theory thus establishing the link of nuclear forces to free space interactions. HFB and RPA theory is used to describe ground and excited states of nuclei from light to heavy masses. In extreme dripline systems pairing…
▽ More
The structure of nuclei far off beta-stability is investigated by nuclear many-body theory. In-medium interactions for asymmetric nuclear matter are obtained by (Dirac-) Brueckner theory thus establishing the link of nuclear forces to free space interactions. HFB and RPA theory is used to describe ground and excited states of nuclei from light to heavy masses. In extreme dripline systems pairing and core polarization are found to be most important for the binding, especially of halo nuclei. The calculations show that far off stability mean-field dynamics is gradually replaced by dynamical correlations, giving rise to the dissolution of shell structures.
△ Less
Submitted 25 July, 2001;
originally announced July 2001.
-
Threshold suppression of Lambda spin-orbit splitting
Authors:
Christoph M. Keil,
Horst Lenske
Abstract:
New experimental data on medium to heavy single Lambda hypernuclei revealed a much larger spin-orbit splitting than observed in older measurements of light hypernuclei. Taking into account particle threshold effects and the density-dependence of in-medium coupling constants the apparent suppression of spin-orbit strength in light hypernuclei as well as the spin-orbit structure observed in medium…
▽ More
New experimental data on medium to heavy single Lambda hypernuclei revealed a much larger spin-orbit splitting than observed in older measurements of light hypernuclei. Taking into account particle threshold effects and the density-dependence of in-medium coupling constants the apparent suppression of spin-orbit strength in light hypernuclei as well as the spin-orbit structure observed in medium to heavy nuclei are explained in a unified manner within the density dependent relativistic hadron field theory. It is concluded that the most valuable information on the Lambda spin-orbit dynamics in finite nuclei has to be extracted from medium to heavy mass nuclei.
△ Less
Submitted 14 March, 2001;
originally announced March 2001.
-
Probing Isospin Dynamics in Halo Nuclei
Authors:
H. Lenske,
F. Hofmann,
C. M. Keil
Abstract:
Nuclear many-body theory is used to study nuclear matter and finite nuclei at extreme isospin. In-medium interactions in asymmetric nuclear matter are obtained from (Dirac-) Brueckner theory. Neutron skin formation in Ni and Sn isotopes is investigated by relativistic mean-field calculations in DDRH theory with density dependent meson-nucleon vertices. Applications to light nuclei are discussed…
▽ More
Nuclear many-body theory is used to study nuclear matter and finite nuclei at extreme isospin. In-medium interactions in asymmetric nuclear matter are obtained from (Dirac-) Brueckner theory. Neutron skin formation in Ni and Sn isotopes is investigated by relativistic mean-field calculations in DDRH theory with density dependent meson-nucleon vertices. Applications to light nuclei are discussed with special emphasis on pairing and core polarization in weakly bound nuclei. Approaches accounting for continuum coupling in dripline pairing and core polarization are presented. Calculations for the halo nuclei $^8$B, $^{11}$Be and $^{19}$C show that shell structures are dissolving when the driplines are approached. Relativistic breakup data are well described by eikonal calculations.
△ Less
Submitted 22 December, 2000;
originally announced December 2000.
-
The structure of lambda hypernuclei
Authors:
C. Keil,
F. Hofmann,
H. Lenske
Abstract:
The density dependent relativistic hadron field theory is extended to also describe strange systems. It is seen that the application to hypernuclei works extremely well. Important spin orbit effects in lambda hypernuclei are studied and their experimental relevance is pointed out.
The density dependent relativistic hadron field theory is extended to also describe strange systems. It is seen that the application to hypernuclei works extremely well. Important spin orbit effects in lambda hypernuclei are studied and their experimental relevance is pointed out.
△ Less
Submitted 13 November, 2000;
originally announced November 2000.
-
Application of the density dependent hadron field theory to neutron star matter
Authors:
F. Hofmann,
C. M. Keil,
H. Lenske
Abstract:
The density dependent hadron field (DDRH) theory, previously applied to isospin nuclei and hypernuclei is used to describe $β$-stable matter and neutron stars under consideration of the complete baryon octet. The meson-hyperon vertices are derived from Dirac-Brueckner calculations of nuclear matter and extended to hyperons. We examine properties of density dependent interactions derived from the…
▽ More
The density dependent hadron field (DDRH) theory, previously applied to isospin nuclei and hypernuclei is used to describe $β$-stable matter and neutron stars under consideration of the complete baryon octet. The meson-hyperon vertices are derived from Dirac-Brueckner calculations of nuclear matter and extended to hyperons. We examine properties of density dependent interactions derived from the Bonn A and from the Groningen NN potential as well as phenomenological interactions. The consistent treatment of the density dependence introduces rearrangement terms in the expression for the baryon chemical potential. This leads to a more complex condition for the $β$-equilibrium compared to standard relativistic mean field (RMF) approaches. We find a strong dependence of the equation of state and the particle distribution on the choice of the vertex density dependence. Results for neutron star masses and radii are presented. We find a good agreement with other models for the maximum mass. Radii are smaller compared to RMF models and indicate a closer agreement with results of non-relativistic Brueckner calculations.
△ Less
Submitted 21 August, 2000;
originally announced August 2000.
-
Dirac-Brueckner Approach to Hyperon Interactions and Hypernuclei
Authors:
H. Lenske,
C. M. Keil,
F. Hofmann,
S. Briganti
Abstract:
The density dependent relativistic hadron (DDRH) theory is introduced as an effective field theory for nuclei and hypernuclei. A Dirac-Brueckner approach to in-medium nucleon-hyperon interactions is presented. Density dependent meson-baryon vertices are determined from DBHF self-energies in infinite matter. Scaling laws for hyperon vertices are derived from a diagrammatic analysis of self-energi…
▽ More
The density dependent relativistic hadron (DDRH) theory is introduced as an effective field theory for nuclei and hypernuclei. A Dirac-Brueckner approach to in-medium nucleon-hyperon interactions is presented. Density dependent meson-baryon vertices are determined from DBHF self-energies in infinite matter. Scaling laws for hyperon vertices are derived from a diagrammatic analysis of self-energies. In a local density approximation the DB vertices are applied in relativistic DDRH Hartree calculations to finite hypernuclei. Lambda single particle spectra and spin-orbit splittings are described reasonably well over the whole mass region.
△ Less
Submitted 9 August, 2000;
originally announced August 2000.
-
Density dependent hadron field theory for asymmetric nuclear matter and exotic nuclei
Authors:
F. Hofmann,
C. M. Keil,
H. Lenske
Abstract:
The density dependent relativistic hadron field (DDRH) theory is applied to strongly asymmetric nuclear matter and finite nuclei far off stability. A new set of in-medium meson-nucleon vertices is derived from Dirac-Brueckner Hartree-Fock (DBHF) calculations in asymmetric matter, now accounting also for the density dependence of isovector coupling constants. The scalar-isovector $δ$ meson is inc…
▽ More
The density dependent relativistic hadron field (DDRH) theory is applied to strongly asymmetric nuclear matter and finite nuclei far off stability. A new set of in-medium meson-nucleon vertices is derived from Dirac-Brueckner Hartree-Fock (DBHF) calculations in asymmetric matter, now accounting also for the density dependence of isovector coupling constants. The scalar-isovector $δ$ meson is included. Nuclear matter calculations show that it is necessary to introduce a momentum correction in the extraction of coupling constants from the DBHF self-energies in order to reproduce the DBHF equation of state by DDRH mean-field calculations. The properties of DDRH vertices derived from the Groningen and the Bonn A nucleon-nucleon (NN) potentials are compared in nuclear matter calculations and for finite nuclei. Relativistic Hartree results for binding energies, charge radii, separation energies and shell gaps for the Ni and Sn isotopic chains are presented. Using the momentum corrected vertices an overall agreement to data on a level of a few percent is obtained. In the accessible range of asymmetries the $δ$ meson contributions to the self-energies are found to be of minor importance but asymmetry dependent fluctuations may occur.
△ Less
Submitted 20 July, 2000;
originally announced July 2000.
-
Density dependent hadron field theory for hypernuclei
Authors:
C. M. Keil,
F. Hofmann,
H. Lenske
Abstract:
The Density Dependent Relativistic Hadron Field (DDRH) theory, previously introduced and applied to isospin nuclei, is extended to hypernuclei by including the octet hyperons. Infinite matter Dirac-Brueckner theory for octet baryons and the derivation of in-medium DDRH baryon-meson vertices is discussed. From the properties of Dirac-Brueckner interactions it is found that hyperon and nucleon sel…
▽ More
The Density Dependent Relativistic Hadron Field (DDRH) theory, previously introduced and applied to isospin nuclei, is extended to hypernuclei by including the octet hyperons. Infinite matter Dirac-Brueckner theory for octet baryons and the derivation of in-medium DDRH baryon-meson vertices is discussed. From the properties of Dirac-Brueckner interactions it is found that hyperon and nucleon self-energies and vertices are related by the ratios of free space coupling constants. This leads to simple scaling laws for the in-medium hyperon and nucleon vertices. The model is applied in relativistic DDRH mean-field calculations to singl$Λnuclei. Free space N-Lambda T-matrix results are used for the scalar vertex. As the only free parameter the hyperon vector vertex scaling factor is adjusted to a selected set of hypernuclear data. Spectroscopic data of single Lambda hypernuclei over the full mass range are well described. The reduced Lambda spin-orbit splitting is reproduced and found to be related closely the medium dependence of scalar and vector interactions.
△ Less
Submitted 3 November, 1999;
originally announced November 1999.