Showing 1–50 of 128 results for author: Leonard, J

Adiabatic State Preparation in a Quantum Ising Spin Chain

Authors: Sooshin Kim, Alexander Lukin, Matthew Rispoli, M. Eric Tai, Adam M. Kaufman, Perrin Segura, Yanfei Li, Joyce Kwan, Julian Léonard, Brice Bakkali-Hassani, Markus Greiner

Abstract: We report on adiabatic state preparation in the one-dimensional quantum Ising model using ultracold bosons in a tilted optical lattice. We prepare many-body ground states of controllable system sizes and observe enhanced fluctuations around the transition between paramagnetic and antiferromagnetic states, marking the precursor of quantum critical behavior. Furthermore, we find evidence for superpo… ▽ More We report on adiabatic state preparation in the one-dimensional quantum Ising model using ultracold bosons in a tilted optical lattice. We prepare many-body ground states of controllable system sizes and observe enhanced fluctuations around the transition between paramagnetic and antiferromagnetic states, marking the precursor of quantum critical behavior. Furthermore, we find evidence for superpositions of domain walls and study their effect on the many-body ground state by measuring the populations of each spin configuration across the transition. These results shed new light on the effect of boundary conditions in finite-size quantum systems. △ Less

Submitted 11 April, 2024; originally announced April 2024.

Comments: 5+5 pages, 4+8 figures

LOSS-SLAM: Lightweight Open-Set Semantic Simultaneous Localization and Map**

Authors: Kurran Singh, Tim Magoun, John J. Leonard

Abstract: Enabling robots to understand the world in terms of objects is a critical building block towards higher level autonomy. The success of foundation models in vision has created the ability to segment and identify nearly all objects in the world. However, utilizing such objects to localize the robot and build an open-set semantic map of the world remains an open research question. In this work, a sys… ▽ More Enabling robots to understand the world in terms of objects is a critical building block towards higher level autonomy. The success of foundation models in vision has created the ability to segment and identify nearly all objects in the world. However, utilizing such objects to localize the robot and build an open-set semantic map of the world remains an open research question. In this work, a system of identifying, localizing, and encoding objects is tightly coupled with probabilistic graphical models for performing open-set semantic simultaneous localization and map** (SLAM). Results are presented demonstrating that the proposed lightweight object encoding can be used to perform more accurate object-based SLAM than existing open-set methods, closed-set methods, and geometric methods while incurring a lower computational overhead than existing open-set map** methods. △ Less

Submitted 5 April, 2024; originally announced April 2024.

MAC: Maximizing Algebraic Connectivity for Graph Sparsification

Authors: Kevin Doherty, Alan Papalia, Yewei Huang, David Rosen, Brendan Englot, John Leonard

Abstract: Simultaneous localization and map** (SLAM) is a critical capability in autonomous navigation, but memory and computational limits make long-term application of common SLAM techniques impractical; a robot must be able to determine what information should be retained and what can safely be forgotten. In graph-based SLAM, the number of edges (measurements) in a pose graph determines both the memory… ▽ More Simultaneous localization and map** (SLAM) is a critical capability in autonomous navigation, but memory and computational limits make long-term application of common SLAM techniques impractical; a robot must be able to determine what information should be retained and what can safely be forgotten. In graph-based SLAM, the number of edges (measurements) in a pose graph determines both the memory requirements of storing a robot's observations and the computational expense of algorithms deployed for performing state estimation using those observations, both of which can grow unbounded during long-term navigation. Motivated by these challenges, we propose a new general purpose approach to sparsify graphs in a manner that maximizes algebraic connectivity, a key spectral property of graphs which has been shown to control the estimation error of pose graph SLAM solutions. Our algorithm, MAC (for maximizing algebraic connectivity), is simple and computationally inexpensive, and admits formal post hoc performance guarantees on the quality of the solution that it provides. In application to the problem of pose-graph SLAM, we show on several benchmark datasets that our approach quickly produces high-quality sparsification results which retain the connectivity of the graph and, in turn, the quality of corresponding SLAM solutions. △ Less

Submitted 28 March, 2024; originally announced March 2024.

Comments: 17 pages, 5 figures. Submitted to IEEE Transactions on Robotics. arXiv admin note: substantial text overlap with arXiv:2203.13897

Opti-Acoustic Semantic SLAM with Unknown Objects in Underwater Environments

Authors: Kurran Singh, Jungseok Hong, Nicholas R. Rypkema, John J. Leonard

Abstract: Despite recent advances in semantic Simultaneous Localization and Map** (SLAM) for terrestrial and aerial applications, underwater semantic SLAM remains an open and largely unaddressed research problem due to the unique sensing modalities and the object classes found underwater. This paper presents an object-based semantic SLAM method for underwater environments that can identify, localize, clas… ▽ More Despite recent advances in semantic Simultaneous Localization and Map** (SLAM) for terrestrial and aerial applications, underwater semantic SLAM remains an open and largely unaddressed research problem due to the unique sensing modalities and the object classes found underwater. This paper presents an object-based semantic SLAM method for underwater environments that can identify, localize, classify, and map a wide variety of marine objects without a priori knowledge of the object classes present in the scene. The method performs unsupervised object segmentation and object-level feature aggregation, and then uses opti-acoustic sensor fusion for object localization. Probabilistic data association is used to determine observation to landmark correspondences. Given such correspondences, the method then jointly optimizes landmark and vehicle position estimates. Indoor and outdoor underwater datasets with a wide variety of objects and challenging acoustic and lighting conditions are collected for evaluation and made publicly available. Quantitative and qualitative results show the proposed method achieves reduced trajectory error compared to baseline methods, and is able to obtain comparable map accuracy to a baseline closed-set method that requires hand-labeled data of all objects in the scene. △ Less

Submitted 19 March, 2024; originally announced March 2024.

Security Advice for Parents and Children About Content Filtering and Circumvention as Found on YouTube and TikTok

Authors: Ran Elgedawy, John Sadik, Anuj Gautam, Trinity Bissahoyo, Christopher Childress, Jacob Leonard, Clay Shubert, Scott Ruoti

Abstract: In today's digital age, concerns about online security and privacy have become paramount. However, addressing these issues can be difficult, especially within the context of family relationships, wherein parents and children may have conflicting interests. In this environment, parents and children may turn to online security advice to determine how to proceed. In this paper, we examine the advice… ▽ More In today's digital age, concerns about online security and privacy have become paramount. However, addressing these issues can be difficult, especially within the context of family relationships, wherein parents and children may have conflicting interests. In this environment, parents and children may turn to online security advice to determine how to proceed. In this paper, we examine the advice available to parents and children regarding content filtering and circumvention as found on YouTube and TikTok. In an analysis of 839 videos returned from queries on these topics, we found that half (n=399) provide relevant advice. Our results show that of these videos, roughly three-quarters are accurate, with the remaining one-fourth containing factually incorrect advice. We find that videos targeting children are both more likely to be incorrect and actionable than videos targeting parents, leaving children at increased risk of taking harmful action. Moreover, we find that while advice videos targeting parents will occasionally discuss the ethics of content filtering and device monitoring (including recommendations to respect children's autonomy) no such discussion of the ethics or risks of circumventing content filtering is given to children, leaving them unaware of any risks that may be involved with doing so. Ultimately, our research indicates that video-based social media sites are already effective sources of security advice propagation and that the public would benefit from security researchers and practitioners engaging more with these platforms, both for the creation of content and of tools designed to help with more effective filtering. △ Less

Submitted 5 February, 2024; originally announced February 2024.

Comments: 15 pages, 5 figures, 8 tables

Bayesian Optimization for Robust State Preparation in Quantum Many-Body Systems

Authors: Tizian Blatz, Joyce Kwan, Julian Léonard, Annabelle Bohrdt

Abstract: New generations of ultracold-atom experiments are continually raising the demand for efficient solutions to optimal control problems. Here, we apply Bayesian optimization to improve a state-preparation protocol recently implemented in an ultracold-atom system to realize a two-particle fractional quantum Hall state. Compared to manual ramp design, we demonstrate the superior performance of our opti… ▽ More New generations of ultracold-atom experiments are continually raising the demand for efficient solutions to optimal control problems. Here, we apply Bayesian optimization to improve a state-preparation protocol recently implemented in an ultracold-atom system to realize a two-particle fractional quantum Hall state. Compared to manual ramp design, we demonstrate the superior performance of our optimization approach in a numerical simulation - resulting in a protocol that is 10x faster at the same fidelity, even when taking into account experimentally realistic levels of disorder in the system. We extensively analyze and discuss questions of robustness and the relationship between numerical simulation and experimental realization, and how to make the best use of the surrogate model trained during optimization. We find that numerical simulation can be expected to substantially reduce the number of experiments that need to be performed with even the most basic transfer learning techniques. The proposed protocol and workflow will pave the way toward the realization of more complex many-body quantum states in experiments. △ Less

Submitted 20 June, 2024; v1 submitted 14 December, 2023; originally announced December 2023.

Comments: 6 + 6 pages

Journal ref: Quantum 8, 1388 (2024)

NashFormer: Leveraging Local Nash Equilibria for Semantically Diverse Trajectory Prediction

Authors: Justin Lidard, Oswin So, Yanxia Zhang, Jonathan DeCastro, Xiongyi Cui, Xin Huang, Yen-Ling Kuo, John Leonard, Avinash Balachandran, Naomi Leonard, Guy Rosman

Abstract: Interactions between road agents present a significant challenge in trajectory prediction, especially in cases involving multiple agents. Because existing diversity-aware predictors do not account for the interactive nature of multi-agent predictions, they may miss these important interaction outcomes. In this paper, we propose NashFormer, a framework for trajectory prediction that leverages game-… ▽ More Interactions between road agents present a significant challenge in trajectory prediction, especially in cases involving multiple agents. Because existing diversity-aware predictors do not account for the interactive nature of multi-agent predictions, they may miss these important interaction outcomes. In this paper, we propose NashFormer, a framework for trajectory prediction that leverages game-theoretic inverse reinforcement learning to improve coverage of multi-modal predictions. We use a training-time game-theoretic analysis as an auxiliary loss resulting in improved coverage and accuracy without presuming a taxonomy of actions for the agents. We demonstrate our approach on the interactive split of the Waymo Open Motion Dataset, including four subsets involving scenarios with high interaction complexity. Experiment results show that our predictor produces accurate predictions while covering $33\%$ more potential interactions versus a baseline model. △ Less

Submitted 11 November, 2023; v1 submitted 27 May, 2023; originally announced May 2023.

Comments: 8 pages, 6 figures

GAPSLAM: Blending Gaussian Approximation and Particle Filters for Real-Time Non-Gaussian SLAM

Authors: Qiangqiang Huang, John J. Leonard

Abstract: Inferring the posterior distribution in SLAM is critical for evaluating the uncertainty in localization and map**, as well as supporting subsequent planning tasks aiming to reduce uncertainty for safe navigation. However, real-time full posterior inference techniques, such as Gaussian approximation and particle filters, either lack expressiveness for representing non-Gaussian posteriors or suffe… ▽ More Inferring the posterior distribution in SLAM is critical for evaluating the uncertainty in localization and map**, as well as supporting subsequent planning tasks aiming to reduce uncertainty for safe navigation. However, real-time full posterior inference techniques, such as Gaussian approximation and particle filters, either lack expressiveness for representing non-Gaussian posteriors or suffer from performance degeneracy when estimating high-dimensional posteriors. Inspired by the complementary strengths of Gaussian approximation and particle filters$\unicode{x2013}$scalability and non-Gaussian estimation, respectively$\unicode{x2013}$we blend these two approaches to infer marginal posteriors in SLAM. Specifically, Gaussian approximation provides robot pose distributions on which particle filters are conditioned to sample landmark marginals. In return, the maximum a posteriori point among these samples can be used to reset linearization points in the nonlinear optimization solver of the Gaussian approximation, facilitating the pursuit of global optima. We demonstrate the scalability, generalizability, and accuracy of our algorithm for real-time full posterior inference on realworld range-only SLAM and object-based bearing-only SLAM datasets. △ Less

Submitted 9 August, 2023; v1 submitted 24 March, 2023; originally announced March 2023.

Comments: 8 pages, 5 figures. To appear in IROS 2023

NeuSE: Neural SE(3)-Equivariant Embedding for Consistent Spatial Understanding with Objects

Authors: Jiahui Fu, Yilun Du, Kurran Singh, Joshua B. Tenenbaum, John J. Leonard

Abstract: We present NeuSE, a novel Neural SE(3)-Equivariant Embedding for objects, and illustrate how it supports object SLAM for consistent spatial understanding with long-term scene changes. NeuSE is a set of latent object embeddings created from partial object observations. It serves as a compact point cloud surrogate for complete object models, encoding full shape information while transforming SE(3)-e… ▽ More We present NeuSE, a novel Neural SE(3)-Equivariant Embedding for objects, and illustrate how it supports object SLAM for consistent spatial understanding with long-term scene changes. NeuSE is a set of latent object embeddings created from partial object observations. It serves as a compact point cloud surrogate for complete object models, encoding full shape information while transforming SE(3)-equivariantly in tandem with the object in the physical world. With NeuSE, relative frame transforms can be directly derived from inferred latent codes. Our proposed SLAM paradigm, using NeuSE for object shape and pose characterization, can operate independently or in conjunction with typical SLAM systems. It directly infers SE(3) camera pose constraints that are compatible with general SLAM pose graph optimization, while also maintaining a lightweight object-centric map that adapts to real-world changes. Our approach is evaluated on synthetic and real-world sequences featuring changed objects and shows improved localization accuracy and change-aware map** capability, when working either standalone or jointly with a common SLAM pipeline. △ Less

Submitted 10 July, 2023; v1 submitted 13 March, 2023; originally announced March 2023.

Comments: 15 Pages and 12 figures. Accepted to RSS 2023. Project webpage: https://neuse-slam.github.io/neuse/

Data-Association-Free Landmark-based SLAM

Authors: Yihao Zhang, Odin A. Severinsen, John J. Leonard, Luca Carlone, Kasra Khosoussi

Abstract: We study landmark-based SLAM with unknown data association: our robot navigates in a completely unknown environment and has to simultaneously reason over its own trajectory, the positions of an unknown number of landmarks in the environment, and potential data associations between measurements and landmarks. This setup is interesting since: (i) it arises when recovering from data association failu… ▽ More We study landmark-based SLAM with unknown data association: our robot navigates in a completely unknown environment and has to simultaneously reason over its own trajectory, the positions of an unknown number of landmarks in the environment, and potential data associations between measurements and landmarks. This setup is interesting since: (i) it arises when recovering from data association failures or from SLAM with information-poor sensors, (ii) it sheds light on fundamental limits (and hardness) of landmark-based SLAM problems irrespective of the front-end data association method, and (iii) it generalizes existing approaches where data association is assumed to be known or partially known. We approach the problem by splitting it into an inner problem of estimating the trajectory, landmark positions and data associations and an outer problem of estimating the number of landmarks. Our approach creates useful and novel connections with existing techniques from discrete-continuous optimization (e.g., k-means clustering), which has the potential to trigger novel research. We demonstrate the proposed approaches in extensive simulations and on real datasets and show that the proposed techniques outperform typical data association baselines and are even competitive against an "oracle" baseline which has access to the number of landmarks and an initial guess for each landmark. △ Less

Submitted 4 May, 2023; v1 submitted 26 February, 2023; originally announced February 2023.

Comments: Accepted at ICRA 2023. Correcting a typo (missing parentheses) in eq. (1) and following equations

Certifiably Correct Range-Aided SLAM

Authors: Alan Papalia, Andrew Fishberg, Brendan W. O'Neill, Jonathan P. How, David M. Rosen, John J. Leonard

Abstract: We present the first algorithm to efficiently compute certifiably optimal solutions to range-aided simultaneous localization and map** (RA-SLAM) problems. Robotic navigation systems increasingly incorporate point-to-point ranging sensors, leading to state estimation problems in the form of RA-SLAM. However, the RA-SLAM problem is significantly more difficult to solve than traditional pose-graph… ▽ More We present the first algorithm to efficiently compute certifiably optimal solutions to range-aided simultaneous localization and map** (RA-SLAM) problems. Robotic navigation systems increasingly incorporate point-to-point ranging sensors, leading to state estimation problems in the form of RA-SLAM. However, the RA-SLAM problem is significantly more difficult to solve than traditional pose-graph SLAM: ranging sensor models introduce non-convexity and single range measurements do not uniquely determine the transform between the involved sensors. As a result, RA-SLAM inference is sensitive to initial estimates yet lacks reliable initialization techniques. Our approach, certifiably correct RA-SLAM (CORA), leverages a novel quadratically constrained quadratic programming (QCQP) formulation of RA-SLAM to relax the RA-SLAM problem to a semidefinite program (SDP). CORA solves the SDP efficiently using the Riemannian Staircase methodology; the SDP solution provides both (i) a lower bound on the RA-SLAM problem's optimal value, and (ii) an approximate solution of the RA-SLAM problem, which can be subsequently refined using local optimization. CORA applies to problems with arbitrary pose-pose, pose-landmark, and ranging measurements and, due to using convex relaxation, is insensitive to initialization. We evaluate CORA on several real-world problems. In contrast to state-of-the-art approaches, CORA is able to obtain high-quality solutions on all problems despite being initialized with random values. Additionally, we study the tightness of the SDP relaxation with respect to important problem parameters: the number of (i) robots, (ii) landmarks, and (iii) range measurements. These experiments demonstrate that the SDP relaxation is often tight and reveal relationships between graph rigidity and the tightness of the SDP relaxation. △ Less

Submitted 19 September, 2023; v1 submitted 22 February, 2023; originally announced February 2023.

Comments: 17 pages, 9 figures, submitted to T-RO

Doubly structured sparsity for grouped multivariate responses with application to functional outcome score modeling

Authors: Jared D. Huling, Jennifer P. Lundine, Julie C. Leonard

Abstract: This work is motivated by the need to accurately model a vector of responses related to pediatric functional status using administrative health data from inpatient rehabilitation visits. The components of the responses have known and structured interrelationships. To make use of these relationships in modeling, we develop a two-pronged regularization approach to borrow information across the respo… ▽ More This work is motivated by the need to accurately model a vector of responses related to pediatric functional status using administrative health data from inpatient rehabilitation visits. The components of the responses have known and structured interrelationships. To make use of these relationships in modeling, we develop a two-pronged regularization approach to borrow information across the responses. The first component of our approach encourages joint selection of the effects of each variable across possibly overlap** groups related responses and the second component encourages shrinkage of effects towards each other for related responses. As the responses in our motivating study are not normally-distributed, our approach does not rely on an assumption of multivariate normality of the responses. We show that with an adaptive version of our penalty, our approach results in the same asymptotic distribution of estimates as if we had known in advance which variables were non-zero and which variables have the same effects across some outcomes. We demonstrate the performance of our method in extensive numerical studies and in an application in the prediction of functional status of pediatric patients using administrative health data in a population of children with neurological injury or illness at a large children's hospital. △ Less

Submitted 21 February, 2023; originally announced February 2023.

Optimizing Fiducial Marker Placement for Improved Visual Localization

Authors: Qiangqiang Huang, Joseph DeGol, Victor Fragoso, Sudipta N. Sinha, John J. Leonard

Abstract: Adding fiducial markers to a scene is a well-known strategy for making visual localization algorithms more robust. Traditionally, these marker locations are selected by humans who are familiar with visual localization techniques. This paper explores the problem of automatic marker placement within a scene. Specifically, given a predetermined set of markers and a scene model, we compute optimized m… ▽ More Adding fiducial markers to a scene is a well-known strategy for making visual localization algorithms more robust. Traditionally, these marker locations are selected by humans who are familiar with visual localization techniques. This paper explores the problem of automatic marker placement within a scene. Specifically, given a predetermined set of markers and a scene model, we compute optimized marker positions within the scene that can improve accuracy in visual localization. Our main contribution is a novel framework for modeling camera localizability that incorporates both natural scene features and artificial fiducial markers added to the scene. We present optimized marker placement (OMP), a greedy algorithm that is based on the camera localizability framework. We have also designed a simulation framework for testing marker placement algorithms on 3D models and images generated from synthetic scenes. We have evaluated OMP within this testbed and demonstrate an improvement in the localization rate by up to 20 percent on four different scenes. △ Less

Submitted 16 March, 2023; v1 submitted 2 November, 2022; originally announced November 2022.

Comments: Extended technical report for publication in IEEE Robotics and Automation Letters (RA-L)

NeRF-SLAM: Real-Time Dense Monocular SLAM with Neural Radiance Fields

Authors: Antoni Rosinol, John J. Leonard, Luca Carlone

Abstract: We propose a novel geometric and photometric 3D map** pipeline for accurate and real-time scene reconstruction from monocular images. To achieve this, we leverage recent advances in dense monocular SLAM and real-time hierarchical volumetric neural radiance fields. Our insight is that dense monocular SLAM provides the right information to fit a neural radiance field of the scene in real-time, by… ▽ More We propose a novel geometric and photometric 3D map** pipeline for accurate and real-time scene reconstruction from monocular images. To achieve this, we leverage recent advances in dense monocular SLAM and real-time hierarchical volumetric neural radiance fields. Our insight is that dense monocular SLAM provides the right information to fit a neural radiance field of the scene in real-time, by providing accurate pose estimates and depth-maps with associated uncertainty. With our proposed uncertainty-based depth loss, we achieve not only good photometric accuracy, but also great geometric accuracy. In fact, our proposed pipeline achieves better geometric and photometric accuracy than competing approaches (up to 179% better PSNR and 86% better L1 depth), while working in real-time and using only monocular images. △ Less

Submitted 24 October, 2022; originally announced October 2022.

Comments: 10 pages, 6 figures

Realization of a fractional quantum Hall state with ultracold atoms

Authors: Julian Léonard, Sooshin Kim, Joyce Kwan, Perrin Segura, Fabian Grusdt, Cécile Repellin, Nathan Goldman, Markus Greiner

Abstract: Strongly interacting topological matter exhibits fundamentally new phenomena with potential applications in quantum information technology. Emblematic instances are fractional quantum Hall states, where the interplay of magnetic fields and strong interactions gives rise to fractionally charged quasi-particles, long-ranged entanglement, and anyonic exchange statistics. Progress in engineering synth… ▽ More Strongly interacting topological matter exhibits fundamentally new phenomena with potential applications in quantum information technology. Emblematic instances are fractional quantum Hall states, where the interplay of magnetic fields and strong interactions gives rise to fractionally charged quasi-particles, long-ranged entanglement, and anyonic exchange statistics. Progress in engineering synthetic magnetic fields has raised the hope to create these exotic states in controlled quantum systems. However, except for a recent Laughlin state of light, preparing fractional quantum Hall states in engineered systems remains elusive. Here, we realize a fractional quantum Hall (FQH) state with ultracold atoms in an optical lattice. The state is a lattice version of a bosonic $ν=1/2$ Laughlin state with two particles on sixteen sites. This minimal system already captures many hallmark features of Laughlin-type FQH states: we observe a suppression of two-body interactions, we find a distinctive vortex structure in the density correlations, and we measure a fractional Hall conductivity of $σ_\text{H}/σ_0= 0.6(2)$ via the bulk response to a magnetic perturbation. Furthermore, by tuning the magnetic field we map out the transition point between the normal and the FQH regime through a spectroscopic probe of the many-body gap. Our work provides a starting point for exploring highly entangled topological matter with ultracold atoms. △ Less

Submitted 29 October, 2022; v1 submitted 19 October, 2022; originally announced October 2022.

Journal ref: Nature 619, 495-499 (2023)

SCORE: A Second-Order Conic Initialization for Range-Aided SLAM

Authors: Alan Papalia, Joseph Morales, Kevin J. Doherty, David M. Rosen, John J. Leonard

Abstract: We present a novel initialization technique for the range-aided simultaneous localization and map** (RA-SLAM) problem. In RA-SLAM we consider measurements of point-to-point distances in addition to measurements of rigid transformations to landmark or pose variables. Standard formulations of RA-SLAM approach the problem as non-convex optimization, which requires a good initialization to obtain qu… ▽ More We present a novel initialization technique for the range-aided simultaneous localization and map** (RA-SLAM) problem. In RA-SLAM we consider measurements of point-to-point distances in addition to measurements of rigid transformations to landmark or pose variables. Standard formulations of RA-SLAM approach the problem as non-convex optimization, which requires a good initialization to obtain quality results. The initialization technique proposed here relaxes the RA-SLAM problem to a convex problem which is then solved to determine an initialization for the original, non-convex problem. The relaxation is a second-order cone program (SOCP), which is derived from a quadratically constrained quadratic program (QCQP) formulation of the RA-SLAM problem. As a SOCP, the method is highly scalable. We name this relaxation Second-order COnic RElaxation for RA-SLAM (SCORE). To our knowledge, this work represents the first convex relaxation for RA-SLAM. We present real-world and simulated experiments which show SCORE initialization permits the efficient recovery of quality solutions for a variety of challenging single- and multi-robot RA-SLAM problems with thousands of poses and range measurements. △ Less

Submitted 6 October, 2022; originally announced October 2022.

Comments: 9 pages, 8 figures, extended version of paper submitted to ICRA 2023

Probabilistic Volumetric Fusion for Dense Monocular SLAM

Authors: Antoni Rosinol, John J. Leonard, Luca Carlone

Abstract: We present a novel method to reconstruct 3D scenes from images by leveraging deep dense monocular SLAM and fast uncertainty propagation. The proposed approach is able to 3D reconstruct scenes densely, accurately, and in real-time while being robust to extremely noisy depth estimates coming from dense monocular SLAM. Differently from previous approaches, that either use ad-hoc depth filters, or tha… ▽ More We present a novel method to reconstruct 3D scenes from images by leveraging deep dense monocular SLAM and fast uncertainty propagation. The proposed approach is able to 3D reconstruct scenes densely, accurately, and in real-time while being robust to extremely noisy depth estimates coming from dense monocular SLAM. Differently from previous approaches, that either use ad-hoc depth filters, or that estimate the depth uncertainty from RGB-D cameras' sensor models, our probabilistic depth uncertainty derives directly from the information matrix of the underlying bundle adjustment problem in SLAM. We show that the resulting depth uncertainty provides an excellent signal to weight the depth-maps for volumetric fusion. Without our depth uncertainty, the resulting mesh is noisy and with artifacts, while our approach generates an accurate 3D mesh with significantly fewer artifacts. We provide results on the challenging Euroc dataset, and show that our approach achieves 92% better accuracy than directly fusing depths from monocular SLAM, and up to 90% improvements compared to the best competing approach. △ Less

Submitted 16 October, 2022; v1 submitted 3 October, 2022; originally announced October 2022.

Comments: 9 pages, 6 figures, 2 tables

Robust Change Detection Based on Neural Descriptor Fields

Authors: Jiahui Fu, Yilun Du, Kurran Singh, Joshua B. Tenenbaum, John J. Leonard

Abstract: The ability to reason about changes in the environment is crucial for robots operating over extended periods of time. Agents are expected to capture changes during operation so that actions can be followed to ensure a smooth progression of the working session. However, varying viewing angles and accumulated localization errors make it easy for robots to falsely detect changes in the surrounding wo… ▽ More The ability to reason about changes in the environment is crucial for robots operating over extended periods of time. Agents are expected to capture changes during operation so that actions can be followed to ensure a smooth progression of the working session. However, varying viewing angles and accumulated localization errors make it easy for robots to falsely detect changes in the surrounding world due to low observation overlap and drifted object associations. In this paper, based on the recently proposed category-level Neural Descriptor Fields (NDFs), we develop an object-level online change detection approach that is robust to partially overlap** observations and noisy localization results. Utilizing the shape completion capability and SE(3)-equivariance of NDFs, we represent objects with compact shape codes encoding full object shapes from partial observations. The objects are then organized in a spatial tree structure based on object centers recovered from NDFs for fast queries of object neighborhoods. By associating objects via shape code similarity and comparing local object-neighbor spatial layout, our proposed approach demonstrates robustness to low observation overlap and localization noises. We conduct experiments on both synthetic and real-world sequences and achieve improved change detection results compared to multiple baseline methods. Project webpage: https://yilundu.github.io/ndf_change △ Less

Submitted 1 August, 2022; originally announced August 2022.

Comments: 8 pages, 8 figures, and 2 tables. Accepted to IROS 2022. Project webpage: https://yilundu.github.io/ndf_change

PlaneSDF-based Change Detection for Long-term Dense Map**

Authors: Jiahui Fu, Chengyuan Lin, Yuichi Taguchi, Andrea Cohen, Yifu Zhang, Stephen Mylabathula, John J. Leonard

Abstract: The ability to process environment maps across multiple sessions is critical for robots operating over extended periods of time. Specifically, it is desirable for autonomous agents to detect changes amongst maps of different sessions so as to gain a conflict-free understanding of the current environment. In this paper, we look into the problem of change detection based on a novel map representatio… ▽ More The ability to process environment maps across multiple sessions is critical for robots operating over extended periods of time. Specifically, it is desirable for autonomous agents to detect changes amongst maps of different sessions so as to gain a conflict-free understanding of the current environment. In this paper, we look into the problem of change detection based on a novel map representation, dubbed Plane Signed Distance Fields (PlaneSDF), where dense maps are represented as a collection of planes and their associated geometric components in SDF volumes. Given point clouds of the source and target scenes, we propose a three-step PlaneSDF-based change detection approach: (1) PlaneSDF volumes are instantiated within each scene and registered across scenes using plane poses; 2D height maps and object maps are extracted per volume via height projection and connected component analysis. (2) Height maps are compared and intersected with the object map to produce a 2D change location mask for changed object candidates in the source scene. (3) 3D geometric validation is performed using SDF-derived features per object candidate for change mask refinement. We evaluate our approach on both synthetic and real-world datasets and demonstrate its effectiveness via the task of changed object detection. Supplementary video: https://youtu.be/oh-MQPWTwZI △ Less

Submitted 5 October, 2022; v1 submitted 17 July, 2022; originally announced July 2022.

Comments: 8 pages, 7 figures, and 1 table. To be published in Robotics and Automation Letters and IROS 2022. Link to supplementary video added in the abstract: https://youtu.be/oh-MQPWTwZI

Reproducibility of the First Image of a Black Hole in the Galaxy M87 from the Event Horizon Telescope (EHT) Collaboration

Authors: Ria Patel, Brandan Roachell, Silvina Caino-Lores, Ross Ketron, Jacob Leonard, Nigel Tan, Duncan Brown, Ewa Deelman, Michela Taufer

Abstract: This paper presents an interdisciplinary effort aiming to develop and share sustainable knowledge necessary to analyze, understand, and use published scientific results to advance reproducibility in multi-messenger astrophysics. Specifically, we target the breakthrough work associated with the generation of the first image of a black hole, called M87. The image was computed by the Event Horizon Te… ▽ More This paper presents an interdisciplinary effort aiming to develop and share sustainable knowledge necessary to analyze, understand, and use published scientific results to advance reproducibility in multi-messenger astrophysics. Specifically, we target the breakthrough work associated with the generation of the first image of a black hole, called M87. The image was computed by the Event Horizon Telescope Collaboration. Based on the artifacts made available by EHT, we deliver documentation, code, and a computational environment to reproduce the first image of a black hole. Our deliverables support new discovery in multi-messenger astrophysics by providing all the necessary tools for generalizing methods and findings from the EHT use case. Challenges encountered during the reproducibility of EHT results are reported. The result of our effort is an open-source, containerized software package that enables the public to reproduce the first image of a black hole in the galaxy M87. △ Less

Submitted 20 May, 2022; originally announced May 2022.

Discrete-Continuous Smoothing and Map**

Authors: Kevin J. Doherty, Ziqi Lu, Kurran Singh, John J. Leonard

Abstract: We describe a general approach for maximum a posteriori (MAP) inference in a class of discrete-continuous factor graphs commonly encountered in robotics applications. While there are openly available tools providing flexible and easy-to-use interfaces for specifying and solving inference problems formulated in terms of either discrete or continuous graphical models, at present, no similarly genera… ▽ More We describe a general approach for maximum a posteriori (MAP) inference in a class of discrete-continuous factor graphs commonly encountered in robotics applications. While there are openly available tools providing flexible and easy-to-use interfaces for specifying and solving inference problems formulated in terms of either discrete or continuous graphical models, at present, no similarly general tools exist enabling the same functionality for hybrid discrete-continuous problems. We aim to address this problem. In particular, we provide a library, DC-SAM, extending existing tools for inference problems defined in terms of factor graphs to the setting of discrete-continuous models. A key contribution of our work is a novel solver for efficiently recovering approximate solutions to discrete-continuous inference problems. The key insight to our approach is that while joint inference over continuous and discrete state spaces is often hard, many commonly encountered discrete-continuous problems can naturally be split into a "discrete part" and a "continuous part" that can individually be solved easily. Leveraging this structure, we optimize discrete and continuous variables in an alternating fashion. In consequence, our proposed work enables straightforward representation of and approximate inference in discrete-continuous graphical models. We also provide a method to approximate the uncertainty in estimates of both discrete and continuous variables. We demonstrate the versatility of our approach through its application to distinct robot perception applications, including robust pose graph optimization, and object-based map** and localization. △ Less

Submitted 17 November, 2022; v1 submitted 25 April, 2022; originally announced April 2022.

Comments: Extended technical report for publication in IEEE Robotics and Automation Letters (RA-L)

Spectral Measurement Sparsification for Pose-Graph SLAM

Authors: Kevin J. Doherty, David M. Rosen, John J. Leonard

Abstract: Simultaneous localization and map** (SLAM) is a critical capability in autonomous navigation, but in order to scale SLAM to the setting of "lifelong" SLAM, particularly under memory or computation constraints, a robot must be able to determine what information should be retained and what can safely be forgotten. In graph-based SLAM, the number of edges (measurements) in a pose graph determines b… ▽ More Simultaneous localization and map** (SLAM) is a critical capability in autonomous navigation, but in order to scale SLAM to the setting of "lifelong" SLAM, particularly under memory or computation constraints, a robot must be able to determine what information should be retained and what can safely be forgotten. In graph-based SLAM, the number of edges (measurements) in a pose graph determines both the memory requirements of storing a robot's observations and the computational expense of algorithms deployed for performing state estimation using those observations; both of which can grow unbounded during long-term navigation. To address this, we propose a spectral approach for pose graph sparsification which maximizes the algebraic connectivity of the sparsified measurement graphs, a key quantity which has been shown to control the estimation error of pose graph SLAM solutions. Our algorithm, MAC (for "maximizing algebraic connectivity"), which is based on convex relaxation, is simple and computationally inexpensive, and admits formal post hoc performance guarantees on the quality of the solutions it provides. In experiments on benchmark pose-graph SLAM datasets, we show that our approach quickly produces high-quality sparsification results which retain the connectivity of the graph and, in turn, the quality of corresponding SLAM solutions, as compared to a baseline approach which does not consider graph connectivity. △ Less

Submitted 25 March, 2022; originally announced March 2022.

Comments: Submitted to the IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) 2022

The Lick Observatory Supernova Search follow-up program: photometry data release of 70 stripped-envelope supernovae

Authors: WeiKang Zheng, Benjamin E. Stahl, Thomas de Jaeger, Alexei V. Filippenko, Shan-Qin Wang, Wen-Pei Gan, Thomas G. Brink, Ivan Altunin, Raphael Baer-Way, Andrew Bigley, Kyle Blanchard, Peter K. Blanchard, James Bradley, Samantha K. Cargill, Chadwick Casper, Teagan Chapman, Vidhi Chander, Sanyum Channa, Byung Yun Choi, Nick Choksi, Matthew Chu, Kelsey I. Clubb, Daniel P. Cohen, Paul A. Dalba, Asia deGraw , et al. (63 additional authors not shown)

Abstract: We present BVRI and unfiltered Clear light curves of 70 stripped-envelope supernovae (SESNe), observed between 2003 and 2020, from the Lick Observatory Supernova Search (LOSS) follow-up program. Our SESN sample consists of 19 spectroscopically normal SNe~Ib, two peculiar SNe Ib, six SN Ibn, 14 normal SNe Ic, one peculiar SN Ic, ten SNe Ic-BL, 15 SNe IIb, one ambiguous SN IIb/Ib/c, and two superlum… ▽ More We present BVRI and unfiltered Clear light curves of 70 stripped-envelope supernovae (SESNe), observed between 2003 and 2020, from the Lick Observatory Supernova Search (LOSS) follow-up program. Our SESN sample consists of 19 spectroscopically normal SNe~Ib, two peculiar SNe Ib, six SN Ibn, 14 normal SNe Ic, one peculiar SN Ic, ten SNe Ic-BL, 15 SNe IIb, one ambiguous SN IIb/Ib/c, and two superluminous SNe. Our follow-up photometry has (on a per-SN basis) a mean coverage of 81 photometric points (median of 58 points) and a mean cadence of 3.6d (median of 1.2d). From our full sample, a subset of 38 SNe have pre-maximum coverage in at least one passband, allowing for the peak brightness of each SN in this subset to be quantitatively determined. We describe our data collection and processing techniques, with emphasis toward our automated photometry pipeline, from which we derive publicly available data products to enable and encourage further study by the community. Using these data products, we derive host-galaxy extinction values through the empirical colour evolution relationship and, for the first time, produce accurate rise-time measurements for a large sample of SESNe in both optical and infrared passbands. By modeling multiband light curves, we find that SNe Ic tend to have lower ejecta masses and lower ejecta velocities than SNe~Ib and IIb, but higher $^{56}$Ni masses. △ Less

Submitted 10 March, 2022; originally announced March 2022.

Comments: Accepted by MNRAS

SLAM-Supported Self-Training for 6D Object Pose Estimation

Authors: Ziqi Lu, Yihao Zhang, Kevin Doherty, Odin Severinsen, Ethan Yang, John Leonard

Abstract: Recent progress in object pose prediction provides a promising path for robots to build object-level scene representations during navigation. However, as we deploy a robot in novel environments, the out-of-distribution data can degrade the prediction performance. To mitigate the domain gap, we can potentially perform self-training in the target domain, using predictions on robot-captured images as… ▽ More Recent progress in object pose prediction provides a promising path for robots to build object-level scene representations during navigation. However, as we deploy a robot in novel environments, the out-of-distribution data can degrade the prediction performance. To mitigate the domain gap, we can potentially perform self-training in the target domain, using predictions on robot-captured images as pseudo labels to fine-tune the object pose estimator. Unfortunately, the pose predictions are typically outlier-corrupted, and it is hard to quantify their uncertainties, which can result in low-quality pseudo-labeled data. To address the problem, we propose a SLAM-supported self-training method, leveraging robot understanding of the 3D scene geometry to enhance the object pose inference performance. Combining the pose predictions with robot odometry, we formulate and solve pose graph optimization to refine the object pose estimates and make pseudo labels more consistent across frames. We incorporate the pose prediction covariances as variables into the optimization to automatically model their uncertainties. This automatic covariance tuning (ACT) process can fit 6D pose prediction noise at the component level, leading to higher-quality pseudo training data. We test our method with the deep object pose estimator (DOPE) on the YCB video dataset and in real robot experiments. It achieves respectively 34.3% and 17.8% accuracy enhancements in pose prediction on the two tests. Our code is available at https://github.com/520xyxyzq/slam-super-6d. △ Less

Submitted 15 August, 2022; v1 submitted 8 March, 2022; originally announced March 2022.

Performance Guarantees for Spectral Initialization in Rotation Averaging and Pose-Graph SLAM

Authors: Kevin J. Doherty, David M. Rosen, John J. Leonard

Abstract: In this work we present the first initialization methods equipped with explicit performance guarantees adapted to the pose-graph simultaneous localization and map** (SLAM) and rotation averaging (RA) problems. SLAM and rotation averaging are typically formalized as large-scale nonconvex point estimation problems, with many bad local minima that can entrap the smooth optimization methods typicall… ▽ More In this work we present the first initialization methods equipped with explicit performance guarantees adapted to the pose-graph simultaneous localization and map** (SLAM) and rotation averaging (RA) problems. SLAM and rotation averaging are typically formalized as large-scale nonconvex point estimation problems, with many bad local minima that can entrap the smooth optimization methods typically applied to solve them; the performance of standard SLAM and RA algorithms thus crucially depends upon the quality of the estimates used to initialize this local search. While many initialization methods for SLAM and RA have appeared in the literature, these are typically obtained as purely heuristic approximations, making it difficult to determine whether (or under what circumstances) these techniques can be reliably deployed. In contrast, in this work we study the problem of initialization through the lens of spectral relaxation. Specifically, we derive a simple spectral relaxation of SLAM and RA, the form of which enables us to exploit classical linear-algebraic techniques (eigenvector perturbation bounds) to control the distance from our spectral estimate to both the (unknown) ground-truth and the global minimizer of the estimation problem as a function of measurement noise. Our results reveal the critical role that spectral graph-theoretic properties of the measurement network play in controlling estimation accuracy; moreover, as a by-product of our analysis we obtain new bounds on the estimation error for the maximum likelihood estimators in SLAM and RA, which are likely to be of independent interest. Finally, we show experimentally that our spectral estimator is very effective in practice, producing initializations of comparable or superior quality at lower computational cost compared to existing state-of-the-art techniques. △ Less

Submitted 10 January, 2022; originally announced January 2022.

A CO2 cycle on Ariel? Radiolytic production and migration to low latitude cold traps

Authors: Richard J. Cartwright, Tom A. Nordheim, David DeColibus, William M. Grundy, Bryan J. Holler, Chloe B. Beddingfield, Michael M. Sori, Michael P. Lucas, Catherine M. Elder, Leonardo H. Regoli, Dale P. Cruikshank, Joshua P. Emery, Erin J. Leonard, Corey J. Cochrane

Abstract: CO2 ice is present on the trailing hemisphere of Ariel but is mostly absent from its leading hemisphere. The leading/trailing hemispherical asymmetry in the distribution of CO2 ice is consistent with radiolytic production of CO2, formed by charged particle bombardment of H2O ice and carbonaceous material in Ariel's regolith. This longitudinal distribution of CO2 on Ariel was previously characteriz… ▽ More CO2 ice is present on the trailing hemisphere of Ariel but is mostly absent from its leading hemisphere. The leading/trailing hemispherical asymmetry in the distribution of CO2 ice is consistent with radiolytic production of CO2, formed by charged particle bombardment of H2O ice and carbonaceous material in Ariel's regolith. This longitudinal distribution of CO2 on Ariel was previously characterized using 13 near-infrared reflectance spectra collected at 'low' sub-observer latitudes between 30S to 30N. Here, we investigated the distribution of CO2 ice on Ariel using 18 new spectra: two collected over low sub-observer latitudes, five collected at 'mid' sub-observer latitudes (31 - 44N), and eleven collected over 'high' sub-observer latitudes (45 - 51N). Analysis of these data indicates that CO2 ice is primarily concentrated on Ariel's trailing hemisphere. However, CO2 ice band strengths are diminished in the spectra collected over mid and high sub-observer latitudes. This sub-observer latitudinal trend may result from radiolytic production of CO2 molecules at high latitudes and subsequent migration of this constituent to low latitude cold traps. We detected a subtle feature near 2.13 microns in two spectra collected over high sub-observer latitudes, which might result from a 'forbidden' transition mode of CO2 ice that is substantially stronger in well mixed substrates composed of CO2 and H2O ice, consistent with regolith-mixed CO2 ice grains formed by radiolysis. Additionally, we detected a 2.35-micron feature in some low sub-observer latitude spectra, which might result from CO formed as part of a CO2 radiolytic production cycle. △ Less

Submitted 28 November, 2021; originally announced November 2021.

Comments: Accepted in Planetary Science Journal

Trajectory Prediction with Linguistic Representations

Authors: Yen-Ling Kuo, Xin Huang, Andrei Barbu, Stephen G. McGill, Boris Katz, John J. Leonard, Guy Rosman

Abstract: Language allows humans to build mental models that interpret what is happening around them resulting in more accurate long-term predictions. We present a novel trajectory prediction model that uses linguistic intermediate representations to forecast trajectories, and is trained using trajectory samples with partially-annotated captions. The model learns the meaning of each of the words without dir… ▽ More Language allows humans to build mental models that interpret what is happening around them resulting in more accurate long-term predictions. We present a novel trajectory prediction model that uses linguistic intermediate representations to forecast trajectories, and is trained using trajectory samples with partially-annotated captions. The model learns the meaning of each of the words without direct per-word supervision. At inference time, it generates a linguistic description of trajectories which captures maneuvers and interactions over an extended time interval. This generated description is used to refine predictions of the trajectories of multiple agents. We train and validate our model on the Argoverse dataset, and demonstrate improved accuracy results in trajectory prediction. In addition, our model is more interpretable: it presents part of its reasoning in plain language as captions, which can aid model development and can aid in building confidence in the model before deploying it. △ Less

Submitted 9 March, 2022; v1 submitted 19 October, 2021; originally announced October 2021.

Comments: Accepted in ICRA 2022

TIP: Task-Informed Motion Prediction for Intelligent Vehicles

Authors: Xin Huang, Guy Rosman, Ashkan Jasour, Stephen G. McGill, John J. Leonard, Brian C. Williams

Abstract: When predicting trajectories of road agents, motion predictors usually approximate the future distribution by a limited number of samples. This constraint requires the predictors to generate samples that best support the task given task specifications. However, existing predictors are often optimized and evaluated via task-agnostic measures without accounting for the use of predictions in downstre… ▽ More When predicting trajectories of road agents, motion predictors usually approximate the future distribution by a limited number of samples. This constraint requires the predictors to generate samples that best support the task given task specifications. However, existing predictors are often optimized and evaluated via task-agnostic measures without accounting for the use of predictions in downstream tasks, and thus could result in sub-optimal task performance. In this paper, we propose a task-informed motion prediction model that better supports the tasks through its predictions, by jointly reasoning about prediction accuracy and the utility of the downstream tasks, which is commonly used to evaluate the task performance. The task utility function does not require the full task information, but rather a specification of the utility of the task, resulting in predictors that serve a wide range of downstream tasks. We demonstrate our approach on two use cases of common decision making tasks and their utility functions, in the context of autonomous driving and parallel autonomy. Experiment results show that our predictor produces accurate predictions that improve the task performance by a large margin in both tasks when compared to task-agnostic baselines on the Waymo Open Motion dataset. △ Less

Submitted 26 May, 2022; v1 submitted 17 October, 2021; originally announced October 2021.

Comments: 9 pages, 5 figures, 5 tables

MAAD: A Model and Dataset for "Attended Awareness" in Driving

Authors: Deepak Gopinath, Guy Rosman, Simon Stent, Katsuya Terahata, Luke Fletcher, Brenna Argall, John Leonard

Abstract: We propose a computational model to estimate a person's attended awareness of their environment. We define attended awareness to be those parts of a potentially dynamic scene which a person has attended to in recent history and which they are still likely to be physically aware of. Our model takes as input scene information in the form of a video and noisy gaze estimates, and outputs visual salien… ▽ More We propose a computational model to estimate a person's attended awareness of their environment. We define attended awareness to be those parts of a potentially dynamic scene which a person has attended to in recent history and which they are still likely to be physically aware of. Our model takes as input scene information in the form of a video and noisy gaze estimates, and outputs visual saliency, a refined gaze estimate, and an estimate of the person's attended awareness. In order to test our model, we capture a new dataset with a high-precision gaze tracker including 24.5 hours of gaze sequences from 23 subjects attending to videos of driving scenes. The dataset also contains third-party annotations of the subjects' attended awareness based on observations of their scan path. Our results show that our model is able to reasonably estimate attended awareness in a controlled setting, and in the future could potentially be extended to real egocentric driving data to help enable more effective ahead-of-time warnings in safety systems and thereby augment driver performance. We also demonstrate our model's effectiveness on the tasks of saliency, gaze calibration, and denoising, using both our dataset and an existing saliency dataset. We make our model and dataset available at https://github.com/ToyotaResearchInstitute/att-aware/. △ Less

Submitted 16 October, 2021; originally announced October 2021.

Comments: 25 pages, 13 figures, 14 tables, Accepted at EPIC@ICCV 2021 Workshop. Main paper + Supplementary Material

HYPER: Learned Hybrid Trajectory Prediction via Factored Inference and Adaptive Sampling

Authors: Xin Huang, Guy Rosman, Igor Gilitschenski, Ashkan Jasour, Stephen G. McGill, John J. Leonard, Brian C. Williams

Abstract: Modeling multi-modal high-level intent is important for ensuring diversity in trajectory prediction. Existing approaches explore the discrete nature of human intent before predicting continuous trajectories, to improve accuracy and support explainability. However, these approaches often assume the intent to remain fixed over the prediction horizon, which is problematic in practice, especially over… ▽ More Modeling multi-modal high-level intent is important for ensuring diversity in trajectory prediction. Existing approaches explore the discrete nature of human intent before predicting continuous trajectories, to improve accuracy and support explainability. However, these approaches often assume the intent to remain fixed over the prediction horizon, which is problematic in practice, especially over longer horizons. To overcome this limitation, we introduce HYPER, a general and expressive hybrid prediction framework that models evolving human intent. By modeling traffic agents as a hybrid discrete-continuous system, our approach is capable of predicting discrete intent changes over time. We learn the probabilistic hybrid model via a maximum likelihood estimation problem and leverage neural proposal distributions to sample adaptively from the exponentially growing discrete space. The overall approach affords a better trade-off between accuracy and coverage. We train and validate our model on the Argoverse dataset, and demonstrate its effectiveness through comprehensive ablation studies and comparisons with state-of-the-art models. △ Less

Submitted 5 October, 2021; originally announced October 2021.

Comments: 12 pages, 10 figures, 4 tables

Incremental Non-Gaussian Inference for SLAM Using Normalizing Flows

Authors: Qiangqiang Huang, Can Pu, Kasra Khosoussi, David M. Rosen, Dehann Fourie, Jonathan P. How, John J. Leonard

Abstract: This paper presents normalizing flows for incremental smoothing and map** (NF-iSAM), a novel algorithm for inferring the full posterior distribution in SLAM problems with nonlinear measurement models and non-Gaussian factors. NF-iSAM exploits the expressive power of neural networks, and trains normalizing flows to model and sample the full posterior. By leveraging the Bayes tree, NF-iSAM enables… ▽ More This paper presents normalizing flows for incremental smoothing and map** (NF-iSAM), a novel algorithm for inferring the full posterior distribution in SLAM problems with nonlinear measurement models and non-Gaussian factors. NF-iSAM exploits the expressive power of neural networks, and trains normalizing flows to model and sample the full posterior. By leveraging the Bayes tree, NF-iSAM enables efficient incremental updates similar to iSAM2, albeit in the more challenging non-Gaussian setting. We demonstrate the advantages of NF-iSAM over state-of-the-art point and distribution estimation algorithms using range-only SLAM problems with data association ambiguity. NF-iSAM presents superior accuracy in describing the posterior beliefs of continuous variables (e.g., position) and discrete variables (e.g., data association). △ Less

Submitted 2 July, 2022; v1 submitted 2 October, 2021; originally announced October 2021.

Comments: Extension of work published at arXiv:2105.05045

Nested Sampling for Non-Gaussian Inference in SLAM Factor Graphs

Authors: Qiangqiang Huang, Alan Papalia, John J. Leonard

Abstract: We present nested sampling for factor graphs (NSFG), a novel nested sampling approach to approximate inference for posterior distributions expressed over factor-graphs. Performing such inference is a key step in simultaneous localization and map** (SLAM). Although the Gaussian approximation often works well, in other more challenging SLAM situations, the posterior distribution is non-Gaussian an… ▽ More We present nested sampling for factor graphs (NSFG), a novel nested sampling approach to approximate inference for posterior distributions expressed over factor-graphs. Performing such inference is a key step in simultaneous localization and map** (SLAM). Although the Gaussian approximation often works well, in other more challenging SLAM situations, the posterior distribution is non-Gaussian and cannot be explicitly represented with standard distributions. Our technique applies to settings where the posterior distribution is substantially non-Gaussian (e.g., multi-modal) and thus needs a more expressive representation. NSFG exploits nested sampling methods to directly sample the posterior to represent the distribution without parametric density models. While nested sampling methods are known for their powerful capability in sampling multi-modal distributions, the application of the methods to SLAM factor graphs is not straightforward. NSFG leverages the structure of factor graphs to construct informative prior distributions which are efficiently sampled and provide notable computational benefits for nested sampling methods. We present simulated experiments which demonstrate that NSFG is more robust and computes solutions over an order of magnitude faster than state-of-the-art sampling techniques. Similarly, we compare NSFG to state-of-the-art Gaussian and non-Gaussian SLAM approaches and demonstrate that NSFG is notably more robust in describing non-Gaussian posteriors. △ Less

Submitted 8 August, 2022; v1 submitted 22 September, 2021; originally announced September 2021.

Journal ref: IEEE Robotics and Automation Letters, vol. 7, no. 4, pp. 9232-9239, Oct. 2022

Prioritized Planning for Cooperative Range-Only Localization in Multi-Robot Networks

Authors: Alan Papalia, Nicole Thumma, John Leonard

Abstract: We present a novel path-planning algorithm to reduce localization error for a network of robots cooperatively localizing via inter-robot range measurements. The quality of localization with range measurements depends on the configuration of the network, and poor configurations can cause substantial localization errors. To reduce the effect of network configuration on localization error for moving… ▽ More We present a novel path-planning algorithm to reduce localization error for a network of robots cooperatively localizing via inter-robot range measurements. The quality of localization with range measurements depends on the configuration of the network, and poor configurations can cause substantial localization errors. To reduce the effect of network configuration on localization error for moving networks we consider various optimality measures of the Fisher information matrix (FIM), which have well-studied relationships with the localization error. In particular, we pose a trajectory planning problem with constraints on the FIM optimality measures. By constraining these optimality measures we can control the statistical properties of the localization error. To efficiently generate trajectories which satisfy these FIM constraints we present a prioritized planner which leverages graph-based planning and unique properties of the range-only FIM. We show results in simulated experiments that demonstrate the trajectories generated by our algorithm reduce worst-case localization error by up to 42\% in comparison to existing planning approaches and can scalably plan distance-efficient trajectories in complicated environments for large numbers of robots. △ Less

Submitted 10 September, 2021; originally announced September 2021.

Comments: 8 pages, 3 figures, 1 table, 2 algorithms. Extension of work published at arXiv:2010.02861

Internal rubble properties of asteroid (101955) Bennu

Authors: P. Tricarico, D. J. Scheeres, A. S. French, J. W. McMahon, D. N. Brack, J. M. Leonard, P. Antreasian, S. R. Chesley, D. Farnocchia, Y. Takahashi, E. M. Mazarico, D. Rowlands, D. Highsmith, K. Getzandanner, M. Moreau, C. L. Johnson, L. Philpott, E. B. Bierhaus, K. J. Walsh, O. S. Barnouin, E. E. Palmer, J. R. Weirich, R. W. Gaskell, M. G. Daly, J. A. Seabrook , et al. (2 additional authors not shown)

Abstract: Exploration of asteroid (101955) Bennu by the OSIRIS-REx mission has provided an in-depth look at this rubble-pile near-Earth asteroid. In particular, the measured gravity field and the detailed shape model of Bennu indicate significant heterogeneities in its interior structure, compatible with a lower density at its center. Here we combine gravity inversion methods with a statistical rubble-pile… ▽ More Exploration of asteroid (101955) Bennu by the OSIRIS-REx mission has provided an in-depth look at this rubble-pile near-Earth asteroid. In particular, the measured gravity field and the detailed shape model of Bennu indicate significant heterogeneities in its interior structure, compatible with a lower density at its center. Here we combine gravity inversion methods with a statistical rubble-pile model to determine the density and size-frequency distribution (SFD) index of the rubble that constitutes Bennu. The best-fitting models indicate that the SFD of the interior is consistent with that observed on the surface, with a cumulative SFD index of approximately $-2.9$. The rubble bulk density is approximately $1.35$ g/cm$^3$, corresponding to a $12$% macro-porosity. We find the largest rubble particle to be approximately $145$ m, whereas the largest void is approximately $10$ m. △ Less

Submitted 23 August, 2021; originally announced August 2021.

Comments: 14 pages, 5 figures, accepted to Icarus

A Multi-Hypothesis Approach to Pose Ambiguity in Object-Based SLAM

Authors: Jiahui Fu, Qiangqiang Huang, Kevin Doherty, Yue Wang, John J. Leonard

Abstract: In object-based Simultaneous Localization and Map** (SLAM), 6D object poses offer a compact representation of landmark geometry useful for downstream planning and manipulation tasks. However, measurement ambiguity then arises as objects may possess complete or partial object shape symmetries (e.g., due to occlusion), making it difficult or impossible to generate a single consistent object pose e… ▽ More In object-based Simultaneous Localization and Map** (SLAM), 6D object poses offer a compact representation of landmark geometry useful for downstream planning and manipulation tasks. However, measurement ambiguity then arises as objects may possess complete or partial object shape symmetries (e.g., due to occlusion), making it difficult or impossible to generate a single consistent object pose estimate. One idea is to generate multiple pose candidates to counteract measurement ambiguity. In this paper, we develop a novel approach that enables an object-based SLAM system to reason about multiple pose hypotheses for an object, and synthesize this locally ambiguous information into a globally consistent robot and landmark pose estimation formulation. In particular, we (1) present a learned pose estimation network that provides multiple hypotheses about the 6D pose of an object; (2) by treating the output of our network as components of a mixture model, we incorporate pose predictions into a SLAM system, which, over successive observations, recovers a globally consistent set of robot and object (landmark) pose estimates. We evaluate our approach on the popular YCB-Video Dataset and a simulated video featuring YCB objects. Experiments demonstrate that our approach is effective in improving the robustness of object-based SLAM in the face of object pose ambiguity. △ Less

Submitted 2 August, 2021; originally announced August 2021.

Comments: 8 pages, 8 figures, and 1 table. Accepted to The IEEE/RSJ International Conference on Intelligent Robots and Systems(IROS) 2021

Consensus-Informed Optimization Over Mixtures for Ambiguity-Aware Object SLAM

Authors: Ziqi Lu, Qiangqiang Huang, Kevin Doherty, John Leonard

Abstract: Building object-level maps can facilitate robot-environment interactions (e.g. planning and manipulation), but objects could often have multiple probable poses when viewed from a single vantage point, due to symmetry, occlusion or perceptual failures. A robust object-level simultaneous localization and map** (object SLAM) algorithm needs to be aware of this pose ambiguity. We propose to maintain… ▽ More Building object-level maps can facilitate robot-environment interactions (e.g. planning and manipulation), but objects could often have multiple probable poses when viewed from a single vantage point, due to symmetry, occlusion or perceptual failures. A robust object-level simultaneous localization and map** (object SLAM) algorithm needs to be aware of this pose ambiguity. We propose to maintain and subsequently disambiguate the multiple pose interpretations to gradually recover a globally consistent world representation. The max-mixtures model is applied to implicitly and efficiently track all pose hypotheses, but the resulting formulation is non-convex, and therefore subject to local optima. To mitigate this problem, temporally consistent hypotheses are extracted, guiding the optimization into the global optimum. This consensus-informed inference method is applied online via landmark variable re-initialization within an incremental SLAM framework, iSAM2, for robust real-time performance. We demonstrate that this approach improves SLAM performance on both simulated and real object SLAM problems with pose ambiguity. △ Less

Submitted 8 September, 2021; v1 submitted 20 July, 2021; originally announced July 2021.

NF-iSAM: Incremental Smoothing and Map** via Normalizing Flows

Authors: Qiangqiang Huang, Can Pu, Dehann Fourie, Kasra Khosoussi, Jonathan P. How, John J. Leonard

Abstract: This paper presents a novel non-Gaussian inference algorithm, Normalizing Flow iSAM (NF-iSAM), for solving SLAM problems with non-Gaussian factors and/or non-linear measurement models. NF-iSAM exploits the expressive power of neural networks, and trains normalizing flows to draw samples from the joint posterior of non-Gaussian factor graphs. By leveraging the Bayes tree, NF-iSAM is able to exploit… ▽ More This paper presents a novel non-Gaussian inference algorithm, Normalizing Flow iSAM (NF-iSAM), for solving SLAM problems with non-Gaussian factors and/or non-linear measurement models. NF-iSAM exploits the expressive power of neural networks, and trains normalizing flows to draw samples from the joint posterior of non-Gaussian factor graphs. By leveraging the Bayes tree, NF-iSAM is able to exploit the sparsity structure of SLAM, thus enabling efficient incremental updates similar to iSAM2, albeit in the more challenging non-Gaussian setting. We demonstrate the performance of NF-iSAM and compare it against the state-of-the-art algorithms such as iSAM2 (Gaussian) and mm-iSAM (non-Gaussian) in synthetic and real range-only SLAM datasets. △ Less

Submitted 11 May, 2021; originally announced May 2021.

Comments: 8 pages, 6 figures, to be published in IEEE International Conference on Robotics and Automation (ICRA) 2021

The science case for spacecraft exploration of the Uranian satellites: Candidate ocean worlds in an ice giant system

Authors: Richard J. Cartwright, Chloe B. Beddingfield, Tom A. Nordheim, Catherine M. Elder, Julie C. Castillo-Rogez, Marc Neveu, Ali M. Bramson, Michael M. Sori, Bonnie J. Buratti, Robert T. Pappalardo, Joseph E. Roser, Ian J. Cohen, Erin J. Leonard, Anton I. Ermakov, Mark R. Showalter, William M. Grundy, Elizabeth P. Turtle, Mark D. Hofstadter

Abstract: The 27 satellites of Uranus are enigmatic, with dark surfaces coated by material that could be rich in organics. Voyager 2 imaged the southern hemispheres of Uranus' five largest 'classical' moons Miranda, Ariel, Umbriel, Titania, and Oberon, as well as the largest ring moon Puck, but their northern hemispheres were largely unobservable at the time of the flyby and were not imaged. Additionally, n… ▽ More The 27 satellites of Uranus are enigmatic, with dark surfaces coated by material that could be rich in organics. Voyager 2 imaged the southern hemispheres of Uranus' five largest 'classical' moons Miranda, Ariel, Umbriel, Titania, and Oberon, as well as the largest ring moon Puck, but their northern hemispheres were largely unobservable at the time of the flyby and were not imaged. Additionally, no spatially resolved datasets exist for the other 21 known moons, and their surface properties are essentially unknown. Because Voyager 2 was not equipped with a near-infrared map** spectrometer, our knowledge of the Uranian moons' surface compositions, and the processes that modify them, is limited to disk-integrated datasets collected by ground- and space-based telescopes. Nevertheless, images collected by the Imaging Science System on Voyager 2 and reflectance spectra collected by telescope facilities indicate that the five classical moons are candidate ocean worlds that might currently have, or had, liquid subsurface layers beneath their icy surfaces. To determine whether these moons are ocean worlds, and investigate Uranus' ring moons and irregular satellites, close-up observations and measurements made by instruments onboard a Uranus orbiter are needed. △ Less

Submitted 5 May, 2021; v1 submitted 3 May, 2021; originally announced May 2021.

Comments: Accepted in AAS Planetary Science Journal. arXiv admin note: text overlap with arXiv:2007.07284

Lidar-Monocular Surface Reconstruction Using Line Segments

Authors: Victor Amblard, Timothy P. Osedach, Arnaud Croux, Andrew Speck, John J. Leonard

Abstract: Structure from Motion (SfM) often fails to estimate accurate poses in environments that lack suitable visual features. In such cases, the quality of the final 3D mesh, which is contingent on the accuracy of those estimates, is reduced. One way to overcome this problem is to combine data from a monocular camera with that of a LIDAR. This allows fine details and texture to be captured while still ac… ▽ More Structure from Motion (SfM) often fails to estimate accurate poses in environments that lack suitable visual features. In such cases, the quality of the final 3D mesh, which is contingent on the accuracy of those estimates, is reduced. One way to overcome this problem is to combine data from a monocular camera with that of a LIDAR. This allows fine details and texture to be captured while still accurately representing featureless subjects. However, fusing these two sensor modalities is challenging due to their fundamentally different characteristics. Rather than directly fusing image features and LIDAR points, we propose to leverage common geometric features that are detected in both the LIDAR scans and image data, allowing data from the two sensors to be processed in a higher-level space. In particular, we propose to find correspondences between 3D lines extracted from LIDAR scans and 2D lines detected in images before performing a bundle adjustment to refine poses. We also exploit the detected and optimized line segments to improve the quality of the final mesh. We test our approach on the recently published dataset, Newer College Dataset. We compare the accuracy and the completeness of the 3D mesh to a ground truth obtained with a survey-grade 3D scanner. We show that our method delivers results that are comparable to a state-of-the-art LIDAR survey while not requiring highly accurate ground truth pose estimates. △ Less

Submitted 6 April, 2021; originally announced April 2021.

A Front-End for Dense Monocular SLAM using a Learned Outlier Mask Prior

Authors: Yihao Zhang, John J. Leonard

Abstract: Recent achievements in depth prediction from a single RGB image have powered the new research area of combining convolutional neural networks (CNNs) with classical simultaneous localization and map** (SLAM) algorithms. The depth prediction from a CNN provides a reasonable initial point in the optimization process in the traditional SLAM algorithms, while the SLAM algorithms further improve the C… ▽ More Recent achievements in depth prediction from a single RGB image have powered the new research area of combining convolutional neural networks (CNNs) with classical simultaneous localization and map** (SLAM) algorithms. The depth prediction from a CNN provides a reasonable initial point in the optimization process in the traditional SLAM algorithms, while the SLAM algorithms further improve the CNN prediction online. However, most of the current CNN-SLAM approaches have only taken advantage of the depth prediction but not yet other products from a CNN. In this work, we explore the use of the outlier mask, a by-product from unsupervised learning of depth from video, as a prior in a classical probability model for depth estimate fusion to step up the outlier-resistant tracking performance of a SLAM front-end. On the other hand, some of the previous CNN-SLAM work builds on feature-based sparse SLAM methods, wasting the per-pixel dense prediction from a CNN. In contrast to these sparse methods, we devise a dense CNN-assisted SLAM front-end that is implementable with TensorFlow and evaluate it on both indoor and outdoor datasets. △ Less

Submitted 1 April, 2021; originally announced April 2021.

Bootstrapped Self-Supervised Training with Monocular Video for Semantic Segmentation and Depth Estimation

Authors: Yihao Zhang, John J. Leonard

Abstract: For a robot deployed in the world, it is desirable to have the ability of autonomous learning to improve its initial pre-set knowledge. We formalize this as a bootstrapped self-supervised learning problem where a system is initially bootstrapped with supervised training on a labeled dataset and we look for a self-supervised training method that can subsequently improve the system over the supervis… ▽ More For a robot deployed in the world, it is desirable to have the ability of autonomous learning to improve its initial pre-set knowledge. We formalize this as a bootstrapped self-supervised learning problem where a system is initially bootstrapped with supervised training on a labeled dataset and we look for a self-supervised training method that can subsequently improve the system over the supervised training baseline using only unlabeled data. In this work, we leverage temporal consistency between frames in monocular video to perform this bootstrapped self-supervised training. We show that a well-trained state-of-the-art semantic segmentation network can be further improved through our method. In addition, we show that the bootstrapped self-supervised training framework can help a network learn depth estimation better than pure supervised training or self-supervised training. △ Less

Submitted 31 July, 2021; v1 submitted 19 March, 2021; originally announced March 2021.

Comments: IROS 2021

Advances in Inference and Representation for Simultaneous Localization and Map**

Authors: David M. Rosen, Kevin J. Doherty, Antonio Teran Espinoza, John J. Leonard

Abstract: Simultaneous localization and map** (SLAM) is the process of constructing a global model of an environment from local observations of it; this is a foundational capability for mobile robots, supporting such core functions as planning, navigation, and control. This article reviews recent progress in SLAM, focusing on advances in the expressive capacity of the environmental models used in SLAM sys… ▽ More Simultaneous localization and map** (SLAM) is the process of constructing a global model of an environment from local observations of it; this is a foundational capability for mobile robots, supporting such core functions as planning, navigation, and control. This article reviews recent progress in SLAM, focusing on advances in the expressive capacity of the environmental models used in SLAM systems (representation) and the performance of the algorithms used to estimate these models from data (inference). A prominent theme of recent SLAM research is the pursuit of environmental representations (including learned representations) that go beyond the classical attributes of geometry and appearance to model properties such as hierarchical organization, affordance, dynamics, and semantics; these advances equip autonomous agents with a more comprehensive understanding of the world, enabling more versatile and intelligent operation. A second major theme is a revitalized interest in the mathematical properties of the SLAM estimation problem itself (including its computational and information-theoretic performance limits); this work has led to the development of novel classes of certifiable and robust inference methods that dramatically improve the reliability of SLAM systems in real-world operation. We survey these advances with an emphasis on their ramifications for achieving robust, long-duration autonomy, and conclude with a discussion of open challenges and a perspective on future research directions. △ Less

Submitted 8 March, 2021; originally announced March 2021.

Comments: 30 pages, 4 figures. To appear in Annual Review of Control, Robotics, and Autonomous Systems 2021

Scalable Hamiltonian learning for large-scale out-of-equilibrium quantum dynamics

Authors: Agnes Valenti, Guliuxin **, Julian Léonard, Sebastian D. Huber, Eliska Greplova

Abstract: Large-scale quantum devices provide insights beyond the reach of classical simulations. However, for a reliable and verifiable quantum simulation, the building blocks of the quantum device require exquisite benchmarking. This benchmarking of large scale dynamical quantum systems represents a major challenge due to lack of efficient tools for their simulation. Here, we present a scalable algorithm… ▽ More Large-scale quantum devices provide insights beyond the reach of classical simulations. However, for a reliable and verifiable quantum simulation, the building blocks of the quantum device require exquisite benchmarking. This benchmarking of large scale dynamical quantum systems represents a major challenge due to lack of efficient tools for their simulation. Here, we present a scalable algorithm based on neural networks for Hamiltonian tomography in out-of-equilibrium quantum systems. We illustrate our approach using a model for a forefront quantum simulation platform: ultracold atoms in optical lattices. Specifically, we show that our algorithm is able to reconstruct the Hamiltonian of an arbitrary size quasi-1D bosonic system using an accessible amount of experimental measurements. We are able to significantly increase the previously known parameter precision. △ Less

Submitted 1 March, 2021; originally announced March 2021.

Comments: 13 pages, 13 figures, code: https://gitlab.com/QMAI/papers/manybodydynlearning

Signatures of bath-induced quantum avalanches in a many-body--localized system

Authors: Julian Léonard, Sooshin Kim, Matthew Rispoli, Alexander Lukin, Robert Schittko, Joyce Kwan, Eugene Demler, Dries Sels, Markus Greiner

Abstract: Strongly correlated systems can exhibit surprising phenomena when brought in a state far from equilibrium. A spectacular example are quantum avalanches, that have been predicted to run through a many-body--localized system and delocalize it. Quantum avalanches occur when the system is locally coupled to a small thermal inclusion that acts as a bath. Here we realize an interface between a many-body… ▽ More Strongly correlated systems can exhibit surprising phenomena when brought in a state far from equilibrium. A spectacular example are quantum avalanches, that have been predicted to run through a many-body--localized system and delocalize it. Quantum avalanches occur when the system is locally coupled to a small thermal inclusion that acts as a bath. Here we realize an interface between a many-body--localized system and a thermal inclusion of variable size, and study its dynamics. We find evidence for accelerated transport into the localized region, signature of a quantum avalanche. By measuring the site-resolved entropy we monitor how the avalanche travels through the localized system and thermalizes it site by site. Furthermore, we isolate the bath-induced dynamics by evaluating multipoint correlations between the bath and the system. Our results have fundamental implications on the robustness of many-body--localized systems and their critical behavior. △ Less

Submitted 18 November, 2022; v1 submitted 30 December, 2020; originally announced December 2020.

Comments: 5+2 pages, 4 figures

Journal ref: Nature Physics 19, 481-485 (2023)

Analyzing non-equilibrium quantum states through snapshots with artificial neural networks

Authors: A. Bohrdt, S. Kim, A. Lukin, M. Rispoli, R. Schittko, M. Knap, M. Greiner, J. Léonard

Abstract: Current quantum simulation experiments are starting to explore non-equilibrium many-body dynamics in previously inaccessible regimes in terms of system sizes and time scales. Therefore, the question emerges which observables are best suited to study the dynamics in such quantum many-body systems. Using machine learning techniques, we investigate the dynamics and in particular the thermalization be… ▽ More Current quantum simulation experiments are starting to explore non-equilibrium many-body dynamics in previously inaccessible regimes in terms of system sizes and time scales. Therefore, the question emerges which observables are best suited to study the dynamics in such quantum many-body systems. Using machine learning techniques, we investigate the dynamics and in particular the thermalization behavior of an interacting quantum system which undergoes a dynamical phase transition from an ergodic to a many-body localized phase. A neural network is trained to distinguish non-equilibrium from thermal equilibrium data, and the network performance serves as a probe for the thermalization behavior of the system. We test our methods with experimental snapshots of ultracold atoms taken with a quantum gas microscope. Our results provide a path to analyze highly-entangled large-scale quantum states for system sizes where numerical calculations of conventional observables become challenging. △ Less

Submitted 20 May, 2022; v1 submitted 21 December, 2020; originally announced December 2020.

Comments: 4+5 pages, 3+9 figures; updated published version

Journal ref: Phys. Rev. Lett. 127, 150504 (2021)

Perspectives on Sim2Real Transfer for Robotics: A Summary of the R:SS 2020 Workshop

Authors: Sebastian Höfer, Kostas Bekris, Ankur Handa, Juan Camilo Gamboa, Florian Golemo, Melissa Mozifian, Chris Atkeson, Dieter Fox, Ken Goldberg, John Leonard, C. Karen Liu, Jan Peters, Shuran Song, Peter Welinder, Martha White

Abstract: This report presents the debates, posters, and discussions of the Sim2Real workshop held in conjunction with the 2020 edition of the "Robotics: Science and System" conference. Twelve leaders of the field took competing debate positions on the definition, viability, and importance of transferring skills from simulation to the real world in the context of robotics problems. The debaters also joined… ▽ More This report presents the debates, posters, and discussions of the Sim2Real workshop held in conjunction with the 2020 edition of the "Robotics: Science and System" conference. Twelve leaders of the field took competing debate positions on the definition, viability, and importance of transferring skills from simulation to the real world in the context of robotics problems. The debaters also joined a large panel discussion, answering audience questions and outlining the future of Sim2Real in robotics. Furthermore, we invited extended abstracts to this workshop which are summarized in this report. Based on the workshop, this report concludes with directions for practitioners exploiting this technology and for researchers further exploring open problems in this area. △ Less

Submitted 7 December, 2020; originally announced December 2020.

Comments: Summary of the "2nd Workshop on Closing the Reality Gap in Sim2Real Transfer for Robotics" held in conjunction with "Robotics: Science and System 2020". Website: https://sim2real.github.io/

Bosonic Pfaffian State in the Hofstadter-Bose-Hubbard Model

Authors: Felix A. Palm, Maximilian Buser, Julian Léonard, Monika Aidelsburger, Ulrich Schollwöck, Fabian Grusdt

Abstract: Topological states of matter, such as fractional quantum Hall states, are an active field of research due to their exotic excitations. In particular, ultracold atoms in optical lattices provide a highly controllable and adaptable platform to study such new types of quantum matter. However, finding a clear route to realize non-Abelian quantum Hall states in these systems remains challenging. Here w… ▽ More Topological states of matter, such as fractional quantum Hall states, are an active field of research due to their exotic excitations. In particular, ultracold atoms in optical lattices provide a highly controllable and adaptable platform to study such new types of quantum matter. However, finding a clear route to realize non-Abelian quantum Hall states in these systems remains challenging. Here we use the density-matrix renormalization-group (DMRG) method to study the Hofstadter-Bose-Hubbard model at filling factor $ν= 1$ and find strong indications that at $α=1/6$ magnetic flux quanta per plaquette the ground state is a lattice analog of the continuum non-Abelian Pfaffian. We study the on-site correlations of the ground state, which indicate its paired nature at $ν= 1$, and find an incompressible state characterized by a charge gap in the bulk. We argue that the emergence of a charge density wave on thin cylinders and the behavior of the two- and three-particle correlation functions at short distances provide evidence for the state being closely related to the continuum Pfaffian. The signatures discussed in this letter are accessible in current cold atom experiments and we show that the Pfaffian-like state is readily realizable in few-body systems using adiabatic preparation schemes. △ Less

Submitted 22 March, 2021; v1 submitted 4 November, 2020; originally announced November 2020.

Comments: 6 + 4 pages, 9 figures

Journal ref: Phys. Rev. B 103, 161101 (2021)

Network Localization Based Planning for Autonomous Underwater Vehicles with Inter-Vehicle Ranging

Authors: Alan Papalia, John Leonard

Abstract: Localization between a swarm of AUVs can be entirely estimated through the use of range measurements between neighboring AUVs via a class of techniques commonly referred to as sensor network localization. However, the localization quality depends on network topology, with degenerate topologies, referred to as low-rigidity configurations, leading to ambiguous or highly uncertain localization result… ▽ More Localization between a swarm of AUVs can be entirely estimated through the use of range measurements between neighboring AUVs via a class of techniques commonly referred to as sensor network localization. However, the localization quality depends on network topology, with degenerate topologies, referred to as low-rigidity configurations, leading to ambiguous or highly uncertain localization results. This paper presents tools for rigidity-based analysis, planning, and control of a multi-AUV network which account for sensor noise and limited sensing range. We evaluate our long-term planning framework in several two-dimensional simulated environments and show we are able to generate paths in feasible time and guarantee a minimum network rigidity over the full course of the paths. △ Less

Submitted 6 October, 2020; originally announced October 2020.

Comments: 7 pages, 4 figures. Extended version of accepted paper to AUV2020

ACM Class: I.2.9

Variational Filtering with Copula Models for SLAM

Authors: John D. Martin, Kevin Doherty, Caralyn Cyr, Brendan Englot, John Leonard

Abstract: The ability to infer map variables and estimate pose is crucial to the operation of autonomous mobile robots. In most cases the shared dependency between these variables is modeled through a multivariate Gaussian distribution, but there are many situations where that assumption is unrealistic. Our paper shows how it is possible to relax this assumption and perform simultaneous localization and map… ▽ More The ability to infer map variables and estimate pose is crucial to the operation of autonomous mobile robots. In most cases the shared dependency between these variables is modeled through a multivariate Gaussian distribution, but there are many situations where that assumption is unrealistic. Our paper shows how it is possible to relax this assumption and perform simultaneous localization and map** (SLAM) with a larger class of distributions, whose multivariate dependency is represented with a copula model. We integrate the distribution model with copulas into a Sequential Monte Carlo estimator and show how unknown model parameters can be learned through gradient-based optimization. We demonstrate our approach is effective in settings where Gaussian assumptions are clearly violated, such as environments with uncertain data association and nonlinear transition models. △ Less

Submitted 2 August, 2020; originally announced August 2020.

Comments: Published at the 2020 International Conference on Intelligent Robots and Systems (IROS)

Fractional Chern insulators of few bosons in a box: Hall plateaus from center-of-mass drifts and density profiles

Authors: C. Repellin, J. Léonard, N. Goldman

Abstract: Realizing strongly-correlated topological phases of ultracold gases is a central goal for ongoing experiments. And while fractional quantum Hall states could soon be implemented in small atomic ensembles, detecting their signatures in few-particle settings remains a fundamental challenge. In this work, we numerically analyze the center-of-mass Hall drift of a small ensemble of hardcore bosons, ini… ▽ More Realizing strongly-correlated topological phases of ultracold gases is a central goal for ongoing experiments. And while fractional quantum Hall states could soon be implemented in small atomic ensembles, detecting their signatures in few-particle settings remains a fundamental challenge. In this work, we numerically analyze the center-of-mass Hall drift of a small ensemble of hardcore bosons, initially prepared in the ground state of the Harper-Hofstadter-Hubbard model in a box potential. By monitoring the Hall drift upon release, for a wide range of magnetic flux values, we identify an emergent Hall plateau compatible with a fractional Chern insulator state: the extracted Hall conductivity approaches a fractional value determined by the many-body Chern number, while the width of the plateau agrees with the spectral and topological properties of the prepared ground state. Besides, a direct application of Streda's formula indicates that such Hall plateaus can also be directly obtained from static density-profile measurements. Our calculations suggest that fractional Chern insulators can be detected in cold-atom experiments, using available detection methods. △ Less

Submitted 18 December, 2020; v1 submitted 19 May, 2020; originally announced May 2020.

Comments: 13 pages, 11 figures; extended version accepted for publication

Journal ref: Phys. Rev. A 102, 063316 (2020)