-
Large-scale Autonomous Flight with Real-time Semantic SLAM under Dense Forest Canopy
Authors:
Xu Liu,
Guilherme V. Nardari,
Fernando Cladera Ojeda,
Yuezhan Tao,
Alex Zhou,
Thomas Donnelly,
Chao Qu,
Steven W. Chen,
Roseli A. F. Romero,
Camillo J. Taylor,
Vijay Kumar
Abstract:
Semantic maps represent the environment using a set of semantically meaningful objects. This representation is storage-efficient, less ambiguous, and more informative, thus facilitating large-scale autonomy and the acquisition of actionable information in highly unstructured, GPS-denied environments. In this letter, we propose an integrated system that can perform large-scale autonomous flights an…
▽ More
Semantic maps represent the environment using a set of semantically meaningful objects. This representation is storage-efficient, less ambiguous, and more informative, thus facilitating large-scale autonomy and the acquisition of actionable information in highly unstructured, GPS-denied environments. In this letter, we propose an integrated system that can perform large-scale autonomous flights and real-time semantic map** in challenging under-canopy environments. We detect and model tree trunks and ground planes from LiDAR data, which are associated across scans and used to constrain robot poses as well as tree trunk models. The autonomous navigation module utilizes a multi-level planning and map** framework and computes dynamically feasible trajectories that lead the UAV to build a semantic map of the user-defined region of interest in a computationally and storage efficient manner. A drift-compensation mechanism is designed to minimize the odometry drift using semantic SLAM outputs in real time, while maintaining planner optimality and controller stability. This leads the UAV to execute its mission accurately and safely at scale.
△ Less
Submitted 15 August, 2023; v1 submitted 14 September, 2021;
originally announced September 2021.
-
Place Recognition in Forests with Urquhart Tessellations
Authors:
Guilherme V. Nardari,
Avraham Cohen,
Steven W. Chen,
Xu Liu,
Vaibhav Arcot,
Roseli A. F. Romero,
Vijay Kumar
Abstract:
In this letter, we present a novel descriptor based on Urquhart tessellations derived from the position of trees in a forest. We propose a framework that uses these descriptors to detect previously seen observations and landmark correspondences, even with partial overlap and noise. We run loop closure detection experiments in simulation and real-world data map-merging from different flights of an…
▽ More
In this letter, we present a novel descriptor based on Urquhart tessellations derived from the position of trees in a forest. We propose a framework that uses these descriptors to detect previously seen observations and landmark correspondences, even with partial overlap and noise. We run loop closure detection experiments in simulation and real-world data map-merging from different flights of an Unmanned Aerial Vehicle (UAV) in a pine tree forest and show that our method outperforms state-of-the-art approaches in accuracy and robustness.
△ Less
Submitted 16 November, 2020; v1 submitted 23 September, 2020;
originally announced October 2020.
-
SLOAM: Semantic Lidar Odometry and Map** for Forest Inventory
Authors:
Steven W. Chen,
Guilherme V. Nardari,
Elijah S. Lee,
Chao Qu,
Xu Liu,
Roseli A. F. Romero,
Vijay Kumar
Abstract:
This paper describes an end-to-end pipeline for tree diameter estimation based on semantic segmentation and lidar odometry and map**. Accurate map** of this type of environment is challenging since the ground and the trees are surrounded by leaves, thorns and vines, and the sensor typically experiences extreme motion. We propose a semantic feature based pose optimization that simultaneously re…
▽ More
This paper describes an end-to-end pipeline for tree diameter estimation based on semantic segmentation and lidar odometry and map**. Accurate map** of this type of environment is challenging since the ground and the trees are surrounded by leaves, thorns and vines, and the sensor typically experiences extreme motion. We propose a semantic feature based pose optimization that simultaneously refines the tree models while estimating the robot pose. The pipeline utilizes a custom virtual reality tool for labeling 3D scans that is used to train a semantic segmentation network. The masked point cloud is used to compute a trellis graph that identifies individual instances and extracts relevant features that are used by the SLAM module. We show that traditional lidar and image based methods fail in the forest environment on both Unmanned Aerial Vehicle (UAV) and hand-carry systems, while our method is more robust, scalable, and automatically generates tree diameter estimations.
△ Less
Submitted 29 December, 2019;
originally announced December 2019.