-
Localization and Map** of Sparse Geologic Features with Unpiloted Aircraft Systems
Authors:
Zhiang Chen,
Sarah Bearman,
J Ramon Arrowsmith,
Jnaneshwar Das
Abstract:
Robotic map** is attractive in many scientific applications that involve environmental surveys. This paper presents a system for localization and map** of sparsely distributed surface features such as precariously balanced rocks (PBRs), whose geometric fragility parameters provide valuable information on earthquake processes and landscape development. With this geomorphologic problem as the te…
▽ More
Robotic map** is attractive in many scientific applications that involve environmental surveys. This paper presents a system for localization and map** of sparsely distributed surface features such as precariously balanced rocks (PBRs), whose geometric fragility parameters provide valuable information on earthquake processes and landscape development. With this geomorphologic problem as the test domain, we carry out a lawn-mower search pattern from a high elevation using an Unpiloted Aerial Vehicle (UAV) equipped with a flight controller, GPS module, stereo camera, and onboard computer. Once a potential PBR target is detected by a deep neural network in real time, we track its bounding box in the image coordinates by applying a Kalman filter that fuses the deep learning detection with Kanade-Lucas-Tomasi (KLT) tracking. The target is localized in world coordinates using depth filtering where a set of 3D points are filtered by object bounding boxes from different camera perspectives. The 3D points also provide a strong prior on target shape, which is used for UAV path planning to closely map the target using RGBD SLAM. After target map**, the UAS resumes the lawn-mower search pattern to locate and map the next target.
△ Less
Submitted 1 November, 2020; v1 submitted 2 July, 2020;
originally announced July 2020.
-
OpenUAV Cloud Testbed: a Collaborative Design Studio for Field Robotics
Authors:
Harish Anand,
Stephen A. Rees,
Zhiang Chen,
Ashwin Jose,
Sarah Bearman,
Prasad Antervedi,
Jnaneshwar Das
Abstract:
Simulations play a crucial role in robotics research and education. This paper presents the OpenUAV testbed, an open-source, easy-to-use, web-based, and reproducible software system that enables students and researchers to run robotic simulations on the cloud. We have built upon our previous work and have addressed some of the educational and research challenges associated with the prior work. The…
▽ More
Simulations play a crucial role in robotics research and education. This paper presents the OpenUAV testbed, an open-source, easy-to-use, web-based, and reproducible software system that enables students and researchers to run robotic simulations on the cloud. We have built upon our previous work and have addressed some of the educational and research challenges associated with the prior work. The critical contributions of the paper to the robotics and automation community are threefold: First, OpenUAV saves students and researchers from tedious and complicated software setups by providing web-browser-based Linux desktop sessions with standard robotics software like Gazebo, ROS, and flight autonomy stack. Second, a method for saving an individual's research work with its dependencies for the work's future reproducibility. Third, the platform provides a mechanism to support photorealistic robotics simulations by combining Unity game engine-based camera rendering and Gazebo physics. The paper addresses a research need for photorealistic simulations and describes a methodology for creating a photorealistic aquatic simulation. We also present the various academic and research use-cases of this platform to improve robotics education and research, especially during times like the COVID-19 pandemic, when virtual collaboration is necessary.
△ Less
Submitted 6 May, 2021; v1 submitted 1 October, 2019;
originally announced October 2019.
-
Geomorphological Analysis Using Unpiloted Aircraft Systems, Structure from Motion, and Deep Learning
Authors:
Zhiang Chen,
Tyler R. Scott,
Sarah Bearman,
Harish Anand,
Devin Keating,
Chelsea Scott,
J Ramon Arrowsmith,
Jnaneshwar Das
Abstract:
We present a pipeline for geomorphological analysis that uses structure from motion (SfM) and deep learning on close-range aerial imagery to estimate spatial distributions of rock traits (size, roundness, and orientation) along a tectonic fault scarp. The properties of the rocks on the fault scarp derive from the combination of initial volcanic fracturing and subsequent tectonic and geomorphic fra…
▽ More
We present a pipeline for geomorphological analysis that uses structure from motion (SfM) and deep learning on close-range aerial imagery to estimate spatial distributions of rock traits (size, roundness, and orientation) along a tectonic fault scarp. The properties of the rocks on the fault scarp derive from the combination of initial volcanic fracturing and subsequent tectonic and geomorphic fracturing, and our pipeline allows scientists to leverage UAS-based imagery to gain a better understanding of such surface processes. We start by using SfM on aerial imagery to produce georeferenced orthomosaics and digital elevation models (DEM). A human expert then annotates rocks on a set of image tiles sampled from the orthomosaics, and these annotations are used to train a deep neural network to detect and segment individual rocks in the entire site. The extracted semantic information (rock masks) on large volumes of unlabeled, high-resolution SfM products allows subsequent structural analysis and shape descriptors to estimate rock size, roundness, and orientation. We present results of two experiments conducted along a fault scarp in the Volcanic Tablelands near Bishop, California. We conducted the first, proof-of-concept experiment with a DJI Phantom 4 Pro equipped with an RGB camera and inspected if elevation information assisted instance segmentation from RGB channels. Rock-trait histograms along and across the fault scarp were obtained with the neural network inference. In the second experiment, we deployed a hexrotor and a multispectral camera to produce a DEM and five spectral orthomosaics in red, green, blue, red edge, and near infrared. We focused on examining the effectiveness of different combinations of input channels in instance segmentation.
△ Less
Submitted 17 February, 2021; v1 submitted 27 September, 2019;
originally announced September 2019.
