-
Building an Aerial-Ground Robotics System for Precision Farming: An Adaptable Solution
Authors:
Alberto Pretto,
Stéphanie Aravecchia,
Wolfram Burgard,
Nived Chebrolu,
Christian Dornhege,
Tillmann Falck,
Freya Fleckenstein,
Alessandra Fontenla,
Marco Imperoli,
Raghav Khanna,
Frank Liebisch,
Philipp Lottes,
Andres Milioto,
Daniele Nardi,
Sandro Nardi,
Johannes Pfeifer,
Marija Popović,
Ciro Potena,
Cédric Pradalier,
Elisa Rothacker-Feder,
Inkyu Sa,
Alexander Schaefer,
Roland Siegwart,
Cyrill Stachniss,
Achim Walter
, et al. (3 additional authors not shown)
Abstract:
The application of autonomous robots in agriculture is gaining increasing popularity thanks to the high impact it may have on food security, sustainability, resource use efficiency, reduction of chemical treatments, and the optimization of human effort and yield. With this vision, the Flourish research project aimed to develop an adaptable robotic solution for precision farming that combines the a…
▽ More
The application of autonomous robots in agriculture is gaining increasing popularity thanks to the high impact it may have on food security, sustainability, resource use efficiency, reduction of chemical treatments, and the optimization of human effort and yield. With this vision, the Flourish research project aimed to develop an adaptable robotic solution for precision farming that combines the aerial survey capabilities of small autonomous unmanned aerial vehicles (UAVs) with targeted intervention performed by multi-purpose unmanned ground vehicles (UGVs). This paper presents an overview of the scientific and technological advances and outcomes obtained in the project. We introduce multi-spectral perception algorithms and aerial and ground-based systems developed for monitoring crop density, weed pressure, crop nitrogen nutrition status, and to accurately classify and locate weeds. We then introduce the navigation and map** systems tailored to our robots in the agricultural environment, as well as the modules for collaborative map**. We finally present the ground intervention hardware, software solutions, and interfaces we implemented and tested in different field conditions and with different crops. We describe a real use case in which a UAV collaborates with a UGV to monitor the field and to perform selective spraying without human intervention.
△ Less
Submitted 7 June, 2022; v1 submitted 8 November, 2019;
originally announced November 2019.
-
Combined Task and Action Learning from Human Demonstrations for Mobile Manipulation Applications
Authors:
Tim Welschehold,
Nichola Abdo,
Christian Dornhege,
Wolfram Burgard
Abstract:
Learning from demonstrations is a promising paradigm for transferring knowledge to robots. However, learning mobile manipulation tasks directly from a human teacher is a complex problem as it requires learning models of both the overall task goal and of the underlying actions. Additionally, learning from a small number of demonstrations often introduces ambiguity with respect to the intention of t…
▽ More
Learning from demonstrations is a promising paradigm for transferring knowledge to robots. However, learning mobile manipulation tasks directly from a human teacher is a complex problem as it requires learning models of both the overall task goal and of the underlying actions. Additionally, learning from a small number of demonstrations often introduces ambiguity with respect to the intention of the teacher, making it challenging to commit to one model for generalizing the task to new settings. In this paper, we present an approach to learning flexible mobile manipulation action models and task goal representations from teacher demonstrations. Our action models enable the robot to consider different likely outcomes of each action and to generate feasible trajectories for achieving them. Accordingly, we leverage a probabilistic framework based on Monte Carlo tree search to compute sequences of feasible actions imitating the teacher intention in new settings without requiring the teacher to specify an explicit goal state. We demonstrate the effectiveness of our approach in complex tasks carried out in real-world settings.
△ Less
Submitted 25 August, 2019;
originally announced August 2019.
-
3D Human Pose Estimation in RGBD Images for Robotic Task Learning
Authors:
Christian Zimmermann,
Tim Welschehold,
Christian Dornhege,
Wolfram Burgard,
Thomas Brox
Abstract:
We propose an approach to estimate 3D human pose in real world units from a single RGBD image and show that it exceeds performance of monocular 3D pose estimation approaches from color as well as pose estimation exclusively from depth. Our approach builds on robust human keypoint detectors for color images and incorporates depth for lifting into 3D. We combine the system with our learning from dem…
▽ More
We propose an approach to estimate 3D human pose in real world units from a single RGBD image and show that it exceeds performance of monocular 3D pose estimation approaches from color as well as pose estimation exclusively from depth. Our approach builds on robust human keypoint detectors for color images and incorporates depth for lifting into 3D. We combine the system with our learning from demonstration framework to instruct a service robot without the need of markers. Experiments in real world settings demonstrate that our approach enables a PR2 robot to imitate manipulation actions observed from a human teacher.
△ Less
Submitted 13 March, 2018; v1 submitted 7 March, 2018;
originally announced March 2018.
-
Why did the Robot Cross the Road? - Learning from Multi-Modal Sensor Data for Autonomous Road Crossing
Authors:
Noha Radwan,
Wera Winterhalter,
Christian Dornhege,
Wolfram Burgard
Abstract:
We consider the problem of develo** robots that navigate like pedestrians on sidewalks through city centers for performing various tasks including delivery and surveillance. One particular challenge for such robots is crossing streets without pedestrian traffic lights. To solve this task the robot has to decide based on its sensory input if the road is clear. In this work, we propose a novel mul…
▽ More
We consider the problem of develo** robots that navigate like pedestrians on sidewalks through city centers for performing various tasks including delivery and surveillance. One particular challenge for such robots is crossing streets without pedestrian traffic lights. To solve this task the robot has to decide based on its sensory input if the road is clear. In this work, we propose a novel multi-modal learning approach for the problem of autonomous street crossing. Our approach solely relies on laser and radar data and learns a classifier based on Random Forests to predict when it is safe to cross the road. We present extensive experimental evaluations using real-world data collected from multiple street crossing situations which demonstrate that our approach yields a safe and accurate street crossing behavior and generalizes well over different types of situations. A comparison to alternative methods demonstrates the advantages of our approach.
△ Less
Submitted 18 September, 2017;
originally announced September 2017.
