How To Train Your HERON
Authors:
Antoine Richard,
Stephanie Aravecchia,
Thomas Schillaci,
Matthieu Geist,
Cedric Pradalier
Abstract:
In this paper we apply Deep Reinforcement Learning (Deep RL) and Domain Randomization to solve a navigation task in a natural environment relying solely on a 2D laser scanner. We train a model-based RL agent in simulation to follow lake and river shores and apply it on a real Unmanned Surface Vehicle in a zero-shot setup. We demonstrate that even though the agent has not been trained in the real w…
▽ More
In this paper we apply Deep Reinforcement Learning (Deep RL) and Domain Randomization to solve a navigation task in a natural environment relying solely on a 2D laser scanner. We train a model-based RL agent in simulation to follow lake and river shores and apply it on a real Unmanned Surface Vehicle in a zero-shot setup. We demonstrate that even though the agent has not been trained in the real world, it can fulfill its task successfully and adapt to changes in the robot's environment and dynamics. Finally, we show that the RL agent is more robust, faster, and more accurate than a state-aware Model-Predictive-Controller.
△ Less
Submitted 20 February, 2021;
originally announced February 2021.
Building an Aerial-Ground Robotics System for Precision Farming: An Adaptable Solution
Authors:
Alberto Pretto,
Stéphanie Aravecchia,
Wolfram Burgard,
Nived Chebrolu,
Christian Dornhege,
Tillmann Falck,
Freya Fleckenstein,
Alessandra Fontenla,
Marco Imperoli,
Raghav Khanna,
Frank Liebisch,
Philipp Lottes,
Andres Milioto,
Daniele Nardi,
Sandro Nardi,
Johannes Pfeifer,
Marija Popović,
Ciro Potena,
Cédric Pradalier,
Elisa Rothacker-Feder,
Inkyu Sa,
Alexander Schaefer,
Roland Siegwart,
Cyrill Stachniss,
Achim Walter
, et al. (3 additional authors not shown)
Abstract:
The application of autonomous robots in agriculture is gaining increasing popularity thanks to the high impact it may have on food security, sustainability, resource use efficiency, reduction of chemical treatments, and the optimization of human effort and yield. With this vision, the Flourish research project aimed to develop an adaptable robotic solution for precision farming that combines the a…
▽ More
The application of autonomous robots in agriculture is gaining increasing popularity thanks to the high impact it may have on food security, sustainability, resource use efficiency, reduction of chemical treatments, and the optimization of human effort and yield. With this vision, the Flourish research project aimed to develop an adaptable robotic solution for precision farming that combines the aerial survey capabilities of small autonomous unmanned aerial vehicles (UAVs) with targeted intervention performed by multi-purpose unmanned ground vehicles (UGVs). This paper presents an overview of the scientific and technological advances and outcomes obtained in the project. We introduce multi-spectral perception algorithms and aerial and ground-based systems developed for monitoring crop density, weed pressure, crop nitrogen nutrition status, and to accurately classify and locate weeds. We then introduce the navigation and map** systems tailored to our robots in the agricultural environment, as well as the modules for collaborative map**. We finally present the ground intervention hardware, software solutions, and interfaces we implemented and tested in different field conditions and with different crops. We describe a real use case in which a UAV collaborates with a UGV to monitor the field and to perform selective spraying without human intervention.
△ Less
Submitted 7 June, 2022; v1 submitted 8 November, 2019;
originally announced November 2019.
Image-Based Place Recognition on Bucolic Environment Across Seasons From Semantic Edge Description
Authors:
Assia Benbihi,
Stéphanie Aravecchia,
Matthieu Geist,
Cédric Pradalier
Abstract:
Most of the research effort on image-based place recognition is designed for urban environments. In bucolic environments such as natural scenes with low texture and little semantic content, the main challenge is to handle the variations in visual appearance across time such as illumination, weather, vegetation state or viewpoints. The nature of the variations is different and this leads to a diffe…
▽ More
Most of the research effort on image-based place recognition is designed for urban environments. In bucolic environments such as natural scenes with low texture and little semantic content, the main challenge is to handle the variations in visual appearance across time such as illumination, weather, vegetation state or viewpoints. The nature of the variations is different and this leads to a different approach to describing a bucolic scene. We introduce a global image descriptor computed from its semantic and topological information. It is built from the wavelet transforms of the image semantic edges. Matching two images is then equivalent to matching their semantic edge descriptors. We show that this method reaches state-of-the-art image retrieval performance on two multi-season environment-monitoring datasets: the CMU-Seasons and the Symphony Lake dataset. It also generalises to urban scenes on which it is on par with the current baselines NetVLAD and DELF.
△ Less
Submitted 1 April, 2021; v1 submitted 28 October, 2019;
originally announced October 2019.
