Reinforcement-learning robotic sailboats: simulator and preliminary results
Authors:
Eduardo Charles Vasconcellos,
Ronald M Sampaio,
André P D Araújo,
Esteban Walter Gonzales Clua,
Philippe Preux,
Raphael Guerra,
Luiz M G Gonçalves,
Luis Martí,
Hernan Lira,
Nayat Sanchez-Pi
Abstract:
This work focuses on the main challenges and problems in develo** a virtual oceanic environment reproducing real experiments using Unmanned Surface Vehicles (USV) digital twins. We introduce the key features for building virtual worlds, considering using Reinforcement Learning (RL) agents for autonomous navigation and control. With this in mind, the main problems concern the definition of the si…
▽ More
This work focuses on the main challenges and problems in develo** a virtual oceanic environment reproducing real experiments using Unmanned Surface Vehicles (USV) digital twins. We introduce the key features for building virtual worlds, considering using Reinforcement Learning (RL) agents for autonomous navigation and control. With this in mind, the main problems concern the definition of the simulation equations (physics and mathematics), their effective implementation, and how to include strategies for simulated control and perception (sensors) to be used with RL. We present the modeling, implementation steps, and challenges required to create a functional digital twin based on a real robotic sailing vessel. The application is immediate for develo** navigation algorithms based on RL to be applied on real boats.
△ Less
Submitted 16 January, 2024;
originally announced February 2024.
