Deep Reinforcement Learning-based Quadcopter Controller: A Practical Approach and Experiments
Authors:
Truong-Dong Do,
Nguyen Xuan Mung,
Sung Kyung Hong
Abstract:
Quadcopters have been studied for decades thanks to their maneuverability and capability of operating in a variety of circumstances. However, quadcopters suffer from dynamical nonlinearity, actuator saturation, as well as sensor noise that make it challenging and time consuming to obtain accurate dynamic models and achieve satisfactory control performance. Fortunately, deep reinforcement learning…
▽ More
Quadcopters have been studied for decades thanks to their maneuverability and capability of operating in a variety of circumstances. However, quadcopters suffer from dynamical nonlinearity, actuator saturation, as well as sensor noise that make it challenging and time consuming to obtain accurate dynamic models and achieve satisfactory control performance. Fortunately, deep reinforcement learning came and has shown significant potential in system modelling and control of autonomous multirotor aerial vehicles, with recent advancements in deployment, performance enhancement, and generalization. In this paper, an end-to-end deep reinforcement learning-based controller for quadcopters is proposed that is secure for real-world implementation, data-efficient, and free of human gain adjustments. First, a novel actor-critic-based architecture is designed to map the robot states directly to the motor outputs. Then, a quadcopter dynamics-based simulator was devised to facilitate the training of the controller policy. Finally, the trained policy is deployed on a real Crazyflie nano quadrotor platform, without any additional fine-tuning process. Experimental results show that the quadcopter exhibits satisfactory performance as it tracks a given complicated trajectory, which demonstrates the effectiveness and feasibility of the proposed method and signifies its capability in filling the simulation-to-reality gap.
△ Less
Submitted 18 June, 2024; v1 submitted 13 June, 2024;
originally announced June 2024.
Collision-free Formation Control of Multiple Nano-quadrotors
Authors:
Anh Tung Nguyen,
Ji-Won Lee,
Thanh Binh Nguyen,
Sung Kyung Hong
Abstract:
The utilisation of unmanned aerial vehicles has witnessed significant growth in real-world applications including surveillance tasks, military missions, and transportation deliveries. This letter investigates practical problems of formation control for multiple nano-quadrotor systems. To be more specific, the first aim of this work is to develop a theoretical framework for the time-varying formati…
▽ More
The utilisation of unmanned aerial vehicles has witnessed significant growth in real-world applications including surveillance tasks, military missions, and transportation deliveries. This letter investigates practical problems of formation control for multiple nano-quadrotor systems. To be more specific, the first aim of this work is to develop a theoretical framework for the time-varying formation flight of the multi-quadrotor system regarding anti-collisions. In order to achieve this goal, the finite cut-off potential function is devoted to avoiding collisions among vehicles in the group as well as between vehicles and an obstacle. The control algorithm navigates the group of nano-quadrotors to asymptotically reach an anticipated time-varying formation. The second aim is to implement the proposed algorithm on Crazyflies nanoquadrotors, one of the most ubiquitous indoor experimentation platforms. Several practical scenarios are conducted to tendentiously expose anti-collision abilities among group members as well as between vehicles and an obstacle. The experimental outcomes validate the effectiveness of the proposed method in the formation tracking and the collision avoidance of multiple nano-quadrotors.
△ Less
Submitted 28 July, 2021;
originally announced July 2021.
