-
Free as a Bird: Event-based Dynamic Sense-and-Avoid for Ornithopter Robot Flight
Authors:
J. P. Rodríguez-Gómez,
R. Tapia,
M. M. Guzmán,
J. R. Martínez-de Dios,
A. Ollero
Abstract:
Autonomous flight of flap**-wing robots is a major challenge for robot perception. Most of the previous sense-and-avoid works have studied the problem of obstacle avoidance for flap**-wing robots considering only static obstacles. This paper presents a fully onboard dynamic sense-and-avoid scheme for large-scale ornithopters using event cameras. These sensors trigger pixel information due to c…
▽ More
Autonomous flight of flap**-wing robots is a major challenge for robot perception. Most of the previous sense-and-avoid works have studied the problem of obstacle avoidance for flap**-wing robots considering only static obstacles. This paper presents a fully onboard dynamic sense-and-avoid scheme for large-scale ornithopters using event cameras. These sensors trigger pixel information due to changes of illumination in the scene such as those produced by dynamic objects. The method performs event-by-event processing in low-cost hardware such as those onboard small aerial vehicles. The proposed scheme detects obstacles and evaluates possible collisions with the robot body. The onboard controller actuates over the horizontal and vertical tail deflections to execute the avoidance maneuver. The scheme is validated in both indoor and outdoor scenarios using obstacles of different shapes and sizes. To the best of the authors' knowledge, this is the first event-based method for dynamic obstacle avoidance in a flap**-wing robot.
△ Less
Submitted 15 October, 2023;
originally announced October 2023.
-
A Comparison between Frame-based and Event-based Cameras for Flap**-Wing Robot Perception
Authors:
Raul Tapia,
Juan Pablo Rodríguez-Gómez,
Juan Antonio Sanchez-Diaz,
Francisco Javier Gañán,
Iván Gutierrez Rodríguez,
Javier Luna-Santamaria,
José Ramiro Martínez-de Dios,
Anibal Ollero
Abstract:
Perception systems for ornithopters face severe challenges. The harsh vibrations and abrupt movements caused during flap** are prone to produce motion blur and strong lighting condition changes. Their strict restrictions in weight, size, and energy consumption also limit the type and number of sensors to mount onboard. Lightweight traditional cameras have become a standard off-the-shelf solution…
▽ More
Perception systems for ornithopters face severe challenges. The harsh vibrations and abrupt movements caused during flap** are prone to produce motion blur and strong lighting condition changes. Their strict restrictions in weight, size, and energy consumption also limit the type and number of sensors to mount onboard. Lightweight traditional cameras have become a standard off-the-shelf solution in many flap**-wing designs. However, bioinspired event cameras are a promising solution for ornithopter perception due to their microsecond temporal resolution, high dynamic range, and low power consumption. This paper presents an experimental comparison between frame-based and an event-based camera. Both technologies are analyzed considering the particular flap**-wing robot specifications and also experimentally analyzing the performance of well-known vision algorithms with data recorded onboard a flap**-wing robot. Our results suggest event cameras as the most suitable sensors for ornithopters. Nevertheless, they also evidence the open challenges for event-based vision on board flap**-wing robots.
△ Less
Submitted 11 September, 2023;
originally announced September 2023.
-
Experimental Energy Consumption Analysis of a Flap**-Wing Robot
Authors:
Raul Tapia,
Alvaro Cesar Satue,
Saeed Rafee Nekoo,
José Ramiro Martínez-de Dios,
Anibal Ollero
Abstract:
One of the motivations for exploring flap**-wing aerial robotic systems is to seek energy reduction, by maintaining manoeuvrability, compared to conventional unmanned aerial systems. A Flap** Wing Flying Robot (FWFR) can glide in favourable wind conditions, decreasing energy consumption significantly. In addition, it is also necessary to investigate the power consumption of the components in t…
▽ More
One of the motivations for exploring flap**-wing aerial robotic systems is to seek energy reduction, by maintaining manoeuvrability, compared to conventional unmanned aerial systems. A Flap** Wing Flying Robot (FWFR) can glide in favourable wind conditions, decreasing energy consumption significantly. In addition, it is also necessary to investigate the power consumption of the components in the flap**-wing robot. In this work, two sets of the FWFR components are analyzed in terms of power consumption: a) motor/electronics components and b) a vision system for monitoring the environment during the flight. A measurement device is used to record the power utilization of the motors in the launching and ascending phases of the flight and also in cruising flight around the desired height. Additionally, an analysis of event cameras and stereo vision systems in terms of energy consumption has been performed. The results provide a first step towards decreasing battery usage and, consequently, providing additional flight time.
△ Less
Submitted 1 June, 2023;
originally announced June 2023.
-
ASAP: Adaptive Transmission Scheme for Online Processing of Event-based Algorithms
Authors:
Raul Tapia,
José Ramiro Martínez-de Dios,
Augusto Gómez Eguíluz,
Anibal Ollero
Abstract:
Online event-based perception techniques on board robots navigating in complex, unstructured, and dynamic environments can suffer unpredictable changes in the incoming event rates and their processing times, which can cause computational overflow or loss of responsiveness. This paper presents ASAP: a novel event handling framework that dynamically adapts the transmission of events to the processin…
▽ More
Online event-based perception techniques on board robots navigating in complex, unstructured, and dynamic environments can suffer unpredictable changes in the incoming event rates and their processing times, which can cause computational overflow or loss of responsiveness. This paper presents ASAP: a novel event handling framework that dynamically adapts the transmission of events to the processing algorithm, kee** the system responsiveness and preventing overflows. ASAP is composed of two adaptive mechanisms. The first one prevents event processing overflows by discarding an adaptive percentage of the incoming events. The second mechanism dynamically adapts the size of the event packages to reduce the delay between event generation and processing. ASAP has guaranteed convergence and is flexible to the processing algorithm. It has been validated on board a quadrotor and an ornithopter robot in challenging conditions.
△ Less
Submitted 18 September, 2022;
originally announced September 2022.
-
ASAP: Adaptive Scheme for Asynchronous Processing of Event-based Vision Algorithms
Authors:
Raul Tapia,
Augusto Gómez Eguíluz,
José Ramiro Martínez-de Dios,
Anibal Ollero
Abstract:
Event cameras can capture pixel-level illumination changes with very high temporal resolution and dynamic range. They have received increasing research interest due to their robustness to lighting conditions and motion blur. Two main approaches exist in the literature to feed the event-based processing algorithms: packaging the triggered events in event packages and sending them one-by-one as sing…
▽ More
Event cameras can capture pixel-level illumination changes with very high temporal resolution and dynamic range. They have received increasing research interest due to their robustness to lighting conditions and motion blur. Two main approaches exist in the literature to feed the event-based processing algorithms: packaging the triggered events in event packages and sending them one-by-one as single events. These approaches suffer limitations from either processing overflow or lack of responsivity. Processing overflow is caused by high event generation rates when the algorithm cannot process all the events in real-time. Conversely, lack of responsivity happens in cases of low event generation rates when the event packages are sent at too low frequencies. This paper presents ASAP, an adaptive scheme to manage the event stream through variable-size packages that accommodate to the event package processing times. The experimental results show that ASAP is capable of feeding an asynchronous event-by-event clustering algorithm in a responsive and efficient manner and at the same time prevents overflow.
△ Less
Submitted 18 September, 2022;
originally announced September 2022.
-
Perception-Aware Perching on Powerlines with Multirotors
Authors:
Julio L. Paneque,
Jose Ramiro Martínez de Dios,
Aníbal Ollero. Drew Hanover,
Sihao Sun,
Ángel Romero,
Davide Scaramuzza
Abstract:
Multirotor aerial robots are becoming widely used for the inspection of powerlines. To enable continuous, robust inspection without human intervention, the robots must be able to perch on the powerlines to recharge their batteries. Highly versatile perching capabilities are necessary to adapt to the variety of configurations and constraints that are present in real powerline systems. This paper pr…
▽ More
Multirotor aerial robots are becoming widely used for the inspection of powerlines. To enable continuous, robust inspection without human intervention, the robots must be able to perch on the powerlines to recharge their batteries. Highly versatile perching capabilities are necessary to adapt to the variety of configurations and constraints that are present in real powerline systems. This paper presents a novel perching trajectory generation framework that computes perception-aware, collision-free, and dynamically-feasible maneuvers to guide the robot to the desired final state. Trajectory generation is achieved via solving a Nonlinear Programming problem using the Primal-Dual Interior Point method. The problem considers the full dynamic model of the robot down to its single rotor thrusts and minimizes the final pose and velocity errors while avoiding collisions and maximizing the visibility of the powerline during the maneuver. The generated maneuvers consider both the perching and the posterior recovery trajectories. The framework adopts costs and constraints defined by efficient mathematical representations of powerlines, enabling online onboard execution in resource-constrained hardware. The method is validated on-board an agile quadrotor conducting powerline inspection and various perching maneuvers with final pitch values of up to 180 degrees. The developed code is available online at: https://github.com/grvcPerception/pa_powerline_perching
△ Less
Submitted 13 February, 2022;
originally announced February 2022.
-
The GRIFFIN Perception Dataset: Bridging the Gap Between Flap**-Wing Flight and Robotic Perception
Authors:
J. P. Rodríguez-Gómez,
R. Tapia,
J. L. Paneque,
P. Grau,
A. Gómez Eguíluz,
J. R. Martínez-de Dios,
A. Ollero
Abstract:
The development of automatic perception systems and techniques for bio-inspired flap**-wing robots is severely hampered by the high technical complexity of these platforms and the installation of onboard sensors and electronics. Besides, flap**-wing robot perception suffers from high vibration levels and abrupt movements during flight, which cause motion blur and strong changes in lighting con…
▽ More
The development of automatic perception systems and techniques for bio-inspired flap**-wing robots is severely hampered by the high technical complexity of these platforms and the installation of onboard sensors and electronics. Besides, flap**-wing robot perception suffers from high vibration levels and abrupt movements during flight, which cause motion blur and strong changes in lighting conditions. This paper presents a perception dataset for bird-scale flap**-wing robots as a tool to help alleviate the aforementioned problems. The presented data include measurements from onboard sensors widely used in aerial robotics and suitable to deal with the perception challenges of flap**-wing robots, such as an event camera, a conventional camera, and two Inertial Measurement Units (IMUs), as well as ground truth measurements from a laser tracker or a motion capture system. A total of 21 datasets of different types of flights were collected in three different scenarios (one indoor and two outdoor). To the best of the authors' knowledge this is the first dataset for flap**-wing robot perception.
△ Less
Submitted 18 February, 2021; v1 submitted 25 January, 2021;
originally announced January 2021.
