Dynamic Q-planning for Online UAV Path Planning in Unknown and Complex Environments
Authors:
Lidia Gianne Souza da Rocha,
Kenny Anderson Queiroz Caldas,
Marco Henrique Terra,
Fabio Ramos,
Kelen Cristiane Teixeira Vivaldini
Abstract:
Unmanned Aerial Vehicles need an online path planning capability to move in high-risk missions in unknown and complex environments to complete them safely. However, many algorithms reported in the literature may not return reliable trajectories to solve online problems in these scenarios. The Q-Learning algorithm, a Reinforcement Learning Technique, can generate trajectories in real-time and has d…
▽ More
Unmanned Aerial Vehicles need an online path planning capability to move in high-risk missions in unknown and complex environments to complete them safely. However, many algorithms reported in the literature may not return reliable trajectories to solve online problems in these scenarios. The Q-Learning algorithm, a Reinforcement Learning Technique, can generate trajectories in real-time and has demonstrated fast and reliable results. This technique, however, has the disadvantage of defining the iteration number. If this value is not well defined, it will take a long time or not return an optimal trajectory. Therefore, we propose a method to dynamically choose the number of iterations to obtain the best performance of Q-Learning. The proposed method is compared to the Q-Learning algorithm with a fixed number of iterations, A*, Rapid-Exploring Random Tree, and Particle Swarm Optimization. As a result, the proposed Q-learning algorithm demonstrates the efficacy and reliability of online path planning with a dynamic number of iterations to carry out online missions in unknown and complex environments.
△ Less
Submitted 9 February, 2024;
originally announced February 2024.
Compact Dual-Polarization Silicon Integrated Couplers for Multicore Fibers
Authors:
Julian L. Pita Ruiz,
Lucas G. Rocha,
Jun Yang,
Sukru Ekin Kocabas,
Ming-Jun Li,
Ivan Aldaya,
Paulo Dainese,
Lucas H. Gabrielli
Abstract:
Compact fiber-to-chip couplers play an important role in optical interconnections, especially in data centers. However, the development of couplers has been mostly limited to standard single mode fibers, with few devices compatible with multicore and multimode fibers. Through the use of state-of-the-art optimization algorithms, we designed a compact dual-polarization coupler to interface chips and…
▽ More
Compact fiber-to-chip couplers play an important role in optical interconnections, especially in data centers. However, the development of couplers has been mostly limited to standard single mode fibers, with few devices compatible with multicore and multimode fibers. Through the use of state-of-the-art optimization algorithms, we designed a compact dual-polarization coupler to interface chips and dense multicore fibers, demonstrating, for the first time, coupling to both polarizations of all the cores, with measured coupling efficiency of $-$4.3 dB and with a 3 dB bandwidth of 48 nm. The dual-polarization coupler has footprint of 200 $μm^2$ per core, which makes it the smallest fiber-to-chip coupler experimentally demonstrated on a standard silicon-on-insulator platform.
△ Less
Submitted 7 October, 2021; v1 submitted 17 February, 2021;
originally announced February 2021.
