Showing 1–2 of 2 results for author: van Hove, A

Guiding drones by information gain

Authors: Alouette van Hove, Kristoffer Aalstad, Norbert Pirk

Abstract: The accurate estimation of locations and emission rates of gas sources is crucial across various domains, including environmental monitoring and greenhouse gas emission analysis. This study investigates two drone sampling strategies for inferring source term parameters of gas plumes from atmospheric measurements. Both strategies are guided by the goal of maximizing information gain attained from o… ▽ More The accurate estimation of locations and emission rates of gas sources is crucial across various domains, including environmental monitoring and greenhouse gas emission analysis. This study investigates two drone sampling strategies for inferring source term parameters of gas plumes from atmospheric measurements. Both strategies are guided by the goal of maximizing information gain attained from observations at sequential locations. Our research compares the myopic approach of infotaxis to a far-sighted navigation strategy trained through deep reinforcement learning. We demonstrate the superior performance of deep reinforcement learning over infotaxis in environments with non-isotropic gas plumes. △ Less

Submitted 8 January, 2024; originally announced January 2024.

Comments: To be published in Proceedings of Machine Learning Research (Proceedings of the 5th Northern Lights Deep Learning Conference (NLDL))

Journal ref: Proceedings of Machine Learning Research (PMLR) 233 (2024) 89-96

Using reinforcement learning to improve drone-based inference of greenhouse gas fluxes

Authors: Alouette van Hove, Kristoffer Aalstad, Norbert Pirk

Abstract: Accurate map** of greenhouse gas fluxes at the Earth's surface is essential for the validation and calibration of climate models. In this study, we present a framework for surface flux estimation with drones. Our approach uses data assimilation (DA) to infer fluxes from drone-based observations, and reinforcement learning (RL) to optimize the drone's sampling strategy. Herein, we demonstrate tha… ▽ More Accurate map** of greenhouse gas fluxes at the Earth's surface is essential for the validation and calibration of climate models. In this study, we present a framework for surface flux estimation with drones. Our approach uses data assimilation (DA) to infer fluxes from drone-based observations, and reinforcement learning (RL) to optimize the drone's sampling strategy. Herein, we demonstrate that a RL-trained drone can quantify a CO2 hotspot more accurately than a drone sampling along a predefined flight path that traverses the emission plume. We find that information-based reward functions can match the performance of an error-based reward function that quantifies the difference between the estimated surface flux and the true value. Reward functions based on information gain and information entropy can motivate actions that increase the drone's confidence in its updated belief, without requiring knowledge of the true surface flux. These findings provide valuable insights for further development of the framework for the map** of more complex surface flux fields. △ Less

Submitted 8 January, 2024; originally announced January 2024.

Journal ref: Nordic Machine Intelligence 3 (2023) 1-6