-
Online Calibration of Deep Learning Sub-Models for Hybrid Numerical Modeling Systems
Authors:
Said Ouala,
Bertrand Chapron,
Fabrice Collard,
Lucile Gaultier,
Ronan Fablet
Abstract:
Artificial intelligence and deep learning are currently resha** numerical simulation frameworks by introducing new modeling capabilities. These frameworks are extensively investigated in the context of model correction and parameterization where they demonstrate great potential and often outperform traditional physical models. Most of these efforts in defining hybrid dynamical systems follow {of…
▽ More
Artificial intelligence and deep learning are currently resha** numerical simulation frameworks by introducing new modeling capabilities. These frameworks are extensively investigated in the context of model correction and parameterization where they demonstrate great potential and often outperform traditional physical models. Most of these efforts in defining hybrid dynamical systems follow {offline} learning strategies in which the neural parameterization (called here sub-model) is trained to output an ideal correction. Yet, these hybrid models can face hard limitations when defining what should be a relevant sub-model response that would translate into a good forecasting performance. End-to-end learning schemes, also referred to as online learning, could address such a shortcoming by allowing the deep learning sub-models to train on historical data. However, defining end-to-end training schemes for the calibration of neural sub-models in hybrid systems requires working with an optimization problem that involves the solver of the physical equations. Online learning methodologies thus require the numerical model to be differentiable, which is not the case for most modeling systems. To overcome this difficulty and bypass the differentiability challenge of physical models, we present an efficient and practical online learning approach for hybrid systems. The method, called EGA for Euler Gradient Approximation, assumes an additive neural correction to the physical model, and an explicit Euler approximation of the gradients. We demonstrate that the EGA converges to the exact gradients in the limit of infinitely small time steps. Numerical experiments are performed on various case studies, including prototypical ocean-atmosphere dynamics. Results show significant improvements over offline learning, highlighting the potential of end-to-end online learning for hybrid modeling.
△ Less
Submitted 17 November, 2023;
originally announced November 2023.
-
Bounded nonlinear forecasts of partially observed geophysical systems with physics-constrained deep learning
Authors:
Said Ouala,
Steven L. Brunton,
Ananda Pascual,
Bertrand Chapron,
Fabrice Collard,
Lucile Gaultier,
Ronan Fablet
Abstract:
The complexity of real-world geophysical systems is often compounded by the fact that the observed measurements depend on hidden variables. These latent variables include unresolved small scales and/or rapidly evolving processes, partially observed couplings, or forcings in coupled systems. This is the case in ocean-atmosphere dynamics, for which unknown interior dynamics can affect surface observ…
▽ More
The complexity of real-world geophysical systems is often compounded by the fact that the observed measurements depend on hidden variables. These latent variables include unresolved small scales and/or rapidly evolving processes, partially observed couplings, or forcings in coupled systems. This is the case in ocean-atmosphere dynamics, for which unknown interior dynamics can affect surface observations. The identification of computationally-relevant representations of such partially-observed and highly nonlinear systems is thus challenging and often limited to short-term forecast applications. Here, we investigate the physics-constrained learning of implicit dynamical embeddings, leveraging neural ordinary differential equation (NODE) representations. A key objective is to constrain their boundedness, which promotes the generalization of the learned dynamics to arbitrary initial condition. The proposed architecture is implemented within a deep learning framework, and its relevance is demonstrated with respect to state-of-the-art schemes for different case-studies representative of geophysical dynamics.
△ Less
Submitted 2 March, 2022; v1 submitted 11 February, 2022;
originally announced February 2022.
-
Learning Runge-Kutta Integration Schemes for ODE Simulation and Identification
Authors:
Said Ouala,
Laurent Debreu,
Ananda Pascual,
Bertrand Chapron,
Fabrice Collard,
Lucile Gaultier,
Ronan Fablet
Abstract:
Deriving analytical solutions of ordinary differential equations is usually restricted to a small subset of problems and numerical techniques are considered. Inevitably, a numerical simulation of a differential equation will then always be distinct from a true analytical solution. An efficient integration scheme shall further not only provide a trajectory throughout a given state, but also be deri…
▽ More
Deriving analytical solutions of ordinary differential equations is usually restricted to a small subset of problems and numerical techniques are considered. Inevitably, a numerical simulation of a differential equation will then always be distinct from a true analytical solution. An efficient integration scheme shall further not only provide a trajectory throughout a given state, but also be derived to ensure the generated simulation to be close to the analytical one. Consequently, several integration schemes were developed for different classes of differential equations. Unfortunately, when considering the integration of complex non-linear systems, as well as the identification of non-linear equations from data, this choice of the integration scheme is often far from being trivial. In this paper, we propose a novel framework to learn integration schemes that minimize an integration-related cost function. We demonstrate the relevance of the proposed learning-based approach for non-linear equations and include a quantitative analysis w.r.t. classical state-of-the-art integration techniques, especially where the latter may not apply.
△ Less
Submitted 11 May, 2021;
originally announced May 2021.
-
Learning Latent Dynamics for Partially-Observed Chaotic Systems
Authors:
Said Ouala,
Duong Nguyen,
Lucas Drumetz,
Bertrand Chapron,
Ananda Pascual,
Fabrice Collard,
Lucile Gaultier,
Ronan Fablet
Abstract:
This paper addresses the data-driven identification of latent dynamical representations of partially-observed systems, i.e., dynamical systems for which some components are never observed, with an emphasis on forecasting applications, including long-term asymptotic patterns. Whereas state-of-the-art data-driven approaches rely on delay embeddings and linear decompositions of the underlying operato…
▽ More
This paper addresses the data-driven identification of latent dynamical representations of partially-observed systems, i.e., dynamical systems for which some components are never observed, with an emphasis on forecasting applications, including long-term asymptotic patterns. Whereas state-of-the-art data-driven approaches rely on delay embeddings and linear decompositions of the underlying operators, we introduce a framework based on the data-driven identification of an augmented state-space model using a neural-network-based representation. For a given training dataset, it amounts to jointly learn an ODE (Ordinary Differential Equation) representation in the latent space and reconstructing latent states. Through numerical experiments, we demonstrate the relevance of the proposed framework w.r.t. state-of-the-art approaches in terms of short-term forecasting performance and long-term behaviour. We further discuss how the proposed framework relates to Koopman operator theory and Takens' embedding theorem.
△ Less
Submitted 4 July, 2019;
originally announced July 2019.
-
Wind, wave and current interactions appear key for quantifying cross-shelf transport and carbon export; new knowledge and the potential of SKIM to enable monitoring
Authors:
Jamie D. Shutler,
Thomas Holding,
Clement Ubelmann,
Lucile Gaultier,
Fabrice Collard,
Fabrice Ardhuin,
Bertrand Chapron,
Marie-Helene Rio,
Craig Donlon
Abstract:
The highly heterogeneous and biologically active continental shelf-seas are important components of the oceanic carbon sink. Carbon rich water from shelf-seas is exported at depth to the open ocean, a process known as the continental shelf pump, with open-ocean surface water moving (transported) onto the shelf driving the export at depth. Existing methods to study shelf-wide exchange focus on the…
▽ More
The highly heterogeneous and biologically active continental shelf-seas are important components of the oceanic carbon sink. Carbon rich water from shelf-seas is exported at depth to the open ocean, a process known as the continental shelf pump, with open-ocean surface water moving (transported) onto the shelf driving the export at depth. Existing methods to study shelf-wide exchange focus on the wind or geostrophic currents, often ignoring their combined effect, spatial heterogeniety or any other ageostrophic components. Here we investigate the influence that wind, wave and current interactions can have on surface transport and carbon export across continental shelves. Using a 21 year global re-analysis dataset we confirm that geostrophic and wind driven Ekman processes are important for the transport of water onto shelf seas; but the dominance of each is location and season dependent. A global wave model re-analysis shows that one type of ageostrophic flow, Stokes drift due to waves, can also be significant. A regional case study using two submesocale model simulations identifies that up to 100% of the cross-shelf surface flow in European seas can be due to ageostrophic components. Using these results and grou** shelf-seas based on their observed carbon accumulation rates shows that differences in rates are consistent with imbalances between the processes driving atmosphere-ocean exchange at the surface and those driving carbon export at depth. Therefore expected future changes in wind and wave climate support the need to monitor cross-shelf transport and the size of the continental shelf-sea carbon pump. The results presented show that the Sea Surface Kinematics Multiscale monitoring satellite mission (SKIM), will be capable of providing measurements of the total cross-shelf current, which are now needed to enable routine monitoring of the global continental shelf-sea carbon pump.
△ Less
Submitted 21 May, 2019;
originally announced May 2019.
