-
Learning fluid physics from highly turbulent data using sparse physics-informed discovery of empirical relations (SPIDER)
Authors:
Daniel R. Gurevich,
Matthew R. Golden,
Patrick A. K. Reinbold,
Roman O. Grigoriev
Abstract:
We show how a complete mathematical description of a complicated physical phenomenon can be learned from observational data via a hybrid approach combining three simple and general ingredients: physical assumptions of smoothness, locality, and symmetry, a weak formulation of differential equations, and sparse regression. To illustrate this, we extract a system of governing equations describing flo…
▽ More
We show how a complete mathematical description of a complicated physical phenomenon can be learned from observational data via a hybrid approach combining three simple and general ingredients: physical assumptions of smoothness, locality, and symmetry, a weak formulation of differential equations, and sparse regression. To illustrate this, we extract a system of governing equations describing flows of incompressible Newtonian fluids -- the Navier-Stokes equation, the continuity equation, and the boundary conditions -- from numerical data describing a highly turbulent channel flow in three dimensions. These relations have the familiar form of partial differential equations, which are easily interpretable and readily provide information about the relative importance of different physical effects as well as insight into the quality of the data, serving as a useful diagnostic tool. The approach described here is remarkably robust, yielding accurate results for very high noise levels, and should thus be well-suited to experimental data.
△ Less
Submitted 13 November, 2023; v1 submitted 30 April, 2021;
originally announced May 2021.
-
Robust learning from noisy, incomplete, high-dimensional experimental data via physically constrained symbolic regression
Authors:
Patrick A. K. Reinbold,
Logan M. Kageorge,
Michael F. Schatz,
Roman O. Grigoriev
Abstract:
Machine learning offers an intriguing alternative to first-principles analysis for discovering new physics from experimental data. However, to date, purely data-driven methods have only proven successful in uncovering physical laws describing simple, low-dimensional systems with low levels of noise. Here we demonstrate that combining a data-driven methodology with some general physical principles…
▽ More
Machine learning offers an intriguing alternative to first-principles analysis for discovering new physics from experimental data. However, to date, purely data-driven methods have only proven successful in uncovering physical laws describing simple, low-dimensional systems with low levels of noise. Here we demonstrate that combining a data-driven methodology with some general physical principles enables discovery of a quantitatively accurate model of a non-equilibrium spatially-extended system from high-dimensional data that is both noisy and incomplete. We illustrate this using an experimental weakly turbulent fluid flow where only the velocity field is accessible. We also show that this hybrid approach allows reconstruction of the inaccessible variables -- the pressure and forcing field driving the flow.
△ Less
Submitted 23 February, 2021;
originally announced February 2021.
-
Using Noisy or Incomplete Data to Discover Models of Spatiotemporal Dynamics
Authors:
Patrick A. K. Reinbold,
Daniel R. Gurevich,
Roman O. Grigoriev
Abstract:
Sparse regression has recently emerged as an attractive approach for discovering models of spatiotemporally complex dynamics directly from data. In many instances, such models are in the form of nonlinear partial differential equations (PDEs); hence sparse regression typically requires evaluation of various partial derivatives. However, accurate evaluation of derivatives, especially of high order,…
▽ More
Sparse regression has recently emerged as an attractive approach for discovering models of spatiotemporally complex dynamics directly from data. In many instances, such models are in the form of nonlinear partial differential equations (PDEs); hence sparse regression typically requires evaluation of various partial derivatives. However, accurate evaluation of derivatives, especially of high order, is infeasible when the data are noisy, which has a dramatic negative effect on the result of regression. We present a novel and rather general approach that addresses this difficulty by using a weak formulation of the problem. For instance, it allows accurate reconstruction of PDEs involving high-order derivatives, such as the Kuramoto-Sivashinsky equation, from data with a considerable amount of noise. The flexibility of our approach also allows reconstruction of PDE models that involve latent variables which cannot be measured directly with acceptable accuracy. This is illustrated by reconstructing a model for a weakly turbulent flow in a thin fluid layer, where neither the forcing nor the pressure field is known.
△ Less
Submitted 8 November, 2019;
originally announced November 2019.
-
Robust and optimal sparse regression for nonlinear PDE models
Authors:
Daniel R. Gurevich,
Patrick A. K. Reinbold,
Roman O. Grigoriev
Abstract:
This paper investigates how models of spatiotemporal dynamics in the form of nonlinear partial differential equations can be identified directly from noisy data using a combination of sparse regression and weak formulation. Using the 4th-order Kuramoto-Sivashinsky equation for illustration, we show how this approach can be optimized in the limits of low and high noise, achieving accuracy that is o…
▽ More
This paper investigates how models of spatiotemporal dynamics in the form of nonlinear partial differential equations can be identified directly from noisy data using a combination of sparse regression and weak formulation. Using the 4th-order Kuramoto-Sivashinsky equation for illustration, we show how this approach can be optimized in the limits of low and high noise, achieving accuracy that is orders of magnitude better than what existing techniques allow. In particular, we derive the scaling relation between the accuracy of the model, the parameters of the weak formulation, and the properties of the data, such as its spatial and temporal resolution and the level of noise.
△ Less
Submitted 22 July, 2019;
originally announced July 2019.
-
Data-driven discovery of partial differential equation models with latent variables
Authors:
Patrick A. K. Reinbold,
Roman O. Grigoriev
Abstract:
In spatially extended systems, it is common to find latent variables that are hard, or even impossible, to measure with acceptable precision, but are crucially important for the proper description of the dynamics. This substantially complicates construction of an accurate model for such systems using data-driven approaches. The present paper illustrates how physical constraints can be employed to…
▽ More
In spatially extended systems, it is common to find latent variables that are hard, or even impossible, to measure with acceptable precision, but are crucially important for the proper description of the dynamics. This substantially complicates construction of an accurate model for such systems using data-driven approaches. The present paper illustrates how physical constraints can be employed to overcome this limitation using the example of a weakly turbulent quasi-two-dimensional Kolmogorov flow driven by a steady Lorenz force with an unknown spatial profile. Specifically, the terms involving latent variables in the partial differential equations governing the dynamics can be eliminated at the expense of raising the order of that equation. We show that local polynomial interpolation combined with symbolic regression can handle sparse data on grids that are representative of typical experimental measurement techniques such as particle image velocimetry. However, we also find that the reconstructed model is sensitive to measurement noise and trace this sensitivity to the presence of high order spatial and/or temporal derivatives.
△ Less
Submitted 5 April, 2019;
originally announced April 2019.
