Showing 51–100 of 173 results for author: Brunton, S L

Learning normal form autoencoders for data-driven discovery of universal,parameter-dependent governing equations

Authors: Manu Kalia, Steven L. Brunton, Hil G. E. Meijer, Christoph Brune, J. Nathan Kutz

Abstract: Complex systems manifest a small number of instabilities and bifurcations that are canonical in nature, resulting in universal pattern forming characteristics as a function of some parametric dependence. Such parametric instabilities are mathematically characterized by their universal un-foldings, or normal form dynamics, whereby a parsimonious model can be used to represent the dynamics. Although… ▽ More Complex systems manifest a small number of instabilities and bifurcations that are canonical in nature, resulting in universal pattern forming characteristics as a function of some parametric dependence. Such parametric instabilities are mathematically characterized by their universal un-foldings, or normal form dynamics, whereby a parsimonious model can be used to represent the dynamics. Although center manifold theory guarantees the existence of such low-dimensional normal forms, finding them has remained a long standing challenge. In this work, we introduce deep learning autoencoders to discover coordinate transformations that capture the underlying parametric dependence of a dynamical system in terms of its canonical normal form, allowing for a simple representation of the parametric dependence and bifurcation structure. The autoencoder constrains the latent variable to adhere to a given normal form, thus allowing it to learn the appropriate coordinate transformation. We demonstrate the method on a number of example problems, showing that it can capture a diverse set of normal forms associated with Hopf, pitchfork, transcritical and/or saddle node bifurcations. This method shows how normal forms can be leveraged as canonical and universal building blocks in deep learning approaches for model discovery and reduced-order modeling. △ Less

Submitted 9 June, 2021; originally announced June 2021.

Comments: 18 pages, 7 figures

MSC Class: 37G05

On the role of nonlinear correlations in reduced-order modeling

Authors: Jared L. Callaham, Steven L. Brunton, Jean-Christophe Loiseau

Abstract: A major goal for reduced-order models of unsteady fluid flows is to uncover and exploit latent low-dimensional structure. Proper orthogonal decomposition (POD) provides an energy-optimal linear basis to represent the flow kinematics, but converges slowly for advection-dominated flows and tends to overestimate the number of dynamically relevant variables. We show that nonlinear correlations in the… ▽ More A major goal for reduced-order models of unsteady fluid flows is to uncover and exploit latent low-dimensional structure. Proper orthogonal decomposition (POD) provides an energy-optimal linear basis to represent the flow kinematics, but converges slowly for advection-dominated flows and tends to overestimate the number of dynamically relevant variables. We show that nonlinear correlations in the temporal POD coefficients can be exploited to identify the underlying attractor, characterized by a minimal set of driving modes and a manifold equation for the remaining modes. By viewing these nonlinear correlations as an invariant manifold reduction, this least-order representation can be used to stabilize POD-Galerkin models or as a state space for data-driven model identification. In the latter case, we use sparse polynomial regression to learn a compact, interpretable dynamical system model from the time series of the active modal coefficients. We demonstrate this perspective on a quasiperiodic shear-driven cavity flow and show that the dynamics evolve on a torus generated by two independent Stuart-Landau oscillators. These results emphasize the importance of nonlinear dimensionality reduction to reveal underlying structure in complex flows. △ Less

Submitted 4 June, 2021; originally announced June 2021.

Comments: 33 pages, 14 figures

Kernel Learning for Robust Dynamic Mode Decomposition: Linear and Nonlinear Disambiguation Optimization (LANDO)

Authors: Peter J. Baddoo, Benjamin Herrmann, Beverley J. McKeon, Steven L. Brunton

Abstract: Research in modern data-driven dynamical systems is typically focused on the three key challenges of high dimensionality, unknown dynamics, and nonlinearity. The dynamic mode decomposition (DMD) has emerged as a cornerstone for modeling high-dimensional systems from data. However, the quality of the linear DMD model is known to be fragile with respect to strong nonlinearity, which contaminates the… ▽ More Research in modern data-driven dynamical systems is typically focused on the three key challenges of high dimensionality, unknown dynamics, and nonlinearity. The dynamic mode decomposition (DMD) has emerged as a cornerstone for modeling high-dimensional systems from data. However, the quality of the linear DMD model is known to be fragile with respect to strong nonlinearity, which contaminates the model estimate. In contrast, sparse identification of nonlinear dynamics (SINDy) learns fully nonlinear models, disambiguating the linear and nonlinear effects, but is restricted to low-dimensional systems. In this work, we present a kernel method that learns interpretable data-driven models for high-dimensional, nonlinear systems. Our method performs kernel regression on a sparse dictionary of samples that appreciably contribute to the underlying dynamics. We show that this kernel method efficiently handles high-dimensional data and is flexible enough to incorporate partial knowledge of system physics. It is possible to accurately recover the linear model contribution with this approach, disambiguating the effects of the implicitly defined nonlinear terms, resulting in a DMD-like model that is robust to strongly nonlinear dynamics. We demonstrate our approach on data from a wide range of nonlinear ordinary and partial differential equations that arise in the physical sciences. This framework can be used for many practical engineering tasks such as model order reduction, diagnostics, prediction, control, and discovery of governing laws. △ Less

Submitted 2 June, 2021; originally announced June 2021.

Comments: 44 pages, 12 figures

An empirical mean-field model of symmetry-breaking in a turbulent wake

Authors: Jared L. Callaham, Georgios Rigas, Jean-Christophe Loiseau, Steven L. Brunton

Abstract: This work develops a low-dimensional nonlinear stochastic model of symmetry-breaking coherent structures from experimental measurements of a turbulent axisymmetric bluff body wake. Traditional model reduction methods decompose the field into a set of modes with fixed spatial support but time-varying amplitudes. However, this fixed basis cannot resolve the mean flow deformation due to variable Reyn… ▽ More This work develops a low-dimensional nonlinear stochastic model of symmetry-breaking coherent structures from experimental measurements of a turbulent axisymmetric bluff body wake. Traditional model reduction methods decompose the field into a set of modes with fixed spatial support but time-varying amplitudes. However, this fixed basis cannot resolve the mean flow deformation due to variable Reynolds stresses, a central feature of Stuart's nonlinear stability mechanism, without the further assumption of weakly nonlinear interactions. Here, we introduce a parametric modal basis that depends on the instantaneous value of the unsteady aerodynamic center of pressure, which quantifies the degree to which the rotational symmetry of the wake is broken. Thus, the modes naturally interpolate between the unstable symmetric state and the nonlinear equilibrium. We estimate the modes from experimental measurements of the base pressure distribution by reducing the symmetry via phase alignment and averaging conditioned on the center of pressure. The amplitude dependence of the symmetric mode deviates significantly from the polynomial scaling predicted by weakly nonlinear analysis, confirming that the parametric basis is crucial for capturing the effect of strongly nonlinear interactions. We also introduce a second model term capturing axisymmetric fluctuations associated with the mean-field deformation. We then apply the Langevin regression system identification method to construct a stochastically forced nonlinear model for these two generalized mode coefficients. The resulting model reproduces empirical power spectra and probability distributions, suggesting a path towards develo** interpretable low-dimensional models of globally unstable turbulent flows from experimental measurements. △ Less

Submitted 28 May, 2021; originally announced May 2021.

Comments: 23 pages, 10 figures

Promoting global stability in data-driven models of quadratic nonlinear dynamics

Authors: Alan A. Kaptanoglu, Jared L. Callaham, Christopher J. Hansen, Aleksandr Aravkin, Steven L. Brunton

Abstract: Modeling realistic fluid and plasma flows is computationally intensive, motivating the use of reduced-order models for a variety of scientific and engineering tasks. However, it is challenging to characterize, much less guarantee, the global stability (i.e., long-time boundedness) of these models. The seminal work of Schlegel and Noack (JFM, 2015) provided a theorem outlining necessary and suffici… ▽ More Modeling realistic fluid and plasma flows is computationally intensive, motivating the use of reduced-order models for a variety of scientific and engineering tasks. However, it is challenging to characterize, much less guarantee, the global stability (i.e., long-time boundedness) of these models. The seminal work of Schlegel and Noack (JFM, 2015) provided a theorem outlining necessary and sufficient conditions to ensure global stability in systems with energy-preserving, quadratic nonlinearities, with the goal of evaluating the stability of projection-based models. In this work, we incorporate this theorem into modern data-driven models obtained via machine learning. First, we propose that this theorem should be a standard diagnostic for the stability of projection-based and data-driven models, examining the conditions under which it holds. Second, we illustrate how to modify the objective function in machine learning algorithms to promote globally stable models, with implications for the modeling of fluid and plasma flows. Specifically, we introduce a modified "trap** SINDy" algorithm based on the sparse identification of nonlinear dynamics (SINDy) method. This method enables the identification of models that, by construction, only produce bounded trajectories. The effectiveness and accuracy of this approach are demonstrated on a broad set of examples of varying model complexity and physical origin, including the vortex shedding in the wake of a circular cylinder. △ Less

Submitted 4 May, 2021; originally announced May 2021.

Journal ref: Phys. Rev. Fluids 6, 094401 (2021)

Improved approximations to the Wagner function using sparse identification of nonlinear dynamics

Authors: Scott T. M. Dawson, Steven L. Brunton

Abstract: The Wagner function in classical unsteady aerodynamic theory represents the response in lift on an airfoil that is subject to a sudden change in conditions. While it plays a fundamental role in the development and application of unsteady aerodynamic methods, explicit expressions for this function are difficult to obtain. The Wagner function requires computation of an inverse Laplace transform, or… ▽ More The Wagner function in classical unsteady aerodynamic theory represents the response in lift on an airfoil that is subject to a sudden change in conditions. While it plays a fundamental role in the development and application of unsteady aerodynamic methods, explicit expressions for this function are difficult to obtain. The Wagner function requires computation of an inverse Laplace transform, or similar inversion, of a non-rational function in the Laplace domain, which is closely related to the Theodorsen function. This has led to numerous proposed approximations to the Wagner function, which facilitate convenient and rapid computations. While these approximations can be sufficient for many purposes, their behavior is often noticeably different from the true Wagner function, especially for long-time asymptotic behavior. In particular, while many approximations have small maximum absolute error across all times, the relative error of the asymptotic behavior can be substantial. As well as documenting this error, we propose an alternative approximation methodology that is accurate for all times, for a variety of accuracy measures. This methodology casts the Wagner function as the solution of a nonlinear scalar ordinary differential equation, which is identified using a variant of the sparse identification of nonlinear dynamics (SINDy) algorithm. We show that this approach can give accurate approximations using either first- or second-order differential equations. We additionally show that this method can be applied to model the analogous lift response for a more realistic aerodynamic system, featuring a finite thickness airfoil and a nonplanar wake. △ Less

Submitted 15 September, 2021; v1 submitted 30 April, 2021; originally announced April 2021.

Deep Learning of Conjugate Map**s

Authors: Jason J. Bramburger, Steven L. Brunton, J. Nathan Kutz

Abstract: Despite many of the most common chaotic dynamical systems being continuous in time, it is through discrete time map**s that much of the understanding of chaos is formed. Henri Poincaré first made this connection by tracking consecutive iterations of the continuous flow with a lower-dimensional, transverse subspace. The map** that iterates the dynamics through consecutive intersections of the f… ▽ More Despite many of the most common chaotic dynamical systems being continuous in time, it is through discrete time map**s that much of the understanding of chaos is formed. Henri Poincaré first made this connection by tracking consecutive iterations of the continuous flow with a lower-dimensional, transverse subspace. The map** that iterates the dynamics through consecutive intersections of the flow with the subspace is now referred to as a Poincaré map, and it is the primary method available for interpreting and classifying chaotic dynamics. Unfortunately, in all but the simplest systems, an explicit form for such a map** remains outstanding. This work proposes a method for obtaining explicit Poincaré map**s by using deep learning to construct an invertible coordinate transformation into a conjugate representation where the dynamics are governed by a relatively simple chaotic map**. The invertible change of variable is based on an autoencoder, which allows for dimensionality reduction, and has the advantage of classifying chaotic systems using the equivalence relation of topological conjugacies. Indeed, the enforcement of topological conjugacies is the critical neural network regularization for learning the coordinate and dynamics pairing. We provide expository applications of the method to low-dimensional systems such as the Rössler and Lorenz systems, while also demonstrating the utility of the method on infinite-dimensional systems, such as the Kuramoto--Sivashinsky equation. △ Less

Submitted 13 July, 2021; v1 submitted 1 April, 2021; originally announced April 2021.

Extraction of instantaneous frequencies and amplitudes in nonstationary time-series data

Authors: Daniel E. Shea, Rajiv Giridharagopal, David S. Ginger, Steven L. Brunton, J. Nathan Kutz

Abstract: Time-series analysis is critical for a diversity of applications in science and engineering. By leveraging the strengths of modern gradient descent algorithms, the Fourier transform, multi-resolution analysis, and Bayesian spectral analysis, we propose a data-driven approach to time-frequency analysis that circumvents many of the shortcomings of classic approaches, including the extraction of nons… ▽ More Time-series analysis is critical for a diversity of applications in science and engineering. By leveraging the strengths of modern gradient descent algorithms, the Fourier transform, multi-resolution analysis, and Bayesian spectral analysis, we propose a data-driven approach to time-frequency analysis that circumvents many of the shortcomings of classic approaches, including the extraction of nonstationary signals with discontinuities in their behavior. The method introduced is equivalent to a {\em nonstationary Fourier mode decomposition} (NFMD) for nonstationary and nonlinear temporal signals, allowing for the accurate identification of instantaneous frequencies and their amplitudes. The method is demonstrated on a diversity of time-series data, including on data from cantilever-based electrostatic force microscopy to quantify the time-dependent evolution of charging dynamics at the nanoscale. △ Less

Submitted 2 April, 2021; originally announced April 2021.

Journal ref: IEEE Access, vol. 9, pp. 83453-83466, 2021

Data-driven stochastic modeling of coarse-grained dynamics with finite-size effects using Langevin regression

Authors: Jordan Snyder, Jared L. Callaham, Steven L. Brunton, J. Nathan Kutz

Abstract: Obtaining coarse-grained models that accurately incorporate finite-size effects is an important open challenge in the study of complex, multi-scale systems. We apply Langevin regression, a recently developed method for finding stochastic differential equation (SDE) descriptions of realistically-sampled time series data, to understand finite-size effects in the Kuramoto model of coupled oscillators… ▽ More Obtaining coarse-grained models that accurately incorporate finite-size effects is an important open challenge in the study of complex, multi-scale systems. We apply Langevin regression, a recently developed method for finding stochastic differential equation (SDE) descriptions of realistically-sampled time series data, to understand finite-size effects in the Kuramoto model of coupled oscillators. We find that across the entire bifurcation diagram, the dynamics of the Kuramoto order parameter are statistically consistent with an SDE whose drift term has the form predicted by the Ott-Antonsen ansatz in the $N\to \infty$ limit. We find that the diffusion term is nearly independent of the bifurcation parameter, and has a magnitude decaying as $N^{-1/2}$, consistent with the central limit theorem. This shows that the diverging fluctuations of the order parameter near the critical point are driven by a bifurcation in the underlying drift term, rather than increased stochastic forcing. △ Less

Submitted 11 October, 2021; v1 submitted 30 March, 2021; originally announced March 2021.

Comments: 18 pages, 7 figures

Finite-Horizon, Energy-Optimal Trajectories in Unsteady Flows

Authors: Kartik Krishna, Zhuoyuan Song, Steven L. Brunton

Abstract: Intelligent mobile sensors, such as uninhabited aerial or underwater vehicles, are becoming prevalent in environmental sensing and monitoring applications. These active sensing platforms operate in unsteady fluid flows, including windy urban environments, hurricanes, and ocean currents. Often constrained in their actuation capabilities, the dynamics of these mobile sensors depend strongly on the b… ▽ More Intelligent mobile sensors, such as uninhabited aerial or underwater vehicles, are becoming prevalent in environmental sensing and monitoring applications. These active sensing platforms operate in unsteady fluid flows, including windy urban environments, hurricanes, and ocean currents. Often constrained in their actuation capabilities, the dynamics of these mobile sensors depend strongly on the background flow, making their deployment and control particularly challenging. Therefore, efficient trajectory planning with partial knowledge about the background flow is essential for teams of mobile sensors to adaptively sense and monitor their environments. In this work, we investigate the use of finite-horizon model predictive control (MPC) for the energy-efficient trajectory planning of an active mobile sensor in an unsteady fluid flow field. We uncover connections between the finite-time optimal trajectories and finite-time Lyapunov exponents (FTLE) of the background flow, confirming that energy-efficient trajectories exploit invariant coherent structures in the flow. We demonstrate our findings on the unsteady double gyre vector field, which is a canonical model for chaotic mixing in the ocean. We present an exhaustive search through critical MPC parameters including the prediction horizon, maximum sensor actuation, and relative penalty on the accumulated state error and actuation effort. We find that even relatively short prediction horizons can often yield nearly energy-optimal trajectories. These results are promising for the adaptive planning of energy-efficient trajectories for swarms of mobile sensors in distributed sensing and monitoring. △ Less

Submitted 18 March, 2021; originally announced March 2021.

Comments: 30 pages, 19 figures

MSC Class: 37N35; 34H05; 37D10; 34D08; 37N10; 76F25; 93B45

Projection-tree reduced order modeling for fast N-body computations

Authors: Steven N. Rodriguez, Athanasios P. Iliopoulos, Kevin T. Carlberg, Steven L. Brunton, John C. Steuben, John G. Michopoulos

Abstract: This work presents a data-driven reduced-order modeling framework to accelerate the computations of $N$-body dynamical systems and their pair-wise interactions. The proposed framework differs from traditional acceleration methods, like the Barnes-Hut method, which requires online tree building of the state space, or the fast-multipole method, which requires rigorous $a$ $priori$ analysis of govern… ▽ More This work presents a data-driven reduced-order modeling framework to accelerate the computations of $N$-body dynamical systems and their pair-wise interactions. The proposed framework differs from traditional acceleration methods, like the Barnes-Hut method, which requires online tree building of the state space, or the fast-multipole method, which requires rigorous $a$ $priori$ analysis of governing kernels and online tree building. Our approach combines Barnes-Hut hierarchical decomposition, dimensional compression via the least-squares Petrov-Galerkin (LSPG) projection, and hyper-reduction by way of the Gauss-Newton with approximated tensor (GNAT) approach. The resulting $projection-tree$ reduced order model (PTROM) enables a drastic reduction in operational count complexity by constructing sparse hyper-reduced pairwise interactions of the $N$-body dynamical system. As a result, the presented framework is capable of achieving an operational count complexity that is independent of $N$, the number of bodies in the numerical domain. Capabilities of the PTROM method are demonstrated on the two-dimensional fluid-dynamic Biot-Savart kernel within a parametric and reproductive setting. Results show the PTROM is capable of achieving over 2000$\times$ wall-time speed-up with respect to the full-order model, where the speed-up increases with $N$. The resulting solution delivers quantities of interest with errors that are less than 0.1$\%$ with respect to full-order model. △ Less

Submitted 17 May, 2021; v1 submitted 2 March, 2021; originally announced March 2021.

Near-Wake Dynamics of a Vertical-Axis Turbine

Authors: Benjamin Strom, Brian Polagye, Steven L. Brunton

Abstract: Cross-flow, or vertical-axis, turbines are a promising technology for capturing kinetic energy in wind or flowing water and their inherently unsteady fluid mechanics present unique opportunities for control optimization of individual rotors or arrays. To explore the potential for beneficial interactions between turbines in an array, coherent structures in the wake of a single two-bladed cross-flow… ▽ More Cross-flow, or vertical-axis, turbines are a promising technology for capturing kinetic energy in wind or flowing water and their inherently unsteady fluid mechanics present unique opportunities for control optimization of individual rotors or arrays. To explore the potential for beneficial interactions between turbines in an array, coherent structures in the wake of a single two-bladed cross-flow turbine are examined using planar stereo particle image velocimetry in a water channel. First, the mean wake structure of this high chord-to-radius ratio rotor is described, compared to previous studies, and a simple explanation for observed wake deflection is presented. Second, the unsteady flow is then analyzed via the triple decomposition, with the periodic component extracted using a combination of traditional techniques and a novel implementation of the optimized dynamic mode decomposition. The latter method is shown to outperform conditional averaging and Fourier methods, as well as uncover frequencies suggesting a transition to bluff-body shedding in the far wake. Third, vorticity and finite-time Lyapunov exponents are then employed to further analyze the oscillatory wake component. Vortex streets on both sides of the wake are identified, and their formation mechanisms and effects on the mean flow are discussed. Strong axial (vertical) flow is observed in vortical structures shed on the retreating side of the rotor where the blades travel downstream. Time-resolved tracking of these vortices is performed, which demonstrates that vortex trajectories have significant rotation-to-rotation variation within one diameter downstream. This variability suggests it would be challenging to harness or avoid such structures at greater downstream distances. △ Less

Submitted 28 February, 2021; originally announced March 2021.

Comments: 25 pages, 12 figures

MSC Class: 76-05; 76M27; 76M23; 76D55

PySensors: A Python Package for Sparse Sensor Placement

Authors: Brian M. de Silva, Krithika Manohar, Emily Clark, Bingni W. Brunton, Steven L. Brunton, J. Nathan Kutz

Abstract: PySensors is a Python package for selecting and placing a sparse set of sensors for classification and reconstruction tasks. Specifically, PySensors implements algorithms for data-driven sparse sensor placement optimization for reconstruction (SSPOR) and sparse sensor placement optimization for classification (SSPOC). In this work we provide a brief description of the mathematical algorithms and t… ▽ More PySensors is a Python package for selecting and placing a sparse set of sensors for classification and reconstruction tasks. Specifically, PySensors implements algorithms for data-driven sparse sensor placement optimization for reconstruction (SSPOR) and sparse sensor placement optimization for classification (SSPOC). In this work we provide a brief description of the mathematical algorithms and theory for sparse sensor optimization, along with an overview and demonstration of the features implemented in PySensors (with code examples). We also include practical advice for user and a list of potential extensions to PySensors. Software is available at https://github.com/dynamicslab/pysensors. △ Less

Submitted 20 February, 2021; originally announced February 2021.

Modern Koopman Theory for Dynamical Systems

Authors: Steven L. Brunton, Marko Budišić, Eurika Kaiser, J. Nathan Kutz

Abstract: The field of dynamical systems is being transformed by the mathematical tools and algorithms emerging from modern computing and data science. First-principles derivations and asymptotic reductions are giving way to data-driven approaches that formulate models in operator theoretic or probabilistic frameworks. Koopman spectral theory has emerged as a dominant perspective over the past decade, in wh… ▽ More The field of dynamical systems is being transformed by the mathematical tools and algorithms emerging from modern computing and data science. First-principles derivations and asymptotic reductions are giving way to data-driven approaches that formulate models in operator theoretic or probabilistic frameworks. Koopman spectral theory has emerged as a dominant perspective over the past decade, in which nonlinear dynamics are represented in terms of an infinite-dimensional linear operator acting on the space of all possible measurement functions of the system. This linear representation of nonlinear dynamics has tremendous potential to enable the prediction, estimation, and control of nonlinear systems with standard textbook methods developed for linear systems. However, obtaining finite-dimensional coordinate systems and embeddings in which the dynamics appear approximately linear remains a central open challenge. The success of Koopman analysis is due primarily to three key factors: 1) there exists rigorous theory connecting it to classical geometric approaches for dynamical systems, 2) the approach is formulated in terms of measurements, making it ideal for leveraging big-data and machine learning techniques, and 3) simple, yet powerful numerical algorithms, such as the dynamic mode decomposition (DMD), have been developed and extended to reduce Koopman theory to practice in real-world applications. In this review, we provide an overview of modern Koopman operator theory, describing recent theoretical and algorithmic developments and highlighting these methods with a diverse range of applications. We also discuss key advances and challenges in the rapidly growing field of machine learning that are likely to drive future developments and significantly transform the theoretical landscape of dynamical systems. △ Less

Submitted 29 October, 2021; v1 submitted 24 February, 2021; originally announced February 2021.

Comments: 110 pages, 27 figures

MSC Class: 34A34; 37A30; 37C10; 37M10; 37M99; 37N35; 47A35; 47B33

Structured Time-Delay Models for Dynamical Systems with Connections to Frenet-Serret Frame

Authors: Seth M. Hirsh, Sara M. Ichinaga, Steven L. Brunton, J. Nathan Kutz, Bingni W. Brunton

Abstract: Time-delay embeddings and dimensionality reduction are powerful techniques for discovering effective coordinate systems to represent the dynamics of physical systems. Recently, it has been shown that models identified by dynamic mode decomposition (DMD) on time-delay coordinates provide linear representations of strongly nonlinear systems, in the so-called Hankel alternative view of Koopman (HAVOK… ▽ More Time-delay embeddings and dimensionality reduction are powerful techniques for discovering effective coordinate systems to represent the dynamics of physical systems. Recently, it has been shown that models identified by dynamic mode decomposition (DMD) on time-delay coordinates provide linear representations of strongly nonlinear systems, in the so-called Hankel alternative view of Koopman (HAVOK) approach. Curiously, the resulting linear model has a matrix representation that is approximately antisymmetric and tridiagonal with a zero diagonal; for chaotic systems, there is an additional forcing term in the last component. In this paper, we establish a new theoretical connection between HAVOK and the Frenet-Serret frame from differential geometry, and also develop an improved algorithm to identify more stable and accurate models from less data. In particular, we show that the sub- and super-diagonal entries of the linear model correspond to the intrinsic curvatures in Frenet-Serret frame. Based on this connection, we modify the algorithm to promote this antisymmetric structure, even in the noisy, low-data limit. We demonstrate this improved modeling procedure on data from several nonlinear synthetic and real-world examples. △ Less

Submitted 20 January, 2021; originally announced January 2021.

Comments: 34 pages, 9 figures

DeepGreen: Deep Learning of Green's Functions for Nonlinear Boundary Value Problems

Authors: Craig R. Gin, Daniel E. Shea, Steven L. Brunton, J. Nathan Kutz

Abstract: Boundary value problems (BVPs) play a central role in the mathematical analysis of constrained physical systems subjected to external forces. Consequently, BVPs frequently emerge in nearly every engineering discipline and span problem domains including fluid mechanics, electromagnetics, quantum mechanics, and elasticity. The fundamental solution, or Green's function, is a leading method for solvin… ▽ More Boundary value problems (BVPs) play a central role in the mathematical analysis of constrained physical systems subjected to external forces. Consequently, BVPs frequently emerge in nearly every engineering discipline and span problem domains including fluid mechanics, electromagnetics, quantum mechanics, and elasticity. The fundamental solution, or Green's function, is a leading method for solving linear BVPs that enables facile computation of new solutions to systems under any external forcing. However, fundamental Green's function solutions for nonlinear BVPs are not feasible since linear superposition no longer holds. In this work, we propose a flexible deep learning approach to solve nonlinear BVPs using a dual-autoencoder architecture. The autoencoders discover an invertible coordinate transform that linearizes the nonlinear BVP and identifies both a linear operator $L$ and Green's function $G$ which can be used to solve new nonlinear BVPs. We find that the method succeeds on a variety of nonlinear systems including nonlinear Helmholtz and Sturm--Liouville problems, nonlinear elasticity, and a 2D nonlinear Poisson equation. The method merges the strengths of the universal approximation capabilities of deep learning with the physics knowledge of Green's functions to yield a flexible tool for identifying fundamental solutions to a variety of nonlinear systems. △ Less

Submitted 31 December, 2020; originally announced January 2021.

The structure of global conservation laws in Galerkin plasma models

Authors: Alan A. Kaptanoglu, Kyle D. Morgan, Christopher J. Hansen, Steven L. Brunton

Abstract: Plasmas are highly nonlinear and multi-scale, motivating a hierarchy of models to understand and describe their behavior. However, there is a scarcity of plasma models of lower fidelity than magnetohydrodynamics (MHD). Galerkin models, obtained by projection of the MHD equations onto a truncated modal basis, can furnish this gap in the lower levels of the model hierarchy. In the present work, we d… ▽ More Plasmas are highly nonlinear and multi-scale, motivating a hierarchy of models to understand and describe their behavior. However, there is a scarcity of plasma models of lower fidelity than magnetohydrodynamics (MHD). Galerkin models, obtained by projection of the MHD equations onto a truncated modal basis, can furnish this gap in the lower levels of the model hierarchy. In the present work, we develop low-dimensional Galerkin plasma models which preserve global conservation laws by construction. This additional model structure enables physics-constrained machine learning algorithms that can discover these types of low-dimensional plasma models directly from data. This formulation relies on an energy-based inner product which takes into account all of the dynamic variables. The theoretical results here build a bridge to the extensive Galerkin literature in fluid mechanics, and facilitate the development of physics-constrained reduced-order models from plasma data. △ Less

Submitted 9 January, 2021; originally announced January 2021.

Comments: arXiv admin note: text overlap with arXiv:2004.10389

Bilinear dynamic mode decomposition for quantum control

Authors: Andy Goldschmidt, Eurika Kaiser, Jonathan L. Dubois, Steven L. Brunton, J. Nathan Kutz

Abstract: Data-driven methods for establishing quantum optimal control (QOC) using time-dependent control pulses tailored to specific quantum dynamical systems and desired control objectives are critical for many emerging quantum technologies. We develop a data-driven regression procedure, bilinear dynamic mode decomposition (biDMD), that leverages time-series measurements to establish quantum system identi… ▽ More Data-driven methods for establishing quantum optimal control (QOC) using time-dependent control pulses tailored to specific quantum dynamical systems and desired control objectives are critical for many emerging quantum technologies. We develop a data-driven regression procedure, bilinear dynamic mode decomposition (biDMD), that leverages time-series measurements to establish quantum system identification for QOC. The biDMD optimization framework is a physics-informed regression that makes use of the known underlying Hamiltonian structure. Further, the biDMD can be modified to model both fast and slow sampling of control signals, the latter by way of stroboscopic sampling strategies. The biDMD method provides a flexible, interpretable, and adaptive regression framework for real-time, online implementation in quantum systems. Further, the method has strong theoretical connections to Koopman theory, which approximates non-linear dynamics with linear operators. In comparison with many machine learning paradigms, it requires minimal data and the biDMD model is easily updated as new data is collected. We demonstrate the efficacy and performance of the approach on a number of representative quantum systems, showing that it also matches experimental results. △ Less

Submitted 2 December, 2020; v1 submitted 27 October, 2020; originally announced October 2020.

Comments: 16 pages, 7 figures

Data-Driven Stabilization of Periodic Orbits

Authors: Jason J. Bramburger, J. Nathan Kutz, Steven L. Brunton

Abstract: Periodic orbits are among the simplest non-equilibrium solutions to dynamical systems, and they play a significant role in our modern understanding of the rich structures observed in many systems. For example, it is known that embedded within any chaotic attractor are infinitely many unstable periodic orbits (UPOs) and so a chaotic trajectory can be thought of as `jum**' from one UPO to another… ▽ More Periodic orbits are among the simplest non-equilibrium solutions to dynamical systems, and they play a significant role in our modern understanding of the rich structures observed in many systems. For example, it is known that embedded within any chaotic attractor are infinitely many unstable periodic orbits (UPOs) and so a chaotic trajectory can be thought of as `jum**' from one UPO to another in a seemingly unpredictable manner. A number of studies have sought to exploit the existence of these UPOs to control a chaotic system. These methods rely on introducing small, precise parameter manipulations each time the trajectory crosses a transverse section to the flow. Typically these methods suffer from the fact that they require a precise description of the Poincaré map** for the flow, which is a difficult task since there is no systematic way of producing such a map** associated to a given system. Here we employ recent model discovery methods for producing accurate and parsimonious parameter-dependent Poincaré map**s to stabilize UPOs in nonlinear dynamical systems. Specifically, we use the sparse identification of nonlinear dynamics (SINDy) method to frame model discovery as a sparse regression problem, which can be implemented in a computationally efficient manner. This approach provides an explicit Poincaré map** that faithfully describes the dynamics of the flow in the Poincaré section and can be used to identify UPOs. For each UPO, we then determine the parameter manipulations that stabilize this orbit. The utility of these methods are demonstrated on a variety of differential equations, including the Rössler system in a chaotic parameter regime. △ Less

Submitted 11 March, 2021; v1 submitted 21 October, 2020; originally announced October 2020.

Comments: Minor edits after review process. Current version is accepted to IEEE Access

Data-driven resolvent analysis

Authors: Benjamin Herrmann, Peter J. Baddoo, Richard Semaan, Steven L. Brunton, Beverley J. McKeon

Abstract: Resolvent analysis identifies the most responsive forcings and most receptive states of a dynamical system, in an input--output sense, based on its governing equations. Interest in the method has continued to grow during the past decade due to its potential to reveal structures in turbulent flows, to guide sensor/actuator placement, and for flow control applications. However, resolvent analysis re… ▽ More Resolvent analysis identifies the most responsive forcings and most receptive states of a dynamical system, in an input--output sense, based on its governing equations. Interest in the method has continued to grow during the past decade due to its potential to reveal structures in turbulent flows, to guide sensor/actuator placement, and for flow control applications. However, resolvent analysis requires access to high-fidelity numerical solvers to produce the linearized dynamics operator. In this work, we develop a purely data-driven algorithm to perform resolvent analysis to obtain the leading forcing and response modes, without recourse to the governing equations, but instead based on snapshots of the transient evolution of linearly stable flows. The formulation of our method follows from two established facts: $1)$ dynamic mode decomposition can approximate eigenvalues and eigenvectors of the underlying operator governing the evolution of a system from measurement data, and $2)$ a projection of the resolvent operator onto an invariant subspace can be built from this learned eigendecomposition. We demonstrate the method on numerical data of the linearized complex Ginzburg--Landau equation and of three-dimensional transitional channel flow, and discuss data requirements. The ability to perform resolvent analysis in a completely equation-free and adjoint-free manner will play a significant role in lowering the barrier of entry to resolvent research and applications. △ Less

Submitted 5 October, 2020; originally announced October 2020.

Go with the FLOW: Visualizing spatiotemporal dynamics in optical widefield calcium imaging

Authors: Nathaniel J Linden, Dennis R Tabuena, Nicholas A Steinmetz, William J Moody, Steven L Brunton, Bingni W Brunton

Abstract: Widefield calcium imaging has recently emerged as a powerful experimental technique to record coordinated large-scale brain activity. These measurements present a unique opportunity to characterize spatiotemporal coherent structures that underlie neural activity across many regions of the brain. In this work, we leverage analytic techniques from fluid dynamics to develop a visualization framework… ▽ More Widefield calcium imaging has recently emerged as a powerful experimental technique to record coordinated large-scale brain activity. These measurements present a unique opportunity to characterize spatiotemporal coherent structures that underlie neural activity across many regions of the brain. In this work, we leverage analytic techniques from fluid dynamics to develop a visualization framework that highlights features of flow across the cortex, map** wave fronts that may be correlated with behavioral events. First, we transform the time series of widefield calcium images into time-varying vector fields using optic flow. Next, we extract concise diagrams summarizing the dynamics, which we refer to as FLOW (flow lines in optical widefield imaging) portraits. These FLOW portraits provide an intuitive map of dynamic calcium activity, including regions of initiation and termination, as well as the direction and extent of activity spread. To extract these structures, we use the finite-time Lyapunov exponent (FTLE) technique developed to analyze time-varying manifolds in unsteady fluids. Importantly, our approach captures coherent structures that are poorly represented by traditional modal decomposition techniques. We demonstrate the application of FLOW portraits on three simple synthetic datasets and two widefield calcium imaging datasets, including cortical waves in the develo** mouse and spontaneous cortical activity in an adult mouse. △ Less

Submitted 24 June, 2021; v1 submitted 29 September, 2020; originally announced September 2020.

Comments: 25 pages, 8 figures

Sparse nonlinear models of chaotic electroconvection

Authors: Yifei Guan, Steven L. Brunton, Igor Novosselov

Abstract: Convection is a fundamental fluid transport phenomenon, where the large-scale motion of a fluid is driven, for example, by a thermal gradient or an electric potential. Modeling convection has given rise to the development of chaos theory and the reduced-order modeling of multiphysics systems; however, these models have been limited to relatively simple thermal convection phenomena. In this work, w… ▽ More Convection is a fundamental fluid transport phenomenon, where the large-scale motion of a fluid is driven, for example, by a thermal gradient or an electric potential. Modeling convection has given rise to the development of chaos theory and the reduced-order modeling of multiphysics systems; however, these models have been limited to relatively simple thermal convection phenomena. In this work, we develop a reduced-order model for chaotic electroconvection at high electric Rayleigh number. The chaos in this system is related to the standard Lorenz model obtained from Rayleigh-Benard convection, although our system is driven by a more complex three-way coupling between the fluid, the charge density, and the electric field. Coherent structures are extracted from temporally and spatially resolved charge density fields via proper orthogonal decomposition (POD). A nonlinear model is then developed for the chaotic time evolution of these coherent structures using the sparse identification of nonlinear dynamics (SINDy) algorithm, constrained to preserve the symmetries observed in the original system. The resulting model exhibits the dominant chaotic dynamics of the original high-dimensional system, capturing the essential nonlinear interactions with a simple reduced-order model. △ Less

Submitted 24 September, 2020; originally announced September 2020.

Comments: 14 pages, 4 figures

Automatic Differentiation to Simultaneously Identify Nonlinear Dynamics and Extract Noise Probability Distributions from Data

Authors: Kadierdan Kaheman, Steven L. Brunton, J. Nathan Kutz

Abstract: The sparse identification of nonlinear dynamics (SINDy) is a regression framework for the discovery of parsimonious dynamic models and governing equations from time-series data. As with all system identification methods, noisy measurements compromise the accuracy and robustness of the model discovery procedure. In this work, we develop a variant of the SINDy algorithm that integrates automatic dif… ▽ More The sparse identification of nonlinear dynamics (SINDy) is a regression framework for the discovery of parsimonious dynamic models and governing equations from time-series data. As with all system identification methods, noisy measurements compromise the accuracy and robustness of the model discovery procedure. In this work, we develop a variant of the SINDy algorithm that integrates automatic differentiation and recent time-step** constrained motivated by Rudy et al. for simultaneously (i) denoising the data, (ii) learning and parametrizing the noise probability distribution, and (iii) identifying the underlying parsimonious dynamical system responsible for generating the time-series data. Thus within an integrated optimization framework, noise can be separated from signal, resulting in an architecture that is approximately twice as robust to noise as state-of-the-art methods, handling as much as 40% noise on a given time-series signal and explicitly parametrizing the noise probability distribution. We demonstrate this approach on several numerical examples, from Lotka-Volterra models to the spatio-temporal Lorenz 96 model. Further, we show the method can identify a diversity of probability distributions including Gaussian, uniform, Gamma, and Rayleigh. △ Less

Submitted 29 September, 2020; v1 submitted 12 September, 2020; originally announced September 2020.

Comments: 30 pages, 16 figures, 3 tables

MSC Class: 93B30

Nonlinear stochastic modeling with Langevin regression

Authors: Jared L. Callaham, Jean-Christophe Loiseau, Georgios Rigas, Steven L. Brunton

Abstract: Many physical systems characterized by nonlinear multiscale interactions can be effectively modeled by treating unresolved degrees of freedom as random fluctuations. However, even when the microscopic governing equations and qualitative macroscopic behavior are known, it is often difficult to derive a stochastic model that is consistent with observations. This is especially true for systems such a… ▽ More Many physical systems characterized by nonlinear multiscale interactions can be effectively modeled by treating unresolved degrees of freedom as random fluctuations. However, even when the microscopic governing equations and qualitative macroscopic behavior are known, it is often difficult to derive a stochastic model that is consistent with observations. This is especially true for systems such as turbulence where the perturbations do not behave like Gaussian white noise, introducing non-Markovian behavior to the dynamics. We address these challenges with a framework for identifying interpretable stochastic nonlinear dynamics from experimental data, using both forward and adjoint Fokker-Planck equations to enforce statistical consistency. If the form of the Langevin equation is unknown, a simple sparsifying procedure can provide an appropriate functional form. We demonstrate that this method can effectively learn stochastic models in two artificial examples: recovering a nonlinear Langevin equation forced by colored noise and approximating the second-order dynamics of a particle in a double-well potential with the corresponding first-order bifurcation normal form. Finally, we apply the proposed method to experimental measurements of a turbulent bluff body wake and show that the statistical behavior of the center of pressure can be described by the dynamics of the corresponding laminar flow driven by nonlinear state-dependent noise. △ Less

Submitted 15 March, 2021; v1 submitted 2 September, 2020; originally announced September 2020.

Comments: 30 pages, 13 figures

Journal ref: Proceedings of the Royal Society A 477, 2250 (2021)

Bracketing brackets with bras and kets

Authors: Emily Clark, Angelie Vincent, J. Nathan Kutz, Steven L. Brunton

Abstract: Brackets are an essential component in aircraft manufacture and design, joining parts together, supporting weight, holding wires, and strengthening joints. Hundreds or thousands of unique brackets are used in every aircraft, but manufacturing a large number of distinct brackets is inefficient and expensive. Fortunately, many so-called "different" brackets are in fact very similar or even identical… ▽ More Brackets are an essential component in aircraft manufacture and design, joining parts together, supporting weight, holding wires, and strengthening joints. Hundreds or thousands of unique brackets are used in every aircraft, but manufacturing a large number of distinct brackets is inefficient and expensive. Fortunately, many so-called "different" brackets are in fact very similar or even identical to each other. In this manuscript, we present a data-driven framework for constructing a comparatively small group of representative brackets from a large catalog of current brackets, based on hierarchical clustering of bracket data. We find that for a modern commercial aircraft, the full set of brackets can be reduced by 30\% while still describing half of the test set sufficiently accurately. This approach is based on designing an inner product that quantifies a multi-objective similarity between two brackets, which are the "bra" and the "ket" of the inner product. Although we demonstrate this algorithm to reduce the number of brackets in aerospace manufacturing, it may be generally applied to any large-scale component standardization effort. △ Less

Submitted 31 July, 2020; originally announced August 2020.

Comments: 10 pages, 9 figures

Data-Driven Aerospace Engineering: Reframing the Industry with Machine Learning

Authors: Steven L. Brunton, J. Nathan Kutz, Krithika Manohar, Aleksandr Y. Aravkin, Kristi Morgansen, Jennifer Klemisch, Nicholas Goebel, James Buttrick, Jeffrey Poskin, Agnes Blom-Schieber, Thomas Hogan, Darren McDonald

Abstract: Data science, and machine learning in particular, is rapidly transforming the scientific and industrial landscapes. The aerospace industry is poised to capitalize on big data and machine learning, which excels at solving the types of multi-objective, constrained optimization problems that arise in aircraft design and manufacturing. Indeed, emerging methods in machine learning may be thought of as… ▽ More Data science, and machine learning in particular, is rapidly transforming the scientific and industrial landscapes. The aerospace industry is poised to capitalize on big data and machine learning, which excels at solving the types of multi-objective, constrained optimization problems that arise in aircraft design and manufacturing. Indeed, emerging methods in machine learning may be thought of as data-driven optimization techniques that are ideal for high-dimensional, non-convex, and constrained, multi-objective optimization problems, and that improve with increasing volumes of data. In this review, we will explore the opportunities and challenges of integrating data-driven science and engineering into the aerospace industry. Importantly, we will focus on the critical need for interpretable, generalizeable, explainable, and certifiable machine learning techniques for safety-critical applications. This review will include a retrospective, an assessment of the current state-of-the-art, and a roadmap looking forward. Recent algorithmic and technological trends will be explored in the context of critical challenges in aerospace design, manufacturing, verification, validation, and services. In addition, we will explore this landscape through several case studies in the aerospace industry. This document is the result of close collaboration between UW and Boeing to summarize past efforts and outline future opportunities. △ Less

Submitted 24 August, 2020; originally announced August 2020.

Comments: 35 pages, 16 figures

Deep learning to accelerate Maxwell's equations for inverse design of dielectric metasurfaces

Authors: Maksym V. Zhelyeznyakov, Steven L. Brunton, Arka Majumdar

Abstract: The inverse design of optical metasurfaces is a rapidly emerging field that has already shown great promise in miniaturizing conventional optics as well as develo** completely new optical functionalities. Such a design process relies on many forward simulations of a device's optical response in order to optimize its performance. We present a data-driven forward simulation framework for the inver… ▽ More The inverse design of optical metasurfaces is a rapidly emerging field that has already shown great promise in miniaturizing conventional optics as well as develo** completely new optical functionalities. Such a design process relies on many forward simulations of a device's optical response in order to optimize its performance. We present a data-driven forward simulation framework for the inverse design of metasurfaces that is more accurate than methods based on the local phase approximation, a factor of $10^4$ times faster and requires $15$ times less memory than mesh based solvers, and is not constrained to spheroidal scatterer geometries. We explore the scattered electromagnetic field distribution from wavelength scale cylindrical pillars, obtaining low-dimensional representations of our data via the singular value decomposition. We create a differentiable model fiting the input geometries and configurations of our metasurface scatterers to the low-dimensional representation of the output field. To validate our model, we inverse design two optical elements: a wavelength multiplexed element that focuses light for $λ=633$nm and produces an annular beam at $λ=400$nm and an extended depth of focus lens. △ Less

Submitted 24 August, 2020; originally announced August 2020.

Hierarchical Deep Learning of Multiscale Differential Equation Time-Steppers

Authors: Yuying Liu, J. Nathan Kutz, Steven L. Brunton

Abstract: Nonlinear differential equations rarely admit closed-form solutions, thus requiring numerical time-step** algorithms to approximate solutions. Further, many systems characterized by multiscale physics exhibit dynamics over a vast range of timescales, making numerical integration computationally expensive due to numerical stiffness. In this work, we develop a hierarchy of deep neural network time… ▽ More Nonlinear differential equations rarely admit closed-form solutions, thus requiring numerical time-step** algorithms to approximate solutions. Further, many systems characterized by multiscale physics exhibit dynamics over a vast range of timescales, making numerical integration computationally expensive due to numerical stiffness. In this work, we develop a hierarchy of deep neural network time-steppers to approximate the flow map of the dynamical system over a disparate range of time-scales. The resulting model is purely data-driven and leverages features of the multiscale dynamics, enabling numerical integration and forecasting that is both accurate and highly efficient. Moreover, similar ideas can be used to couple neural network-based models with classical numerical time-steppers. Our multiscale hierarchical time-step** scheme provides important advantages over current time-step** algorithms, including (i) circumventing numerical stiffness due to disparate time-scales, (ii) improved accuracy in comparison with leading neural-network architectures, (iii) efficiency in long-time simulation/forecasting due to explicit training of slow time-scale dynamics, and (iv) a flexible framework that is parallelizable and may be integrated with standard numerical time-step** algorithms. The method is demonstrated on a wide range of nonlinear dynamical systems, including the Van der Pol oscillator, the Lorenz system, the Kuramoto-Sivashinsky equation, and fluid flow pass a cylinder; audio and video signals are also explored. On the sequence generation examples, we benchmark our algorithm against state-of-the-art methods, such as LSTM, reservoir computing, and clockwork RNN. Despite the structural simplicity of our method, it outperforms competing methods on numerical integration. △ Less

Submitted 22 August, 2020; originally announced August 2020.

Comments: 22 pages, 10 figures

Data-driven Modeling of Rotating Detonation Waves

Authors: Ariana Mendible, James Koch, Henning Lange, Steven L. Brunton, J. Nathan Kutz

Abstract: The direct monitoring of a rotating detonation engine (RDE) combustion chamber has enabled the observation of combustion front dynamics that are composed of a number of co- and/or counter-rotating coherent traveling shock waves whose nonlinear mode-locking behavior exhibit bifurcations and instabilities which are not well understood. Computational fluid dynamics simulations are ubiquitous in chara… ▽ More The direct monitoring of a rotating detonation engine (RDE) combustion chamber has enabled the observation of combustion front dynamics that are composed of a number of co- and/or counter-rotating coherent traveling shock waves whose nonlinear mode-locking behavior exhibit bifurcations and instabilities which are not well understood. Computational fluid dynamics simulations are ubiquitous in characterizing the dynamics of RDE's reactive, compressible flow. Such simulations are prohibitively expensive when considering multiple engine geometries, different operating conditions, and the long-time dynamics of the mode-locking interactions. Reduced-order models (ROMs) provide a critically enabling simulation framework because they exploit low-rank structure in the data to minimize computational cost and allow for rapid parameterized studies and long-time simulations. However, ROMs are inherently limited by translational invariances manifest by the combustion waves present in RDEs. In this work, we leverage machine learning algorithms to discover moving coordinate frames into which the data is shifted, thus overcoming limitations imposed by the underlying translational invariance of the RDE and allowing for the application of traditional dimensionality reduction techniques. We explore a diverse suite of data-driven ROM strategies for characterizing the complex shock wave dynamics and interactions in the RDE. Specifically, we employ the dynamic mode decomposition and a deep Koopman embedding to give new modeling insights and understanding of combustion wave interactions in RDEs. △ Less

Submitted 12 August, 2020; originally announced August 2020.

Comments: 17 pages, 12 figures

Journal ref: Phys. Rev. Fluids 6, 050507 (2021)

Geometric and Control Optimization of a Two Cross-Flow Turbine Array

Authors: Isabel Scherl, Benjamin Strom, Steven L. Brunton, Brian L. Polagye

Abstract: Cross-flow turbines, also known as vertical-axis turbines, convert the kinetic energy in moving fluid to mechanical energy using blades that rotate about an axis perpendicular to the incoming flow. In this work, the performance of a two-turbine array in a recirculating water channel was experimentally optimized across sixty-four unique array configurations. For each configuration, turbine performa… ▽ More Cross-flow turbines, also known as vertical-axis turbines, convert the kinetic energy in moving fluid to mechanical energy using blades that rotate about an axis perpendicular to the incoming flow. In this work, the performance of a two-turbine array in a recirculating water channel was experimentally optimized across sixty-four unique array configurations. For each configuration, turbine performance was optimized using tip-speed ratio control, where the rotation rate for each turbine is optimized individually, and using coordinated control, where the turbines are optimized to operate at synchronous rotation rates, but with a phase difference. For each configuration and control strategy, the consequences of co- and counter-rotation were also evaluated. We hypothesize how array configurations and control cases influence interactions between turbines and impact array performance. △ Less

Submitted 17 July, 2020; originally announced July 2020.

Physics-informed machine learning for sensor fault detection with flight test data

Authors: Brian M. de Silva, Jared Callaham, Jonathan Jonker, Nicholas Goebel, Jennifer Klemisch, Darren McDonald, Nathan Hicks, J. Nathan Kutz, Steven L. Brunton, Aleksandr Y. Aravkin

Abstract: We develop data-driven algorithms to fully automate sensor fault detection in systems governed by underlying physics. The proposed machine learning method uses a time series of typical behavior to approximate the evolution of measurements of interest by a linear time-invariant system. Given additional data from related sensors, a Kalman observer is used to maintain a separate real-time estimate of… ▽ More We develop data-driven algorithms to fully automate sensor fault detection in systems governed by underlying physics. The proposed machine learning method uses a time series of typical behavior to approximate the evolution of measurements of interest by a linear time-invariant system. Given additional data from related sensors, a Kalman observer is used to maintain a separate real-time estimate of the measurement of interest. Sustained deviation between the measurements and the estimate is used to detect anomalous behavior. A decision tree, informed by integrating other sensor measurement values, is used to determine the amount of deviation required to identify a sensor fault. We validate the method by applying it to three test systems exhibiting various types of sensor faults: commercial flight test data, an unsteady aerodynamics model with dynamic stall, and a model for longitudinal flight dynamics forced by atmospheric turbulence. In the latter two cases we test fault detection for several prototypical failure modes. The combination of a learned dynamical model with the automated decision tree accurately detects sensor faults in each case. △ Less

Submitted 23 June, 2020; originally announced June 2020.

Comments: 21 pages, 10 figures, submitted to AIAA

Deep reinforcement learning for optical systems: A case study of mode-locked lasers

Authors: Chang Sun, Eurika Kaiser, Steven L. Brunton, J. Nathan Kutz

Abstract: We demonstrate that deep reinforcement learning (deep RL) provides a highly effective strategy for the control and self-tuning of optical systems. Deep RL integrates the two leading machine learning architectures of deep neural networks and reinforcement learning to produce robust and stable learning for control. Deep RL is ideally suited for optical systems as the tuning and control relies on int… ▽ More We demonstrate that deep reinforcement learning (deep RL) provides a highly effective strategy for the control and self-tuning of optical systems. Deep RL integrates the two leading machine learning architectures of deep neural networks and reinforcement learning to produce robust and stable learning for control. Deep RL is ideally suited for optical systems as the tuning and control relies on interactions with its environment with a goal-oriented objective to achieve optimal immediate or delayed rewards. This allows the optical system to recognize bi-stable structures and navigate, via trajectory planning, to optimally performing solutions, the first such algorithm demonstrated to do so in optical systems. We specifically demonstrate the deep RL architecture on a mode-locked laser, where robust self-tuning and control can be established through access of the deep RL agent to its waveplates and polarizers. We further integrate transfer learning to help the deep RL agent rapidly learn new parameter regimes and generalize its control authority. Additionally, the deep RL learning can be easily integrated with other control paradigms to provide a broad framework to control any optical system. △ Less

Submitted 9 June, 2020; originally announced June 2020.

Principal component trajectories for modeling spectrally-continuous dynamics as forced linear systems

Authors: Daniel Dylewsky, Eurika Kaiser, Steven L. Brunton, J. Nathan Kutz

Abstract: Delay embeddings of time series data have emerged as a promising coordinate basis for data-driven estimation of the Koopman operator, which seeks a linear representation for observed nonlinear dynamics. Recent work has demonstrated the efficacy of Dynamic Mode Decomposition (DMD) for obtaining finite-dimensional Koopman approximations in delay coordinates. In this paper we demonstrate how nonlinea… ▽ More Delay embeddings of time series data have emerged as a promising coordinate basis for data-driven estimation of the Koopman operator, which seeks a linear representation for observed nonlinear dynamics. Recent work has demonstrated the efficacy of Dynamic Mode Decomposition (DMD) for obtaining finite-dimensional Koopman approximations in delay coordinates. In this paper we demonstrate how nonlinear dynamics with sparse Fourier spectra can be (i) represented by a superposition of principal component trajectories (PCT) and (ii) modeled by DMD in this coordinate space. For continuous or mixed (discrete and continuous) spectra, DMD can be augmented with an external forcing term. We present a method for learning linear control models in delay coordinates while simultaneously discovering the corresponding exogeneous forcing signal in a fully unsupervised manner. This extends the existing DMD with control (DMDc) algorithm to cases where a control signal is not known a priori. We provide examples to validate the learned forcing against a known ground truth and illustrate their statistical similarity. Finally we offer a demonstration of this method applied to real-world power grid load data to show its utility for diagnostics and interpretation on systems in which somewhat periodic behavior is strongly forced by unknown and unmeasurable environmental variables. △ Less

Submitted 12 January, 2022; v1 submitted 28 May, 2020; originally announced May 2020.

SINDy-BVP: Sparse Identification of Nonlinear Dynamics for Boundary Value Problems

Authors: Daniel E. Shea, Steven L. Brunton, J. Nathan Kutz

Abstract: We develop a data-driven model discovery and system identification technique for spatially-dependent boundary value problems (BVPs). Specifically, we leverage the sparse identification of nonlinear dynamics (SINDy) algorithm and group sparse regression techniques with a set of forcing functions and corresponding state variable measurements to yield a parsimonious model of the system. The approach… ▽ More We develop a data-driven model discovery and system identification technique for spatially-dependent boundary value problems (BVPs). Specifically, we leverage the sparse identification of nonlinear dynamics (SINDy) algorithm and group sparse regression techniques with a set of forcing functions and corresponding state variable measurements to yield a parsimonious model of the system. The approach models forced systems governed by linear or nonlinear operators of the form $L[u(x)] = f(x)$ on a prescribed domain $x \in [a, b]$. We demonstrate the approach on a range of example systems, including Sturm-Liouville operators, beam theory (elasticity), and a class of nonlinear BVPs. The generated data-driven model is used to infer both the operator and/or spatially-dependent parameters that describe the heterogenous, physical quantities of the system. Our SINDy-BVP framework will enables the characterization of a broad range of systems, including for instance, the discovery of anisotropic materials with heterogeneous variability. △ Less

Submitted 21 May, 2020; v1 submitted 19 May, 2020; originally announced May 2020.

Journal ref: Phys. Rev. Research 3, 023255 (2021)

Multi-fidelity sensor selection: Greedy algorithms to place cheap and expensive sensors with cost constraints

Authors: Emily Clark, Steven L. Brunton, J. Nathan Kutz

Abstract: We develop greedy algorithms to approximate the optimal solution to the multi-fidelity sensor selection problem, which is a cost constrained optimization problem prescribing the placement and number of cheap (low signal-to-noise) and expensive (high signal-to-noise) sensors in an environment or state space. Specifically, we evaluate the composition of cheap and expensive sensors, along with their… ▽ More We develop greedy algorithms to approximate the optimal solution to the multi-fidelity sensor selection problem, which is a cost constrained optimization problem prescribing the placement and number of cheap (low signal-to-noise) and expensive (high signal-to-noise) sensors in an environment or state space. Specifically, we evaluate the composition of cheap and expensive sensors, along with their placement, required to achieve accurate reconstruction of a high-dimensional state. We use the column-pivoted QR decomposition to obtain preliminary sensor positions. How many of each type of sensor to use is highly dependent upon the sensor noise levels, sensor costs, overall cost budget, and the singular value spectrum of the data measured. Such nuances allow us to provide sensor selection recommendations based on computational results for asymptotic regions of parameter space. We also present a systematic exploration of the effects of the number of modes and sensors on reconstruction error when using one type of sensor. Our extensive exploration of multi-fidelity sensor composition as a function of data characteristics is the first of its kind to provide guidelines towards optimal multi-fidelity sensor selection. △ Less

Submitted 7 May, 2020; originally announced May 2020.

Comments: 11 pages, 12 figures

Phase-based control of periodic fluid flows

Authors: Aditya G. Nair, Kunihiko Taira, Bingni W. Brunton, Steven L. Brunton

Abstract: Fluid flows play a central role in scientific and technological development, and many of these flows are characterized by a dominant oscillation, such as the vortex shedding in the wake of nearly all transportation vehicles. The ability to control vortex shedding is critical to improve the aerodynamic performance of these unsteady fluid flow systems. This goal requires precise characterization of… ▽ More Fluid flows play a central role in scientific and technological development, and many of these flows are characterized by a dominant oscillation, such as the vortex shedding in the wake of nearly all transportation vehicles. The ability to control vortex shedding is critical to improve the aerodynamic performance of these unsteady fluid flow systems. This goal requires precise characterization of how perturbations affect the long-time phase of the oscillatory flow, as well as the ability to control transient behaviors. In this work, we develop an energy-efficient flow control strategy to rapidly alter the oscillation phase of time-periodic fluid flows, leveraging theory developed for periodic biological systems. First, we perform a phase-sensitivity analysis to construct a reduced-order model for the response of the flow oscillation to impulsive control inputs at various phases. Next, we introduce two control strategies for real-time phase control based on the phase-sensitivity function: 1) optimal phase control, obtained by solving the Euler-Lagrange equations as a two-point boundary value problem, and 2) model-predictive control (MPC). Our approach is demonstrated for two unsteady flow systems, the incompressible laminar flow past a circular cylinder and the flow past an airfoil. We show that effective phase control may be achieved with several actuation strategies, including blowing and rotary control. Moreover, our control approach uses realistic measurements of the lift force on the body, rather than requiring high-dimensional measurements of the full flow field. △ Less

Submitted 22 April, 2020; originally announced April 2020.

Comments: 23 pages, 11 figures

Physics-constrained, low-dimensional models for MHD: First-principles and data-driven approaches

Authors: Alan A. Kaptanoglu, Kyle D. Morgan, Chris J. Hansen, Steven L. Brunton

Abstract: Plasmas are highly nonlinear and multi-scale, motivating a hierarchy of models to understand and describe their behavior. However, there is a scarcity of plasma models of lower fidelity than magnetohydrodynamics (MHD), although these reduced models hold promise for understanding key physical mechanisms, efficient computation, and real-time optimization and control. Galerkin models, obtained by pro… ▽ More Plasmas are highly nonlinear and multi-scale, motivating a hierarchy of models to understand and describe their behavior. However, there is a scarcity of plasma models of lower fidelity than magnetohydrodynamics (MHD), although these reduced models hold promise for understanding key physical mechanisms, efficient computation, and real-time optimization and control. Galerkin models, obtained by projection of the MHD equations onto a truncated modal basis, and data-driven models, obtained by modern machine learning and system identification, can furnish this gap in the lower levels of the model hierarchy. This work develops a reduced-order modeling framework for compressible plasmas, leveraging decades of progress in projection-based and data-driven modeling of fluids. We begin by formalizing projection-based model reduction for nonlinear MHD systems. To avoid separate modal decompositions for the magnetic, velocity, and pressure fields, we introduce an energy inner product to synthesize all of the fields into a dimensionally-consistent, reduced-order basis. Next, we obtain an analytic model by Galerkin projection of the Hall-MHD equations onto these modes. We illustrate how global conservation laws constrain the model parameters, revealing symmetries that can be enforced in data-driven models, directly connecting these models to the underlying physics. We demonstrate the effectiveness of this approach on data from high-fidelity numerical simulations of a 3D spheromak experiment. This manuscript builds a bridge to the extensive Galerkin literature in fluid mechanics, and facilitates future principled development of projection-based and data-driven models for plasmas. △ Less

Submitted 15 July, 2021; v1 submitted 22 April, 2020; originally announced April 2020.

Journal ref: Phys. Rev. E 104, 015206 (2021)

PySINDy: A Python package for the Sparse Identification of Nonlinear Dynamics from Data

Authors: Brian M. de Silva, Kathleen Champion, Markus Quade, Jean-Christophe Loiseau, J. Nathan Kutz, Steven L. Brunton

Abstract: PySINDy is a Python package for the discovery of governing dynamical systems models from data. In particular, PySINDy provides tools for applying the sparse identification of nonlinear dynamics (SINDy) (Brunton et al. 2016) approach to model discovery. In this work we provide a brief description of the mathematical underpinnings of SINDy, an overview and demonstration of the features implemented i… ▽ More PySINDy is a Python package for the discovery of governing dynamical systems models from data. In particular, PySINDy provides tools for applying the sparse identification of nonlinear dynamics (SINDy) (Brunton et al. 2016) approach to model discovery. In this work we provide a brief description of the mathematical underpinnings of SINDy, an overview and demonstration of the features implemented in PySINDy (with code examples), practical advice for users, and a list of potential extensions to PySINDy. Software is available at https://github.com/dynamicslab/pysindy. △ Less

Submitted 17 April, 2020; originally announced April 2020.

Multiresolution Convolutional Autoencoders

Authors: Yuying Liu, Colin Ponce, Steven L. Brunton, J. Nathan Kutz

Abstract: We propose a multi-resolution convolutional autoencoder (MrCAE) architecture that integrates and leverages three highly successful mathematical architectures: (i) multigrid methods, (ii) convolutional autoencoders and (iii) transfer learning. The method provides an adaptive, hierarchical architecture that capitalizes on a progressive training approach for multiscale spatio-temporal data. This fram… ▽ More We propose a multi-resolution convolutional autoencoder (MrCAE) architecture that integrates and leverages three highly successful mathematical architectures: (i) multigrid methods, (ii) convolutional autoencoders and (iii) transfer learning. The method provides an adaptive, hierarchical architecture that capitalizes on a progressive training approach for multiscale spatio-temporal data. This framework allows for inputs across multiple scales: starting from a compact (small number of weights) network architecture and low-resolution data, our network progressively deepens and widens itself in a principled manner to encode new information in the higher resolution data based on its current performance of reconstruction. Basic transfer learning techniques are applied to ensure information learned from previous training steps can be rapidly transferred to the larger network. As a result, the network can dynamically capture different scaled features at different depths of the network. The performance gains of this adaptive multiscale architecture are illustrated through a sequence of numerical experiments on synthetic examples and real-world spatial-temporal data. △ Less

Submitted 10 April, 2020; originally announced April 2020.

Comments: 20 pages, 11 figures

SINDy-PI: A Robust Algorithm for Parallel Implicit Sparse Identification of Nonlinear Dynamics

Authors: Kadierdan Kaheman, J. Nathan Kutz, Steven L. Brunton

Abstract: Accurately modeling the nonlinear dynamics of a system from measurement data is a challenging yet vital topic. The sparse identification of nonlinear dynamics (SINDy) algorithm is one approach to discover dynamical systems models from data. Although extensions have been developed to identify implicit dynamics, or dynamics described by rational functions, these extensions are extremely sensitive to… ▽ More Accurately modeling the nonlinear dynamics of a system from measurement data is a challenging yet vital topic. The sparse identification of nonlinear dynamics (SINDy) algorithm is one approach to discover dynamical systems models from data. Although extensions have been developed to identify implicit dynamics, or dynamics described by rational functions, these extensions are extremely sensitive to noise. In this work, we develop SINDy-PI (parallel, implicit), a robust variant of the SINDy algorithm to identify implicit dynamics and rational nonlinearities. The SINDy-PI framework includes multiple optimization algorithms and a principled approach to model selection. We demonstrate the ability of this algorithm to learn implicit ordinary and partial differential equations and conservation laws from limited and noisy data. In particular, we show that the proposed approach is several orders of magnitude more noise robust than previous approaches, and may be used to identify a class of complex ODE and PDE dynamics that were previously unattainable with SINDy, including for the double pendulum dynamics and the Belousov Zhabotinsky (BZ) reaction. △ Less

Submitted 29 September, 2020; v1 submitted 5 April, 2020; originally announced April 2020.

Comments: 25 pages, 9 figures, 5 tables

MSC Class: 93B30

From Fourier to Koopman: Spectral Methods for Long-term Time Series Prediction

Authors: Henning Lange, Steven L. Brunton, Nathan Kutz

Abstract: We propose spectral methods for long-term forecasting of temporal signals stemming from linear and nonlinear quasi-periodic dynamical systems. For linear signals, we introduce an algorithm with similarities to the Fourier transform but which does not rely on periodicity assumptions, allowing for forecasting given potentially arbitrary sampling intervals. We then extend this algorithm to handle non… ▽ More We propose spectral methods for long-term forecasting of temporal signals stemming from linear and nonlinear quasi-periodic dynamical systems. For linear signals, we introduce an algorithm with similarities to the Fourier transform but which does not rely on periodicity assumptions, allowing for forecasting given potentially arbitrary sampling intervals. We then extend this algorithm to handle nonlinearities by leveraging Koopman theory. The resulting algorithm performs a spectral decomposition in a nonlinear, data-dependent basis. The optimization objective for both algorithms is highly non-convex. However, expressing the objective in the frequency domain allows us to compute global optima of the error surface in a scalable and efficient manner, partially by exploiting the computational properties of the Fast Fourier Transform. Because of their close relation to Bayesian Spectral Analysis, uncertainty quantification metrics are a natural byproduct of the spectral forecasting methods. We extensively benchmark these algorithms against other leading forecasting methods on a range of synthetic experiments as well as in the context of real-world power systems and fluid flows. △ Less

Submitted 1 April, 2020; originally announced April 2020.

Sensor Selection With Cost Constraints for Dynamically Relevant Bases

Authors: Emily Clark, J. Nathan Kutz, Steven L. Brunton

Abstract: We consider cost-constrained sparse sensor selection for full-state reconstruction, applying a well-known greedy algorithm to dynamical systems for which the usual singular value decomposition (SVD) basis may not be available or preferred. We apply the cost-modified, column-pivoted QR decomposition to a physically relevant basis -- the pivots correspond to sensor locations, and these locations are… ▽ More We consider cost-constrained sparse sensor selection for full-state reconstruction, applying a well-known greedy algorithm to dynamical systems for which the usual singular value decomposition (SVD) basis may not be available or preferred. We apply the cost-modified, column-pivoted QR decomposition to a physically relevant basis -- the pivots correspond to sensor locations, and these locations are penalized with a heterogeneous cost function. In considering different bases, we are able to account for the dynamics of the particular system, yielding sensor arrays that are nearly Pareto optimal in sensor cost and performance in the chosen basis. This flexibility extends our framework to include actuation and dynamic estimation, and to select sensors without training data. We provide three examples from the physical and engineering sciences and evaluate sensor selection in three dynamically relevant bases: truncated balanced modes for control systems, dynamic mode decomposition (DMD) modes, and a basis of analytic modes. We find that these bases all yield effective sensor arrays and reconstructions for their respective systems. When possible, we compare to results using an SVD basis and evaluate tradeoffs between methods. △ Less

Submitted 17 March, 2020; originally announced March 2020.

Comments: 12 pages, 12 figures

Data-driven nonlinear aeroelastic models of morphing wings for control

Authors: Nicola Fonzi, Steven L. Brunton, Urban Fasel

Abstract: Accurate and efficient aeroelastic models are critically important for enabling the optimization and control of highly flexible aerospace structures, which are expected to become pervasive in future transportation and energy systems. Advanced materials and morphing wing technologies are resulting in next-generation aeroelastic systems that are characterized by highly-coupled and nonlinear interact… ▽ More Accurate and efficient aeroelastic models are critically important for enabling the optimization and control of highly flexible aerospace structures, which are expected to become pervasive in future transportation and energy systems. Advanced materials and morphing wing technologies are resulting in next-generation aeroelastic systems that are characterized by highly-coupled and nonlinear interactions between the aerodynamic and structural dynamics. In this work, we leverage emerging data-driven modeling techniques to develop highly accurate and tractable reduced-order aeroelastic models that are valid over a wide range of operating conditions and are suitable for control. In particular, we develop two extensions to the recent dynamic mode decomposition with control (DMDc) algorithm to make it suitable for flexible aeroelastic systems: 1) we introduce a formulation to handle algebraic equations, and 2) we develop an interpolation scheme to smoothly connect several linear DMDc models developed in different operating regimes. Thus, the innovation lies in accurately modeling the nonlinearities of the coupled aerostructural dynamics over multiple operating regimes, not restricting the validity of the model to a narrow region around a linearization point. We demonstrate this approach on a high-fidelity, three-dimensional numerical model of an airborne wind energy (AWE) system, although the methods are generally applicable to any highly coupled aeroelastic system or dynamical system operating over multiple operating regimes. Our proposed modeling framework results in real-time prediction of nonlinear unsteady aeroelastic responses of flexible aerospace structures, and we demonstrate the enhanced model performance for model predictive control. Thus, the proposed architecture may help enable the widespread adoption of next-generation morphing wing technologies. △ Less

Submitted 8 February, 2020; originally announced February 2020.

Modeling synchronization in forced turbulent oscillator flows

Authors: Benjamin Herrmann, Philipp Oswald, Richard Semaan, Steven L. Brunton

Abstract: Periodically forced, oscillatory fluid flows have been the focus of intense research for decades due to their richness as a nonlinear dynamical system and their relevance to applications in transportation, aeronautics, and energy conversion. Recently, it has been observed that turbulent bluff-body wakes exhibit a subharmonic resonant response when excited with specific spatial symmetries at twice… ▽ More Periodically forced, oscillatory fluid flows have been the focus of intense research for decades due to their richness as a nonlinear dynamical system and their relevance to applications in transportation, aeronautics, and energy conversion. Recently, it has been observed that turbulent bluff-body wakes exhibit a subharmonic resonant response when excited with specific spatial symmetries at twice the natural vortex shedding frequency, which is hypothesized to be caused by triadic interactions. The focus of this paper is to provide new physical insight into the dynamics of turbulent oscillator flows, based on improved mechanistic models informed by a comprehensive experimental study of the turbulent wake behind a D-shaped body under periodic forcing. We confirm for the first time the role of resonant triadic interactions in the forced flow by studying the dominant components in the power spectra across multiple excitation frequencies and amplitudes. We then develop an extended Stuart-Landau model for the forced global wake mode, incorporating parametric and non-harmonic forcing. This model captures the system dynamics and reveals the boundaries of multiple synchronization regions. Further, it is possible to identify model coefficients from sparse measurement data, making it applicable to a wide range of turbulent oscillator flows. We believe these generalized synchronization models will be valuable for prediction, control, and understanding of the underlying physics in this ubiquitous class of flows. △ Less

Submitted 31 January, 2020; originally announced January 2020.

Comments: 10 pages, 5 figures

Learning dominant physical processes with data-driven balance models

Authors: Jared L. Callaham, James V. Koch, Bingni W. Brunton, J. Nathan Kutz, Steven L. Brunton

Abstract: Throughout the history of science, physics-based modeling has relied on judiciously approximating observed dynamics as a balance between a few dominant processes. However, this traditional approach is mathematically cumbersome and only applies in asymptotic regimes where there is a strict separation of scales in the physics. Here, we automate and generalize this approach to non-asymptotic regimes… ▽ More Throughout the history of science, physics-based modeling has relied on judiciously approximating observed dynamics as a balance between a few dominant processes. However, this traditional approach is mathematically cumbersome and only applies in asymptotic regimes where there is a strict separation of scales in the physics. Here, we automate and generalize this approach to non-asymptotic regimes by introducing the idea of an equation space, in which different local balances appear as distinct subspace clusters. Unsupervised learning can then automatically identify regions where groups of terms may be neglected. We show that our data-driven balance models successfully delineate dominant balance physics in a much richer class of systems. In particular, this approach uncovers key mechanistic models in turbulence, combustion, nonlinear optics, geophysical fluids, and neuroscience. △ Less

Submitted 19 January, 2021; v1 submitted 27 January, 2020; originally announced January 2020.

Comments: 30 pages, 13 figures

Journal ref: Nature Communications 12, 1016 (2021)

Phase-consistent dynamic mode decomposition from multiple overlap** spatial domains

Authors: Aditya G. Nair, Benjamin Strom, Bingni W. Brunton, Steven L. Brunton

Abstract: Dynamic mode decomposition (DMD) provides a principled approach to extract physically interpretable spatial modes from time-resolved flow field data, along with a linear model for how the amplitudes of these modes evolve in time. Recently, DMD has been extended to work with more realistic data that is under-resolved either in time or space, or with data collected in the same spatial domain over mu… ▽ More Dynamic mode decomposition (DMD) provides a principled approach to extract physically interpretable spatial modes from time-resolved flow field data, along with a linear model for how the amplitudes of these modes evolve in time. Recently, DMD has been extended to work with more realistic data that is under-resolved either in time or space, or with data collected in the same spatial domain over multiple independent time windows. In this work, we develop an extension to DMD to synthesize globally consistent modes from velocity fields collected independently in multiple partially overlap** spatial domains. We propose a tractable optimization to identify modes that span multiple windows and align their phases to be consistent in the overlap** regions. First, we demonstrate this approach on data from direct numerical simulation, where it is possible to split the data into overlap** domains and benchmark against ground-truth modes. We consider the laminar flow past a cylinder as an example with distinct frequencies, along with the spatially develo** mixing layer, which exhibits a frequency spectrum that evolves continuously as the measurement window moves downstream. Next, we analyze experimental velocity fields from PIV in six overlap** domains in the wake of a cross-flow turbine. On the numerical examples, we demonstrate the robustness of this approach to increasing measurement noise and decreasing size of the overlap regions. In all cases, it is possible to obtain a phase-aligned, composite reconstruction of the full time-resolved flow field from the phase-consistent modes over the entire domain. △ Less

Submitted 14 January, 2020; originally announced January 2020.

Comments: 20 pages, 11 figures

Journal ref: Phys. Rev. Fluids 5, 074702 (2020)

Learning Precisely Timed Feedforward Control of the Sensor-Denied Inverted Pendulum

Authors: Thomas L. Mohren, Thomas L. Daniel, Steven L. Brunton

Abstract: Time delays due to signal latency, computational complexity, and sensor-denied environments, pose a critical challenge in both engineered and biological control systems. In this work, we investigate biologically inspired strategies to develop precisely timed feedforward control laws for engineered systems with large time delays. We demonstrate this approach on the nonlinear pendulum with partially… ▽ More Time delays due to signal latency, computational complexity, and sensor-denied environments, pose a critical challenge in both engineered and biological control systems. In this work, we investigate biologically inspired strategies to develop precisely timed feedforward control laws for engineered systems with large time delays. We demonstrate this approach on the nonlinear pendulum with partially denied observations, so that it is only possible to measure the state of the system near the upright position. Given a large disturbance that overwhelms the local feedback controller, it is necessary to add or remove energy from the pendulum so that it returns to the upright position after one full revolution. The partial observation near the upright position introduces a significant delay between observations and the region where actuation is most effective. Thus, we develop a learning algorithm that integrates sensor information into a precisely timed feedforward control signal to overcome this delay with minimal computation, training data, and set of control decisions. This simple controller can serve as a model for many biological systems, and can be implemented in engineered systems with time delays. △ Less

Submitted 10 December, 2019; originally announced December 2019.

Comments: 6 pages, 5 figures

Characterizing Magnetized Plasmas with Dynamic Mode Decomposition

Authors: Alan A. Kaptanoglu, Kyle D. Morgan, Chris J. Hansen, Steven L. Brunton

Abstract: Accurate and efficient plasma models are essential to understand and control experimental devices. Existing magnetohydrodynamic or kinetic models are nonlinear, computationally intensive, and can be difficult to interpret, while often only approximating the true dynamics. In this work, data-driven techniques recently developed in the field of fluid dynamics are leveraged to develop interpretable r… ▽ More Accurate and efficient plasma models are essential to understand and control experimental devices. Existing magnetohydrodynamic or kinetic models are nonlinear, computationally intensive, and can be difficult to interpret, while often only approximating the true dynamics. In this work, data-driven techniques recently developed in the field of fluid dynamics are leveraged to develop interpretable reduced-order models of plasmas that strike a balance between accuracy and efficiency. In particular, dynamic mode decomposition (DMD) is used to extract spatio-temporal magnetic coherent structures from the experimental and simulation datasets of the HIT-SI experiment. Three-dimensional magnetic surface probes from the HIT-SI experiment are analyzed, along with companion simulations with synthetic internal magnetic probes. A number of leading variants of the DMD algorithm are compared, including the sparsity-promoting and optimized DMD. Optimized DMD results in the highest overall prediction accuracy, while sparsity-promoting DMD yields physically interpretable models that avoid overfitting. These DMD algorithms uncover several coherent magnetic modes that provide new physical insights into the inner plasma structure. These modes were subsequently used to discover a previously unobserved three-dimensional structure in the simulation, rotating at the second injector harmonic. Finally, using data from probes at experimentally accessible locations, DMD identifies a resistive kink mode, a ubiquitous instability seen in magnetized plasmas. △ Less

Submitted 15 November, 2019; originally announced November 2019.

Deep Learning Models for Global Coordinate Transformations that Linearize PDEs

Authors: Craig Gin, Bethany Lusch, Steven L. Brunton, J. Nathan Kutz

Abstract: We develop a deep autoencoder architecture that can be used to find a coordinate transformation which turns a nonlinear PDE into a linear PDE. Our architecture is motivated by the linearizing transformations provided by the Cole-Hopf transform for Burgers equation and the inverse scattering transform for completely integrable PDEs. By leveraging a residual network architecture, a near-identity tra… ▽ More We develop a deep autoencoder architecture that can be used to find a coordinate transformation which turns a nonlinear PDE into a linear PDE. Our architecture is motivated by the linearizing transformations provided by the Cole-Hopf transform for Burgers equation and the inverse scattering transform for completely integrable PDEs. By leveraging a residual network architecture, a near-identity transformation can be exploited to encode intrinsic coordinates in which the dynamics are linear. The resulting dynamics are given by a Koopman operator matrix $\mathbf{K}$. The decoder allows us to transform back to the original coordinates as well. Multiple time step prediction can be performed by repeated multiplication by the matrix $\mathbf{K}$ in the intrinsic coordinates. We demonstrate our method on a number of examples, including the heat equation and Burgers equation, as well as the substantially more challenging Kuramoto-Sivashinsky equation, showing that our method provides a robust architecture for discovering interpretable, linearizing transforms for nonlinear PDEs. △ Less

Submitted 6 November, 2019; originally announced November 2019.

Comments: 23 pages, 18 figures

MSC Class: 35A22; 35A35; 37M99; 65P99; 68T99

Dimensionality Reduction and Reduced Order Modeling for Traveling Wave Physics

Authors: Ariana Mendible, Steven L. Brunton, Aleksandr Y. Aravkin, Wes Lowrie, J. Nathan Kutz

Abstract: We develop an unsupervised machine learning algorithm for the automated discovery and identification of traveling waves in spatio-temporal systems governed by partial differential equations (PDEs). Our method uses sparse regression and subspace clustering to robustly identify translational invariances that can be leveraged to build improved reduced order models (ROMs). Invariances, whether transla… ▽ More We develop an unsupervised machine learning algorithm for the automated discovery and identification of traveling waves in spatio-temporal systems governed by partial differential equations (PDEs). Our method uses sparse regression and subspace clustering to robustly identify translational invariances that can be leveraged to build improved reduced order models (ROMs). Invariances, whether translational or rotational, are well known to compromise the ability of ROMs to produce accurate and/or low-rank representations of the spatio-temporal dynamics. However, by discovering translations in a principled way, data can be shifted into a coordinate systems where quality, low-dimensional ROMs can be constructed. This approach can be used on either numerical or experimental data with or without knowledge of the governing equations. We demonstrate our method on a variety of PDEs of increasing difficulty, taken from the field of fluid dynamics, showing the efficacy and robustness of the proposed approach. △ Less

Submitted 18 May, 2020; v1 submitted 1 November, 2019; originally announced November 2019.

Comments: 14 pages, 8 figures