Showing 1–50 of 84 results for author: Brunton, S L

Machine Learning in Viscoelastic Fluids via Energy-Based Kernel Embedding

Authors: Samuel E. Otto, Cassio M. Oishi, Fabio Amaral, Steven L. Brunton, J. Nathan Kutz

Abstract: The ability to measure differences in collected data is of fundamental importance for quantitative science and machine learning, motivating the establishment of metrics grounded in physical principles. In this study, we focus on the development of such metrics for viscoelastic fluid flows governed by a large class of linear and nonlinear stress models. To do this, we introduce a kernel function co… ▽ More The ability to measure differences in collected data is of fundamental importance for quantitative science and machine learning, motivating the establishment of metrics grounded in physical principles. In this study, we focus on the development of such metrics for viscoelastic fluid flows governed by a large class of linear and nonlinear stress models. To do this, we introduce a kernel function corresponding to a given viscoelastic stress model that implicitly embeds flowfield snapshots into a Reproducing Kernel Hilbert Space (RKHS) whose squared norm equals the total mechanical energy. Working implicitly with lifted representations in the RKHS via the kernel function provides natural and unambiguous metrics for distances and angles between flowfields without the need for hyperparameter tuning. Additionally, we present a solution to the preimage problem for our kernels, enabling accurate reconstruction of flowfields from their RKHS representations. Through numerical experiments on an unsteady viscoelastic lid-driven cavity flow, we demonstrate the utility of our kernels for extracting energetically-dominant coherent structures in viscoelastic flows across a range of Reynolds and Weissenberg numbers. Specifically, the features extracted by Kernel Principal Component Analysis (KPCA) of flowfield snapshots using our kernel functions yield reconstructions with superior accuracy in terms of mechanical energy compared to conventional methods such as ordinary Principal Component Analysis (PCA) with naïvely-defined state vectors or KPCA with ad-hoc choices of kernel functions. Our findings underscore the importance of principled choices of metrics in both scientific and machine learning investigations of complex fluid systems. △ Less

Submitted 22 April, 2024; originally announced April 2024.

PyDMD: A Python package for robust dynamic mode decomposition

Authors: Sara M. Ichinaga, Francesco Andreuzzi, Nicola Demo, Marco Tezzele, Karl Lapo, Gianluigi Rozza, Steven L. Brunton, J. Nathan Kutz

Abstract: The dynamic mode decomposition (DMD) is a simple and powerful data-driven modeling technique that is capable of revealing coherent spatiotemporal patterns from data. The method's linear algebra-based formulation additionally allows for a variety of optimizations and extensions that make the algorithm practical and viable for real-world data analysis. As a result, DMD has grown to become a leading… ▽ More The dynamic mode decomposition (DMD) is a simple and powerful data-driven modeling technique that is capable of revealing coherent spatiotemporal patterns from data. The method's linear algebra-based formulation additionally allows for a variety of optimizations and extensions that make the algorithm practical and viable for real-world data analysis. As a result, DMD has grown to become a leading method for dynamical system analysis across multiple scientific disciplines. PyDMD is a Python package that implements DMD and several of its major variants. In this work, we expand the PyDMD package to include a number of cutting-edge DMD methods and tools specifically designed to handle dynamics that are noisy, multiscale, parameterized, prohibitively high-dimensional, or even strongly nonlinear. We provide a complete overview of the features available in PyDMD as of version 1.0, along with a brief overview of the theory behind the DMD algorithm, information for developers, tips regarding practical DMD usage, and introductory coding examples. All code is available at https://github.com/PyDMD/PyDMD . △ Less

Submitted 12 February, 2024; originally announced February 2024.

Extending the aircraft flight envelope by mitigating transonic airfoil buffet

Authors: Esther Lagemann, Steven L. Brunton, Wolfgang Schröder, Christian Lagemann

Abstract: In the age of globalization, commercial aviation plays a central role in maintaining our international connectivity by providing fast air transport services for passengers and freight. However, the upper limit of the aircraft flight envelope, i.e., its operational limit in the high-speed regime, is usually fixed by the occurrence of an aerodynamic phenomenon called transonic airfoil buffet. It ref… ▽ More In the age of globalization, commercial aviation plays a central role in maintaining our international connectivity by providing fast air transport services for passengers and freight. However, the upper limit of the aircraft flight envelope, i.e., its operational limit in the high-speed regime, is usually fixed by the occurrence of an aerodynamic phenomenon called transonic airfoil buffet. It refers to shock wave oscillations occurring on the aircraft wings, which induce unsteady aerodynamic loads acting on the wing structure. Since these loads can cause severe structural damage endangering flight safety, the aviation industry is highly interested in suppressing transonic airfoil buffet to extend the flight envelope to higher aircraft speeds. In this contribution, we demonstrate experimentally that the application of porous trailing edges substantially attenuates the buffet phenomenon. Since porous trailing edges have the additional benefit of reducing acoustic aircraft emissions, our findings could pave the way for faster air transport with reduced noise emissions. △ Less

Submitted 25 January, 2024; v1 submitted 16 January, 2024; originally announced January 2024.

Uncovering wall-shear stress dynamics from neural-network enhanced fluid flow measurements

Authors: Esther Lagemann, Steven L. Brunton, Christian Lagemann

Abstract: Friction drag from a turbulent fluid moving past or inside an object plays a crucial role in domains as diverse as transportation, public utility infrastructure, energy technology, and human health. As a direct measure of the shear-induced friction forces, an accurate prediction of the wall-shear stress can contribute to sustainability, conservation of resources, and carbon neutrality in civil avi… ▽ More Friction drag from a turbulent fluid moving past or inside an object plays a crucial role in domains as diverse as transportation, public utility infrastructure, energy technology, and human health. As a direct measure of the shear-induced friction forces, an accurate prediction of the wall-shear stress can contribute to sustainability, conservation of resources, and carbon neutrality in civil aviation as well as enhanced medical treatment of vascular diseases and cancer. Despite such importance for our modern society, we still lack adequate experimental methods to capture the instantaneous wall-shear stress dynamics. In this contribution, we present a holistic approach that derives velocity and wall-shear stress fields with impressive spatial and temporal resolution from flow measurements using a deep optical flow estimator with physical knowledge. The validity and physical correctness of the derived flow quantities is demonstrated with synthetic and real-world experimental data covering a range of relevant fluid flows. △ Less

Submitted 18 October, 2023; v1 submitted 17 October, 2023; originally announced October 2023.

Lagrangian Gradient Regression for the Detection of Coherent Structures from Sparse Trajectory Data

Authors: Tanner D. Harms, Steven L. Brunton, Beverley J. McKeon

Abstract: Lagrangian Coherent Structures (LCS) are flow features which are defined to objectively characterize complex fluid behavior over a finite time regardless of the orientation of the observer. Fluidic applications of LCS include geophysical, aerodynamic, biological, and bio-inspired flows -- among others -- and can be generalized to broader classes of dynamical systems. One of the prevailing paradigm… ▽ More Lagrangian Coherent Structures (LCS) are flow features which are defined to objectively characterize complex fluid behavior over a finite time regardless of the orientation of the observer. Fluidic applications of LCS include geophysical, aerodynamic, biological, and bio-inspired flows -- among others -- and can be generalized to broader classes of dynamical systems. One of the prevailing paradigms for identifying LCS involves examining continuum-mechanical properties of the underlying flow. Such methods, including finite-time Lyapunov exponent (FTLE) and Lagrangian-averaged vorticity deviation (LAVD) analyses, provide consistent and physically-meaningful results but require expensive computations on a dense array of numerically integrated trajectories. Faster, more robust, sparse methods, on the other hand, are typically non-deterministic and require a-priori intuition of flow field behavior for interpretation. If LCS are to be used in the decision-making protocol of future autonomous technologies, a bridge between dense and sparse approaches must be made. This work begins to address this goal through the development of Lagrangian gradient regression (LGR), which enables the computation of deformation gradients and velocity gradients from sparse data via regression. Using LGR, velocity gradients, flow map Jacobians (thereby FTLE), and rotational Lagrangian metrics like the LAVD are accurately computed from sparse trajectory data which is orders of magnitude less dense than traditional approaches require. Moreover, there is no need to compute velocity or numerically differentiate at any point when using LGR. Therefore, it is a purely Lagrangian technique. △ Less

Submitted 17 October, 2023; originally announced October 2023.

Comments: 46 pages, 13 figures

Nonlinear parametric models of viscoelastic fluid flows

Authors: Cassio M. Oishi, Alan A. Kaptanoglu, J. Nathan Kutz, Steven L. Brunton

Abstract: Reduced-order models have been widely adopted in fluid mechanics, particularly in the context of Newtonian fluid flows. These models offer the ability to predict complex dynamics, such as instabilities and oscillations, at a considerably reduced computational cost. In contrast, the reduced-order modeling of non-Newtonian viscoelastic fluid flows remains relatively unexplored. This work leverag… ▽ More Reduced-order models have been widely adopted in fluid mechanics, particularly in the context of Newtonian fluid flows. These models offer the ability to predict complex dynamics, such as instabilities and oscillations, at a considerably reduced computational cost. In contrast, the reduced-order modeling of non-Newtonian viscoelastic fluid flows remains relatively unexplored. This work leverages the sparse identification of nonlinear dynamics algorithm to develop interpretable reduced-order models for viscoelastic flows. In particular, we explore a benchmark oscillatory viscoelastic flow on the four-roll mill geometry using the classical Oldroyd-B fluid. This flow exemplifies many canonical challenges associated with non-Newtonian flows, including transitions, asymmetries, instabilities, and bifurcations arising from the interplay of viscous and elastic forces, all of which require expensive computations in order to resolve the fast timescales and long transients characteristic of such flows. First, we demonstrate the effectiveness of our data-driven surrogate model to predict the transient evolution and accurately reconstruct the spatial flow field for fixed flow parameters. We then develop a fully parametric, nonlinear model capable of capturing the dynamic variations as a function of the Weissenberg number. While the training data is predominantly concentrated on a limit cycle regime for moderate Wi, we show that the parameterized model can be used to extrapolate, accurately predicting the dominant dynamics in the case of high Weissenberg numbers. The proposed methodology represents an initial step in the field of reduced-order modeling for viscoelastic flows with the potential to be further refined and enhanced for the design, optimization, and control of a wide range of non-Newtonian fluid flows using machine learning and reduced-order modeling techniques. △ Less

Submitted 1 December, 2023; v1 submitted 8 August, 2023; originally announced August 2023.

Control of Vortex Dynamics using Invariants

Authors: Kartik Krishna, Aditya G. Nair, Anand Krishnan, Steven L. Brunton, Eurika Kaiser

Abstract: Vortex-dominated flows are ubiquitous in engineering, and the ability to efficiently manipulate the dynamics of these vortices has broad applications, from wake sha** to mixing enhancement. However, the strongly nonlinear behavior of the vortex dynamics makes this a challenging task. In this work, we investigate the control of vortex dynamics by using a change of coordinates from the Biot-Savart… ▽ More Vortex-dominated flows are ubiquitous in engineering, and the ability to efficiently manipulate the dynamics of these vortices has broad applications, from wake sha** to mixing enhancement. However, the strongly nonlinear behavior of the vortex dynamics makes this a challenging task. In this work, we investigate the control of vortex dynamics by using a change of coordinates from the Biot-Savart equations into well-known invariants, such as the Hamiltonian, linear, and angular impulses, which are Koopman eigenfunctions. We then combine the resulting model with model predictive control to generate control laws that force the vortex system using "virtual cylinders". The invariant model is beneficial as it provides a linear, global description of the vortex dynamics through a recently developed Koopman control scheme for conserved quantities and invariants. The use of this model has not been well studied in the literature in the context of control. In this paper, we seek to understand the effect of changing each invariant individually or multiple invariants simultaneously. We use the 4-vortex system as our primary test bed, as it is the simplest configuration that exhibits chaotic behavior. We show that by controlling to specific invariant quantities, we can modify the transition from chaotic to quasiperiodic states. Finally, we computationally demonstrate the effectiveness of invariant control on a toy example of tracer mixing in the 4-vortex system. △ Less

Submitted 7 November, 2023; v1 submitted 7 August, 2023; originally announced August 2023.

MSC Class: 76B57; 76B47; 34H10

PyKoopman: A Python Package for Data-Driven Approximation of the Koopman Operator

Authors: Shaowu Pan, Eurika Kaiser, Brian M. de Silva, J. Nathan Kutz, Steven L. Brunton

Abstract: PyKoopman is a Python package for the data-driven approximation of the Koopman operator associated with a dynamical system. The Koopman operator is a principled linear embedding of nonlinear dynamics and facilitates the prediction, estimation, and control of strongly nonlinear dynamics using linear systems theory. In particular, PyKoopman provides tools for data-driven system identification for un… ▽ More PyKoopman is a Python package for the data-driven approximation of the Koopman operator associated with a dynamical system. The Koopman operator is a principled linear embedding of nonlinear dynamics and facilitates the prediction, estimation, and control of strongly nonlinear dynamics using linear systems theory. In particular, PyKoopman provides tools for data-driven system identification for unforced and actuated systems that build on the equation-free dynamic mode decomposition (DMD) and its variants. In this work, we provide a brief description of the mathematical underpinnings of the Koopman operator, an overview and demonstration of the features implemented in PyKoopman (with code examples), practical advice for users, and a list of potential extensions to PyKoopman. Software is available at http://github.com/dynamicslab/pykoopman △ Less

Submitted 22 June, 2023; originally announced June 2023.

Comments: 16 pages

Data-Driven Modeling for Transonic Aeroelastic Analysis

Authors: Nicola Fonzi, Steven L. Brunton, Urban Fasel

Abstract: Aeroelasticity in the transonic regime is challenging because of the strongly nonlinear phenomena involved in the formation of shock waves and flow separation. In this work, we introduce a computationally efficient framework for accurate transonic aeroelastic analysis. We use dynamic mode decomposition with control (DMDc) to extract surrogate models from high-fidelity computational fluid dynamics… ▽ More Aeroelasticity in the transonic regime is challenging because of the strongly nonlinear phenomena involved in the formation of shock waves and flow separation. In this work, we introduce a computationally efficient framework for accurate transonic aeroelastic analysis. We use dynamic mode decomposition with control (DMDc) to extract surrogate models from high-fidelity computational fluid dynamics (CFD) simulations. Instead of identifying models of the full flow field or focusing on global performance indices, we directly predict the pressure distribution on the body surface. The learned surrogate models provide information about the system stability and can be used for control synthesis and response studies. Specific techniques are introduced to avoid spurious instabilities of the aerodynamic model. We use the high-fidelity CFD code SU2 to generate data and test our method on the benchmark super critical wing (BSCW). Our python-based software is fully open-source and will be included in the SU2 package to streamline the workflow from defining the high-fidelity aerodynamic model to creating a surrogate model for flutter analysis. △ Less

Submitted 14 April, 2023; originally announced April 2023.

Machine Learning for Partial Differential Equations

Authors: Steven L. Brunton, J. Nathan Kutz

Abstract: Partial differential equations (PDEs) are among the most universal and parsimonious descriptions of natural physical laws, capturing a rich variety of phenomenology and multi-scale physics in a compact and symbolic representation. This review will examine several promising avenues of PDE research that are being advanced by machine learning, including: 1) the discovery of new governing PDEs and coa… ▽ More Partial differential equations (PDEs) are among the most universal and parsimonious descriptions of natural physical laws, capturing a rich variety of phenomenology and multi-scale physics in a compact and symbolic representation. This review will examine several promising avenues of PDE research that are being advanced by machine learning, including: 1) the discovery of new governing PDEs and coarse-grained approximations for complex natural and engineered systems, 2) learning effective coordinate systems and reduced-order models to make PDEs more amenable to analysis, and 3) representing solution operators and improving traditional numerical algorithms. In each of these fields, we summarize key advances, ongoing challenges, and opportunities for further development. △ Less

Submitted 29 March, 2023; originally announced March 2023.

Comments: 16 pages, 6 figures

The transformative potential of machine learning for experiments in fluid mechanics

Authors: Ricardo Vinuesa, Steven L. Brunton, Beverley J. McKeon

Abstract: The field of machine learning has rapidly advanced the state of the art in many fields of science and engineering, including experimental fluid dynamics, which is one of the original big-data disciplines. This perspective will highlight several aspects of experimental fluid mechanics that stand to benefit from progress advances in machine learning, including: 1) augmenting the fidelity and quality… ▽ More The field of machine learning has rapidly advanced the state of the art in many fields of science and engineering, including experimental fluid dynamics, which is one of the original big-data disciplines. This perspective will highlight several aspects of experimental fluid mechanics that stand to benefit from progress advances in machine learning, including: 1) augmenting the fidelity and quality of measurement techniques, 2) improving experimental design and surrogate digital-twin models and 3) enabling real-time estimation and control. In each case, we discuss recent success stories and ongoing challenges, along with caveats and limitations, and outline the potential for new avenues of ML-augmented and ML-enabled experimental fluid mechanics. △ Less

Submitted 29 March, 2023; v1 submitted 28 March, 2023; originally announced March 2023.

Benchmarking sparse system identification with low-dimensional chaos

Authors: Alan A. Kaptanoglu, Lanyue Zhang, Zachary G. Nicolaou, Urban Fasel, Steven L. Brunton

Abstract: Sparse system identification is the data-driven process of obtaining parsimonious differential equations that describe the evolution of a dynamical system, balancing model complexity and accuracy. There has been rapid innovation in system identification across scientific domains, but there remains a gap in the literature for large-scale methodological comparisons that are evaluated on a variety of… ▽ More Sparse system identification is the data-driven process of obtaining parsimonious differential equations that describe the evolution of a dynamical system, balancing model complexity and accuracy. There has been rapid innovation in system identification across scientific domains, but there remains a gap in the literature for large-scale methodological comparisons that are evaluated on a variety of dynamical systems. In this work, we systematically benchmark sparse regression variants by utilizing the dysts standardized database of chaotic systems. In particular, we demonstrate how this open-source tool can be used to quantitatively compare different methods of system identification. To illustrate how this benchmark can be utilized, we perform a large comparison of four algorithms for solving the sparse identification of nonlinear dynamics (SINDy) optimization problem, finding strong performance of the original algorithm and a recent mixed-integer discrete algorithm. In all cases, we used ensembling to improve the noise robustness of SINDy and provide statistical comparisons. In addition, we show very compelling evidence that the weak SINDy formulation provides significant improvements over the traditional method, even on clean data. Lastly, we investigate how Pareto-optimal models generated from SINDy algorithms depend on the properties of the equations, finding that the performance shows no significant dependence on a set of dynamical properties that quantify the amount of chaos, scale separation, degree of nonlinearity, and the syntactic complexity. △ Less

Submitted 4 February, 2023; originally announced February 2023.

From resolvent to Gramians: extracting forcing and response modes for control

Authors: Benjamin Herrmann, Peter J. Baddoo, Scott T. M. Dawson, Richard Semaan, Steven L. Brunton, Beverley J. McKeon

Abstract: During the last decade, forcing and response modes produced by resolvent analysis have demonstrated great potential to guide sensor and actuator placement and design in flow control applications. However, resolvent modes are frequency-dependent, which, although responsible for their success in identifying scale interactions in turbulence, complicates their use for control purposes. In this work, w… ▽ More During the last decade, forcing and response modes produced by resolvent analysis have demonstrated great potential to guide sensor and actuator placement and design in flow control applications. However, resolvent modes are frequency-dependent, which, although responsible for their success in identifying scale interactions in turbulence, complicates their use for control purposes. In this work, we seek orthogonal bases of forcing and response modes that are the most responsive and receptive, respectively, across all frequencies. We show that these frequency-independent bases of \emph{representative} resolvent modes are given by the eigenvectors of the observability and controllability Gramians of the system considering full state inputs and outputs. We present several numerical examples where we leverage these bases by building orthogonal or interpolatory projectors onto the dominant forcing and response subspaces. Gramian-based forcing modes are used to identify dynamically relevant disturbances, to place point sensors to measure disturbances, and to design actuators for feedforward control in the subcritical linearized Ginzburg--Landau equation. Gramian-based response modes are used to identify coherent structures and for point sensor placement aiming at state reconstruction in the turbulent flow in a minimal channel at $\mathrm{Re}_τ=185$. The approach does not require data snapshots and relies only on knowledge of the steady or mean flow. △ Less

Submitted 31 January, 2023; v1 submitted 30 January, 2023; originally announced January 2023.

Large area optimization of meta-lens via data-free machine learning

Authors: Maksym V. Zhelyeznyakov, Johannes E. Froch, Anna Wirth-Singh, Jaebum Noh, Junsuk Rho, Steven L. Brunton, Arka Majumdar

Abstract: Sub-wavelength diffractive optics meta-optics present a multi-scale optical system, where the behavior of constituent sub-wavelength scatterers, or meta-atoms, need to be modelled by full-wave electromagnetic simulations, whereas the whole meta-optical system can be modelled using ray/ wave optics. Current simulation techniques for large-scale meta-optics rely on the local phase approximation (LPA… ▽ More Sub-wavelength diffractive optics meta-optics present a multi-scale optical system, where the behavior of constituent sub-wavelength scatterers, or meta-atoms, need to be modelled by full-wave electromagnetic simulations, whereas the whole meta-optical system can be modelled using ray/ wave optics. Current simulation techniques for large-scale meta-optics rely on the local phase approximation (LPA), where the coupling between dissimilar meta-atoms are completely neglected. Here we introduce a physics-informed neural network, which can efficiently model the meta-optics while still incorporating all of the coupling between meta-atoms. Unlike existing deep learning techniques which generally predict the mean transmission and reflection coefficients of meta-atoms, we predict the full electro-magnetic field distribution. We demonstrate the efficacy of our technique by designing 1mm aperture cylindrical meta-lenses exhibiting higher efficiency than the ones designed under LPA. We experimentally validated the maximum intensity improvement (up to $53\%$) of the inverse-designed meta-lens. Our reported method can design large aperture $(\sim 10^4-10^5λ)$ meta-optics in a reasonable time (approximately 15 minutes on a graphics processing unit) without relying on any approximation. △ Less

Submitted 20 December, 2022; originally announced December 2022.

Multiscale model reduction for incompressible flows

Authors: Jared L. Callaham, Jean-Christophe Loiseau, Steven L. Brunton

Abstract: Many unsteady flows exhibiting complex dynamics are nevertheless characterized by emergent large-scale coherence in space and time. Reduced-order models based on Galerkin projection of the governing equations onto an orthogonal modal basis approximate the flow as a low-dimensional dynamical system with linear and quadratic terms. However, these Galerkin models often fail to reproduce the true dyna… ▽ More Many unsteady flows exhibiting complex dynamics are nevertheless characterized by emergent large-scale coherence in space and time. Reduced-order models based on Galerkin projection of the governing equations onto an orthogonal modal basis approximate the flow as a low-dimensional dynamical system with linear and quadratic terms. However, these Galerkin models often fail to reproduce the true dynamics, in part because they ignore important nonlinear interactions with unresolved flow scales. Here, we use a separation of time scales between the resolved and subscale variables to derive a reduced-order model with cubic closure terms for the truncated modes, generalizing the classic Stuart-Landau equation. The leading order cubic terms are determined by averaging out fast variables through a perturbation series approximation of the action of a stochastic Koopman operator. We show analytically that this multiscale closure model can capture both the effects of mean-flow deformation and the energy cascade before demonstrating improved stability and accuracy in models of chaotic lid-driven cavity flow and vortex pairing in a mixing layer. This approach to closure modeling establishes a general theory for the origin and role of cubic nonlinearities in low-dimensional models of incompressible flows △ Less

Submitted 27 June, 2022; originally announced June 2022.

Comments: 46 pages, 14 figures

The Experimental Multi-Arm Pendulum on a Cart: A Benchmark System for Chaos, Learning, and Control

Authors: Kadierdan Kaheman, Urban Fasel, Jason J. Bramburger, Benjamin Strom, J. Nathan Kutz, Steven L. Brunton

Abstract: The single, double, and triple pendulum has served as an illustrative experimental benchmark system for scientists to study dynamical behavior for more than four centuries. The pendulum system exhibits a wide range of interesting behaviors, from simple harmonic motion in the single pendulum to chaotic dynamics in multi-arm pendulums. Under forcing, even the single pendulum may exhibit chaos, provi… ▽ More The single, double, and triple pendulum has served as an illustrative experimental benchmark system for scientists to study dynamical behavior for more than four centuries. The pendulum system exhibits a wide range of interesting behaviors, from simple harmonic motion in the single pendulum to chaotic dynamics in multi-arm pendulums. Under forcing, even the single pendulum may exhibit chaos, providing a simple example of a damped-driven system. All multi-armed pendulums are characterized by the existence of index-one saddle points, which mediate the transport of trajectories in the system, providing a simple mechanical analog of various complex transport phenomena, from biolocomotion to transport within the solar system. Further, pendulum systems have long been used to design and test both linear and nonlinear control strategies, with the addition of more arms making the problem more challenging. In this work, we provide extensive designs for the construction and operation of a high-performance, multi-link pendulum on a cart system. Although many experimental setups have been built to study the behavior of pendulum systems, such an extensive documentation on the design, construction, and operation is missing from the literature. The resulting experimental system is highly flexible, enabling a wide range of benchmark problems in dynamical systems modeling, system identification and learning, and control. To promote reproducible research, we have made our entire system open-source, including 3D CAD drawings, basic tutorial code, and data. Moreover, we discuss the possibility of extending our system capability to be operated remotely to enable researchers all around the world to use it, thus increasing access. △ Less

Submitted 12 May, 2022; originally announced May 2022.

Comments: 72 pages, 39 figures, 9 tables

ACM Class: B.0; D.0; E.0

Swarm Modelling with Dynamic Mode Decomposition

Authors: Emma Hansen, Steven L. Brunton, Zhuoyuan Song

Abstract: Modelling biological or engineering swarms is challenging due to the inherently high dimension of the system, despite the often low-dimensional emergent dynamics. Most existing swarm modelling approaches are based on first principles and often result in swarm-specific parameterizations that do not generalize to a broad range of applications. In this work, we apply a purely data-driven method to (1… ▽ More Modelling biological or engineering swarms is challenging due to the inherently high dimension of the system, despite the often low-dimensional emergent dynamics. Most existing swarm modelling approaches are based on first principles and often result in swarm-specific parameterizations that do not generalize to a broad range of applications. In this work, we apply a purely data-driven method to (1) learn local interactions of homogeneous swarms through observation data and to (2) generate similar swarming behaviour using the learned model. In particular, a modified version of dynamic mode decomposition with control, called swarmDMD, is developed and tested on the canonical Vicsek swarm model. The goal is to use swarmDMD to learn inter-agent interactions that give rise to the observed swarm behaviour. We show that swarmDMD can faithfully reconstruct the swarm dynamics, and the model learned by swarmDMD provides a short prediction window for data extrapolation with a trade-off between prediction accuracy and prediction horizon. We also provide a comprehensive analysis on the efficacy of different observation data types on the modelling, where we find that inter-agent distance yields the most accurate models. We believe the proposed swarmDMD approach will be useful for studying multi-agent systems found in biology, physics, and engineering. △ Less

Submitted 8 April, 2022; originally announced April 2022.

Comments: 15 pages, 18 figures

MSC Class: 37M99; 92D50; 70E55; 37M05; 37M10

Dimensionally Consistent Learning with Buckingham Pi

Authors: Joseph Bakarji, Jared Callaham, Steven L. Brunton, J. Nathan Kutz

Abstract: In the absence of governing equations, dimensional analysis is a robust technique for extracting insights and finding symmetries in physical systems. Given measurement variables and parameters, the Buckingham Pi theorem provides a procedure for finding a set of dimensionless groups that spans the solution space, although this set is not unique. We propose an automated approach using the symmetric… ▽ More In the absence of governing equations, dimensional analysis is a robust technique for extracting insights and finding symmetries in physical systems. Given measurement variables and parameters, the Buckingham Pi theorem provides a procedure for finding a set of dimensionless groups that spans the solution space, although this set is not unique. We propose an automated approach using the symmetric and self-similar structure of available measurement data to discover the dimensionless groups that best collapse this data to a lower dimensional space according to an optimal fit. We develop three data-driven techniques that use the Buckingham Pi theorem as a constraint: (i) a constrained optimization problem with a non-parametric input-output fitting function, (ii) a deep learning algorithm (BuckiNet) that projects the input parameter space to a lower dimension in the first layer, and (iii) a technique based on sparse identification of nonlinear dynamics (SINDy) to discover dimensionless equations whose coefficients parameterize the dynamics. We explore the accuracy, robustness and computational complexity of these methods as applied to three example problems: a bead on a rotating hoop, a laminar boundary layer, and Rayleigh-Bénard convection. △ Less

Submitted 9 February, 2022; originally announced February 2022.

Physics-informed dynamic mode decomposition (piDMD)

Authors: Peter J. Baddoo, Benjamin Herrmann, Beverley J. McKeon, J. Nathan Kutz, Steven L. Brunton

Abstract: In this work, we demonstrate how physical principles -- such as symmetries, invariances, and conservation laws -- can be integrated into the dynamic mode decomposition (DMD). DMD is a widely-used data analysis technique that extracts low-rank modal structures and dynamics from high-dimensional measurements. However, DMD frequently produces models that are sensitive to noise, fail to generalize out… ▽ More In this work, we demonstrate how physical principles -- such as symmetries, invariances, and conservation laws -- can be integrated into the dynamic mode decomposition (DMD). DMD is a widely-used data analysis technique that extracts low-rank modal structures and dynamics from high-dimensional measurements. However, DMD frequently produces models that are sensitive to noise, fail to generalize outside the training data, and violate basic physical laws. Our physics-informed DMD (piDMD) optimization, which may be formulated as a Procrustes problem, restricts the family of admissible models to a matrix manifold that respects the physical structure of the system. We focus on five fundamental physical principles -- conservation, self-adjointness, localization, causality, and shift-invariance -- and derive several closed-form solutions and efficient algorithms for the corresponding piDMD optimizations. With fewer degrees of freedom, piDMD models are less prone to overfitting, require less training data, and are often less computationally expensive to build than standard DMD models. We demonstrate piDMD on a range of challenging problems in the physical sciences, including energy-preserving fluid flow, travelling-wave systems, the Schrödinger equation, solute advection-diffusion, a system with causal dynamics, and three-dimensional transitional channel flow. In each case, piDMD significantly outperforms standard DMD in metrics such as spectral identification, state prediction, and estimation of optimal forcings and responses. △ Less

Submitted 8 December, 2021; originally announced December 2021.

Comments: 36 pages, 9 figures

Data-driven unsteady aeroelastic modeling for control

Authors: Michelle Hickner, Urban Fasel, Aditya G. Nair, Bingni W. Brunton, Steven L. Brunton

Abstract: Aeroelastic structures, from insect wings to wind turbine blades, experience transient unsteady aerodynamic loads that are coupled to their motion. Effective real-time control of flexible structures relies on accurate and efficient predictions of both the unsteady aeroelastic forces and airfoil deformation. For rigid wings, classical unsteady aerodynamic models have recently been reformulated in s… ▽ More Aeroelastic structures, from insect wings to wind turbine blades, experience transient unsteady aerodynamic loads that are coupled to their motion. Effective real-time control of flexible structures relies on accurate and efficient predictions of both the unsteady aeroelastic forces and airfoil deformation. For rigid wings, classical unsteady aerodynamic models have recently been reformulated in state-space for control and extended to include viscous effects. Here we further extend this modeling framework to include the deformation of a flexible wing in addition to the quasi-steady, added mass, and unsteady viscous forces. We develop low-order linear models based on data from direct numerical simulations of flow past a flexible wing at low Reynolds number. We demonstrate the effectiveness of these models to track aggressive maneuvers with model predictive control while constraining maximum wing deformation. This system identification approach provides an interpretable, accurate, and low-dimensional representation of an aeroelastic system that can aid in system and controller design for applications where transients play an important role. △ Less

Submitted 12 July, 2022; v1 submitted 22 November, 2021; originally announced November 2021.

PySINDy: A comprehensive Python package for robust sparse system identification

Authors: Alan A. Kaptanoglu, Brian M. de Silva, Urban Fasel, Kadierdan Kaheman, Andy J. Goldschmidt, Jared L. Callaham, Charles B. Delahunt, Zachary G. Nicolaou, Kathleen Champion, Jean-Christophe Loiseau, J. Nathan Kutz, Steven L. Brunton

Abstract: Automated data-driven modeling, the process of directly discovering the governing equations of a system from data, is increasingly being used across the scientific community. PySINDy is a Python package that provides tools for applying the sparse identification of nonlinear dynamics (SINDy) approach to data-driven model discovery. In this major update to PySINDy, we implement several advanced feat… ▽ More Automated data-driven modeling, the process of directly discovering the governing equations of a system from data, is increasingly being used across the scientific community. PySINDy is a Python package that provides tools for applying the sparse identification of nonlinear dynamics (SINDy) approach to data-driven model discovery. In this major update to PySINDy, we implement several advanced features that enable the discovery of more general differential equations from noisy and limited data. The library of candidate terms is extended for the identification of actuated systems, partial differential equations (PDEs), and implicit differential equations. Robust formulations, including the integral form of SINDy and ensembling techniques, are also implemented to improve performance for real-world data. Finally, we provide a range of new optimization algorithms, including several sparse regression techniques and algorithms to enforce and promote inequality constraints and stability. Together, these updates enable entirely new SINDy model discovery capabilities that have not been reported in the literature, such as constrained PDE identification and ensembling with different sparse regression optimizers. △ Less

Submitted 25 January, 2022; v1 submitted 12 November, 2021; originally announced November 2021.

Dynamic Mode Decomposition for Aero-Optic Wavefront Characterization

Authors: Shervin Sahba, Diya Sashidhar, Christopher C. Wilcox, Austin McDaniel, Steven L. Brunton, J. Nathan Kutz

Abstract: Aero-optical beam control relies on the development of low-latency forecasting techniques to quickly predict wavefronts aberrated by the Turbulent Boundary Layer (TBL) around an airborne optical system, and its study applies to a multi-domain need from astronomy to microscopy for high-fidelity laser propagation. We leverage the forecasting capabilities of the Dynamic Mode Decomposition (DMD) -- an… ▽ More Aero-optical beam control relies on the development of low-latency forecasting techniques to quickly predict wavefronts aberrated by the Turbulent Boundary Layer (TBL) around an airborne optical system, and its study applies to a multi-domain need from astronomy to microscopy for high-fidelity laser propagation. We leverage the forecasting capabilities of the Dynamic Mode Decomposition (DMD) -- an equation-free, data-driven method for identifying coherent flow structures and their associated spatiotemporal dynamics -- in order to estimate future state wavefront phase aberrations to feed into an adaptive optic (AO) control loop. We specifically leverage the optimized DMD (opt-DMD) algorithm on a subset of the Airborne Aero-Optics Laboratory Transonic (AAOL-T) experimental dataset, characterizing aberrated wavefront dynamics for 23 beam propagation directions via the spatiotemporal decomposition underlying DMD. Critically, we show that opt-DMD produces an optimally de-biased eigenvalue spectrum with imaginary eigenvalues, allowing for arbitrarily long forecasting to produce a robust future-state prediction, while exact DMD loses structural information due to modal decay rates. △ Less

Submitted 13 January, 2022; v1 submitted 28 September, 2021; originally announced October 2021.

Comments: 15 pages, 8 figures, the two first-authors contributed equally to this work

Deeptime: a Python library for machine learning dynamical models from time series data

Authors: Moritz Hoffmann, Martin Scherer, Tim Hempel, Andreas Mardt, Brian de Silva, Brooke E. Husic, Stefan Klus, Hao Wu, Nathan Kutz, Steven L. Brunton, Frank Noé

Abstract: Generation and analysis of time-series data is relevant to many quantitative fields ranging from economics to fluid mechanics. In the physical sciences, structures such as metastable and coherent sets, slow relaxation processes, collective variables dominant transition pathways or manifolds and channels of probability flow can be of great importance for understanding and characterizing the kinetic… ▽ More Generation and analysis of time-series data is relevant to many quantitative fields ranging from economics to fluid mechanics. In the physical sciences, structures such as metastable and coherent sets, slow relaxation processes, collective variables dominant transition pathways or manifolds and channels of probability flow can be of great importance for understanding and characterizing the kinetic, thermodynamic and mechanistic properties of the system. Deeptime is a general purpose Python library offering various tools to estimate dynamical models based on time-series data including conventional linear learning methods, such as Markov state models (MSMs), Hidden Markov Models and Koopman models, as well as kernel and deep learning approaches such as VAMPnets and deep MSMs. The library is largely compatible with scikit-learn, having a range of Estimator classes for these different models, but in contrast to scikit-learn also provides deep Model classes, e.g. in the case of an MSM, which provide a multitude of analysis methods to compute interesting thermodynamic, kinetic and dynamical quantities, such as free energies, relaxation times and transition paths. The library is designed for ease of use but also easily maintainable and extensible code. In this paper we introduce the main features and structure of the deeptime software. △ Less

Submitted 11 December, 2021; v1 submitted 28 October, 2021; originally announced October 2021.

Journal ref: Machine Learning: Science and Technology, Volume 3, Number 1, 2021

Enhancing Computational Fluid Dynamics with Machine Learning

Authors: Ricardo Vinuesa, Steven L. Brunton

Abstract: Machine learning is rapidly becoming a core technology for scientific computing, with numerous opportunities to advance the field of computational fluid dynamics. In this Perspective, we highlight some of the areas of highest potential impact, including to accelerate direct numerical simulations, to improve turbulence closure modeling, and to develop enhanced reduced-order models. We also discuss… ▽ More Machine learning is rapidly becoming a core technology for scientific computing, with numerous opportunities to advance the field of computational fluid dynamics. In this Perspective, we highlight some of the areas of highest potential impact, including to accelerate direct numerical simulations, to improve turbulence closure modeling, and to develop enhanced reduced-order models. We also discuss emerging areas of machine learning that are promising for computational fluid dynamics, as well as some potential limitations that should be taken into account. △ Less

Submitted 1 July, 2022; v1 submitted 5 October, 2021; originally announced October 2021.

Comments: 15 pages, 4 figures

Applying Machine Learning to Study Fluid Mechanics

Authors: Steven L. Brunton

Abstract: This paper provides a short overview of how to use machine learning to build data-driven models in fluid mechanics. The process of machine learning is broken down into five stages: (1) formulating a problem to model, (2) collecting and curating training data to inform the model, (3) choosing an architecture with which to represent the model, (4) designing a loss function to assess the performance… ▽ More This paper provides a short overview of how to use machine learning to build data-driven models in fluid mechanics. The process of machine learning is broken down into five stages: (1) formulating a problem to model, (2) collecting and curating training data to inform the model, (3) choosing an architecture with which to represent the model, (4) designing a loss function to assess the performance of the model, and (5) selecting and implementing an optimization algorithm to train the model. At each stage, we discuss how prior physical knowledge may be embedding into the process, with specific examples from the field of fluid mechanics. △ Less

Submitted 5 October, 2021; originally announced October 2021.

Data-driven Modeling of Two-Dimensional Detonation Wave Fronts

Authors: Ariana Mendible, Weston Lowrie, Steven L. Brunton, J. Nathan Kutz

Abstract: Historical experimental testing of high-altitude nuclear explosions (HANEs) are known to cause severe and detrimental effects to radio frequency signals and communications infrastructure. In order to study and predict the impact of HANEs, tractable computational approaches are required to model the complex physical processes involved in the detonation wave physics. Modern reduced-order models (ROM… ▽ More Historical experimental testing of high-altitude nuclear explosions (HANEs) are known to cause severe and detrimental effects to radio frequency signals and communications infrastructure. In order to study and predict the impact of HANEs, tractable computational approaches are required to model the complex physical processes involved in the detonation wave physics. Modern reduced-order models (ROMs) can enable long-time and many-parameter simulations with minimal computational cost. However, translational and scale invariances inherent to this type of wave propagation problem are known to limit traditional ROM approaches. Specifically, dimensionality reduction methods are typically ineffective in producing low-rank models when invariances are present in the data. In this work, an unsupervised machine learning method is used to discover coordinate systems that make such invariances amenable to traditional dimensionality reduction methods. The method, which has previously been demonstrated on one-dimensional translations, is extended to higher dimensions and additional invariances. A surrogate HANE system, i.e. a HANE-ROM, with one detonation wave is captured well at extremely low-rank. Two detonation-waves are also considered with various amounts of interaction between the waves, with improvements to low-rank models for multiple wave quantities with limited interaction. △ Less

Submitted 30 June, 2021; originally announced June 2021.

Comments: 22 pages, 13 figures

On the role of nonlinear correlations in reduced-order modeling

Authors: Jared L. Callaham, Steven L. Brunton, Jean-Christophe Loiseau

Abstract: A major goal for reduced-order models of unsteady fluid flows is to uncover and exploit latent low-dimensional structure. Proper orthogonal decomposition (POD) provides an energy-optimal linear basis to represent the flow kinematics, but converges slowly for advection-dominated flows and tends to overestimate the number of dynamically relevant variables. We show that nonlinear correlations in the… ▽ More A major goal for reduced-order models of unsteady fluid flows is to uncover and exploit latent low-dimensional structure. Proper orthogonal decomposition (POD) provides an energy-optimal linear basis to represent the flow kinematics, but converges slowly for advection-dominated flows and tends to overestimate the number of dynamically relevant variables. We show that nonlinear correlations in the temporal POD coefficients can be exploited to identify the underlying attractor, characterized by a minimal set of driving modes and a manifold equation for the remaining modes. By viewing these nonlinear correlations as an invariant manifold reduction, this least-order representation can be used to stabilize POD-Galerkin models or as a state space for data-driven model identification. In the latter case, we use sparse polynomial regression to learn a compact, interpretable dynamical system model from the time series of the active modal coefficients. We demonstrate this perspective on a quasiperiodic shear-driven cavity flow and show that the dynamics evolve on a torus generated by two independent Stuart-Landau oscillators. These results emphasize the importance of nonlinear dimensionality reduction to reveal underlying structure in complex flows. △ Less

Submitted 4 June, 2021; originally announced June 2021.

Comments: 33 pages, 14 figures

Kernel Learning for Robust Dynamic Mode Decomposition: Linear and Nonlinear Disambiguation Optimization (LANDO)

Authors: Peter J. Baddoo, Benjamin Herrmann, Beverley J. McKeon, Steven L. Brunton

Abstract: Research in modern data-driven dynamical systems is typically focused on the three key challenges of high dimensionality, unknown dynamics, and nonlinearity. The dynamic mode decomposition (DMD) has emerged as a cornerstone for modeling high-dimensional systems from data. However, the quality of the linear DMD model is known to be fragile with respect to strong nonlinearity, which contaminates the… ▽ More Research in modern data-driven dynamical systems is typically focused on the three key challenges of high dimensionality, unknown dynamics, and nonlinearity. The dynamic mode decomposition (DMD) has emerged as a cornerstone for modeling high-dimensional systems from data. However, the quality of the linear DMD model is known to be fragile with respect to strong nonlinearity, which contaminates the model estimate. In contrast, sparse identification of nonlinear dynamics (SINDy) learns fully nonlinear models, disambiguating the linear and nonlinear effects, but is restricted to low-dimensional systems. In this work, we present a kernel method that learns interpretable data-driven models for high-dimensional, nonlinear systems. Our method performs kernel regression on a sparse dictionary of samples that appreciably contribute to the underlying dynamics. We show that this kernel method efficiently handles high-dimensional data and is flexible enough to incorporate partial knowledge of system physics. It is possible to accurately recover the linear model contribution with this approach, disambiguating the effects of the implicitly defined nonlinear terms, resulting in a DMD-like model that is robust to strongly nonlinear dynamics. We demonstrate our approach on data from a wide range of nonlinear ordinary and partial differential equations that arise in the physical sciences. This framework can be used for many practical engineering tasks such as model order reduction, diagnostics, prediction, control, and discovery of governing laws. △ Less

Submitted 2 June, 2021; originally announced June 2021.

Comments: 44 pages, 12 figures

An empirical mean-field model of symmetry-breaking in a turbulent wake

Authors: Jared L. Callaham, Georgios Rigas, Jean-Christophe Loiseau, Steven L. Brunton

Abstract: This work develops a low-dimensional nonlinear stochastic model of symmetry-breaking coherent structures from experimental measurements of a turbulent axisymmetric bluff body wake. Traditional model reduction methods decompose the field into a set of modes with fixed spatial support but time-varying amplitudes. However, this fixed basis cannot resolve the mean flow deformation due to variable Reyn… ▽ More This work develops a low-dimensional nonlinear stochastic model of symmetry-breaking coherent structures from experimental measurements of a turbulent axisymmetric bluff body wake. Traditional model reduction methods decompose the field into a set of modes with fixed spatial support but time-varying amplitudes. However, this fixed basis cannot resolve the mean flow deformation due to variable Reynolds stresses, a central feature of Stuart's nonlinear stability mechanism, without the further assumption of weakly nonlinear interactions. Here, we introduce a parametric modal basis that depends on the instantaneous value of the unsteady aerodynamic center of pressure, which quantifies the degree to which the rotational symmetry of the wake is broken. Thus, the modes naturally interpolate between the unstable symmetric state and the nonlinear equilibrium. We estimate the modes from experimental measurements of the base pressure distribution by reducing the symmetry via phase alignment and averaging conditioned on the center of pressure. The amplitude dependence of the symmetric mode deviates significantly from the polynomial scaling predicted by weakly nonlinear analysis, confirming that the parametric basis is crucial for capturing the effect of strongly nonlinear interactions. We also introduce a second model term capturing axisymmetric fluctuations associated with the mean-field deformation. We then apply the Langevin regression system identification method to construct a stochastically forced nonlinear model for these two generalized mode coefficients. The resulting model reproduces empirical power spectra and probability distributions, suggesting a path towards develo** interpretable low-dimensional models of globally unstable turbulent flows from experimental measurements. △ Less

Submitted 28 May, 2021; originally announced May 2021.

Comments: 23 pages, 10 figures

Promoting global stability in data-driven models of quadratic nonlinear dynamics

Authors: Alan A. Kaptanoglu, Jared L. Callaham, Christopher J. Hansen, Aleksandr Aravkin, Steven L. Brunton

Abstract: Modeling realistic fluid and plasma flows is computationally intensive, motivating the use of reduced-order models for a variety of scientific and engineering tasks. However, it is challenging to characterize, much less guarantee, the global stability (i.e., long-time boundedness) of these models. The seminal work of Schlegel and Noack (JFM, 2015) provided a theorem outlining necessary and suffici… ▽ More Modeling realistic fluid and plasma flows is computationally intensive, motivating the use of reduced-order models for a variety of scientific and engineering tasks. However, it is challenging to characterize, much less guarantee, the global stability (i.e., long-time boundedness) of these models. The seminal work of Schlegel and Noack (JFM, 2015) provided a theorem outlining necessary and sufficient conditions to ensure global stability in systems with energy-preserving, quadratic nonlinearities, with the goal of evaluating the stability of projection-based models. In this work, we incorporate this theorem into modern data-driven models obtained via machine learning. First, we propose that this theorem should be a standard diagnostic for the stability of projection-based and data-driven models, examining the conditions under which it holds. Second, we illustrate how to modify the objective function in machine learning algorithms to promote globally stable models, with implications for the modeling of fluid and plasma flows. Specifically, we introduce a modified "trap** SINDy" algorithm based on the sparse identification of nonlinear dynamics (SINDy) method. This method enables the identification of models that, by construction, only produce bounded trajectories. The effectiveness and accuracy of this approach are demonstrated on a broad set of examples of varying model complexity and physical origin, including the vortex shedding in the wake of a circular cylinder. △ Less

Submitted 4 May, 2021; originally announced May 2021.

Journal ref: Phys. Rev. Fluids 6, 094401 (2021)

Improved approximations to the Wagner function using sparse identification of nonlinear dynamics

Authors: Scott T. M. Dawson, Steven L. Brunton

Abstract: The Wagner function in classical unsteady aerodynamic theory represents the response in lift on an airfoil that is subject to a sudden change in conditions. While it plays a fundamental role in the development and application of unsteady aerodynamic methods, explicit expressions for this function are difficult to obtain. The Wagner function requires computation of an inverse Laplace transform, or… ▽ More The Wagner function in classical unsteady aerodynamic theory represents the response in lift on an airfoil that is subject to a sudden change in conditions. While it plays a fundamental role in the development and application of unsteady aerodynamic methods, explicit expressions for this function are difficult to obtain. The Wagner function requires computation of an inverse Laplace transform, or similar inversion, of a non-rational function in the Laplace domain, which is closely related to the Theodorsen function. This has led to numerous proposed approximations to the Wagner function, which facilitate convenient and rapid computations. While these approximations can be sufficient for many purposes, their behavior is often noticeably different from the true Wagner function, especially for long-time asymptotic behavior. In particular, while many approximations have small maximum absolute error across all times, the relative error of the asymptotic behavior can be substantial. As well as documenting this error, we propose an alternative approximation methodology that is accurate for all times, for a variety of accuracy measures. This methodology casts the Wagner function as the solution of a nonlinear scalar ordinary differential equation, which is identified using a variant of the sparse identification of nonlinear dynamics (SINDy) algorithm. We show that this approach can give accurate approximations using either first- or second-order differential equations. We additionally show that this method can be applied to model the analogous lift response for a more realistic aerodynamic system, featuring a finite thickness airfoil and a nonplanar wake. △ Less

Submitted 15 September, 2021; v1 submitted 30 April, 2021; originally announced April 2021.

Near-Wake Dynamics of a Vertical-Axis Turbine

Authors: Benjamin Strom, Brian Polagye, Steven L. Brunton

Abstract: Cross-flow, or vertical-axis, turbines are a promising technology for capturing kinetic energy in wind or flowing water and their inherently unsteady fluid mechanics present unique opportunities for control optimization of individual rotors or arrays. To explore the potential for beneficial interactions between turbines in an array, coherent structures in the wake of a single two-bladed cross-flow… ▽ More Cross-flow, or vertical-axis, turbines are a promising technology for capturing kinetic energy in wind or flowing water and their inherently unsteady fluid mechanics present unique opportunities for control optimization of individual rotors or arrays. To explore the potential for beneficial interactions between turbines in an array, coherent structures in the wake of a single two-bladed cross-flow turbine are examined using planar stereo particle image velocimetry in a water channel. First, the mean wake structure of this high chord-to-radius ratio rotor is described, compared to previous studies, and a simple explanation for observed wake deflection is presented. Second, the unsteady flow is then analyzed via the triple decomposition, with the periodic component extracted using a combination of traditional techniques and a novel implementation of the optimized dynamic mode decomposition. The latter method is shown to outperform conditional averaging and Fourier methods, as well as uncover frequencies suggesting a transition to bluff-body shedding in the far wake. Third, vorticity and finite-time Lyapunov exponents are then employed to further analyze the oscillatory wake component. Vortex streets on both sides of the wake are identified, and their formation mechanisms and effects on the mean flow are discussed. Strong axial (vertical) flow is observed in vortical structures shed on the retreating side of the rotor where the blades travel downstream. Time-resolved tracking of these vortices is performed, which demonstrates that vortex trajectories have significant rotation-to-rotation variation within one diameter downstream. This variability suggests it would be challenging to harness or avoid such structures at greater downstream distances. △ Less

Submitted 28 February, 2021; originally announced March 2021.

Comments: 25 pages, 12 figures

MSC Class: 76-05; 76M27; 76M23; 76D55

DeepGreen: Deep Learning of Green's Functions for Nonlinear Boundary Value Problems

Authors: Craig R. Gin, Daniel E. Shea, Steven L. Brunton, J. Nathan Kutz

Abstract: Boundary value problems (BVPs) play a central role in the mathematical analysis of constrained physical systems subjected to external forces. Consequently, BVPs frequently emerge in nearly every engineering discipline and span problem domains including fluid mechanics, electromagnetics, quantum mechanics, and elasticity. The fundamental solution, or Green's function, is a leading method for solvin… ▽ More Boundary value problems (BVPs) play a central role in the mathematical analysis of constrained physical systems subjected to external forces. Consequently, BVPs frequently emerge in nearly every engineering discipline and span problem domains including fluid mechanics, electromagnetics, quantum mechanics, and elasticity. The fundamental solution, or Green's function, is a leading method for solving linear BVPs that enables facile computation of new solutions to systems under any external forcing. However, fundamental Green's function solutions for nonlinear BVPs are not feasible since linear superposition no longer holds. In this work, we propose a flexible deep learning approach to solve nonlinear BVPs using a dual-autoencoder architecture. The autoencoders discover an invertible coordinate transform that linearizes the nonlinear BVP and identifies both a linear operator $L$ and Green's function $G$ which can be used to solve new nonlinear BVPs. We find that the method succeeds on a variety of nonlinear systems including nonlinear Helmholtz and Sturm--Liouville problems, nonlinear elasticity, and a 2D nonlinear Poisson equation. The method merges the strengths of the universal approximation capabilities of deep learning with the physics knowledge of Green's functions to yield a flexible tool for identifying fundamental solutions to a variety of nonlinear systems. △ Less

Submitted 31 December, 2020; originally announced January 2021.

The structure of global conservation laws in Galerkin plasma models

Authors: Alan A. Kaptanoglu, Kyle D. Morgan, Christopher J. Hansen, Steven L. Brunton

Abstract: Plasmas are highly nonlinear and multi-scale, motivating a hierarchy of models to understand and describe their behavior. However, there is a scarcity of plasma models of lower fidelity than magnetohydrodynamics (MHD). Galerkin models, obtained by projection of the MHD equations onto a truncated modal basis, can furnish this gap in the lower levels of the model hierarchy. In the present work, we d… ▽ More Plasmas are highly nonlinear and multi-scale, motivating a hierarchy of models to understand and describe their behavior. However, there is a scarcity of plasma models of lower fidelity than magnetohydrodynamics (MHD). Galerkin models, obtained by projection of the MHD equations onto a truncated modal basis, can furnish this gap in the lower levels of the model hierarchy. In the present work, we develop low-dimensional Galerkin plasma models which preserve global conservation laws by construction. This additional model structure enables physics-constrained machine learning algorithms that can discover these types of low-dimensional plasma models directly from data. This formulation relies on an energy-based inner product which takes into account all of the dynamic variables. The theoretical results here build a bridge to the extensive Galerkin literature in fluid mechanics, and facilitate the development of physics-constrained reduced-order models from plasma data. △ Less

Submitted 9 January, 2021; originally announced January 2021.

Comments: arXiv admin note: text overlap with arXiv:2004.10389

Data-driven resolvent analysis

Authors: Benjamin Herrmann, Peter J. Baddoo, Richard Semaan, Steven L. Brunton, Beverley J. McKeon

Abstract: Resolvent analysis identifies the most responsive forcings and most receptive states of a dynamical system, in an input--output sense, based on its governing equations. Interest in the method has continued to grow during the past decade due to its potential to reveal structures in turbulent flows, to guide sensor/actuator placement, and for flow control applications. However, resolvent analysis re… ▽ More Resolvent analysis identifies the most responsive forcings and most receptive states of a dynamical system, in an input--output sense, based on its governing equations. Interest in the method has continued to grow during the past decade due to its potential to reveal structures in turbulent flows, to guide sensor/actuator placement, and for flow control applications. However, resolvent analysis requires access to high-fidelity numerical solvers to produce the linearized dynamics operator. In this work, we develop a purely data-driven algorithm to perform resolvent analysis to obtain the leading forcing and response modes, without recourse to the governing equations, but instead based on snapshots of the transient evolution of linearly stable flows. The formulation of our method follows from two established facts: $1)$ dynamic mode decomposition can approximate eigenvalues and eigenvectors of the underlying operator governing the evolution of a system from measurement data, and $2)$ a projection of the resolvent operator onto an invariant subspace can be built from this learned eigendecomposition. We demonstrate the method on numerical data of the linearized complex Ginzburg--Landau equation and of three-dimensional transitional channel flow, and discuss data requirements. The ability to perform resolvent analysis in a completely equation-free and adjoint-free manner will play a significant role in lowering the barrier of entry to resolvent research and applications. △ Less

Submitted 5 October, 2020; originally announced October 2020.

Sparse nonlinear models of chaotic electroconvection

Authors: Yifei Guan, Steven L. Brunton, Igor Novosselov

Abstract: Convection is a fundamental fluid transport phenomenon, where the large-scale motion of a fluid is driven, for example, by a thermal gradient or an electric potential. Modeling convection has given rise to the development of chaos theory and the reduced-order modeling of multiphysics systems; however, these models have been limited to relatively simple thermal convection phenomena. In this work, w… ▽ More Convection is a fundamental fluid transport phenomenon, where the large-scale motion of a fluid is driven, for example, by a thermal gradient or an electric potential. Modeling convection has given rise to the development of chaos theory and the reduced-order modeling of multiphysics systems; however, these models have been limited to relatively simple thermal convection phenomena. In this work, we develop a reduced-order model for chaotic electroconvection at high electric Rayleigh number. The chaos in this system is related to the standard Lorenz model obtained from Rayleigh-Benard convection, although our system is driven by a more complex three-way coupling between the fluid, the charge density, and the electric field. Coherent structures are extracted from temporally and spatially resolved charge density fields via proper orthogonal decomposition (POD). A nonlinear model is then developed for the chaotic time evolution of these coherent structures using the sparse identification of nonlinear dynamics (SINDy) algorithm, constrained to preserve the symmetries observed in the original system. The resulting model exhibits the dominant chaotic dynamics of the original high-dimensional system, capturing the essential nonlinear interactions with a simple reduced-order model. △ Less

Submitted 24 September, 2020; originally announced September 2020.

Comments: 14 pages, 4 figures

Nonlinear stochastic modeling with Langevin regression

Authors: Jared L. Callaham, Jean-Christophe Loiseau, Georgios Rigas, Steven L. Brunton

Abstract: Many physical systems characterized by nonlinear multiscale interactions can be effectively modeled by treating unresolved degrees of freedom as random fluctuations. However, even when the microscopic governing equations and qualitative macroscopic behavior are known, it is often difficult to derive a stochastic model that is consistent with observations. This is especially true for systems such a… ▽ More Many physical systems characterized by nonlinear multiscale interactions can be effectively modeled by treating unresolved degrees of freedom as random fluctuations. However, even when the microscopic governing equations and qualitative macroscopic behavior are known, it is often difficult to derive a stochastic model that is consistent with observations. This is especially true for systems such as turbulence where the perturbations do not behave like Gaussian white noise, introducing non-Markovian behavior to the dynamics. We address these challenges with a framework for identifying interpretable stochastic nonlinear dynamics from experimental data, using both forward and adjoint Fokker-Planck equations to enforce statistical consistency. If the form of the Langevin equation is unknown, a simple sparsifying procedure can provide an appropriate functional form. We demonstrate that this method can effectively learn stochastic models in two artificial examples: recovering a nonlinear Langevin equation forced by colored noise and approximating the second-order dynamics of a particle in a double-well potential with the corresponding first-order bifurcation normal form. Finally, we apply the proposed method to experimental measurements of a turbulent bluff body wake and show that the statistical behavior of the center of pressure can be described by the dynamics of the corresponding laminar flow driven by nonlinear state-dependent noise. △ Less

Submitted 15 March, 2021; v1 submitted 2 September, 2020; originally announced September 2020.

Comments: 30 pages, 13 figures

Journal ref: Proceedings of the Royal Society A 477, 2250 (2021)

Deep learning to accelerate Maxwell's equations for inverse design of dielectric metasurfaces

Authors: Maksym V. Zhelyeznyakov, Steven L. Brunton, Arka Majumdar

Abstract: The inverse design of optical metasurfaces is a rapidly emerging field that has already shown great promise in miniaturizing conventional optics as well as develo** completely new optical functionalities. Such a design process relies on many forward simulations of a device's optical response in order to optimize its performance. We present a data-driven forward simulation framework for the inver… ▽ More The inverse design of optical metasurfaces is a rapidly emerging field that has already shown great promise in miniaturizing conventional optics as well as develo** completely new optical functionalities. Such a design process relies on many forward simulations of a device's optical response in order to optimize its performance. We present a data-driven forward simulation framework for the inverse design of metasurfaces that is more accurate than methods based on the local phase approximation, a factor of $10^4$ times faster and requires $15$ times less memory than mesh based solvers, and is not constrained to spheroidal scatterer geometries. We explore the scattered electromagnetic field distribution from wavelength scale cylindrical pillars, obtaining low-dimensional representations of our data via the singular value decomposition. We create a differentiable model fiting the input geometries and configurations of our metasurface scatterers to the low-dimensional representation of the output field. To validate our model, we inverse design two optical elements: a wavelength multiplexed element that focuses light for $λ=633$nm and produces an annular beam at $λ=400$nm and an extended depth of focus lens. △ Less

Submitted 24 August, 2020; originally announced August 2020.

Hierarchical Deep Learning of Multiscale Differential Equation Time-Steppers

Authors: Yuying Liu, J. Nathan Kutz, Steven L. Brunton

Abstract: Nonlinear differential equations rarely admit closed-form solutions, thus requiring numerical time-step** algorithms to approximate solutions. Further, many systems characterized by multiscale physics exhibit dynamics over a vast range of timescales, making numerical integration computationally expensive due to numerical stiffness. In this work, we develop a hierarchy of deep neural network time… ▽ More Nonlinear differential equations rarely admit closed-form solutions, thus requiring numerical time-step** algorithms to approximate solutions. Further, many systems characterized by multiscale physics exhibit dynamics over a vast range of timescales, making numerical integration computationally expensive due to numerical stiffness. In this work, we develop a hierarchy of deep neural network time-steppers to approximate the flow map of the dynamical system over a disparate range of time-scales. The resulting model is purely data-driven and leverages features of the multiscale dynamics, enabling numerical integration and forecasting that is both accurate and highly efficient. Moreover, similar ideas can be used to couple neural network-based models with classical numerical time-steppers. Our multiscale hierarchical time-step** scheme provides important advantages over current time-step** algorithms, including (i) circumventing numerical stiffness due to disparate time-scales, (ii) improved accuracy in comparison with leading neural-network architectures, (iii) efficiency in long-time simulation/forecasting due to explicit training of slow time-scale dynamics, and (iv) a flexible framework that is parallelizable and may be integrated with standard numerical time-step** algorithms. The method is demonstrated on a wide range of nonlinear dynamical systems, including the Van der Pol oscillator, the Lorenz system, the Kuramoto-Sivashinsky equation, and fluid flow pass a cylinder; audio and video signals are also explored. On the sequence generation examples, we benchmark our algorithm against state-of-the-art methods, such as LSTM, reservoir computing, and clockwork RNN. Despite the structural simplicity of our method, it outperforms competing methods on numerical integration. △ Less

Submitted 22 August, 2020; originally announced August 2020.

Comments: 22 pages, 10 figures

Data-driven Modeling of Rotating Detonation Waves

Authors: Ariana Mendible, James Koch, Henning Lange, Steven L. Brunton, J. Nathan Kutz

Abstract: The direct monitoring of a rotating detonation engine (RDE) combustion chamber has enabled the observation of combustion front dynamics that are composed of a number of co- and/or counter-rotating coherent traveling shock waves whose nonlinear mode-locking behavior exhibit bifurcations and instabilities which are not well understood. Computational fluid dynamics simulations are ubiquitous in chara… ▽ More The direct monitoring of a rotating detonation engine (RDE) combustion chamber has enabled the observation of combustion front dynamics that are composed of a number of co- and/or counter-rotating coherent traveling shock waves whose nonlinear mode-locking behavior exhibit bifurcations and instabilities which are not well understood. Computational fluid dynamics simulations are ubiquitous in characterizing the dynamics of RDE's reactive, compressible flow. Such simulations are prohibitively expensive when considering multiple engine geometries, different operating conditions, and the long-time dynamics of the mode-locking interactions. Reduced-order models (ROMs) provide a critically enabling simulation framework because they exploit low-rank structure in the data to minimize computational cost and allow for rapid parameterized studies and long-time simulations. However, ROMs are inherently limited by translational invariances manifest by the combustion waves present in RDEs. In this work, we leverage machine learning algorithms to discover moving coordinate frames into which the data is shifted, thus overcoming limitations imposed by the underlying translational invariance of the RDE and allowing for the application of traditional dimensionality reduction techniques. We explore a diverse suite of data-driven ROM strategies for characterizing the complex shock wave dynamics and interactions in the RDE. Specifically, we employ the dynamic mode decomposition and a deep Koopman embedding to give new modeling insights and understanding of combustion wave interactions in RDEs. △ Less

Submitted 12 August, 2020; originally announced August 2020.

Comments: 17 pages, 12 figures

Journal ref: Phys. Rev. Fluids 6, 050507 (2021)

Geometric and Control Optimization of a Two Cross-Flow Turbine Array

Authors: Isabel Scherl, Benjamin Strom, Steven L. Brunton, Brian L. Polagye

Abstract: Cross-flow turbines, also known as vertical-axis turbines, convert the kinetic energy in moving fluid to mechanical energy using blades that rotate about an axis perpendicular to the incoming flow. In this work, the performance of a two-turbine array in a recirculating water channel was experimentally optimized across sixty-four unique array configurations. For each configuration, turbine performa… ▽ More Cross-flow turbines, also known as vertical-axis turbines, convert the kinetic energy in moving fluid to mechanical energy using blades that rotate about an axis perpendicular to the incoming flow. In this work, the performance of a two-turbine array in a recirculating water channel was experimentally optimized across sixty-four unique array configurations. For each configuration, turbine performance was optimized using tip-speed ratio control, where the rotation rate for each turbine is optimized individually, and using coordinated control, where the turbines are optimized to operate at synchronous rotation rates, but with a phase difference. For each configuration and control strategy, the consequences of co- and counter-rotation were also evaluated. We hypothesize how array configurations and control cases influence interactions between turbines and impact array performance. △ Less

Submitted 17 July, 2020; originally announced July 2020.

Deep reinforcement learning for optical systems: A case study of mode-locked lasers

Authors: Chang Sun, Eurika Kaiser, Steven L. Brunton, J. Nathan Kutz

Abstract: We demonstrate that deep reinforcement learning (deep RL) provides a highly effective strategy for the control and self-tuning of optical systems. Deep RL integrates the two leading machine learning architectures of deep neural networks and reinforcement learning to produce robust and stable learning for control. Deep RL is ideally suited for optical systems as the tuning and control relies on int… ▽ More We demonstrate that deep reinforcement learning (deep RL) provides a highly effective strategy for the control and self-tuning of optical systems. Deep RL integrates the two leading machine learning architectures of deep neural networks and reinforcement learning to produce robust and stable learning for control. Deep RL is ideally suited for optical systems as the tuning and control relies on interactions with its environment with a goal-oriented objective to achieve optimal immediate or delayed rewards. This allows the optical system to recognize bi-stable structures and navigate, via trajectory planning, to optimally performing solutions, the first such algorithm demonstrated to do so in optical systems. We specifically demonstrate the deep RL architecture on a mode-locked laser, where robust self-tuning and control can be established through access of the deep RL agent to its waveplates and polarizers. We further integrate transfer learning to help the deep RL agent rapidly learn new parameter regimes and generalize its control authority. Additionally, the deep RL learning can be easily integrated with other control paradigms to provide a broad framework to control any optical system. △ Less

Submitted 9 June, 2020; originally announced June 2020.

Principal component trajectories for modeling spectrally-continuous dynamics as forced linear systems

Authors: Daniel Dylewsky, Eurika Kaiser, Steven L. Brunton, J. Nathan Kutz

Abstract: Delay embeddings of time series data have emerged as a promising coordinate basis for data-driven estimation of the Koopman operator, which seeks a linear representation for observed nonlinear dynamics. Recent work has demonstrated the efficacy of Dynamic Mode Decomposition (DMD) for obtaining finite-dimensional Koopman approximations in delay coordinates. In this paper we demonstrate how nonlinea… ▽ More Delay embeddings of time series data have emerged as a promising coordinate basis for data-driven estimation of the Koopman operator, which seeks a linear representation for observed nonlinear dynamics. Recent work has demonstrated the efficacy of Dynamic Mode Decomposition (DMD) for obtaining finite-dimensional Koopman approximations in delay coordinates. In this paper we demonstrate how nonlinear dynamics with sparse Fourier spectra can be (i) represented by a superposition of principal component trajectories (PCT) and (ii) modeled by DMD in this coordinate space. For continuous or mixed (discrete and continuous) spectra, DMD can be augmented with an external forcing term. We present a method for learning linear control models in delay coordinates while simultaneously discovering the corresponding exogeneous forcing signal in a fully unsupervised manner. This extends the existing DMD with control (DMDc) algorithm to cases where a control signal is not known a priori. We provide examples to validate the learned forcing against a known ground truth and illustrate their statistical similarity. Finally we offer a demonstration of this method applied to real-world power grid load data to show its utility for diagnostics and interpretation on systems in which somewhat periodic behavior is strongly forced by unknown and unmeasurable environmental variables. △ Less

Submitted 12 January, 2022; v1 submitted 28 May, 2020; originally announced May 2020.

Phase-based control of periodic fluid flows

Authors: Aditya G. Nair, Kunihiko Taira, Bingni W. Brunton, Steven L. Brunton

Abstract: Fluid flows play a central role in scientific and technological development, and many of these flows are characterized by a dominant oscillation, such as the vortex shedding in the wake of nearly all transportation vehicles. The ability to control vortex shedding is critical to improve the aerodynamic performance of these unsteady fluid flow systems. This goal requires precise characterization of… ▽ More Fluid flows play a central role in scientific and technological development, and many of these flows are characterized by a dominant oscillation, such as the vortex shedding in the wake of nearly all transportation vehicles. The ability to control vortex shedding is critical to improve the aerodynamic performance of these unsteady fluid flow systems. This goal requires precise characterization of how perturbations affect the long-time phase of the oscillatory flow, as well as the ability to control transient behaviors. In this work, we develop an energy-efficient flow control strategy to rapidly alter the oscillation phase of time-periodic fluid flows, leveraging theory developed for periodic biological systems. First, we perform a phase-sensitivity analysis to construct a reduced-order model for the response of the flow oscillation to impulsive control inputs at various phases. Next, we introduce two control strategies for real-time phase control based on the phase-sensitivity function: 1) optimal phase control, obtained by solving the Euler-Lagrange equations as a two-point boundary value problem, and 2) model-predictive control (MPC). Our approach is demonstrated for two unsteady flow systems, the incompressible laminar flow past a circular cylinder and the flow past an airfoil. We show that effective phase control may be achieved with several actuation strategies, including blowing and rotary control. Moreover, our control approach uses realistic measurements of the lift force on the body, rather than requiring high-dimensional measurements of the full flow field. △ Less

Submitted 22 April, 2020; originally announced April 2020.

Comments: 23 pages, 11 figures

Physics-constrained, low-dimensional models for MHD: First-principles and data-driven approaches

Authors: Alan A. Kaptanoglu, Kyle D. Morgan, Chris J. Hansen, Steven L. Brunton

Abstract: Plasmas are highly nonlinear and multi-scale, motivating a hierarchy of models to understand and describe their behavior. However, there is a scarcity of plasma models of lower fidelity than magnetohydrodynamics (MHD), although these reduced models hold promise for understanding key physical mechanisms, efficient computation, and real-time optimization and control. Galerkin models, obtained by pro… ▽ More Plasmas are highly nonlinear and multi-scale, motivating a hierarchy of models to understand and describe their behavior. However, there is a scarcity of plasma models of lower fidelity than magnetohydrodynamics (MHD), although these reduced models hold promise for understanding key physical mechanisms, efficient computation, and real-time optimization and control. Galerkin models, obtained by projection of the MHD equations onto a truncated modal basis, and data-driven models, obtained by modern machine learning and system identification, can furnish this gap in the lower levels of the model hierarchy. This work develops a reduced-order modeling framework for compressible plasmas, leveraging decades of progress in projection-based and data-driven modeling of fluids. We begin by formalizing projection-based model reduction for nonlinear MHD systems. To avoid separate modal decompositions for the magnetic, velocity, and pressure fields, we introduce an energy inner product to synthesize all of the fields into a dimensionally-consistent, reduced-order basis. Next, we obtain an analytic model by Galerkin projection of the Hall-MHD equations onto these modes. We illustrate how global conservation laws constrain the model parameters, revealing symmetries that can be enforced in data-driven models, directly connecting these models to the underlying physics. We demonstrate the effectiveness of this approach on data from high-fidelity numerical simulations of a 3D spheromak experiment. This manuscript builds a bridge to the extensive Galerkin literature in fluid mechanics, and facilitates future principled development of projection-based and data-driven models for plasmas. △ Less

Submitted 15 July, 2021; v1 submitted 22 April, 2020; originally announced April 2020.

Journal ref: Phys. Rev. E 104, 015206 (2021)

PySINDy: A Python package for the Sparse Identification of Nonlinear Dynamics from Data

Authors: Brian M. de Silva, Kathleen Champion, Markus Quade, Jean-Christophe Loiseau, J. Nathan Kutz, Steven L. Brunton

Abstract: PySINDy is a Python package for the discovery of governing dynamical systems models from data. In particular, PySINDy provides tools for applying the sparse identification of nonlinear dynamics (SINDy) (Brunton et al. 2016) approach to model discovery. In this work we provide a brief description of the mathematical underpinnings of SINDy, an overview and demonstration of the features implemented i… ▽ More PySINDy is a Python package for the discovery of governing dynamical systems models from data. In particular, PySINDy provides tools for applying the sparse identification of nonlinear dynamics (SINDy) (Brunton et al. 2016) approach to model discovery. In this work we provide a brief description of the mathematical underpinnings of SINDy, an overview and demonstration of the features implemented in PySINDy (with code examples), practical advice for users, and a list of potential extensions to PySINDy. Software is available at https://github.com/dynamicslab/pysindy. △ Less

Submitted 17 April, 2020; originally announced April 2020.

SINDy-PI: A Robust Algorithm for Parallel Implicit Sparse Identification of Nonlinear Dynamics

Authors: Kadierdan Kaheman, J. Nathan Kutz, Steven L. Brunton

Abstract: Accurately modeling the nonlinear dynamics of a system from measurement data is a challenging yet vital topic. The sparse identification of nonlinear dynamics (SINDy) algorithm is one approach to discover dynamical systems models from data. Although extensions have been developed to identify implicit dynamics, or dynamics described by rational functions, these extensions are extremely sensitive to… ▽ More Accurately modeling the nonlinear dynamics of a system from measurement data is a challenging yet vital topic. The sparse identification of nonlinear dynamics (SINDy) algorithm is one approach to discover dynamical systems models from data. Although extensions have been developed to identify implicit dynamics, or dynamics described by rational functions, these extensions are extremely sensitive to noise. In this work, we develop SINDy-PI (parallel, implicit), a robust variant of the SINDy algorithm to identify implicit dynamics and rational nonlinearities. The SINDy-PI framework includes multiple optimization algorithms and a principled approach to model selection. We demonstrate the ability of this algorithm to learn implicit ordinary and partial differential equations and conservation laws from limited and noisy data. In particular, we show that the proposed approach is several orders of magnitude more noise robust than previous approaches, and may be used to identify a class of complex ODE and PDE dynamics that were previously unattainable with SINDy, including for the double pendulum dynamics and the Belousov Zhabotinsky (BZ) reaction. △ Less

Submitted 29 September, 2020; v1 submitted 5 April, 2020; originally announced April 2020.

Comments: 25 pages, 9 figures, 5 tables

MSC Class: 93B30

Data-driven nonlinear aeroelastic models of morphing wings for control

Authors: Nicola Fonzi, Steven L. Brunton, Urban Fasel

Abstract: Accurate and efficient aeroelastic models are critically important for enabling the optimization and control of highly flexible aerospace structures, which are expected to become pervasive in future transportation and energy systems. Advanced materials and morphing wing technologies are resulting in next-generation aeroelastic systems that are characterized by highly-coupled and nonlinear interact… ▽ More Accurate and efficient aeroelastic models are critically important for enabling the optimization and control of highly flexible aerospace structures, which are expected to become pervasive in future transportation and energy systems. Advanced materials and morphing wing technologies are resulting in next-generation aeroelastic systems that are characterized by highly-coupled and nonlinear interactions between the aerodynamic and structural dynamics. In this work, we leverage emerging data-driven modeling techniques to develop highly accurate and tractable reduced-order aeroelastic models that are valid over a wide range of operating conditions and are suitable for control. In particular, we develop two extensions to the recent dynamic mode decomposition with control (DMDc) algorithm to make it suitable for flexible aeroelastic systems: 1) we introduce a formulation to handle algebraic equations, and 2) we develop an interpolation scheme to smoothly connect several linear DMDc models developed in different operating regimes. Thus, the innovation lies in accurately modeling the nonlinearities of the coupled aerostructural dynamics over multiple operating regimes, not restricting the validity of the model to a narrow region around a linearization point. We demonstrate this approach on a high-fidelity, three-dimensional numerical model of an airborne wind energy (AWE) system, although the methods are generally applicable to any highly coupled aeroelastic system or dynamical system operating over multiple operating regimes. Our proposed modeling framework results in real-time prediction of nonlinear unsteady aeroelastic responses of flexible aerospace structures, and we demonstrate the enhanced model performance for model predictive control. Thus, the proposed architecture may help enable the widespread adoption of next-generation morphing wing technologies. △ Less

Submitted 8 February, 2020; originally announced February 2020.

Modeling synchronization in forced turbulent oscillator flows

Authors: Benjamin Herrmann, Philipp Oswald, Richard Semaan, Steven L. Brunton

Abstract: Periodically forced, oscillatory fluid flows have been the focus of intense research for decades due to their richness as a nonlinear dynamical system and their relevance to applications in transportation, aeronautics, and energy conversion. Recently, it has been observed that turbulent bluff-body wakes exhibit a subharmonic resonant response when excited with specific spatial symmetries at twice… ▽ More Periodically forced, oscillatory fluid flows have been the focus of intense research for decades due to their richness as a nonlinear dynamical system and their relevance to applications in transportation, aeronautics, and energy conversion. Recently, it has been observed that turbulent bluff-body wakes exhibit a subharmonic resonant response when excited with specific spatial symmetries at twice the natural vortex shedding frequency, which is hypothesized to be caused by triadic interactions. The focus of this paper is to provide new physical insight into the dynamics of turbulent oscillator flows, based on improved mechanistic models informed by a comprehensive experimental study of the turbulent wake behind a D-shaped body under periodic forcing. We confirm for the first time the role of resonant triadic interactions in the forced flow by studying the dominant components in the power spectra across multiple excitation frequencies and amplitudes. We then develop an extended Stuart-Landau model for the forced global wake mode, incorporating parametric and non-harmonic forcing. This model captures the system dynamics and reveals the boundaries of multiple synchronization regions. Further, it is possible to identify model coefficients from sparse measurement data, making it applicable to a wide range of turbulent oscillator flows. We believe these generalized synchronization models will be valuable for prediction, control, and understanding of the underlying physics in this ubiquitous class of flows. △ Less

Submitted 31 January, 2020; originally announced January 2020.

Comments: 10 pages, 5 figures

Learning dominant physical processes with data-driven balance models

Authors: Jared L. Callaham, James V. Koch, Bingni W. Brunton, J. Nathan Kutz, Steven L. Brunton

Abstract: Throughout the history of science, physics-based modeling has relied on judiciously approximating observed dynamics as a balance between a few dominant processes. However, this traditional approach is mathematically cumbersome and only applies in asymptotic regimes where there is a strict separation of scales in the physics. Here, we automate and generalize this approach to non-asymptotic regimes… ▽ More Throughout the history of science, physics-based modeling has relied on judiciously approximating observed dynamics as a balance between a few dominant processes. However, this traditional approach is mathematically cumbersome and only applies in asymptotic regimes where there is a strict separation of scales in the physics. Here, we automate and generalize this approach to non-asymptotic regimes by introducing the idea of an equation space, in which different local balances appear as distinct subspace clusters. Unsupervised learning can then automatically identify regions where groups of terms may be neglected. We show that our data-driven balance models successfully delineate dominant balance physics in a much richer class of systems. In particular, this approach uncovers key mechanistic models in turbulence, combustion, nonlinear optics, geophysical fluids, and neuroscience. △ Less

Submitted 19 January, 2021; v1 submitted 27 January, 2020; originally announced January 2020.

Comments: 30 pages, 13 figures

Journal ref: Nature Communications 12, 1016 (2021)