Showing 1–21 of 21 results for author: Sapsis, T

Evaluation of machine learning architectures on the quantification of epistemic and aleatoric uncertainties in complex dynamical systems

Authors: Stephen Guth, Alireza Mojahed, Themistoklis P. Sapsis

Abstract: Machine learning methods for the construction of data-driven reduced order model models are used in an increasing variety of engineering domains, especially as a supplement to expensive computational fluid dynamics for design problems. An important check on the reliability of surrogate models is Uncertainty Quantification (UQ), a self assessed estimate of the model error. Accurate UQ allows for co… ▽ More Machine learning methods for the construction of data-driven reduced order model models are used in an increasing variety of engineering domains, especially as a supplement to expensive computational fluid dynamics for design problems. An important check on the reliability of surrogate models is Uncertainty Quantification (UQ), a self assessed estimate of the model error. Accurate UQ allows for cost savings by reducing both the required size of training data sets and the required safety factors, while poor UQ prevents users from confidently relying on model predictions. We examine several machine learning techniques, including both Gaussian processes and a family UQ-augmented neural networks: Ensemble neural networks (ENN), Bayesian neural networks (BNN), Dropout neural networks (D-NN), and Gaussian neural networks (G-NN). We evaluate UQ accuracy (distinct from model accuracy) using two metrics: the distribution of normalized residuals on validation data, and the distribution of estimated uncertainties. We apply these metrics to two model data sets, representative of complex dynamical systems: an ocean engineering problem in which a ship traverses irregular wave episodes, and a dispersive wave turbulence system with extreme events, the Majda-McLaughlin-Tabak model. We present conclusions concerning model architecture and hyperparameter tuning. △ Less

Submitted 26 June, 2023; originally announced June 2023.

Comments: Submitted for publication to "Computer Methods in Applied Mechanics and Engineering." 25 pages, 20 figures. arXiv admin note: text overlap with arXiv:1505.05424 by other authors

Harnessing the instability mechanisms in airfoil flow for the data-driven forecasting of extreme events

Authors: Benedikt Barthel, Themistoklis Sapsis

Abstract: This work addresses the data-driven forecasting of extreme events in the airfoil flow. These events may be seen as examples of the kind of unsteady and intermittent dynamics relevant to the flow around airfoils and wings in a variety of laboratory and real-world applications. W investigate the instability mechanisms at the heart of these extreme events, and how knowledge thereof may be harnessed f… ▽ More This work addresses the data-driven forecasting of extreme events in the airfoil flow. These events may be seen as examples of the kind of unsteady and intermittent dynamics relevant to the flow around airfoils and wings in a variety of laboratory and real-world applications. W investigate the instability mechanisms at the heart of these extreme events, and how knowledge thereof may be harnessed for efficient data driven forecasting. Through a wavelet and spectral analysis of the flow we find that the extreme events arise due to the instability of a specific frequency component distinct from the vortex shedding mode. During these events this extreme event manifold draws energy from the energetically dominant vortex shedding flow and undergoes an abrupt energy transfer from small to large scales. We also investigate the spatial dependence of the temporal correlation and mutual information between the surface pressure and the aerodynamic forces, with the aim of identifying regions of the airfoil amenable to sparse sensing and the efficient forecasting of extremes. Building on previous work, we show that relying solely on the mutual information for optimal sensor placement fails to improve model prediction over uniform or random sensor placement. However, we show that by isolating the extreme event frequency component offline through a wavelet transform we are able to circumvent the requirement for a recursive long-short term memory (LSTM) network -- resulting in a significant reduction in computational complexity over the previous state of the art. Using the wavelet pre-processed data in conjunction with an extreme event-tailored loss function we find that our model is capable of forecasting extreme events using only three pressure sensors. Furthermore, we find our model to be robust to sensor location -- showing promise for the use of our model in dynamically varying applications. △ Less

Submitted 13 March, 2023; originally announced March 2023.

Optimal criteria and their asymptotic form for data selection in data-driven reduced-order modeling with Gaussian process regression

Authors: Themistoklis P. Sapsis, Antoine Blanchard

Abstract: We derive criteria for the selection of datapoints used for data-driven reduced-order modeling and other areas of supervised learning based on Gaussian process regression (GPR). While this is a well-studied area in the fields of active learning and optimal experimental design, most criteria in the literature are empirical. Here we introduce an optimality condition for the selection of a new input… ▽ More We derive criteria for the selection of datapoints used for data-driven reduced-order modeling and other areas of supervised learning based on Gaussian process regression (GPR). While this is a well-studied area in the fields of active learning and optimal experimental design, most criteria in the literature are empirical. Here we introduce an optimality condition for the selection of a new input defined as the minimizer of the distance between the approximated output probability density function (pdf) of the reduced-order model and the exact one. Given that the exact pdf is unknown, we define the selection criterion as the supremum over the unit sphere of the native Hilbert space for the GPR. The resulting selection criterion, however, has a form that is difficult to compute. We combine results from GPR theory and asymptotic analysis to derive a computable form of the defined optimality criterion that is valid in the limit of small predictive variance. The derived asymptotic form of the selection criterion leads to convergence of the GPR model that guarantees a balanced distribution of data resources between probable and large-deviation outputs, resulting in an effective way for sampling towards data-driven reduced-order modeling. △ Less

Submitted 5 December, 2021; originally announced December 2021.

Output-weighted and relative entropy loss functions for deep learning precursors of extreme events

Authors: Samuel Rudy, Themistoklis Sapsis

Abstract: Many scientific and engineering problems require accurate models of dynamical systems with rare and extreme events. Such problems present a challenging task for data-driven modelling, with many naive machine learning methods failing to predict or accurately quantify such events. One cause for this difficulty is that systems with extreme events, by definition, yield imbalanced datasets and that sta… ▽ More Many scientific and engineering problems require accurate models of dynamical systems with rare and extreme events. Such problems present a challenging task for data-driven modelling, with many naive machine learning methods failing to predict or accurately quantify such events. One cause for this difficulty is that systems with extreme events, by definition, yield imbalanced datasets and that standard loss functions easily ignore rare events. That is, metrics for goodness of fit used to train models are not designed to ensure accuracy on rare events. This work seeks to improve the performance of regression models for extreme events by considering loss functions designed to highlight outliers. We propose a novel loss function, the adjusted output weighted loss, and extend the applicability of relative entropy based loss functions to systems with low dimensional output. The proposed functions are tested using several cases of dynamical systems exhibiting extreme events and shown to significantly improve accuracy in predictions of extreme events. △ Less

Submitted 1 December, 2021; originally announced December 2021.

Hybrid quadrature moment method for accurate and stable representation of non-Gaussian processes and their dynamics

Authors: Alexis-Tzianni Charalampopoulos, Spencer H. Bryngelson, Tim Colonius, Themistoklis P. Sapsis

Abstract: Solving the population balance equation (PBE) for the dynamics of a dispersed phase coupled to a continuous fluid is expensive. Still, one can reduce the cost by representing the evolving particle density function in terms of its moments. In particular, quadrature-based moment methods (QBMMs) invert these moments with a quadrature rule, approximating the required statistics. QBMMs have been shown… ▽ More Solving the population balance equation (PBE) for the dynamics of a dispersed phase coupled to a continuous fluid is expensive. Still, one can reduce the cost by representing the evolving particle density function in terms of its moments. In particular, quadrature-based moment methods (QBMMs) invert these moments with a quadrature rule, approximating the required statistics. QBMMs have been shown to accurately model sprays and soot with a relatively compact set of moments. However, significantly non-Gaussian processes such as bubble dynamics lead to numerical instabilities when extending their moment sets accordingly. We solve this problem by training a recurrent neural network (RNN) that adjusts the QBMM quadrature to evaluate unclosed moments with higher accuracy. The proposed method is tested on a simple model of bubbles oscillating in response to a temporally fluctuating pressure field. The approach decreases model-form error by a factor of 10 when compared to traditional QBMMs. It is both numerically stable and computationally efficient since it does not expand the baseline moment set. Additional quadrature points are also assessed, optimally placed and weighted according to an additional RNN. These points further decrease the error at low cost since the moment set is again unchanged. △ Less

Submitted 15 September, 2021; originally announced October 2021.

Journal ref: Philosophical Transactions of the Royal Society A, 380 (2229), 2022

Probabilistic characterization of the effect of transient stochastic loads on the fatigue-crack nucleation time

Authors: Stephen Guth, Themistoklis P. Sapsis

Abstract: The rainflow counting algorithm for material fatigue is both simple to implement and extraordinarily successful for predicting material failure times. However, it neglects memory effects and time-ordering dependence, and therefore runs into difficulties dealing with highly intermittent or transient stochastic loads with heavy tailed distributions. Such loads appear frequently in a wide range of ap… ▽ More The rainflow counting algorithm for material fatigue is both simple to implement and extraordinarily successful for predicting material failure times. However, it neglects memory effects and time-ordering dependence, and therefore runs into difficulties dealing with highly intermittent or transient stochastic loads with heavy tailed distributions. Such loads appear frequently in a wide range of applications in ocean and mechanical engineering, such as wind turbines and offshore structures. In this work we employ the Serebrinsky-Ortiz cohesive envelope model for material fatigue to characterize the effects of load intermittency on the fatigue-crack nucleation time. We first formulate efficient numerical integration schemes, which allow for the direct characterization of the fatigue life in terms of any given load time-series. Subsequently, we consider the case of stochastic intermittent loads with given statistical characteristics. To overcome the need for expensive Monte-Carlo simulations, we formulate the fatigue life as an up-crossing problem of the coherent envelope. Assuming statistical independence for the large intermittent spikes and using probabilistic arguments we derive closed expressions for the up-crossing properties of the coherent envelope and obtain analytical approximations for the probability mass function of the failure time. The analytical expressions are derived directly in terms of the probability density function of the load, as well as the coherent envelope. We examine the accuracy of the analytical approximations and compare the predicted failure time with the standard rainflow algorithm for various loads. Finally, we use the analytical expressions to examine the robustness of the derived probability distribution for the failure time with respect to the coherent envelope geometrical properties. △ Less

Submitted 12 October, 2020; originally announced November 2020.

Sparse Methods for Automatic Relevance Determination

Authors: Samuel H. Rudy, Themistoklis P. Sapsis

Abstract: This work considers methods for imposing sparsity in Bayesian regression with applications in nonlinear system identification. We first review automatic relevance determination (ARD) and analytically demonstrate the need to additional regularization or thresholding to achieve sparse models. We then discuss two classes of methods, regularization based and thresholding based, which build on ARD to l… ▽ More This work considers methods for imposing sparsity in Bayesian regression with applications in nonlinear system identification. We first review automatic relevance determination (ARD) and analytically demonstrate the need to additional regularization or thresholding to achieve sparse models. We then discuss two classes of methods, regularization based and thresholding based, which build on ARD to learn parsimonious solutions to linear problems. In the case of orthogonal covariates, we analytically demonstrate favorable performance with regards to learning a small set of active terms in a linear system with a sparse solution. Several example problems are presented to compare the set of proposed methods in terms of advantages and limitations to ARD in bases with hundreds of elements. The aim of this paper is to analyze and understand the assumptions that lead to several algorithms and to provide theoretical and empirical results so that the reader may gain insight and make more informed choices regarding sparse Bayesian regression. △ Less

Submitted 18 May, 2020; originally announced May 2020.

A Local Spectral Exterior Calculus for the Sphere and Application to the Shallow Water Equations

Authors: Clauson Carvalho da Silva, Christian Lessig, Boyko Dodov, Henk Dijkstra, Themis Sapsis

Abstract: We introduce $Ψ\mathrm{ec}$, a local spectral exterior calculus for the two-sphere $S^2$. $Ψ\mathrm{ec}$ provides a discretization of Cartan's exterior calculus on $S^2$ formed by spherical differential $r$-form wavelets. These are well localized in space and frequency and provide (Stevenson) frames for the homogeneous Sobolev spaces $\dot{H}^{-r+1}( Ω_ν^{r} , S^2 )$ of differential $r$-forms. At… ▽ More We introduce $Ψ\mathrm{ec}$, a local spectral exterior calculus for the two-sphere $S^2$. $Ψ\mathrm{ec}$ provides a discretization of Cartan's exterior calculus on $S^2$ formed by spherical differential $r$-form wavelets. These are well localized in space and frequency and provide (Stevenson) frames for the homogeneous Sobolev spaces $\dot{H}^{-r+1}( Ω_ν^{r} , S^2 )$ of differential $r$-forms. At the same time, they satisfy important properties of the exterior calculus, such as the de Rahm complex and the Hodge-Helmholtz decomposition. Through this, $Ψ\mathrm{ec}$ is tailored towards structure preserving discretizations that can adapt to solutions with varying regularity. The construction of $Ψ\mathrm{ec}$ is based on a novel spherical wavelet frame for $L_2(S^2)$ that we obtain by introducing scalable reproducing kernel frames. These extend scalable frames to weighted sampling expansions and provide an alternative to quadrature rules for the discretization of needlet-like scale-discrete wavelets. We verify the practicality of $Ψ\mathrm{ec}$ for numerical computations using the rotating shallow water equations. Our numerical results demonstrate that a $Ψ\mathrm{ec}$-based discretization of the equations attains accuracy comparable to those of spectral methods while using a representation that is well localized in space and frequency. △ Less

Submitted 7 May, 2020; originally announced May 2020.

MSC Class: 65M70; 58J90; 65T60

Machine-Learning Ocean Dynamics from Lagrangian Drifter Trajectories

Authors: Nikolas O. Aksamit, Themistoklis P. Sapsis, George Haller

Abstract: Lagrangian ocean drifters provide highly accurate approximations of ocean surface currents but are sparsely located across the globe. As drifters passively follow ocean currents, there is minimal control on where they will be making measurements, providing limited temporal coverage for a given region. Complementary Eulerian velocity data is available with global coverage, but is itself limited by… ▽ More Lagrangian ocean drifters provide highly accurate approximations of ocean surface currents but are sparsely located across the globe. As drifters passively follow ocean currents, there is minimal control on where they will be making measurements, providing limited temporal coverage for a given region. Complementary Eulerian velocity data is available with global coverage, but is itself limited by the spatial and temporal resolution possible with satellite altimetry measurements. Additionally, altimetry measurements approximate geostrophic components of ocean currents but neglect smaller sub-mesoscale motions and require smoothing and interpolation from raw satellite track measurements. In an effort to harness the rich dynamics available in ocean drifter datasets, we have trained a recurrent neural network on the time history of drifter motion to minimize the error in a reduced-order Maxey-Riley drifter model. This approach relies on a slow-manifold approximation to determine the most mathematically-relevant variables with which to train, subsequently improving the temporal and spatial resolution of the underlying velocity field. By adding this neural network component, we also correct drifter trajectories near sub-mesoscale features missed by deterministic models using only satellite and wind reanalysis data. The effect of varying similarity between training and testing trajectory datasets for the blended model was evaluated, as was the effect of seasonality in the Gulf of Mexico. △ Less

Submitted 27 September, 2019; originally announced September 2019.

Generative stochastic modeling of strongly nonlinear flows with non-Gaussian statistics

Authors: Hassan Arbabi, Themistoklis Sapsis

Abstract: Strongly nonlinear flows, which commonly arise in geophysical and engineering turbulence, are characterized by persistent and intermittent energy transfer between various spatial and temporal scales. These systems are difficult to model and analyze due to combination of high dimensionality and uncertainty, and there has been much interest in obtaining reduced models, in the form of stochastic clos… ▽ More Strongly nonlinear flows, which commonly arise in geophysical and engineering turbulence, are characterized by persistent and intermittent energy transfer between various spatial and temporal scales. These systems are difficult to model and analyze due to combination of high dimensionality and uncertainty, and there has been much interest in obtaining reduced models, in the form of stochastic closures, that can replicate their non-Gaussian statistics in many dimensions. Here, we propose a data-driven framework to model stationary chaotic dynamical systems through nonlinear transformations and a set of decoupled stochastic differential equations (SDEs). Specifically, we use optimal transport to find a transformation from the distribution of time-series data to a multiplicative reference probability measure such as the standard normal distribution. Then we find the set of decoupled SDEs that admit the reference measure as the invariant measure, and also closely match the spectrum of the transformed data. As such, this framework represents the chaotic time series as the evolution of a stochastic system observed through the lens of a nonlinear map. We demonstrate the application of this framework in Lorenz-96 system, a 10-dimensional model of high-Reynolds cavity flow, and reanalysis climate data. These examples show that SDE models generated by this framework can reproduce the non-Gaussian statistics of systems with moderate dimensions (e.g. 10 and more), and predict super-Gaussian tails that are not readily available from little training data. These findings suggest that this class of models provide an efficient hypothesis space for learning strongly nonlinear flows from small amounts of data. △ Less

Submitted 22 January, 2022; v1 submitted 20 August, 2019; originally announced August 2019.

Comments: tiny changes to citations

MSC Class: 62G32; 76F20; 49Q22; 60G10

Learning the Tangent Space of Dynamical Instabilities from Data

Authors: Antoine Blanchard, Themistoklis P. Sapsis

Abstract: For a large class of dynamical systems, the optimally time-dependent (OTD) modes, a set of deformable orthonormal tangent vectors that track directions of instabilities along any trajectory, are known to depend "pointwise" on the state of the system on the attractor, and not on the history of the trajectory. We leverage the power of neural networks to learn this "pointwise" map** from phase spac… ▽ More For a large class of dynamical systems, the optimally time-dependent (OTD) modes, a set of deformable orthonormal tangent vectors that track directions of instabilities along any trajectory, are known to depend "pointwise" on the state of the system on the attractor, and not on the history of the trajectory. We leverage the power of neural networks to learn this "pointwise" map** from phase space to OTD space directly from data. The result of the learning process is a cartography of directions associated with strongest instabilities in phase space. Implications for data-driven prediction and control of dynamical instabilities are discussed. △ Less

Submitted 8 November, 2019; v1 submitted 24 July, 2019; originally announced July 2019.

Closed-loop adaptive control of extreme events in a turbulent flow

Authors: Mohammad Farazmand, Themistoklis P. Sapsis

Abstract: Extreme events that arise spontaneously in chaotic dynamical systems often have an adverse impact on the system or the surrounding environment. As such, their mitigation is highly desirable. Here, we introduce a novel control strategy for mitigating extreme events in a turbulent shear flow. The controller combines a probabilistic prediction of the extreme events with a deterministic actuator. The… ▽ More Extreme events that arise spontaneously in chaotic dynamical systems often have an adverse impact on the system or the surrounding environment. As such, their mitigation is highly desirable. Here, we introduce a novel control strategy for mitigating extreme events in a turbulent shear flow. The controller combines a probabilistic prediction of the extreme events with a deterministic actuator. The predictions are used to actuate the controller only when an extreme event is imminent. When actuated, the controller only acts on the degrees of freedom that are involved in the formation of the extreme events, exerting minimal interference with the flow dynamics. As a result, the attractors of the controlled and uncontrolled systems share the same chaotic core (containing the non-extreme events) and only differ in the tail of their distributions. We propose that such adaptive low-dimensional controllers should be used to mitigate extreme events in general chaotic dynamical systems, beyond the shear flow considered here. △ Less

Submitted 4 September, 2019; v1 submitted 7 June, 2019; originally announced June 2019.

Comments: In press in Phys. Rev. E. Includes minor revisions

Journal ref: Phys. Rev. E 100, 033110 (2019)

Are extreme dissipation events predictable in turbulent fluid flows?

Authors: Patrick J. Blonigan, Mohammad Farazmand, Themistoklis P. Sapsis

Abstract: We derive precursors of extreme dissipation events in a turbulent channel flow. Using a recently developed method that combines dynamics and statistics for the underlying attractor, we extract a characteristic state that precedes laminarization events that subsequently lead to extreme dissipation episodes. Our approach utilizes coarse statistical information for the turbulent attractor, in the for… ▽ More We derive precursors of extreme dissipation events in a turbulent channel flow. Using a recently developed method that combines dynamics and statistics for the underlying attractor, we extract a characteristic state that precedes laminarization events that subsequently lead to extreme dissipation episodes. Our approach utilizes coarse statistical information for the turbulent attractor, in the form of second order statistics, to identify high-likelihood regions in the state space. We then search within this high probability manifold for the state that leads to the most finite-time growth of the flow kinetic energy. This state has both high probability of occurrence and leads to extreme values of dissipation. We use the alignment between a given turbulent state and this critical state as a precursor for extreme events and demonstrate its favorable properties for prediction of extreme dissipation events. Finally, we analyze the physical relevance of the derived precursor and show its robust character for different Reynolds numbers. Overall, we find that our choice of precursor works well at the Reynolds number it is computed at and at higher Reynolds number flows with similar extreme events. △ Less

Submitted 26 July, 2018; originally announced July 2018.

Journal ref: Physical Review FLUIDS 4, 044606 (2019)

Extreme Events: Mechanisms and Prediction

Authors: Mohammad Farazmand, Themistoklis P. Sapsis

Abstract: Extreme events, such as rogue waves, earthquakes and stock market crashes, occur spontaneously in many dynamical systems. Because of their usually adverse consequences, quantification, prediction and mitigation of extreme events are highly desirable. Here, we review several aspects of extreme events in phenomena described by high-dimensional, chaotic dynamical systems. We specially focus on two pr… ▽ More Extreme events, such as rogue waves, earthquakes and stock market crashes, occur spontaneously in many dynamical systems. Because of their usually adverse consequences, quantification, prediction and mitigation of extreme events are highly desirable. Here, we review several aspects of extreme events in phenomena described by high-dimensional, chaotic dynamical systems. We specially focus on two pressing aspects of the problem: (i) Mechanisms underlying the formation of extreme events and (ii) Real-time prediction of extreme events. For each aspect, we explore methods relying on models, data or both. We discuss the strengths and limitations of each approach as well as possible future research directions. △ Less

Submitted 16 March, 2018; originally announced March 2018.

Probabilistic response and rare events in Mathieu's equation under correlated parametric excitation

Authors: Mustafa A. Mohamad, Themistoklis P. Sapsis

Abstract: We derive an analytical approximation to the probability distribution function (pdf) for the response of Mathieu's equation under parametric excitation by a random process with a spectrum peaked at the main resonant frequency, motivated by the problem of large amplitude ship roll resonance in random seas. The inclusion of random stochastic excitation renders the otherwise straightforward response… ▽ More We derive an analytical approximation to the probability distribution function (pdf) for the response of Mathieu's equation under parametric excitation by a random process with a spectrum peaked at the main resonant frequency, motivated by the problem of large amplitude ship roll resonance in random seas. The inclusion of random stochastic excitation renders the otherwise straightforward response to a system undergoing intermittent resonances: randomly occurring large amplitude bursts. Intermittent resonance occurs precisely when the random parametric excitation pushes the system into the instability region, causing an extreme magnitude response. As a result, the statistics are characterized by heavy-tails. We apply a recently developed mathematical technique, the probabilistic decomposition-synthesis method, to derive an analytical approximation to the non-Gaussian pdf of the response. We illustrate the validity of this analytic approximation through comparisons with Monte-Carlo simulations that demonstrate our result accurately captures the strong non-Gaussianity of the response. △ Less

Submitted 2 June, 2017; v1 submitted 31 May, 2017; originally announced June 2017.

Journal ref: Ocean Engineering, 120, pp. 289-297 (2016)

Reduced-order Description of Transient Instabilities and Computation of Finite-Time Lyapunov Exponents

Authors: Hessam Babaee, Mohamad Farazmand, George Haller, Themistoklis P. Sapsis

Abstract: High-dimensional chaotic dynamical systems can exhibit strongly transient features. These are often associated with instabilities that have finite-time duration. Because of the finite-time character of these transient events, their detection through infinite-time methods, e.g. long term averages, Lyapunov exponents or information about the statistical steady-state, is not possible. Here we utilize… ▽ More High-dimensional chaotic dynamical systems can exhibit strongly transient features. These are often associated with instabilities that have finite-time duration. Because of the finite-time character of these transient events, their detection through infinite-time methods, e.g. long term averages, Lyapunov exponents or information about the statistical steady-state, is not possible. Here we utilize a recently developed framework, the Optimally Time-Dependent (OTD) modes, to extract a time-dependent subspace that spans the modes associated with transient features associated with finite-time instabilities. As the main result, we prove that the OTD modes, under appropriate conditions, converge exponentially fast to the eigendirections of the Cauchy--Green tensor associated with the most intense finite-time instabilities. Based on this observation, we develop a reduced-order method for the computation of finite-time Lyapunov exponents (FTLE) and vectors. In high-dimensional systems, the computational cost of the reduced-order method is orders of magnitude lower than the full FTLE computation. We demonstrate the validity of the theoretical findings on two numerical examples. △ Less

Submitted 20 April, 2017; originally announced April 2017.

Model order reduction for stochastic dynamical systems with continuous symmetries

Authors: Saviz Mowlavi, Themistoklis P. Sapsis

Abstract: Stochastic dynamical systems with continuous symmetries arise commonly in nature and often give rise to coherent spatio-temporal patterns. However, because of their random locations, these patterns are not well captured by current order reduction techniques and a large number of modes is typically necessary for an accurate solution. In this work, we introduce a new methodology for efficient order… ▽ More Stochastic dynamical systems with continuous symmetries arise commonly in nature and often give rise to coherent spatio-temporal patterns. However, because of their random locations, these patterns are not well captured by current order reduction techniques and a large number of modes is typically necessary for an accurate solution. In this work, we introduce a new methodology for efficient order reduction of such systems by combining (i) the method of slices, a symmetry reduction tool, with (ii) any standard order reduction technique, resulting in efficient mixed symmetry-dimensionality reduction schemes. In particular, using the Dynamically Orthogonal (DO) equations in the second step, we obtain a novel nonlinear Symmetry-reduced Dynamically Orthogonal (SDO) scheme. We demonstrate the performance of the SDO scheme on stochastic solutions of the 1D Korteweg-de Vries and 2D Navier-Stokes equations. △ Less

Submitted 9 March, 2018; v1 submitted 20 April, 2017; originally announced April 2017.

Comments: Minor revisions

Journal ref: SIAM Journal on Scientific Computing 40(3), A1669-A1695 (2018)

A variational approach to probing extreme events in turbulent dynamical systems

Authors: Mohammad Farazmand, Themistoklis P. Sapsis

Abstract: Extreme events are ubiquitous in a wide range of dynamical systems, including turbulent fluid flows, nonlinear waves, large scale networks and biological systems. Here, we propose a variational framework for probing conditions that trigger intermittent extreme events in high-dimensional nonlinear dynamical systems. We seek the triggers as the probabilistically feasible solutions of an appropriatel… ▽ More Extreme events are ubiquitous in a wide range of dynamical systems, including turbulent fluid flows, nonlinear waves, large scale networks and biological systems. Here, we propose a variational framework for probing conditions that trigger intermittent extreme events in high-dimensional nonlinear dynamical systems. We seek the triggers as the probabilistically feasible solutions of an appropriately constrained optimization problem, where the function to be maximized is a system observable exhibiting intermittent extreme bursts. The constraints are imposed to ensure the physical admissibility of the optimal solutions, i.e., significant probability for their occurrence under the natural flow of the dynamical system. We apply the method to a body-forced incompressible Navier--Stokes equation, known as the Kolmogorov flow. We find that the intermittent bursts of the energy dissipation are independent of the external forcing and are instead caused by the spontaneous transfer of energy from large scales to the mean flow via nonlinear triad interactions. The global maximizer of the corresponding variational problem identifies the responsible triad, hence providing a precursor for the occurrence of extreme dissipation events. Specifically, monitoring the energy transfers within this triad, allows us to develop a data-driven short-term predictor for the intermittent bursts of energy dissipation. We assess the performance of this predictor through direct numerical simulations. △ Less

Submitted 14 August, 2017; v1 submitted 11 April, 2017; originally announced April 2017.

Comments: Minor revisions, generalized the constraints in Eq. (2)

Reduced-order prediction of rogue waves in two-dimensional deep-water waves

Authors: Mohammad Farazmand, Themistoklis P. Sapsis

Abstract: We consider the problem of large wave prediction in two-dimensional water waves. Such waves form due to the synergistic effect of dispersive mixing of smaller wave groups and the action of localized nonlinear wave interactions that leads to focusing. Instead of a direct simulation approach, we rely on the decomposition of the wave field into a discrete set of localized wave groups with optimal len… ▽ More We consider the problem of large wave prediction in two-dimensional water waves. Such waves form due to the synergistic effect of dispersive mixing of smaller wave groups and the action of localized nonlinear wave interactions that leads to focusing. Instead of a direct simulation approach, we rely on the decomposition of the wave field into a discrete set of localized wave groups with optimal length scales and amplitudes. Due to the short-term character of the prediction, these wave groups do not interact and therefore their dynamics can be characterized individually. Using direct numerical simulations of the governing envelope equations we precompute the expected maximum elevation for each of those wave groups. The combination of the wave field decomposition algorithm, which provides information about the statistics of the system, and the precomputed map for the expected wave group elevation, which encodes dynamical information, allows (i) for understanding of how the probability of occurrence of rogue waves changes as the spectrum parameters vary, (ii) the computation of a critical length scale characterizing wave groups with high probability of evolving to rogue waves, and (iii) the formulation of a robust and parsimonious reduced-order prediction scheme for large waves. We assess the validity of this scheme in several cases of ocean wave spectra. △ Less

Submitted 30 March, 2017; v1 submitted 29 October, 2016; originally announced October 2016.

Comments: In press, Journal of Computational Physics

Dynamical indicators for the prediction of bursting phenomena in high-dimensional systems

Authors: Mohammad Farazmand, Themistoklis Sapsis

Abstract: Drawing upon the bursting mechanism in slow-fast systems, we propose indicators for the prediction of such rare extreme events which do not require a priori known slow and fast coordinates. The indicators are associated with functionals defined in terms of Optimally Time Dependent (OTD) modes. One such functional has the form of the largest eigenvalue of the symmetric part of the linearized dynami… ▽ More Drawing upon the bursting mechanism in slow-fast systems, we propose indicators for the prediction of such rare extreme events which do not require a priori known slow and fast coordinates. The indicators are associated with functionals defined in terms of Optimally Time Dependent (OTD) modes. One such functional has the form of the largest eigenvalue of the symmetric part of the linearized dynamics reduced to these modes. In contrast to other choices of subspaces, the proposed modes are flow invariant and therefore a projection onto them is dynamically meaningful. We illustrate the application of these indicators on three examples: a prototype low-dimensional model, a body forced turbulent fluid flow, and a unidirectional model of nonlinear water waves. We use Bayesian statistics to quantify the predictive power of the proposed indicators. △ Less

Submitted 7 April, 2016; originally announced April 2016.

Journal ref: Phys. Rev. E 94, 032212 (2016)

Probabilistic description of extreme events in intermittently unstable systems excited by correlated stochastic processes

Authors: Mustafa A. Mohamad, Themistoklis P. Sapsis

Abstract: In this work, we consider systems that are subjected to intermittent instabilities due to external stochastic excitation. These intermittent instabilities, though rare, have a large impact on the probabilistic response of the system and give rise to heavy-tailed probability distributions. By making appropriate assumptions on the form of these instabilities, which are valid for a broad range of sys… ▽ More In this work, we consider systems that are subjected to intermittent instabilities due to external stochastic excitation. These intermittent instabilities, though rare, have a large impact on the probabilistic response of the system and give rise to heavy-tailed probability distributions. By making appropriate assumptions on the form of these instabilities, which are valid for a broad range of systems, we formulate a method for the analytical approximation of the probability distribution function (pdf) of the system response (both the main probability mass and the heavy-tail structure). In particular, this method relies on conditioning the probability density of the response on the occurrence of an instability and the separate analysis of the two states of the system, the unstable and stable state. In the stable regime we employ steady state assumptions, which lead to the derivation of the conditional response pdf using standard methods for random dynamical systems. The unstable regime is inherently transient and in order to analyze this regime we characterize the statistics under the assumption of an exponential growth phase and a subsequent decay phase until the system is brought back to the stable attractor. The method we present allows us to capture the statistics associated with the dynamics that give rise to heavy-tails in the system response and the analytical approximations compare favorably with direct Monte Carlo simulations, which we illustrate for two prototype intermittent systems: an intermittently unstable mechanical oscillator excited by correlated multiplicative noise and a complex mode in a turbulent signal with fixed frequency, where multiplicative stochastic dam** and additive noise model interactions between various modes. △ Less

Submitted 13 October, 2014; v1 submitted 21 July, 2014; originally announced July 2014.

Comments: 29 pages, 15 figures

Journal ref: SIAM/ASA Journal on Uncertainty Quantification, 3, pp. 709-736 (2015)