-
Exponential time differencing for matrix-valued dynamical systems
Authors:
Nayef Shkeir,
Tobias Schäfer,
Tobias Grafke
Abstract:
Matrix evolution equations occur in many applications, such as dynamical Lyapunov/Sylvester systems or Riccati equations in optimization and stochastic control, machine learning or data assimilation. In many cases, their tightest stability condition is coming from a linear term. Exponential time differencing (ETD) is known to produce highly stable numerical schemes by treating the linear term in a…
▽ More
Matrix evolution equations occur in many applications, such as dynamical Lyapunov/Sylvester systems or Riccati equations in optimization and stochastic control, machine learning or data assimilation. In many cases, their tightest stability condition is coming from a linear term. Exponential time differencing (ETD) is known to produce highly stable numerical schemes by treating the linear term in an exact fashion. In particular, for stiff problems, ETD methods are a method of choice. We propose an extension of the class of ETD algorithms to matrix-valued dynamical equations. This allows us to produce highly efficient and stable integration schemes. We show their efficiency and applicability for a variety of real-world problems, from geophysical applications to dynamical problems in machine learning.
△ Less
Submitted 19 June, 2024;
originally announced June 2024.
-
Mean First Passage Times and Eyring-Kramers formula for Fluctuating Hydrodynamics
Authors:
**gbang Liu,
James E. Sprittles,
Tobias Grafke
Abstract:
Thermally activated phenomena in physics and chemistry, such as conformational changes in biomolecules, liquid film rupture, or ferromagnetic field reversal, are often associated with exponentially long transition times described by Arrhenius' law. The associated subexponential prefactor, given by the Eyring-Kramers formula, has recently been rigorously derived for systems in detailed balance, res…
▽ More
Thermally activated phenomena in physics and chemistry, such as conformational changes in biomolecules, liquid film rupture, or ferromagnetic field reversal, are often associated with exponentially long transition times described by Arrhenius' law. The associated subexponential prefactor, given by the Eyring-Kramers formula, has recently been rigorously derived for systems in detailed balance, resulting in a sharp limiting estimate for transition times and reaction rates. Unfortunately, this formula does not trivially apply to systems with conserved quantities, which are ubiquitous in the sciences: The associated zeromodes lead to divergences in the prefactor. We demonstrate how a generalised formula can be derived, and show its applicability to a wide range of systems, including stochastic partial differential equations from fluctuating hydrodynamics, with applications in rupture of nanofilm coatings and social segregation in socioeconomics.
△ Less
Submitted 22 May, 2024;
originally announced May 2024.
-
Optimal Transition Paths for AMOC Collapse and Recovery in a Stochastic Box Model
Authors:
Jelle Soons,
Tobias Grafke,
Henk A. Dijkstra
Abstract:
The present-day Atlantic Meridional Overturning Circulation (AMOC) is considered to be in a bi-stable regime and hence it is important to determine probabilities and pathways for noise-induced transitions between its equilibrium states. Here, using Large Deviation Theory (LDT), the most probable transition pathways for the collapse and recovery of the AMOC are computed in a stochastic box model of…
▽ More
The present-day Atlantic Meridional Overturning Circulation (AMOC) is considered to be in a bi-stable regime and hence it is important to determine probabilities and pathways for noise-induced transitions between its equilibrium states. Here, using Large Deviation Theory (LDT), the most probable transition pathways for the collapse and recovery of the AMOC are computed in a stochastic box model of the World Ocean. This allows us to determine the physical mechanisms of noise-induced AMOC transitions. We show that the most likely path of an AMOC collapse starts paradoxically with a strengthening of the AMOC followed by an immediate drop within a couple of years due to a short but relatively strong freshwater pulse. The recovery on the other hand is a slow process, where the North Atlantic needs to be gradually salinified over a course of 20 years. The proposed method provides several benefits, including an estimate of probability ratios of collapse between various freshwater noise scenarios, showing that the AMOC is most vulnerable to freshwater forcing into the Atlantic thermocline region.
△ Less
Submitted 21 November, 2023;
originally announced November 2023.
-
Saddle avoidance of noise-induced transitions in multiscale systems
Authors:
Reyk Börner,
Ryan Deeley,
Raphael Römer,
Tobias Grafke,
Valerio Lucarini,
Ulrike Feudel
Abstract:
In multistable dynamical systems driven by weak Gaussian noise, transitions between competing states are often assumed to pass via a saddle on the separating basin boundary. Instead, we show that timescale separation can cause saddle avoidance in non-gradient systems. Using toy models from neuroscience and ecology, we study cases where sample transitions deviate strongly from the instanton predict…
▽ More
In multistable dynamical systems driven by weak Gaussian noise, transitions between competing states are often assumed to pass via a saddle on the separating basin boundary. Instead, we show that timescale separation can cause saddle avoidance in non-gradient systems. Using toy models from neuroscience and ecology, we study cases where sample transitions deviate strongly from the instanton predicted by Freidlin-Wentzell theory, even for weak finite noise. We attribute this to a flat quasipotential and present an approach based on the Onsager-Machlup action to aptly predict transition paths.
△ Less
Submitted 11 June, 2024; v1 submitted 16 November, 2023;
originally announced November 2023.
-
Scalable Methods for Computing Sharp Extreme Event Probabilities in Infinite-Dimensional Stochastic Systems
Authors:
Timo Schorlepp,
Shanyin Tong,
Tobias Grafke,
Georg Stadler
Abstract:
We introduce and compare computational techniques for sharp extreme event probability estimates in stochastic differential equations with small additive Gaussian noise. In particular, we focus on strategies that are scalable, i.e. their efficiency does not degrade upon temporal and possibly spatial refinement. For that purpose, we extend algorithms based on the Laplace method for estimating the pr…
▽ More
We introduce and compare computational techniques for sharp extreme event probability estimates in stochastic differential equations with small additive Gaussian noise. In particular, we focus on strategies that are scalable, i.e. their efficiency does not degrade upon temporal and possibly spatial refinement. For that purpose, we extend algorithms based on the Laplace method for estimating the probability of an extreme event to infinite dimensional path space. The method estimates the limiting exponential scaling using a single realization of the random variable, the large deviation minimizer. Finding this minimizer amounts to solving an optimization problem governed by a differential equation. The probability estimate becomes sharp when it additionally includes prefactor information, which necessitates computing the determinant of a second derivative operator to evaluate a Gaussian integral around the minimizer. We present an approach in infinite dimensions based on Fredholm determinants, and develop numerical algorithms to compute these determinants efficiently for the high-dimensional systems that arise upon discretization. We also give an interpretation of this approach using Gaussian process covariances and transition tubes. An example model problem, for which we provide an open-source python implementation, is used throughout the paper to illustrate all methods discussed. To study the performance of the methods, we consider examples of stochastic differential and stochastic partial differential equations, including the randomly forced incompressible three-dimensional Navier-Stokes equations.
△ Less
Submitted 22 November, 2023; v1 submitted 21 March, 2023;
originally announced March 2023.
-
Metadynamics for transition paths in irreversible dynamics
Authors:
Tobias Grafke,
Alessandro Laio
Abstract:
Stochastic systems often exhibit multiple viable metastable states that are long-lived. Over very long timescales, fluctuations may push the system to transition between them, drastically changing its macroscopic configuration. In realistic systems, these transitions can happen via multiple physical mechanisms, corresponding to multiple distinct transition channels for a pair of states. In this pa…
▽ More
Stochastic systems often exhibit multiple viable metastable states that are long-lived. Over very long timescales, fluctuations may push the system to transition between them, drastically changing its macroscopic configuration. In realistic systems, these transitions can happen via multiple physical mechanisms, corresponding to multiple distinct transition channels for a pair of states. In this paper, we use the fact that the transition path ensemble is equivalent to the invariant measure of a gradient flow in pathspace, which can be efficiently sampled via metadynamics. We demonstrate how this pathspace metadynamics, previously restricted to reversible molecular dynamics, is in fact very generally applicable to metastable stochastic systems, including irreversible and time-dependent ones, and allows to estimate rigorously the relative probability of competing transition paths. We showcase this approach on the study of a stochastic partial differential equation describing magnetic field reversal in the presence of advection.
△ Less
Submitted 12 April, 2023; v1 submitted 17 November, 2022;
originally announced November 2022.
-
Symmetries and zero modes in sample path large deviations
Authors:
Timo Schorlepp,
Tobias Grafke,
Rainer Grauer
Abstract:
Sharp large deviation estimates for stochastic differential equations with small noise, based on minimizing the Freidlin-Wentzell action functional under appropriate boundary conditions, can be obtained by integrating certain matrix Riccati differential equations along the large deviation minimizers or instantons, either forward or backward in time. Previous works in this direction often rely on t…
▽ More
Sharp large deviation estimates for stochastic differential equations with small noise, based on minimizing the Freidlin-Wentzell action functional under appropriate boundary conditions, can be obtained by integrating certain matrix Riccati differential equations along the large deviation minimizers or instantons, either forward or backward in time. Previous works in this direction often rely on the existence of isolated minimizers with positive definite second variation. By adopting techniques from field theory and explicitly evaluating the large deviation prefactors as functional determinant ratios using Forman's theorem, we extend the approach to general systems where degenerate submanifolds of minimizers exist. The key technique for this is a boundary-type regularization of the second variation operator. This extension is particularly relevant if the system possesses continuous symmetries that are broken by the instantons. We find that removing the vanishing eigenvalues associated with the zero modes is possible within the Riccati formulation and amounts to modifying the initial or final conditions and evaluation of the Riccati matrices. We apply our results in multiple examples including a dynamical phase transition for the average surface height in short-time large deviations of the one-dimensional Kardar-Parisi-Zhang equation with flat initial profile.
△ Less
Submitted 5 December, 2022; v1 submitted 17 August, 2022;
originally announced August 2022.
-
Mechanism for turbulence proliferation in subcritical flows
Authors:
Anna Frishman,
Tobias Grafke
Abstract:
The subcritical transition to turbulence, as occurs in pipe flow, is believed to generically be a phase transition in the directed percolation universality class. At its heart is a balance between the decay rate and proliferation rate of localized turbulent structures, called puffs in pipe flow. Here we propose the first-ever dynamical mechanism for puff proliferation -- the process by which a puf…
▽ More
The subcritical transition to turbulence, as occurs in pipe flow, is believed to generically be a phase transition in the directed percolation universality class. At its heart is a balance between the decay rate and proliferation rate of localized turbulent structures, called puffs in pipe flow. Here we propose the first-ever dynamical mechanism for puff proliferation -- the process by which a puff splits into two. In the first stage of our mechanism, a puff expands into a slug. In the second stage, a laminar gap is formed within the turbulent core. The notion of a split-edge state, mediating the transition from a single puff to a two puff state, is introduced and its form is predicted. The role of fluctuations in the two stages of the transition, and how splits could be suppressed with increasing Reynolds number, are discussed. Using numerical simulations, the mechanism is validated within the stochastic Barkley model. Concrete predictions to test the proposed mechanism in pipe and other wall bounded flows, and implications for the universality of the directed percolation picture, are discussed.
△ Less
Submitted 15 September, 2022; v1 submitted 11 May, 2022;
originally announced May 2022.
-
Dynamical landscape of transitional pipe flow
Authors:
Anna Frishman,
Tobias Grafke
Abstract:
The transition to turbulence in pipes is characterized by a coexistence of laminar and turbulent states. At the lower end of the transition, localized turbulent pulses, called puffs, can be excited. Puffs can decay when rare fluctuations drive them close to an edge state lying at the phase-space boundary with laminar flow. At higher Reynolds numbers, homogeneous turbulence can be sustained, and do…
▽ More
The transition to turbulence in pipes is characterized by a coexistence of laminar and turbulent states. At the lower end of the transition, localized turbulent pulses, called puffs, can be excited. Puffs can decay when rare fluctuations drive them close to an edge state lying at the phase-space boundary with laminar flow. At higher Reynolds numbers, homogeneous turbulence can be sustained, and dominates over laminar flow. Here we complete this landscape of localized states, placing it within a unified bifurcation picture. We demonstrate our claims within the Barkley model, and motivate them generally. Specifically, we suggest the existence of an antipuff and a gap-edge -- states which mirror the puff and related edge state. Previously observed laminar gaps forming within homogeneous turbulence are then naturally identified as antipuffs nucleating and decaying through the gap edge.
△ Less
Submitted 26 April, 2022; v1 submitted 30 October, 2021;
originally announced November 2021.
-
Extreme events and instantons in Lagrangian passive scalar turbulence models
Authors:
Mnerh Alqahtani,
Leonardo Grigorio,
Tobias Grafke
Abstract:
The advection and mixing of a scalar quantity by fluid flow is an important problem in engineering and natural sciences. If the fluid is turbulent, the statistics of the passive scalar exhibit complex behavior. This paper is concerned with two Lagrangian scalar turbulence models based on the recent fluid deformation model that can be shown to reproduce the statistics of passive scalar turbulence f…
▽ More
The advection and mixing of a scalar quantity by fluid flow is an important problem in engineering and natural sciences. If the fluid is turbulent, the statistics of the passive scalar exhibit complex behavior. This paper is concerned with two Lagrangian scalar turbulence models based on the recent fluid deformation model that can be shown to reproduce the statistics of passive scalar turbulence for a range of Reynolds numbers. For these models, we demonstrate how events of extreme passive scalar gradients can be recovered by computing the instanton, i.e., the saddle-point configuration of the associated stochastic field theory. It allows us to both reproduce the heavy-tailed statistics associated with passive scalar turbulence, and recover the most likely mechanism leading to such extreme events. We further demonstrate that events of large negative strain in these models undergo spontaneous symmetry breaking.
△ Less
Submitted 4 August, 2021;
originally announced August 2021.
-
Spontaneous Symmetry Breaking for Extreme Vorticity and Strain in the 3D Navier-Stokes Equations
Authors:
Timo Schorlepp,
Tobias Grafke,
Sandra May,
Rainer Grauer
Abstract:
We investigate the spatio-temporal structure of the most likely configurations realising extremely high vorticity or strain in the stochastically forced 3D incompressible Navier-Stokes equations. Most likely configurations are computed by numerically finding the highest probability velocity field realising an extreme constraint as solution of a large optimisation problem. High-vorticity configurat…
▽ More
We investigate the spatio-temporal structure of the most likely configurations realising extremely high vorticity or strain in the stochastically forced 3D incompressible Navier-Stokes equations. Most likely configurations are computed by numerically finding the highest probability velocity field realising an extreme constraint as solution of a large optimisation problem. High-vorticity configurations are identified as pinched vortex filaments with swirl, while high-strain configurations correspond to counter-rotating vortex rings. We additionally observe that the most likely configurations for vorticity and strain spontaneously break their rotational symmetry for extremely high observable values. Instanton calculus and large deviation theory allow us to show that these maximum likelihood realisations determine the tail probabilities of the observed quantities. In particular, we are able to demonstrate that artificially enforcing rotational symmetry for large strain configurations leads to a severe underestimate of their probability, as it is dominated in likelihood by an exponentially more likely symmetry broken vortex-sheet configuration.
△ Less
Submitted 31 March, 2022; v1 submitted 13 July, 2021;
originally announced July 2021.
-
A new stochastic framework for ship capsizing
Authors:
Manuela L. Bujorianu,
Robert S. MacKay,
Tobias Grafke,
Shibabrat Naik,
Evangelos Boulougouris
Abstract:
We present a new stochastic framework for studying ship capsize. It is a synthesis of two strands of transition state theory. The first is an extension of deterministic transition state theory to dissipative non-autonomous systems, together with a probability distribution over the forcing functions. The second is stochastic reachability and large deviation theory for transition paths in Markovian…
▽ More
We present a new stochastic framework for studying ship capsize. It is a synthesis of two strands of transition state theory. The first is an extension of deterministic transition state theory to dissipative non-autonomous systems, together with a probability distribution over the forcing functions. The second is stochastic reachability and large deviation theory for transition paths in Markovian systems. In future work we aim to bring these together to make a tool for predicting capsize rate in different stochastic sea states, suggesting control strategies and improving designs.
△ Less
Submitted 12 May, 2021;
originally announced May 2021.
-
Numerics and analysis of Cahn--Hilliard critical points
Authors:
Tobias Grafke,
Sebastian Scholtes,
Alfred Wagner,
Maria G. Westdickenberg
Abstract:
We explore recent progress and open questions concerning local minima and saddle points of the Cahn--Hilliard energy in $d\geq 2$ and the critical parameter regime of large system size and mean value close to $-1$. We employ the String Method of E, Ren, and Vanden-Eijnden -- a numerical algorithm for computing transition pathways in complex systems -- in $d=2$ to gain additional insight into the p…
▽ More
We explore recent progress and open questions concerning local minima and saddle points of the Cahn--Hilliard energy in $d\geq 2$ and the critical parameter regime of large system size and mean value close to $-1$. We employ the String Method of E, Ren, and Vanden-Eijnden -- a numerical algorithm for computing transition pathways in complex systems -- in $d=2$ to gain additional insight into the properties of the minima and saddle point. Motivated by the numerical observations, we adapt a method of Caffarelli and Spruck to study convexity of level sets in $d\geq 2$.
△ Less
Submitted 8 April, 2021;
originally announced April 2021.
-
Gel'fand-Yaglom type equations for calculating fluctuations around Instantons in stochastic systems
Authors:
Timo Schorlepp,
Tobias Grafke,
Rainer Grauer
Abstract:
In recent years, instanton calculus has successfully been employed to estimate tail probabilities of rare events in various stochastic dynamical systems. Without further corrections, however, these estimates can only capture the exponential scaling. In this paper, we derive a general, closed form expression for the leading prefactor contribution of the fluctuations around the instanton trajectory…
▽ More
In recent years, instanton calculus has successfully been employed to estimate tail probabilities of rare events in various stochastic dynamical systems. Without further corrections, however, these estimates can only capture the exponential scaling. In this paper, we derive a general, closed form expression for the leading prefactor contribution of the fluctuations around the instanton trajectory for the computation of probability density functions of general observables. The key technique is applying the Gel'fand-Yaglom recursive evaluation method to the suitably discretized Gaussian path integral of the fluctuations, in order to obtain matrix evolution equations that yield the fluctuation determinant. We demonstrate agreement between these predictions and direct sampling for examples motivated from turbulence theory.
△ Less
Submitted 9 June, 2021; v1 submitted 8 March, 2021;
originally announced March 2021.
-
Sharp Asymptotic Estimates for Expectations, Probabilities, and Mean First Passage Times in Stochastic Systems with Small Noise
Authors:
Tobias Grafke,
Tobias Schäfer,
Eric Vanden-Eijnden
Abstract:
Freidlin-Wentzell theory of large deviations can be used to compute the likelihood of extreme or rare events in stochastic dynamical systems via the solution of an optimization problem. The approach gives exponential estimates that often need to be refined via calculation of a prefactor. Here it is shown how to perform these computations in practice. Specifically, sharp asymptotic estimates are de…
▽ More
Freidlin-Wentzell theory of large deviations can be used to compute the likelihood of extreme or rare events in stochastic dynamical systems via the solution of an optimization problem. The approach gives exponential estimates that often need to be refined via calculation of a prefactor. Here it is shown how to perform these computations in practice. Specifically, sharp asymptotic estimates are derived for expectations, probabilities, and mean first passage times in a form that is geared towards numerical purposes: they require solving well-posed matrix Riccati equations involving the minimizer of the Freidlin-Wentzell action as input, either forward or backward in time with appropriate initial or final conditions tailored to the estimate at hand. The usefulness of our approach is illustrated on several examples. In particular, invariant measure probabilities and mean first passage times are calculated in models involving stochastic partial differential equations of reaction-advection-diffusion type.
△ Less
Submitted 15 September, 2021; v1 submitted 8 March, 2021;
originally announced March 2021.
-
Instantons for rare events in heavy-tailed distributions
Authors:
Mnerh Alqahtani,
Tobias Grafke
Abstract:
Large deviation theory and instanton calculus for stochastic systems are widely used to gain insight into the evolution and probability of rare events. At its core lies the realization that rare events are, under the right circumstances, dominated by their least unlikely realization. Their computation through a saddle-point approximation of the path integral for the corresponding stochastic field…
▽ More
Large deviation theory and instanton calculus for stochastic systems are widely used to gain insight into the evolution and probability of rare events. At its core lies the realization that rare events are, under the right circumstances, dominated by their least unlikely realization. Their computation through a saddle-point approximation of the path integral for the corresponding stochastic field theory then reduces an inefficient stochastic sampling problem into a deterministic optimization problem: finding the path of smallest action, the instanton. In the presence of heavy tails, though, standard algorithms to compute the instanton critically fail to converge. The reason for this failure is the divergence of the scaled cumulant generating function (CGF) due to a non-convex large deviation rate function. We propose a solution to this problem by "convexifying" the rate function through nonlinear reparametrization of the observable, which allows us to compute instantons even in the presence of super-exponential or algebraic tail decay. The approach is generalizable to other situations where the existence of the CGF is required, such as exponential tilting in importance sampling for Monte-Carlo algorithms. We demonstrate the proposed formalism by applying it to rare events in several stochastic systems with heavy tails, including extreme power spikes in fiber optics induced by soliton formation.
△ Less
Submitted 6 December, 2020;
originally announced December 2020.
-
Approximate optimal controls via instanton expansion for low temperature free energy computation
Authors:
Grégoire Ferré,
Tobias Grafke
Abstract:
The computation of free energies is a common issue in statistical physics. A natural technique to compute such high dimensional integrals is to resort to Monte Carlo simulations. However these techniques generally suffer from a high variance in the low temperature regime, because the expectation is often dominated by high values corresponding to rare system trajectories. A standard way to reduce t…
▽ More
The computation of free energies is a common issue in statistical physics. A natural technique to compute such high dimensional integrals is to resort to Monte Carlo simulations. However these techniques generally suffer from a high variance in the low temperature regime, because the expectation is often dominated by high values corresponding to rare system trajectories. A standard way to reduce the variance of the estimator is to modify the drift of the dynamics with a control enhancing the probability of rare event, leading to so-called importance sampling estimators. In theory, the optimal control leads to a zero-variance estimator; it is however defined implicitly and computing it is of the same difficulty as the original problem. We propose here a general strategy to build approximate optimal controls in the small temperature limit for diffusion processes, with the first goal to reduce the variance of free energy Monte Carlo estimators. Our construction builds upon low noise asymptotics by expanding the optimal control around the instanton, which is the path describing most likely fluctuations at low temperature. This technique not only helps reducing variance, but it is also interesting as a theoretical tool since it differs from usual small temperature expansions (WKB ansatz). As a complementary consequence of our expansion, we provide a perturbative formula for computing the free energy in the small temperature regime, which refines the now standard Freidlin--Wentzell asymptotics. We compute this expansion explicitly for lower orders, and explain how our strategy can be extended to an arbitrary order of accuracy. We support our findings with illustrative numerical examples.
△ Less
Submitted 14 May, 2021; v1 submitted 22 November, 2020;
originally announced November 2020.
-
Dynamical Landscape and Multistability of a Climate Model
Authors:
Georgios Margazoglou,
Tobias Grafke,
Alessandro Laio,
Valerio Lucarini
Abstract:
We apply two independent data analysis methodologies to locate stable climate states in an intermediate complexity climate model and analyze their interplay. First, drawing from the theory of quasipotentials, and viewing the state space as an energy landscape with valleys and mountain ridges, we infer the relative likelihood of the identified multistable climate states, and investigate the most li…
▽ More
We apply two independent data analysis methodologies to locate stable climate states in an intermediate complexity climate model and analyze their interplay. First, drawing from the theory of quasipotentials, and viewing the state space as an energy landscape with valleys and mountain ridges, we infer the relative likelihood of the identified multistable climate states, and investigate the most likely transition trajectories as well as the expected transition times between them. Second, harnessing techniques from data science, specifically manifold learning, we characterize the data landscape of the simulation output to find climate states and basin boundaries within a fully agnostic and unsupervised framework. Both approaches show remarkable agreement, and reveal, apart from the well known warm and snowball earth states, a third intermediate stable state in one of the two climate models we consider. The combination of our approaches allows to identify how the negative feedback of ocean heat transport and entropy production via the hydrological cycle drastically change the topography of the dynamical landscape of Earth's climate.
△ Less
Submitted 8 January, 2021; v1 submitted 20 October, 2020;
originally announced October 2020.
-
Experimental Evidence of Hydrodynamic Instantons: The Universal Route to Rogue Waves
Authors:
Giovanni Dematteis,
Tobias Grafke,
Miguel Onorato,
Eric Vanden-Eijnden
Abstract:
A statistical theory of rogue waves is proposed and tested against experimental data collected in a long water tank where random waves with different degrees of nonlinearity are mechanically generated and free to propagate along the flume. Strong evidence is given that the rogue waves observed in the tank are hydrodynamic instantons, that is, saddle point configurations of the action associated wi…
▽ More
A statistical theory of rogue waves is proposed and tested against experimental data collected in a long water tank where random waves with different degrees of nonlinearity are mechanically generated and free to propagate along the flume. Strong evidence is given that the rogue waves observed in the tank are hydrodynamic instantons, that is, saddle point configurations of the action associated with the stochastic model of the wave system. As shown here, these hydrodynamic instantons are complex spatio-temporal wave field configurations, which can be defined using the mathematical framework of Large Deviation Theory and calculated via tailored numerical methods. These results indicate that the instantons describe equally well rogue waves that originate from a simple linear superposition mechanism (in weakly nonlinear conditions) or from a nonlinear focusing one (in strongly nonlinear conditions), paving the way for the development of a unified explanation to rogue wave formation.
△ Less
Submitted 8 November, 2019; v1 submitted 2 July, 2019;
originally announced July 2019.
-
Numerical computation of rare events via large deviation theory
Authors:
Tobias Grafke,
Eric Vanden-Eijnden
Abstract:
An overview of rare events algorithms based on large deviation theory (LDT) is presented. It covers a range of numerical schemes to compute the large deviation minimizer in various setups, and discusses best practices, common pitfalls, and implementation trade-offs. Generalizations, extensions, and improvements of the minimum action methods are proposed. These algorithms are tested on example prob…
▽ More
An overview of rare events algorithms based on large deviation theory (LDT) is presented. It covers a range of numerical schemes to compute the large deviation minimizer in various setups, and discusses best practices, common pitfalls, and implementation trade-offs. Generalizations, extensions, and improvements of the minimum action methods are proposed. These algorithms are tested on example problems which illustrate several common difficulties which arise e.g. when the forcing is degenerate or multiplicative, or the systems are infinite-dimensional. Generalizations to processes driven by non-Gaussian noises or random initial data and parameters are also discussed, along with the connection between the LDT-based approach reviewed here and other methods, such as stochastic field theory and optimal control. Finally, the integration of this approach in importance sampling methods using e.g. genealogical algorithms is explored.
△ Less
Submitted 3 December, 2018;
originally announced December 2018.
-
Extreme event quantification in dynamical systems with random components
Authors:
Giovanni Dematteis,
Tobias Grafke,
Eric Vanden-Eijnden
Abstract:
A central problem in uncertainty quantification is how to characterize the impact that our incomplete knowledge about models has on the predictions we make from them. This question naturally lends itself to a probabilistic formulation, by making the unknown model parameters random with given statistics. Here this approach is used in concert with tools from large deviation theory (LDT) and optimal…
▽ More
A central problem in uncertainty quantification is how to characterize the impact that our incomplete knowledge about models has on the predictions we make from them. This question naturally lends itself to a probabilistic formulation, by making the unknown model parameters random with given statistics. Here this approach is used in concert with tools from large deviation theory (LDT) and optimal control to estimate the probability that some observables in a dynamical system go above a large threshold after some time, given the prior statistical information about the system's parameters and/or its initial conditions. Specifically, it is established under which conditions such extreme events occur in a predictable way, as the minimizer of the LDT action functional. It is also shown how this minimization can be numerically performed in an efficient way using tools from optimal control. These findings are illustrated on the examples of a rod with random elasticity pulled by a time-dependent force, and the nonlinear Schrödinger equation (NLSE) with random initial conditions.
△ Less
Submitted 31 August, 2018;
originally announced August 2018.
-
String Method for Generalized Gradient Flows: Computation of Rare Events in Reversible Stochastic Processes
Authors:
Tobias Grafke
Abstract:
Rare transitions in stochastic processes can often be rigorously described via an underlying large deviation principle. Recent breakthroughs in the classification of reversible stochastic processes as gradient flows have led to a connection of large deviation principles to a generalized gradient structure. Here, we show that, as a consequence, metastable transitions in these reversible processes c…
▽ More
Rare transitions in stochastic processes can often be rigorously described via an underlying large deviation principle. Recent breakthroughs in the classification of reversible stochastic processes as gradient flows have led to a connection of large deviation principles to a generalized gradient structure. Here, we show that, as a consequence, metastable transitions in these reversible processes can be interpreted as heteroclinic orbits of the generalized gradient flow. This in turn suggests a numerical algorithm to compute the transition trajectories in configuration space efficiently, based on the string method traditionally restricted only to gradient diffusions.
△ Less
Submitted 14 March, 2019; v1 submitted 31 July, 2018;
originally announced July 2018.
-
Non-equilibrium transitions in multiscale systems with a bifurcating slow manifold
Authors:
Tobias Grafke,
Eric Vanden-Eijnden
Abstract:
Noise-induced transitions between metastable fixed points in systems evolving on multiple time scales are analyzed in situations where the time scale separation gives rise to a slow manifold with bifurcation. This analysis is performed within the realm of large deviation theory. It is shown that these non-equilibrium transitions make use of a reaction channel created by the bifurcation structure o…
▽ More
Noise-induced transitions between metastable fixed points in systems evolving on multiple time scales are analyzed in situations where the time scale separation gives rise to a slow manifold with bifurcation. This analysis is performed within the realm of large deviation theory. It is shown that these non-equilibrium transitions make use of a reaction channel created by the bifurcation structure of the slow manifold, leading to vastly increased transition rates. Several examples are used to illustrate these findings, including an insect outbreak model, a system modeling phase separation in the presence of evaporation, and a system modeling transitions in active matter self-assembly. The last example involves a spatially extended system modeled by a stochastic partial differential equation.
△ Less
Submitted 4 October, 2017; v1 submitted 21 April, 2017;
originally announced April 2017.
-
Rogue Waves and Large Deviations in Deep Sea
Authors:
Giovanni Dematteis,
Tobias Grafke,
Eric Vanden-Eijnden
Abstract:
The appearance of rogue waves in deep sea is investigated using the modified nonlinear Schrödinger (MNLS) equation in one spatial-dimension with random initial conditions that are assumed to be normally distributed, with a spectrum approximating realistic conditions of a uni-directional sea state. It is shown that one can use the incomplete information contained in this spectrum as prior and suppl…
▽ More
The appearance of rogue waves in deep sea is investigated using the modified nonlinear Schrödinger (MNLS) equation in one spatial-dimension with random initial conditions that are assumed to be normally distributed, with a spectrum approximating realistic conditions of a uni-directional sea state. It is shown that one can use the incomplete information contained in this spectrum as prior and supplement this information with the MNLS dynamics to reliably estimate the probability distribution of the sea surface elevation far in the tail at later times. Our results indicate that rogue waves occur when the system hits unlikely pockets of wave configurations that trigger large disturbances of the surface height. The rogue wave precursors in these pockets are wave patterns of regular height but with a very specific shape that is identified explicitly, thereby allowing for early detection. The method proposed here combines Monte Carlo sampling with tools from large deviations theory that reduce the calculation of the most likely rogue wave precursors to an optimization problem that can be solved efficiently. This approach is transferable to other problems in which the system's governing equations contain random initial conditions and/or parameters.
△ Less
Submitted 23 January, 2018; v1 submitted 5 April, 2017;
originally announced April 2017.
-
Spatiotemporal Self-Organization of Fluctuating Bacterial Colonies
Authors:
Tobias Grafke,
Michael E. Cates,
Eric Vanden-Eijnden
Abstract:
We model an enclosed system of bacteria, whose motility-induced phase separation is coupled to slow population dynamics. Without noise, the system shows both static phase separation and a limit cycle, in which a rising global population causes a dense bacterial colony to form, which then declines by local cell death, before dispersing to re-initiate the cycle. Adding fluctuations, we find that sta…
▽ More
We model an enclosed system of bacteria, whose motility-induced phase separation is coupled to slow population dynamics. Without noise, the system shows both static phase separation and a limit cycle, in which a rising global population causes a dense bacterial colony to form, which then declines by local cell death, before dispersing to re-initiate the cycle. Adding fluctuations, we find that static colonies are now metastable, moving between spatial locations via rare and strongly nonequilibrium pathways, whereas the limit cycle becomes almost periodic such that after each redispersion event the next colony forms in a random location. These results, which hint at some aspects of the biofilm-planktonic life cycle, can be explained by combining tools from large deviation theory with a bifurcation analysis in which the global population density plays the role of control parameter.
△ Less
Submitted 4 October, 2017; v1 submitted 20 March, 2017;
originally announced March 2017.
-
Long Term Effects of Small Random Perturbations on Dynamical Systems: Theoretical and Computational Tools
Authors:
Tobias Grafke,
Tobias Schaefer,
Eric Vanden-Eijnden
Abstract:
Small random perturbations may have a dramatic impact on the long time evolution of dynamical systems, and large deviation theory is often the right theoretical framework to understand these effects. At the core of the theory lies the minimization of an action functional, which in many cases of interest has to be computed by numerical means. Here we review the theoretical and computational aspects…
▽ More
Small random perturbations may have a dramatic impact on the long time evolution of dynamical systems, and large deviation theory is often the right theoretical framework to understand these effects. At the core of the theory lies the minimization of an action functional, which in many cases of interest has to be computed by numerical means. Here we review the theoretical and computational aspects behind these calculations, and propose an algorithm that simplifies the geometric minimum action method to minimize the action in the space of arc-length parametrized curves. We then illustrate this algorithm's capabilities by applying it to various examples from material sciences, fluid dynamics, atmosphere/ocean sciences, and reaction kinetics. In terms of models, these examples involve stochastic (ordinary or partial) differential equations with multiplicative or degenerate noise, Markov jump processes, and systems with fast and slow degrees of freedom, which all violate detailed balance, so that simpler computational methods are not applicable.
△ Less
Submitted 10 October, 2017; v1 submitted 13 April, 2016;
originally announced April 2016.
-
Large Deviations in Fast-Slow Systems
Authors:
Freddy Bouchet,
Tobias Grafke,
Tomás Tangarife,
Eric Vanden-Eijnden
Abstract:
The incidence of rare events in fast-slow systems is investigated via analysis of the large deviation principle (LDP) that characterizes the likelihood and pathway of large fluctuations of the slow variables away from their mean behavior -- such fluctuations are rare on short timescales but become ubiquitous eventually. This LDP involves an Hamilton-Jacobi equation whose Hamiltonian is related to…
▽ More
The incidence of rare events in fast-slow systems is investigated via analysis of the large deviation principle (LDP) that characterizes the likelihood and pathway of large fluctuations of the slow variables away from their mean behavior -- such fluctuations are rare on short timescales but become ubiquitous eventually. This LDP involves an Hamilton-Jacobi equation whose Hamiltonian is related to the leading eigenvalue of the generator of the fast process, and is typically non-quadratic in the momenta -- in other words, the LDP for the slow variables in fast-slow systems is different in general from that of any stochastic differential equation (SDE) one would write for the slow variables alone. It is shown here that the eigenvalue problem for the Hamiltonian can be reduced to a simpler algebraic equation for this Hamiltonian for a specific class of systems in which the fast variables satisfy a linear equation whose coefficients depend nonlinearly on the slow variables, and the fast variables enter quadratically the equation for the slow variables. These results are illustrated via examples, inspired by kinetic theories of turbulent flows and plasma, in which the quasipotential characterizing the long time behavior of the system is calculated and shown again to be different from that of an SDE.
△ Less
Submitted 8 October, 2015;
originally announced October 2015.
-
The instanton method and its numerical implementation in fluid mechanics
Authors:
Tobias Grafke,
Rainer Grauer,
Tobias Schäfer
Abstract:
A precise characterization of structures occurring in turbulent fluid flows at high Reynolds numbers is one of the last open problems of classical physics. In this review we discuss recent developments related to the application of instanton methods to turbulence. Instantons are saddle point configurations of the underlying path integrals. They are equivalent to minimizers of the related Freidlin-…
▽ More
A precise characterization of structures occurring in turbulent fluid flows at high Reynolds numbers is one of the last open problems of classical physics. In this review we discuss recent developments related to the application of instanton methods to turbulence. Instantons are saddle point configurations of the underlying path integrals. They are equivalent to minimizers of the related Freidlin-Wentzell action and known to be able to characterize rare events in such systems. While there is an impressive body of work concerning their analytical description, this review focuses on the question on how to compute these minimizers numerically. In a short introduction we present the relevant mathematical and physical background before we discuss the stochastic Burgers equation in detail. We present algorithms to compute instantons numerically by an efficient solution of the corresponding Euler-Lagrange equations. A second focus is the discussion of a recently developed numerical filtering technique that allows to extract instantons from direct numerical simulations. In the following we present modifications of the algorithms to make them efficient when applied to two- or three-dimensional fluid dynamical problems. We illustrate these ideas using the two-dimensional Burgers equation and the three-dimensional Navier-Stokes equations.
△ Less
Submitted 20 July, 2015; v1 submitted 29 June, 2015;
originally announced June 2015.
-
Relevance of instantons in Burgers turbulence
Authors:
Tobias Grafke,
Rainer Grauer,
Tobias Schäfer,
Eric Vanden-Eijnden
Abstract:
Instanton calculations are performed in the context of stationary Burgers turbulence to estimate the tails of the probability density function (PDF) of velocity gradients. These results are then compared to those obtained from massive direct numerical simulations (DNS) of the randomly forced Burgers equation. The instanton predictions are shown to agree with the DNS in a wide range of regimes, inc…
▽ More
Instanton calculations are performed in the context of stationary Burgers turbulence to estimate the tails of the probability density function (PDF) of velocity gradients. These results are then compared to those obtained from massive direct numerical simulations (DNS) of the randomly forced Burgers equation. The instanton predictions are shown to agree with the DNS in a wide range of regimes, including those that are far from the limiting cases previously considered in the literature. These results settle the controversy of the relevance of the instanton approach for the prediction of the velocity gradient PDF tail exponents. They also demonstrate the usefulness of the instanton formalism in Burgers turbulence, and suggest that this approach may be applicable in other contexts, such as 2D and 3D turbulence in compressible and incompressible flows.
△ Less
Submitted 30 November, 2014;
originally announced December 2014.
-
Efficient Computation of Instantons for Multi-Dimensional Turbulent Flows with Large Scale Forcing
Authors:
Tobias Grafke,
Rainer Grauer,
Stephan Schindel
Abstract:
Extreme events play a crucial role in fluid turbulence. Inspired by methods from field theory, these extreme events, their evolution and probability can be computed with help of the instanton formalism as minimizers of a suitable action functional. Due to the high number of degrees of freedom in multi-dimensional fluid flows, traditional global minimization techniques quickly become prohibitive in…
▽ More
Extreme events play a crucial role in fluid turbulence. Inspired by methods from field theory, these extreme events, their evolution and probability can be computed with help of the instanton formalism as minimizers of a suitable action functional. Due to the high number of degrees of freedom in multi-dimensional fluid flows, traditional global minimization techniques quickly become prohibitive in their memory requirements. We outline a novel method for finding the minimizing trajectory in a wide class of problems that typically occurs in turbulence setups, where the underlying dynamical system is a non-gradient, non-linear partial differential equation, and the forcing is restricted to a limited length scale. We demonstrate the efficiency of the algorithm in terms of performance and memory by computing high resolution instanton field configurations corresponding to viscous shocks for 1D and 2D compressible flows.
△ Less
Submitted 11 August, 2015; v1 submitted 23 October, 2014;
originally announced October 2014.
-
Time-irreversibility of the statistics of a single particle in a compressible turbulence
Authors:
Tobias Grafke,
Anna Frishman,
Gregory Falkovich
Abstract:
We investigate time-irreversibility from the point of view of a single particle in Burgers turbulence. Inspired by the recent work for incompressible flows [Xu et al., PNAS 111.21 (2014) 7558], we analyze the evolution of the kinetic energy for fluid markers and use the fluctuations of the instantaneous power as a measure of time irreversibility. For short times, starting from a uniform distributi…
▽ More
We investigate time-irreversibility from the point of view of a single particle in Burgers turbulence. Inspired by the recent work for incompressible flows [Xu et al., PNAS 111.21 (2014) 7558], we analyze the evolution of the kinetic energy for fluid markers and use the fluctuations of the instantaneous power as a measure of time irreversibility. For short times, starting from a uniform distribution of markers, we find the scaling $\left<[E(t)-E(0)]^n\right>\propto t$ and $\left<p^n\right> \propto \textrm{Re}^{n-1}$ for the power as a function of the Reynolds number. Both observations can be explained using the "flight-crash" model, suggested by Xu et al. Furthermore, we use a simple model for shocks which reproduces the moments of the energy difference including the pre-factor for $\left<E(t)-E(0)\right>$. To complete the single particle picture for Burgers we compute the moments of the Lagrangian velocity difference and show that they are bi-fractal. This arises in a similar manner to the bi-fractality of Eulerian velocity differences. In the above setting time irreversibility is directly manifest as particles eventually end up in shocks. We additionally investigate time irreversibility in the long-time limit when all particles are located inside shocks and the Lagrangian velocity statistics are stationary. We find the same scalings for the power and energy differences as at short times and argue that this is also a consequence of rare "flight-crash" events related to shock collisions.
△ Less
Submitted 2 August, 2015; v1 submitted 24 August, 2014;
originally announced August 2014.
-
Arclength parametrized Hamilton's equations for the calculation of instantons
Authors:
Tobias Grafke,
Rainer Grauer,
Tobias Schäfer,
Eric Vanden-Eijnden
Abstract:
A method is presented to compute minimizers (instantons) of action functionals using arclength parametrization of Hamilton's equations. This method can be interpreted as a local variant of the geometric minimum action method (gMAM) introduced to compute minimizers of the Freidlin-Wentzell action functional that arises in the context of large deviation theory for stochastic differential equations.…
▽ More
A method is presented to compute minimizers (instantons) of action functionals using arclength parametrization of Hamilton's equations. This method can be interpreted as a local variant of the geometric minimum action method (gMAM) introduced to compute minimizers of the Freidlin-Wentzell action functional that arises in the context of large deviation theory for stochastic differential equations. The method is particularly well-suited to calculate expectations dominated by noise-induced excursions from deterministically stable fixpoints. Its simplicity and computational efficiency are illustrated here using several examples: a finite-dimensional stochastic dynamical system (an Ornstein-Uhlenbeck model) and two models based on stochastic partial differential equations: the $φ^4$-model and the stochastically driven Burgers equation.
△ Less
Submitted 20 September, 2013;
originally announced September 2013.
-
Lagrangian and geometric analysis of finite-time Euler singularities
Authors:
Tobias Grafke,
Rainer Grauer
Abstract:
We present a numerical method of analyzing possibly singular incompressible 3D Euler flows using massively parallel high-resolution adaptively refined numerical simulations up to 8192^3 mesh points. Geometrical properties of Lagrangian vortex line segments are used in combination with analytical non-blowup criteria by Deng et al [Commun. PDE 31 (2006)] to reliably distinguish between singular and…
▽ More
We present a numerical method of analyzing possibly singular incompressible 3D Euler flows using massively parallel high-resolution adaptively refined numerical simulations up to 8192^3 mesh points. Geometrical properties of Lagrangian vortex line segments are used in combination with analytical non-blowup criteria by Deng et al [Commun. PDE 31 (2006)] to reliably distinguish between singular and near-singular flow evolution. We then apply the presented technique to a class of high-symmetry initial conditions and present numerical evidence against the formation of a finite-time singularity in this case.
△ Less
Submitted 3 December, 2012;
originally announced December 2012.
-
Finite-Time Euler singularities: A Lagrangian perspective
Authors:
Tobias Grafke,
Rainer Grauer
Abstract:
We address the question whether a singularity in a three-dimensional incompressible inviscid fluid flow can occur in finite time. Analytical considerations and numerical simulations suggest high-symmetry flows being a promising candidate for a finite-time blowup. Utilizing Lagrangian and geometric non-blowup criteria, we present numerical evidence against the formation of a finite-time singularity…
▽ More
We address the question whether a singularity in a three-dimensional incompressible inviscid fluid flow can occur in finite time. Analytical considerations and numerical simulations suggest high-symmetry flows being a promising candidate for a finite-time blowup. Utilizing Lagrangian and geometric non-blowup criteria, we present numerical evidence against the formation of a finite-time singularity for the high-symmetry vortex dodecapole initial condition. We use data obtained from high resolution adaptively refined numerical simulations and inject Lagrangian tracer particles to monitor geometric properties of vortex line segments. We then verify the assumptions made by analytical non-blowup criteria introduced by Deng et. al [Commun. PDE 31 (2006)] connecting vortex line geometry (curvature, spreading) to velocity increase to rule out singular behavior.
△ Less
Submitted 9 October, 2012;
originally announced October 2012.
-
Instanton filtering for the stochastic Burgers equation
Authors:
Tobias Grafke,
Rainer Grauer,
Tobias Schäfer
Abstract:
We address the question whether one can identify instantons in direct numerical simulations of the stochastically driven Burgers equation. For this purpose, we first solve the instanton equations using the Chernykh-Stepanov method [Phys. Rev. E 64, 026306 (2001)]. These results are then compared to direct numerical simulations by introducing a filtering technique to extract prescribed rare events…
▽ More
We address the question whether one can identify instantons in direct numerical simulations of the stochastically driven Burgers equation. For this purpose, we first solve the instanton equations using the Chernykh-Stepanov method [Phys. Rev. E 64, 026306 (2001)]. These results are then compared to direct numerical simulations by introducing a filtering technique to extract prescribed rare events from massive data sets of realizations. Using this approach we can extract the entire time history of the instanton evolution which allows us to identify the different phases predicted by the direct method of Chernykh and Stepanov with remarkable agreement.
△ Less
Submitted 5 September, 2012;
originally announced September 2012.
-
Turbulence properties and global regularity of a modified Navier-Stokes equation
Authors:
Tobias Grafke,
Rainer Grauer,
Thomas C. Sideris
Abstract:
We introduce a modification of the Navier-Stokes equation that has the remarkable property of possessing an infinite number of conserved quantities in the inviscid limit. This new equation is studied numerically and turbulence properties are analyzed concerning energy spectra and scaling of structure functions. The dissipative structures arising in this new equation are curled vortex sheets contra…
▽ More
We introduce a modification of the Navier-Stokes equation that has the remarkable property of possessing an infinite number of conserved quantities in the inviscid limit. This new equation is studied numerically and turbulence properties are analyzed concerning energy spectra and scaling of structure functions. The dissipative structures arising in this new equation are curled vortex sheets contrary to vortex tubes arising in Navier-Stokes turbulence. The numerically calculated scaling of structure functions is compared with a phenomenological model based on the She-Lévêque approach. Finally, for this equation we demonstrate global well-posedness for sufficiently smooth initial conditions in the periodic case and in $\mathbb R^3$. The key feature is the availability of an additional estimate which shows that the $L^4$-norm of the velocity field remains finite.
△ Less
Submitted 25 May, 2012;
originally announced May 2012.
-
Numerical simulations of possible finite time singularities in the incompressible Euler equations: comparison of numerical methods
Authors:
Tobias Grafke,
Holger Homann,
Juergen Dreher,
Rainer Grauer
Abstract:
The numerical simulation of the 3D incompressible Euler equation is analyzed with respect to different integration methods. The numerical schemes we considered include spectral methods with different strategies for dealiasing and two variants of finite difference methods. Based on this comparison, a Kida-Pelz like initial condition is integrated using adaptive mesh refinement and estimates on th…
▽ More
The numerical simulation of the 3D incompressible Euler equation is analyzed with respect to different integration methods. The numerical schemes we considered include spectral methods with different strategies for dealiasing and two variants of finite difference methods. Based on this comparison, a Kida-Pelz like initial condition is integrated using adaptive mesh refinement and estimates on the necessary numerical resolution are given. This estimate is based on analyzing the scaling behavior similar to the procedure in critical phenomena and present simulations are put into perspective.
△ Less
Submitted 14 November, 2007;
originally announced November 2007.
