-
Resilience of the Atlantic Meridional Overturning Circulation
Authors:
Valérian Jacques-Dumas,
Henk A. Dijkstra,
Christian Kuehn
Abstract:
We address the issue of resilience of the Atlantic Meridional Overturning Circulation (AMOC) given the many indications that this dynamical system is in a multi-stable regime. A novel approach to resilience based on rare event techniques is presented which leads to a measure capturing `resistance to change` and `ability to return' aspects in a probabilistic way. The application of this measure to…
▽ More
We address the issue of resilience of the Atlantic Meridional Overturning Circulation (AMOC) given the many indications that this dynamical system is in a multi-stable regime. A novel approach to resilience based on rare event techniques is presented which leads to a measure capturing `resistance to change` and `ability to return' aspects in a probabilistic way. The application of this measure to a conceptual model demonstrates its suitability for assessing AMOC resilience but also shows its potential use in many other non-autonomous dynamical systems. This framework is then extended to compute the probability that the AMOC undergoes a transition conditioned on an external forcing. Such conditional probability can be estimated by exploiting the information available when computing the resilience of this system. This allows us to provide a probabilistic view on safe operating spaces by defining a conditional safe operating space as a subset of the parameter space of the (possibly transient) imposed forcing.
△ Less
Submitted 2 July, 2024;
originally announced July 2024.
-
Warning Signs for Boundary Noise and their Application to an Ocean Boussinesq Model
Authors:
Paolo Bernuzzi,
Henk A. Dijkstra,
Christian Kuehn
Abstract:
In this paper, we construct and discuss early-warning signs of the approach of a parameter to a deterministic bifurcation on a stochastic partial differential equation (SPDE) model with Gaussian white-noise on the boundary. We specifically focus on the qualitative behaviour of the time-asymptotic autocovariance and autocorrelation of the solutions of the linearized system. We also discuss the reli…
▽ More
In this paper, we construct and discuss early-warning signs of the approach of a parameter to a deterministic bifurcation on a stochastic partial differential equation (SPDE) model with Gaussian white-noise on the boundary. We specifically focus on the qualitative behaviour of the time-asymptotic autocovariance and autocorrelation of the solutions of the linearized system. We also discuss the reliability of the tools from an analytic perspective and through various examples. Among those, the application of the early-warning signs for an ocean Boussinesq model is explored through numerical simulations. The analytic results obtained expand on previous work and present valuable early-warning signs for various applications.
△ Less
Submitted 22 May, 2024;
originally announced May 2024.
-
Analysis of the Geometric Structure of Neural Networks and Neural ODEs via Morse Functions
Authors:
Christian Kuehn,
Sara-Viola Kuntz
Abstract:
Besides classical feed-forward neural networks, also neural ordinary differential equations (neural ODEs) gained particular interest in recent years. Neural ODEs can be interpreted as an infinite depth limit of feed-forward or residual neural networks. We study the input-output dynamics of finite and infinite depth neural networks with scalar output. In the finite depth case, the input is a state…
▽ More
Besides classical feed-forward neural networks, also neural ordinary differential equations (neural ODEs) gained particular interest in recent years. Neural ODEs can be interpreted as an infinite depth limit of feed-forward or residual neural networks. We study the input-output dynamics of finite and infinite depth neural networks with scalar output. In the finite depth case, the input is a state associated to a finite number of nodes, which maps under multiple non-linear transformations to the state of one output node. In analogy, a neural ODE maps a linear transformation of the input to a linear transformation of its time-$T$ map. We show that depending on the specific structure of the network, the input-output map has different properties regarding the existence and regularity of critical points. These properties can be characterized via Morse functions, which are scalar functions, where every critical point is non-degenerate. We prove that critical points cannot exist, if the dimension of the hidden layer is monotonically decreasing or the dimension of the phase space is smaller or equal to the input dimension. In the case that critical points exist, we classify their regularity depending on the specific architecture of the network. We show that each critical point is non-degenerate, if for finite depth neural networks the underlying graph has no bottleneck, and if for neural ODEs, the linear transformations used have full rank. For each type of architecture, the proven properties are comparable in the finite and in the infinite depth case. The established theorems allow us to formulate results on universal embedding, i.e.\ on the exact representation of maps by neural networks and neural ODEs. Our dynamical systems viewpoint on the geometric structure of the input-output map provides a fundamental understanding, why certain architectures perform better than others.
△ Less
Submitted 15 May, 2024;
originally announced May 2024.
-
Infinite dimensional Slow Manifolds for a Linear Fast-Reaction System
Authors:
Christian Kuehn,
Pascal Lehner,
Jan-Eric Sulzbach
Abstract:
The aim of this expository paper is twofold. We start with a concise overview of the theory of invariant slow manifolds for fast-slow dynamical systems starting with the work by Tikhonov and Fenichel to the most recent works on infinite-dimensional fast-slow systems. The main part focuses on a class of linear fast-reaction PDE, which are particular forms of fast-reaction systems. The first result…
▽ More
The aim of this expository paper is twofold. We start with a concise overview of the theory of invariant slow manifolds for fast-slow dynamical systems starting with the work by Tikhonov and Fenichel to the most recent works on infinite-dimensional fast-slow systems. The main part focuses on a class of linear fast-reaction PDE, which are particular forms of fast-reaction systems. The first result shows the convergence of solutions of the linear system to the limit system as the time-scale parameter $\varepsilon$ goes to zero. Moreover, from the explicit solutions the slow manifold is constructed and the convergence to the critical manifold is proven. The subsequent result, then, states a generalized version of the Fenichel-Tikhonov theorem for linear fast-reaction systems.
△ Less
Submitted 26 April, 2024;
originally announced April 2024.
-
Adjoint-Based Projections for Uncertainty Quantification near Stochastically Perturbed Limit Cycles and Tori
Authors:
Zaid Ahsan,
Harry Dankowicz,
Christian Kuehn
Abstract:
This paper presents a new boundary-value problem formulation for quantifying uncertainty induced by the presence of small Brownian noise near transversally stable periodic orbits (limit cycles) and quasiperiodic invariant tori of the deterministic dynamical systems obtained in the absence of noise. The formulation uses adjoints to construct a continuous family of transversal hyperplanes that are i…
▽ More
This paper presents a new boundary-value problem formulation for quantifying uncertainty induced by the presence of small Brownian noise near transversally stable periodic orbits (limit cycles) and quasiperiodic invariant tori of the deterministic dynamical systems obtained in the absence of noise. The formulation uses adjoints to construct a continuous family of transversal hyperplanes that are invariant under the linearized deterministic flow near the limit cycle or quasiperiodic invariant torus. The intersections with each hyperplane of stochastic trajectories that remain near the deterministic cycle or torus over intermediate times may be approximated by a Gaussian distribution whose covariance matrix can be obtained from the solution to the corresponding boundary-value problem. In the case of limit cycles, the analysis improves upon results in the literature through the explicit use of state-space projections, transversality constraints, and symmetry-breaking parameters that ensure uniqueness of the solution despite the lack of hyperbolicity along the limit cycle. These same innovations are then generalized to the case of a quasiperiodic invariant torus of arbitrary dimension. In each case, a closed-form solution to the covariance boundary-value problem is found in terms of a convergent series. The methodology is validated against the results of numerical integration for two examples of stochastically perturbed limit cycles and one example of a stochastically perturbed two-dimensional quasiperiodic invariant torus. Finally, an implementation of the covariance boundary-value problem in the numerical continuation package coco is applied to analyze the small-noise limit near a two-dimensional quasiperiodic invariant torus in a nonlinear deterministic dynamical system in $\mathbb{R}^4$ that does not support closed-form analysis.
△ Less
Submitted 20 April, 2024;
originally announced April 2024.
-
Uncertainty quantification analysis of bifurcations of the Allen--Cahn equation with random coefficients
Authors:
Christian Kuehn,
Chiara Piazzola,
Elisabeth Ullmann
Abstract:
In this work we consider the Allen--Cahn equation, a prototypical model problem in nonlinear dynamics that exhibits bifurcations corresponding to variations of a deterministic bifurcation parameter. Going beyond the state-of-the-art, we introduce a random coefficient function in the linear reaction part of the equation, thereby accounting for random, spatially-heterogeneous effects. Importantly, w…
▽ More
In this work we consider the Allen--Cahn equation, a prototypical model problem in nonlinear dynamics that exhibits bifurcations corresponding to variations of a deterministic bifurcation parameter. Going beyond the state-of-the-art, we introduce a random coefficient function in the linear reaction part of the equation, thereby accounting for random, spatially-heterogeneous effects. Importantly, we assume a spatially constant, deterministic mean value of the random coefficient. We show that this mean value is in fact a bifurcation parameter in the Allen--Cahn equation with random coefficients. Moreover, we show that the bifurcation points and bifurcation curves become random objects. We consider two distinct modelling situations: (i) for a spatially homogeneous coefficient we derive analytical expressions for the distribution of the bifurcation points and show that the bifurcation curves are random shifts of a fixed reference curve; (ii) for a spatially heterogeneous coefficient we employ a generalized polynomial chaos expansion to approximate the statistical properties of the random bifurcation points and bifurcation curves. We present numerical examples in 1D physical space, where we combine the popular software package Continuation Core and Toolboxes (CoCo) for numerical continuation and the Sparse Grids Matlab Kit for the polynomial chaos expansion. Our exposition addresses both, dynamical systems and uncertainty quantification, highlighting how analytical and numerical tools from both areas can be combined efficiently for the challenging uncertainty quantification analysis of bifurcations in random differential equations.
△ Less
Submitted 6 April, 2024;
originally announced April 2024.
-
Mean-Field Limits for Stochastic Interacting Particles on Digraph Measures
Authors:
Christian Kuehn,
Carlos Pulido
Abstract:
Many natural phenomena are effectively described by interacting particle systems, which can be modeled using either deterministic or stochastic differential equations (SDEs). In this study, we specifically investigate particle systems modeled by SDEs, wherein the mean field limit converges to a Vlasov-Fokker-Planck-type equation. Departing from conventional approaches in stochastic analysis, we ex…
▽ More
Many natural phenomena are effectively described by interacting particle systems, which can be modeled using either deterministic or stochastic differential equations (SDEs). In this study, we specifically investigate particle systems modeled by SDEs, wherein the mean field limit converges to a Vlasov-Fokker-Planck-type equation. Departing from conventional approaches in stochastic analysis, we explore the network connectivity between particles using diagraph measures (DGMs). DGMs are one possible tool to capture sparse, intermediate and dense network/graph interactions in the mean-field thereby going beyond more classical approaches such as graphons. Since the main goal is to capture large classes of mean-field limits, we set up our approach using measure-theoretic arguments and combine them with suitable moment estimates to ensure approximation results for the mean-field.
△ Less
Submitted 29 March, 2024;
originally announced March 2024.
-
The Amplitude Equation for the Space-Fractional Swift-Hohenberg Equation
Authors:
Christian Kuehn,
Sebastian Throm
Abstract:
Non-local reaction-diffusion partial differential equations (PDEs) involving the fractional Laplacian have arisen in a wide variety of applications. One common tool to analyse the dynamics of classical local PDEs near instability is to derive local amplitude/modulation approximations, which provide local normal forms classifying a wide variety of pattern-formation phenomena. In this work, we study…
▽ More
Non-local reaction-diffusion partial differential equations (PDEs) involving the fractional Laplacian have arisen in a wide variety of applications. One common tool to analyse the dynamics of classical local PDEs near instability is to derive local amplitude/modulation approximations, which provide local normal forms classifying a wide variety of pattern-formation phenomena. In this work, we study amplitude equations for the space-fractional Swift-Hohenberg equation. The Swift-Hohenberg equation is a basic model problem motivated by pattern formation in fluid dynamics and has served as one of the main PDEs to develop general techniques to derive amplitude equations. We prove that there exists near the first bifurcation point an approximation by a (real) Ginzburg-Landau equation. Interestingly, this Ginzburg-Landau equation is a local PDE, which provides a rigorous justification of the physical conjecture that suitably localized unstable modes can out-compete superdiffusion and re-localize a PDE near instability. Our main technical contributions are to provide a suitable function space setting for the approximation problem, and to then bound the residual between the original PDE and its amplitude equation.
△ Less
Submitted 5 March, 2024;
originally announced March 2024.
-
Ergodicity in planar slow-fast systems through slow relation functions
Authors:
Renato Huzak,
Hildeberto Jardón-Kojakhmetov,
Christian Kuehn
Abstract:
In this paper, we study ergodic properties of the slow relation function (or entry-exit function) in planar slow-fast systems. It is well known that zeros of the slow divergence integral associated with canard limit periodic sets give candidates for limit cycles. We present a new approach to detect the zeros of the slow divergence integral by studying the structure of the set of all probability me…
▽ More
In this paper, we study ergodic properties of the slow relation function (or entry-exit function) in planar slow-fast systems. It is well known that zeros of the slow divergence integral associated with canard limit periodic sets give candidates for limit cycles. We present a new approach to detect the zeros of the slow divergence integral by studying the structure of the set of all probability measures invariant under the corresponding slow relation function. Using the slow relation function, we also show how to estimate (in terms of weak convergence) the transformation of families of probability measures that describe initial point distribution of canard orbits during the passage near a slow-fast Hopf point (or a more general turning point). We provide formulas to compute exit densities for given entry densities and the slow relation function. We apply our results to slow-fast Liénard equations.
△ Less
Submitted 26 February, 2024;
originally announced February 2024.
-
Global stability for McKean-Vlasov equations on large networks
Authors:
Christian Kuehn,
Tobias Wöhrer
Abstract:
We investigate the mean-field dynamics of stochastic McKean differential equations with heterogeneous particle interactions described by large network structures. To express a wide range of graphs, from dense and sparse structures, we incorporate the recently developed graph limit theory of graphops into the limiting McKean-Vlasov equations. Global stability of the splay steady state is proven via…
▽ More
We investigate the mean-field dynamics of stochastic McKean differential equations with heterogeneous particle interactions described by large network structures. To express a wide range of graphs, from dense and sparse structures, we incorporate the recently developed graph limit theory of graphops into the limiting McKean-Vlasov equations. Global stability of the splay steady state is proven via a generalized entropy method, leading to explicit graph-structure dependent decay rates. We further analyze the limitations of the methodology and provided examples of random graphs such as power law graphs.
△ Less
Submitted 23 December, 2023;
originally announced December 2023.
-
Fractional Dissipative PDEs
Authors:
Franz Achleitner,
Goro Akagi,
Christian Kuehn,
Jens Markus Melenk,
Jens D. M. Rademacher,
Cinzia Soresina,
Jichen Yang
Abstract:
In this chapter we provide an introduction to fractional dissipative partial differential equations (PDEs) with a focus on trying to understand their dynamics. The class of PDEs we focus on are reaction-diffusion equations but we also provide an outlook on closely related classes of PDEs. To simplify the exposition, we only discuss the cases of fractional time derivatives and fractional space deri…
▽ More
In this chapter we provide an introduction to fractional dissipative partial differential equations (PDEs) with a focus on trying to understand their dynamics. The class of PDEs we focus on are reaction-diffusion equations but we also provide an outlook on closely related classes of PDEs. To simplify the exposition, we only discuss the cases of fractional time derivatives and fractional space derivatives in the PDE separately. As our main tools, we describe analytical as well as numerical methods, which are generically necessary to study nonlinear dynamics. We start with the analytical study of steady states and local linear stability for fractional time derivatives. Then we extend this view to a global perspective and consider time-fractional PDEs and gradient flows. Next, we continue to steady states, linear stability analysis and bifurcations for space-fractional PDEs. As a final analytical consideration we discuss existence and stability of traveling waves for space-fractional PDEs. In the last parts, we provide numerical discretization schemes for fractional (dissipative) PDEs and we utilize these techniques within numerical continuation in applied examples of fractional reaction-diffusion PDEs. We conclude with a brief summary and outlook on open questions in the field.
△ Less
Submitted 9 December, 2023;
originally announced December 2023.
-
Insider trading in discrete time Kyle games
Authors:
Christoph Kühn,
Christopher Lorenz
Abstract:
We present a new discrete time version of Kyle's (1985) classic model of insider trading, formulated as a generalised extensive form game. The model has three kinds of traders: an insider, random noise traders, and a market maker. The insider aims to exploit her informational advantage and maximise expected profits while the market maker observes the total order flow and sets prices accordingly.…
▽ More
We present a new discrete time version of Kyle's (1985) classic model of insider trading, formulated as a generalised extensive form game. The model has three kinds of traders: an insider, random noise traders, and a market maker. The insider aims to exploit her informational advantage and maximise expected profits while the market maker observes the total order flow and sets prices accordingly.
First, we show how the multi-period model with finitely many pure strategies can be reduced to a (static) social system in the sense of Debreu (1952) and prove the existence of a sequential Kyle equilibrium, following Kreps and Wilson (1982). This works for any probability distribution with finite support of the noise trader's demand and the true value, and for any finite information flow of the insider. In contrast to Kyle (1985) with normal distributions, equilibria exist in general only in mixed strategies and not in pure strategies.
In the single-period model we establish bounds for the insider's strategy in equilibrium. Finally, we prove the existence of an equilibrium for the game with a continuum of actions, by considering an approximating sequence of games with finitely many actions. Because of the lack of compactness of the set of measurable price functions, standard infinite-dimensional fixed point theorems are not applicable.
△ Less
Submitted 1 July, 2024; v1 submitted 1 December, 2023;
originally announced December 2023.
-
Early warning signs of critical transitions -- The $α$-stable case
Authors:
Lucia S. Layritz,
Ilya Pavlyukevich,
Anja Rammig,
Christian Kuehn
Abstract:
Statistical early warning signs can be used to identify an approaching bifurcation in stochastic dynamical systems and are now regularly employed in applications concerned with the identification of potential rapid, non-linear change or tip** points. However, the reliability of these early warning signs relies on a number of key mathematical assumptions, most notably the presence of Gaussian noi…
▽ More
Statistical early warning signs can be used to identify an approaching bifurcation in stochastic dynamical systems and are now regularly employed in applications concerned with the identification of potential rapid, non-linear change or tip** points. However, the reliability of these early warning signs relies on a number of key mathematical assumptions, most notably the presence of Gaussian noise. We here show that for systems driven by non-Gaussian, $α$-stable noise, the classical early warning signs of rising variance and autocorrelation are not supported by mathematical theory and their use poses the danger of spurious, false-positive results. To address this, we provide a generalized approach by introduce the scaling factor $γ_X$ as an alternative early warning sign. We show that in the case of the Ornstein-Uhlenbeck process, there exists a direct inverse relationship between $γ_{X}$ and the bifurcation parameter, telling us that $γ_{X}$ will increase as we approach the bifurcation. Our numerical simulations confirm theoretical results and show that our findings generalize well to non-linear, non-equilibrium systems. We thus provide a generalized, robust and applicable statistical early warning sign for systems driven by Gaussian and non-Gaussian $α$-stable noise.
△ Less
Submitted 27 November, 2023;
originally announced November 2023.
-
On network dynamical systems with a nilpotent singularity
Authors:
Hildeberto Jardón-Kojakhmetov,
Christian Kuehn
Abstract:
Network dynamics is nowadays of extreme relevance to model and analyze complex systems. From a dynamical systems perspective, understanding the local behavior near equilibria is of utmost importance. In particular, equilibria with at least one zero eigenvalue play a crucial role in bifurcation analysis. In this paper, we want to shed some light on nilpotent equilibria of network dynamical systems.…
▽ More
Network dynamics is nowadays of extreme relevance to model and analyze complex systems. From a dynamical systems perspective, understanding the local behavior near equilibria is of utmost importance. In particular, equilibria with at least one zero eigenvalue play a crucial role in bifurcation analysis. In this paper, we want to shed some light on nilpotent equilibria of network dynamical systems. As a main result, we show that the blow-up technique, which has proven to be extremely useful in understanding degenerate singularities in low-dimensional ordinary differential equations, is also suitable in the framework of network dynamical systems. Most importantly, we show that the blow-up technique preserves the network structure. The further usefulness of the blow-up technique, especially with regard to the desingularization of a nilpotent point, is showcased through several examples including linear diffusive systems, systems with nilpotent internal dynamics, and an adaptive network of Kuramoto oscillators.
△ Less
Submitted 13 October, 2023;
originally announced October 2023.
-
Extending Discrete Geometric Singular Perturbation Theory to Non-Hyperbolic Points
Authors:
Samuel Jelbart,
Christian Kuehn
Abstract:
We extend the recently developed discrete geometric singular perturbation theory to the non-normally hyperbolic regime. Our primary tool is the Takens embedding theorem, which provides a means of approximating the dynamics of particular maps with the time-1 map of a formal vector field. First, we show that the so-called reduced map, which governs the slow dynamics near slow manifolds in the normal…
▽ More
We extend the recently developed discrete geometric singular perturbation theory to the non-normally hyperbolic regime. Our primary tool is the Takens embedding theorem, which provides a means of approximating the dynamics of particular maps with the time-1 map of a formal vector field. First, we show that the so-called reduced map, which governs the slow dynamics near slow manifolds in the normally hyperbolic regime, can be locally approximated by the time-one map of the reduced vector field which appears in continuous-time geometric singular perturbation theory. In the non-normally hyperbolic regime, we show that the dynamics of fast-slow maps with a unipotent linear part can be locally approximated by the time-1 map induced by a fast-slow vector field in the same dimension, which has a nilpotent singularity of the corresponding type. The latter result is used to describe (i) the local dynamics of two-dimensional fast-slow maps with non-normally singularities of regular fold, transcritical and pitchfork type, and (ii) dynamics on a (potentially high dimensional) local center manifold in $n$-dimensional fast-slow maps with regular contact or fold submanifolds of the critical manifold. In general, our results show that the dynamics near a large and important class of singularities in fast-slow maps can be described via the use of formal embedding theorems which allow for their approximation by the time-1 map of a fast-slow vector field featuring a loss of normal hyperbolicity.
△ Less
Submitted 11 August, 2023;
originally announced August 2023.
-
Embedding Capabilities of Neural ODEs
Authors:
Christian Kuehn,
Sara-Viola Kuntz
Abstract:
A class of neural networks that gained particular interest in the last years are neural ordinary differential equations (neural ODEs). We study input-output relations of neural ODEs using dynamical systems theory and prove several results about the exact embedding of maps in different neural ODE architectures in low and high dimension. The embedding capability of a neural ODE architecture can be i…
▽ More
A class of neural networks that gained particular interest in the last years are neural ordinary differential equations (neural ODEs). We study input-output relations of neural ODEs using dynamical systems theory and prove several results about the exact embedding of maps in different neural ODE architectures in low and high dimension. The embedding capability of a neural ODE architecture can be increased by adding, for example, a linear layer, or augmenting the phase space. Yet, there is currently no systematic theory available and our work contributes towards this goal by develo** various embedding results as well as identifying situations, where no embedding is possible. The mathematical techniques used include as main components iterative functional equations, Morse functions and suspension flows, as well as several further ideas from analysis. Although practically, mainly universal approximation theorems are used, our geometric dynamical systems viewpoint on universal embedding provides a fundamental understanding, why certain neural ODE architectures perform better than others.
△ Less
Submitted 28 September, 2023; v1 submitted 2 August, 2023;
originally announced August 2023.
-
Early-Warning Signs for SPDEs with Continuous Spectrum
Authors:
Paolo Bernuzzi,
Antonia Düx,
Christian Kühn
Abstract:
In this work, we study early-warning signs for stochastic partial differential equations (SPDEs), where the linearization around a steady state has continuous spectrum. The studied warning sign takes the form of qualitative changes in the variance as a deterministic bifurcation threshold is approached via parameter variation. Specifically, we focus on the scaling law of the variance near the trans…
▽ More
In this work, we study early-warning signs for stochastic partial differential equations (SPDEs), where the linearization around a steady state has continuous spectrum. The studied warning sign takes the form of qualitative changes in the variance as a deterministic bifurcation threshold is approached via parameter variation. Specifically, we focus on the scaling law of the variance near the transition. Since we are dealing here, in contrast to previous studies, with the case of continuous spectrum and quantitative scaling laws, it is natural to start with linearizations that are multiplication operators defined by analytic functions. For a one-dimensional spatial domain we obtain precise rates of divergence. In the case of the two- and three-dimensional domains an upper bound to the rate of the early-warning sign is proven. These results are cross-validated by numerical simulations. Our theory can be generically useful for several applications, where stochastic and spatial aspects are important in combination with continuous spectrum bifurcations.
△ Less
Submitted 26 July, 2023;
originally announced July 2023.
-
Preserving Bifurcations through Moment Closures
Authors:
Christian Kuehn,
Jan Mölter
Abstract:
Moment systems arise in a wide range of contexts and applications, e.g. in network modeling of complex systems. Since moment systems consist of a high or even infinite number of coupled equations, an indispensable step in obtaining a low-dimensional representation that is amenable to further analysis is, in many cases, to select a moment closure. A moment closure consists of a set of approximation…
▽ More
Moment systems arise in a wide range of contexts and applications, e.g. in network modeling of complex systems. Since moment systems consist of a high or even infinite number of coupled equations, an indispensable step in obtaining a low-dimensional representation that is amenable to further analysis is, in many cases, to select a moment closure. A moment closure consists of a set of approximations that express certain higher-order moments in terms of lower-order ones, so that applying those leads to a closed system of equations for only the lower-order moments. Closures are frequently found drawing on intuition and heuristics to come up with quantitatively good approximations. In contrast to that, we propose an alternative approach where we instead focus on closures giving rise to certain qualitative features, such as bifurcations. Importantly, this fundamental change of perspective provides one with the possibility of classifying moment closures rigorously in regard to these features. This makes the design and selection of closures more algorithmic, precise, and reliable. In this work, we carefully study the moment systems that arise in the mean-field descriptions of two widely known network dynamical systems, the SIS epidemic and the adaptive voter model. We derive conditions that any moment closure has to satisfy so that the corresponding closed systems exhibit the transcritical bifurcation that one expects in these systems coming from the stochastic particle model.
△ Less
Submitted 15 March, 2024; v1 submitted 7 July, 2023;
originally announced July 2023.
-
The fundamental theorem of asset pricing with and without transaction costs
Authors:
Christoph Kühn
Abstract:
We prove a version of the fundamental theorem of asset pricing (FTAP) in continuous time that is based on the strict no-arbitrage condition and that is applicable to both frictionless markets and markets with proportional transaction costs. We consider a market with a single risky asset whose ask price process is higher than or equal to its bid price process. Neither the concatenation property of…
▽ More
We prove a version of the fundamental theorem of asset pricing (FTAP) in continuous time that is based on the strict no-arbitrage condition and that is applicable to both frictionless markets and markets with proportional transaction costs. We consider a market with a single risky asset whose ask price process is higher than or equal to its bid price process. Neither the concatenation property of the set of wealth processes, that is used in the proof of the frictionless FTAP, nor some boundedness property of the trading volume of admissible strategies usually argued with in models with a nonvanishing bid-ask spread need to be satisfied in our model.
△ Less
Submitted 2 July, 2023;
originally announced July 2023.
-
Persistent synchronization of heterogeneous networks with time-dependent linear diffusive coupling
Authors:
Hildeberto Jardón-Kojakhmetov,
Christian Kuehn,
Iacopo P. Longo
Abstract:
We study synchronization for linearly coupled temporal networks of heterogeneous time-dependent nonlinear agents via the convergence of attracting trajectories of each node. The results are obtained by constructing and studying the stability of a suitable linear nonautonomous problem bounding the evolution of the synchronization errors. Both, the case of the entire network and only a cluster, are…
▽ More
We study synchronization for linearly coupled temporal networks of heterogeneous time-dependent nonlinear agents via the convergence of attracting trajectories of each node. The results are obtained by constructing and studying the stability of a suitable linear nonautonomous problem bounding the evolution of the synchronization errors. Both, the case of the entire network and only a cluster, are addressed and the persistence of the obtained synchronization against perturbation is also discussed. Furthermore, a sufficient condition for the existence of attracting trajectories of each node is given. In all cases, the considered dependence on time requires only local integrability, which is a very mild regularity assumption. Moreover, our results mainly depend on the network structure and its properties, and achieve synchronization up to a constant in finite time. Hence they are quite suitable for applications. The applicability of the results is showcased via several examples: coupled van-der-Pol/FitzHugh-Nagumo oscillators, weighted/signed opinion dynamics, and coupled Lorenz systems.
△ Less
Submitted 9 May, 2023;
originally announced May 2023.
-
Higher-Order Network Interactions through Phase Reduction for Oscillators with Phase-Dependent Amplitude
Authors:
Christian Bick,
Tobias Böhle,
Christian Kuehn
Abstract:
Coupled oscillator networks provide mathematical models for interacting periodic processes. If the coupling is weak, phase reduction -- the reduction of the dynamics onto an invariant torus -- captures the emergence of collective dynamical phenomena, such as synchronization. While a first-order approximation of the dynamics on the torus may be appropriate in some situations, higher-order phase red…
▽ More
Coupled oscillator networks provide mathematical models for interacting periodic processes. If the coupling is weak, phase reduction -- the reduction of the dynamics onto an invariant torus -- captures the emergence of collective dynamical phenomena, such as synchronization. While a first-order approximation of the dynamics on the torus may be appropriate in some situations, higher-order phase reductions become necessary, for example, when the coupling strength increases. However, these are generally hard to compute and thus they have only been derived in special cases: This includes globally coupled Stuart--Landau oscillators, where the limit cycle of the uncoupled nonlinear oscillator is circular as the amplitude is independent of the phase. We go beyond this restriction and derive second-order phase reductions for coupled oscillators for arbitrary networks of coupled nonlinear oscillators with phase-dependent amplitude, a scenario more reminiscent of real-world oscillations. We analyze how the deformation of the limit cycle affects the stability of important dynamical states, such as full synchrony and splay states. By identifying higher-order phase interaction terms with hyperedges of a hypergraph, we obtain natural classes of coupled phase oscillator dynamics on hypergraphs that adequately capture the dynamics of coupled limit cycle oscillators.
△ Less
Submitted 26 January, 2024; v1 submitted 7 May, 2023;
originally announced May 2023.
-
Cross-diffusion induced instability on networks
Authors:
Christian Kuehn,
Cinzia Soresina
Abstract:
The concept of Turing instability, namely that diffusion can destabilize the uniform steady state, is well known either in the context of partial differential equations (PDEs) or in networks of dynamical systems. Recently reaction-diffusion equations with cross-diffusion terms have been investigated, showing an analogous effect called cross-diffusion induced instability. In this paper, we extend t…
▽ More
The concept of Turing instability, namely that diffusion can destabilize the uniform steady state, is well known either in the context of partial differential equations (PDEs) or in networks of dynamical systems. Recently reaction-diffusion equations with cross-diffusion terms have been investigated, showing an analogous effect called cross-diffusion induced instability. In this paper, we extend this concept to networks of dynamical systems, showing that the spectrum of the graph Laplacian determines the instability appearance, as well as the spectrum of the Laplace operator in reaction-diffusion equations. We extend to network dynamics a particular network model for competing species, coming from the PDEs context. In particular, the influence of different topology structures on the cross-diffusion induced instability is highlighted, considering regular rings and lattices, and also small-world, Erdős-Réyni, and Barabási-Albert networks.
△ Less
Submitted 7 August, 2023; v1 submitted 24 April, 2023;
originally announced April 2023.
-
Adaptive Dynamical Networks
Authors:
Rico Berner,
Thilo Gross,
Christian Kuehn,
Jürgen Kurths,
Serhiy Yanchuk
Abstract:
It is a fundamental challenge to understand how the function of a network is related to its structural organization. Adaptive dynamical networks represent a broad class of systems that can change their connectivity over time depending on their dynamical state. The most important feature of such systems is that their function depends on their structure and vice versa. While the properties of static…
▽ More
It is a fundamental challenge to understand how the function of a network is related to its structural organization. Adaptive dynamical networks represent a broad class of systems that can change their connectivity over time depending on their dynamical state. The most important feature of such systems is that their function depends on their structure and vice versa. While the properties of static networks have been extensively investigated in the past, the study of adaptive networks is much more challenging. Moreover, adaptive dynamical networks are of tremendous importance for various application fields, in particular, for the models for neuronal synaptic plasticity, adaptive networks in chemical, epidemic, biological, transport, and social systems, to name a few. In this review, we provide a detailed description of adaptive dynamical networks, show their applications in various areas of research, highlight their dynamical features and describe the arising dynamical phenomena, and give an overview of the available mathematical methods developed for understanding adaptive dynamical networks.
△ Less
Submitted 12 April, 2023;
originally announced April 2023.
-
Integer linear programming supporting portfolio design
Authors:
C. C. N. Kuhn,
G. Calbert,
I. Garanovich,
T. Weir
Abstract:
In large organisations and companies, making investment decisions is a complex and challenging task. In the Australian Department of Defence (Defence), the complexity is even higher because defence capabilities are public goods and do not have a financial return \textit{per se}. In this work we mathematically define Defence's investment portfolio problem as a Set-Union Knapsack Problem (SUKP). We…
▽ More
In large organisations and companies, making investment decisions is a complex and challenging task. In the Australian Department of Defence (Defence), the complexity is even higher because defence capabilities are public goods and do not have a financial return \textit{per se}. In this work we mathematically define Defence's investment portfolio problem as a Set-Union Knapsack Problem (SUKP). We present a practical way to linearise the model as an Integer Linear Programming (ILP) problem. This linear model was developed as the optimisation engine of the New Investments to Risked Options (NITRO) portfolio selection tool developed by the Defence Science \& Technology Group (DSTG) for Defence force design activities in 2021. The model is implemented in the Python package called PuLP which can call several linear solver's Application Programming Interface (API), such as GLPK, COIN CLP/CBC, IBM CPLEX, and Gurobi. After comparing the performance of several solvers, we chose Gurobi in the production server. The implementation of the new model and solver enables the rapid execution of exact solutions to the Defence investment portfolio problem.
△ Less
Submitted 25 March, 2023;
originally announced March 2023.
-
A Formal Geometric Blow-up Method for Pattern Forming Systems
Authors:
Samuel Jelbart,
Christian Kuehn
Abstract:
We extend and apply a recently developed approach to the study of dynamic bifurcations in PDEs based on the geometric blow-up method. We show that this approach, which has so far only been applied to study a dynamic Turing bifurcation in a cubic Swift-Hohenberg equation, can be coupled with a fast-slow extension of the method of multiple scales. This leads to a formal but systematic method, which…
▽ More
We extend and apply a recently developed approach to the study of dynamic bifurcations in PDEs based on the geometric blow-up method. We show that this approach, which has so far only been applied to study a dynamic Turing bifurcation in a cubic Swift-Hohenberg equation, can be coupled with a fast-slow extension of the method of multiple scales. This leads to a formal but systematic method, which can be viewed as a fast-slow generalisation of the formal part of classical modulation theory. We demonstrate the utility and versatility of this method by using it to derive modulation equations, i.e. simpler closed form equations which govern the dynamics of the formal approximations near the underlying bifurcation point, in the context of model equations with dynamic bifurcations of (i) Turing, (ii) Hopf, (iii) Turing-Hopf, and (iv) stationary long-wave type. The modulation equations have a familiar form: They are of real Ginzburg-Landau (GL), complex GL, coupled complex GL and Cahn-Hilliard type respectively. In contrast to the modulation equations derived in classical modulation theory, however, they have time-dependent coefficients induced by the slow parameter drift, they depend on spatial and temporal scales which scale in a dependent and non-trivial way, and the geometry of the space in which they are posed is non-trivial due to the blow-up transformation. The formal derivation of the modulation equations provides the first steps toward the rigorous treatment of these challenging problems, which remains for future work.
△ Less
Submitted 13 February, 2023;
originally announced February 2023.
-
Fast Reactions and Slow Manifolds
Authors:
Christian Kuehn,
Jan-Eric Sulzbach
Abstract:
In this paper we generalize the Fenichel theory for attracting critical/slow manifolds to fast-reaction systems in infinite dimensions. In particular, we generalize the theory of invariant manifolds for fast-slow partial differential equations in standard form to the case of fast reaction terms. We show that the solution of the fast-reaction system can be approximated by the corresponding slow flo…
▽ More
In this paper we generalize the Fenichel theory for attracting critical/slow manifolds to fast-reaction systems in infinite dimensions. In particular, we generalize the theory of invariant manifolds for fast-slow partial differential equations in standard form to the case of fast reaction terms. We show that the solution of the fast-reaction system can be approximated by the corresponding slow flow of the limit system. Introducing an additional parameter that stems from a splitting in the slow variable space, we construct a family of slow manifolds and we prove that the slow manifolds are close to the critical manifold. Moreover, the semi-flow on the slow manifold converges to the semi-flow on the critical manifold. Finally, we apply these results to an example and show that the underlying assumptions can be verified in a straightforward way.
△ Less
Submitted 7 March, 2024; v1 submitted 23 January, 2023;
originally announced January 2023.
-
Bifurcations and Early-Warning Signs for SPDEs with Spatial Heterogeneity
Authors:
Paolo Bernuzzi,
Christian Kühn
Abstract:
Bistability is a key property of many systems arising in the nonlinear sciences. For example, it appears in many partial differential equations (PDEs). For scalar bistable reaction-diffusions PDEs, the bistable case even has take on different names within communities such as Allee, Allen-Cahn, Chafee-Infante, Nagumo, Ginzburg-Landau, $Φ_4$, Schlögl, Stommel, just to name a few structurally similar…
▽ More
Bistability is a key property of many systems arising in the nonlinear sciences. For example, it appears in many partial differential equations (PDEs). For scalar bistable reaction-diffusions PDEs, the bistable case even has take on different names within communities such as Allee, Allen-Cahn, Chafee-Infante, Nagumo, Ginzburg-Landau, $Φ_4$, Schlögl, Stommel, just to name a few structurally similar bistable model names. One key mechanism, how bistability arises under parameter variation is a pitchfork bifurcation. In particular, taking the pitchfork bifurcation normal form for reaction-diffusion PDEs is yet another variant within the family of PDEs mentioned above. More generally, the study of this PDE class considering steady states and stability, related to bifurcations due to a parameter is well-understood for the deterministic case. For the stochastic PDE (SPDE) case, the situation is less well-understood and has been studied recently. In this paper we generalize and unify several recent results for SPDE bifurcations. Our generalisation is motivated directly by applications as we introduce in the equation a spatially heterogeneous term and relax the assumptions on the covariance operator that defines the noise. For this spatially heterogeneous SPDE, we prove a finite-time Lyapunov exponent bifurcation result. Furthermore, we extend the theory of early warning signs in our context and we explain, the role of universal exponents between covariance operator warning signs and the lack of finite-time Lyapunov uniformity. Our results are accompanied and cross-validated by numerical simulations.
△ Less
Submitted 28 December, 2022;
originally announced December 2022.
-
Reduction Methods in Climate Dynamics -- A Brief Review
Authors:
Felix Hummel,
Peter Ashwin,
Christian Kuehn
Abstract:
We review a range of reduction methods that have been, or may be useful for connecting models of the Earth's climate system of differing complexity. We particularly focus on methods where rigorous reduction is possible. We aim to highlight the main mathematical ideas of each reduction method and also provide several benchmark examples from climate modelling.
We review a range of reduction methods that have been, or may be useful for connecting models of the Earth's climate system of differing complexity. We particularly focus on methods where rigorous reduction is possible. We aim to highlight the main mathematical ideas of each reduction method and also provide several benchmark examples from climate modelling.
△ Less
Submitted 25 September, 2022;
originally announced September 2022.
-
Entry-exit functions in fast-slow systems with intersecting eigenvalues
Authors:
Panagiotis Kaklamanos,
Christian Kuehn,
Nikola Popović,
Mattia Sensi
Abstract:
We study delayed loss of stability in a class of fast-slow systems with two fast variables and one slow one, where the linearisation of the fast vector field along a one-dimensional critical manifold has two real eigenvalues which intersect before the accumulated contraction and expansion are balanced along any individual eigendirection. That interplay between eigenvalues and eigendirections rende…
▽ More
We study delayed loss of stability in a class of fast-slow systems with two fast variables and one slow one, where the linearisation of the fast vector field along a one-dimensional critical manifold has two real eigenvalues which intersect before the accumulated contraction and expansion are balanced along any individual eigendirection. That interplay between eigenvalues and eigendirections renders the use of known entry-exit relations unsuitable for calculating the point at which trajectories exit neighbourhoods of the given manifold. We illustrate the various qualitative scenarios that are possible in the class of systems considered here, and we propose novel formulae for the entry-exit functions that underlie the phenomenon of delayed loss of stability therein.
△ Less
Submitted 24 August, 2022;
originally announced August 2022.
-
Geometric Blow-Up for Folded Limit Cycle Manifolds in Three Time-Scale Systems
Authors:
Samuel Jelbart,
Christian Kuehn,
Sara-Viola Kuntz
Abstract:
Geometric singular perturbation theory provides a powerful mathematical framework for the analysis of 'stationary' multiple time-scale systems which possess a critical manifold, i.e. a smooth manifold of steady states for the limiting fast subsystem, particularly when combined with a method of desingularization known as blow-up. The theory for 'oscillatory' multiple time-scale systems which posses…
▽ More
Geometric singular perturbation theory provides a powerful mathematical framework for the analysis of 'stationary' multiple time-scale systems which possess a critical manifold, i.e. a smooth manifold of steady states for the limiting fast subsystem, particularly when combined with a method of desingularization known as blow-up. The theory for 'oscillatory' multiple time-scale systems which possess a limit cycle manifold instead of (or in addition to) a critical manifold is less developed, particularly in the non-normally hyperbolic regime. We use the blow-up method to analyse the global oscillatory transition near a regular folded limit cycle manifold in a class of three time-scale 'semi-oscillatory' systems with two small parameters. The systems considered behave like oscillatory systems as the smallest perturbation parameter tends to zero, and stationary systems as both perturbation parameters tend to zero. The additional time-scale structure is crucial for the applicability of the blow-up method, which cannot be applied directly to the two time-scale oscillatory counterpart of the problem. Our methods allow us to describe the asymptotics and strong contractivity of all solutions which traverse a neighbourhood of the global singularity. Our main results cover a range of different cases with respect to the relative time-scale of the angular dynamics and the parameter drift. We demonstrate the applicability of our results for systems with periodic forcing in the slow equation, in particular for a class of Liénard equations. Finally, we consider a toy model used to study tip** phenomena in climate systems with periodic forcing in the fast equation, which violates the conditions of our main results, in order to demonstrate the applicability of classical (two time-scale) theory for problems of this kind.
△ Less
Submitted 17 November, 2023; v1 submitted 2 August, 2022;
originally announced August 2022.
-
Geometric analysis of fast-slow PDEs with fold singularities
Authors:
Maximilian Engel,
Felix Hummel,
Christian Kuehn,
Nikola Popović,
Mariya Ptashnyk,
Thomas Zacharis
Abstract:
We study a singularly perturbed fast-slow system of two partial differential equations (PDEs) of reaction-diffusion type on a bounded domain. We assume that the reaction terms in the fast variable contain a fold singularity, whereas the slow variable assumes the role of a dynamic bifurcation parameter, thus extending the classical analysis of a fast-slow dynamic fold bifurcation to an infinite-dim…
▽ More
We study a singularly perturbed fast-slow system of two partial differential equations (PDEs) of reaction-diffusion type on a bounded domain. We assume that the reaction terms in the fast variable contain a fold singularity, whereas the slow variable assumes the role of a dynamic bifurcation parameter, thus extending the classical analysis of a fast-slow dynamic fold bifurcation to an infinite-dimensional setting. Our approach combines a spectral Galerkin discretisation with techniques from Geometric Singular Perturbation Theory (GSPT) which are applied to the resulting high-dimensional systems of ordinary differential equations (ODEs). In particular, we show the existence of invariant manifolds away from the fold singularity, while the dynamics in a neighbourhood of the singularity is described by geometric desingularisation, via the blow-up technique. Finally, we relate the Galerkin manifolds that are obtained after the discretisation to the invariant manifolds which exist in the phase space of the original system of PDEs.
△ Less
Submitted 13 July, 2022;
originally announced July 2022.
-
Geometric blow-up of a dynamic Turing instability in the Swift-Hohenberg equation
Authors:
Felix Hummel,
Samuel Jelbart,
Christian Kuehn
Abstract:
We present a rigorous analysis of the slow passage through a Turing bifurcation in the Swift-Hohenberg equation using a novel approach based on geometric blow-up. We show that the formally derived multiple scales ansatz which is known from classical modulation theory can be adapted for use in the fast-slow setting, by reformulating it as a blow-up transformation. This leads to dynamically simpler…
▽ More
We present a rigorous analysis of the slow passage through a Turing bifurcation in the Swift-Hohenberg equation using a novel approach based on geometric blow-up. We show that the formally derived multiple scales ansatz which is known from classical modulation theory can be adapted for use in the fast-slow setting, by reformulating it as a blow-up transformation. This leads to dynamically simpler modulation equations posed in the blown-up space, via a formal procedure which directly extends the established approach to the time-dependent setting. The modulation equations take the form of non-autonomous Ginzburg-Landau equations, which can be analysed within the blow-up. The asymptotics of solutions in weighted Sobelev spaces are given in two different cases: (i) A symmetric case featuring a delayed loss of stability, and (ii) A second case in which the symmetry is broken by a source term. In order to characterise the dynamics of the Swift-Hohenberg equation itself we derive rigorous estimates on the error of the dynamic modulation approximation. These estimates are obtained by bounding weak solutions to an evolution equation for the error which is also posed in the blown-up space. Using the error estimates obtained, we are able to infer the asymptotics of a large class of solutions to the dynamic Swift-Hohenberg equation. We provide rigorous asymptotics for solutions in both cases (i) and (ii). We also prove the existence of the delayed loss of stability in the symmetric case (i), and provide a lower bound for the delay time.
△ Less
Submitted 18 July, 2022; v1 submitted 8 July, 2022;
originally announced July 2022.
-
Vlasov Equations on Directed Hypergraph Measures
Authors:
Christian Kuehn,
Chuang Xu
Abstract:
In this paper we propose a framework to investigate the mean field limit (MFL) of interacting particle systems on directed hypergraphs. We provide a non-trivial measure-theoretic viewpoint and make extensions of directed hypergraphs as directed hypergraph measures (DHGMs), which are measure-valued functions on a compact metric space. These DHGMs can be regarded as hypergraph limits which include l…
▽ More
In this paper we propose a framework to investigate the mean field limit (MFL) of interacting particle systems on directed hypergraphs. We provide a non-trivial measure-theoretic viewpoint and make extensions of directed hypergraphs as directed hypergraph measures (DHGMs), which are measure-valued functions on a compact metric space. These DHGMs can be regarded as hypergraph limits which include limits of a sequence of hypergraphs that are sparse, dense, or of intermediate densities. Our main results show that the Vlasov equation on DHGMs are well-posed and its solution can be approximated by empirical distributions of large networks of higher-order interactions. The results are applied to a Kuramoto network in physics, an epidemic network, and an ecological network, all of which include higher-order interactions. To prove the main results on the approximation and well-posedness of the Vlasov equation on DHGMs, we robustly generalize the method of [Kuehn, Xu. Vlasov equations on digraph measures, arXiv:2107.08419, 2021] to higher-dimensions. In particular, we successfully extend the arguments for the measure-valued functions $f\colon X\to\mathcal{M}_+(X)$ to those for $f\colon X\to\mathcal{M}_+(X^{k-1})$, where $X$ is the vertex space of DHGMs and $k\in\mathbb{N}\setminus\{1\}$ is the \emph{cardinality} of the DHGM.
△ Less
Submitted 5 May, 2023; v1 submitted 8 July, 2022;
originally announced July 2022.
-
Phase Oscillator Networks with Nonlocal Higher-Order Interactions: Twisted States, Stability and Bifurcations
Authors:
Christian Bick,
Tobias Böhle,
Christian Kuehn
Abstract:
The Kuramoto model provides a prototypical framework to synchronization phenomena in interacting particle systems. Apart from full phase synchrony where all oscillators behave identically, identical Kuramoto oscillators with ring-like nonlocal coupling can exhibit more elaborate patterns such as uniformly twisted states. It was discovered by Wiley, Strogatz and Girvan in 2006 that the stability of…
▽ More
The Kuramoto model provides a prototypical framework to synchronization phenomena in interacting particle systems. Apart from full phase synchrony where all oscillators behave identically, identical Kuramoto oscillators with ring-like nonlocal coupling can exhibit more elaborate patterns such as uniformly twisted states. It was discovered by Wiley, Strogatz and Girvan in 2006 that the stability of these twisted states depends on the coupling range of each oscillator. In this paper, we analyze twisted states and their bifurcations in the infinite particle limit of ring-like nonlocal coupling. We not only consider traditional pairwise interactions as in the Kuramoto model but also demonstrate the effects of higher-order nonpairwise interactions, which arise naturally in phase reductions. We elucidate how pairwise and nonpairwise interactions affect the stability of the twisted states, compute bifurcating branches, and show that higher-order interactions can stabilize twisted states that are unstable if the coupling is only pairwise.
△ Less
Submitted 4 June, 2022;
originally announced June 2022.
-
Single-spike solutions to the 1D shadow Gierer-Meinhardt problem
Authors:
Annalisa Iuorio,
Christian Kuehn
Abstract:
A fundamental example of reaction-diffusion system exhibiting Turing type pattern formation is the Gierer-Meinhardt system, which reduces to the shadow Gierer-Meinhardt problem in a suitable singular limit. Thanks to its applicability in a large range of biological applications, this singularly perturbed problem has been widely studied in the last few decades via rigorous, asymptotic, and numerica…
▽ More
A fundamental example of reaction-diffusion system exhibiting Turing type pattern formation is the Gierer-Meinhardt system, which reduces to the shadow Gierer-Meinhardt problem in a suitable singular limit. Thanks to its applicability in a large range of biological applications, this singularly perturbed problem has been widely studied in the last few decades via rigorous, asymptotic, and numerical methods. However, standard matched asymptotics methods do not apply (Ni 1998, Wei 1998), and therefore analytical expressions for single spike solutions are generally lacking.
By introducing an ansatz based on generalized hyperbolic functions, we determine exact radially symmetric solutions to the one-dimensional shadow Gierer-Meinhardt problem for any $1 < p < \infty$, representing both inner and boundary spike solutions depending on the location of the peak. Our approach not only confirms numerical results existing in literature, but also provides guidance for tackling extensions of the shadow Gierer-Meinhardt problem based on different boundary conditions (e.g. mixed) and/or $n$-dimensional domains.
△ Less
Submitted 10 May, 2022;
originally announced May 2022.
-
Graphop Mean-Field Limits and Synchronization for the Stochastic Kuramoto Model
Authors:
Marios Antonios Gkogkas,
Benjamin Jüttner,
Christian Kuehn,
Erik Andreas Martens
Abstract:
Models of coupled oscillator networks play an important role in describing collective synchronization dynamics in biological and technological systems. The Kuramoto model describes oscillator's phase evolution and explains the transition from incoherent to coherent oscillations under simplifying assumptions including all-to-all coupling with uniform strength. Real world networks, however, often di…
▽ More
Models of coupled oscillator networks play an important role in describing collective synchronization dynamics in biological and technological systems. The Kuramoto model describes oscillator's phase evolution and explains the transition from incoherent to coherent oscillations under simplifying assumptions including all-to-all coupling with uniform strength. Real world networks, however, often display heterogeneous connectivity and coupling weights that influence the critical threshold for this transition. We formulate a general mean field theory (Vlasov-Focker Planck equation) for stochastic Kuramoto-type phase oscillator models, valid for coupling graphs/networks with heterogeneous connectivity and coupling strengths, using graphop theory in the mean field limit. Considering symmetric odd-valued coupling functions, we mathematically prove an exact formula for the critical threshold for the incoherence-coherence transition. We numerically test the predicted threshold using large finite-size representations of the network model. For a large class of graph models, we find that the numerical tests agree very well with the predicted threshold obtained from mean field theory. However, the prediction is more difficult in practice for graph structures that are sufficiently sparse. Our findings open future research avenues toward a deeper understanding of mean-field theories for heterogeneous systems.
△ Less
Submitted 30 October, 2022; v1 submitted 31 March, 2022;
originally announced March 2022.
-
Community Integration Algorithms (CIAs) for Dynamical Systems on Networks
Authors:
Tobias Böhle,
Mechthild Thalhammer,
Christian Kuehn
Abstract:
Dynamics of large-scale network processes underlies crucial phenomena ranging across all sciences. Forward simulation of large network models is often computationally prohibitive. Yet, most networks have intrinsic community structure. We exploit these communities and propose a fast simulation algorithm for network dynamics. In particular, aggregating the inputs a node receives constitutes the limi…
▽ More
Dynamics of large-scale network processes underlies crucial phenomena ranging across all sciences. Forward simulation of large network models is often computationally prohibitive. Yet, most networks have intrinsic community structure. We exploit these communities and propose a fast simulation algorithm for network dynamics. In particular, aggregating the inputs a node receives constitutes the limiting factor in numerically simulating large-scale network dynamics. We develop community integration algorithms (CIAs) significantly reducing function-evaluations. We obtain a substantial reduction from polynomial to linear computational complexity. We illustrate our results in multiple applications including classical and higher-order Kuramoto-type systems for synchronisation and Cucker--Smale systems exhibiting flocking behaviour on synthetic as well as real-world networks. Numerical comparison and theoretical analysis confirm the robustness and efficiency of CIAs.
△ Less
Submitted 30 March, 2022;
originally announced March 2022.
-
Computer Validation of Neural Network Dynamics: A First Case Study
Authors:
Christian Kuehn,
Elena Queirolo
Abstract:
A large number of current machine learning methods rely upon deep neural networks. Yet, viewing neural networks as nonlinear dynamical systems, it becomes quickly apparent that mathematically rigorously establishing certain patterns generated by the nodes in the network is extremely difficult. Indeed, it is well-understood in the nonlinear dynamics of complex systems that, even in low-dimensional…
▽ More
A large number of current machine learning methods rely upon deep neural networks. Yet, viewing neural networks as nonlinear dynamical systems, it becomes quickly apparent that mathematically rigorously establishing certain patterns generated by the nodes in the network is extremely difficult. Indeed, it is well-understood in the nonlinear dynamics of complex systems that, even in low-dimensional models, analytical techniques rooted in pencil-and-paper approaches frequently reach their limits. In this work, we propose a completely different perspective via the paradigm of validated numerical methods of nonlinear dynamics. The idea is to use computer-assisted proofs to validate mathematically the existence of nonlinear patterns in neural networks. As a case study, we consider a class of recurrent neural networks, where we prove via computer assistance the existence of several hundred Hopf bifurcation points, their non-degeneracy, and hence also the existence of several hundred periodic orbits. Our paradigm has the capability to rigorously verify complex nonlinear behaviour of neural networks, which provides a first step to explain the full abilities, as well as potential sensitivities, of machine learning methods via computer-assisted proofs. We showcase how validated numerical techniques can shed light on the internal working of recurrent neural networks (RNNs). For this, proofs of Hopf bifurcations are a first step towards an integration of dynamical system theory in practical application of RNNs, by proving the existence of periodic orbits in a variety of settings.
△ Less
Submitted 11 September, 2023; v1 submitted 10 February, 2022;
originally announced February 2022.
-
Mean field limits of co-evolutionary heterogeneous networks
Authors:
Marios Antonios Gkogkas,
Christian Kuehn,
Chuang Xu
Abstract:
Many science phenomena are modelled as interacting particle systems (IPS) coupled on static networks. In reality, network connections are far more dynamic. Connections among individuals receive feedback from nearby individuals and make changes to better adapt to the world. Hence, it is reasonable to model myriad real-world phenomena as co-evolutionary (or adaptive) networks. These networks are use…
▽ More
Many science phenomena are modelled as interacting particle systems (IPS) coupled on static networks. In reality, network connections are far more dynamic. Connections among individuals receive feedback from nearby individuals and make changes to better adapt to the world. Hence, it is reasonable to model myriad real-world phenomena as co-evolutionary (or adaptive) networks. These networks are used in different areas including telecommunication, neuroscience, computer science, biochemistry, social science, as well as physics, where Kuramoto-type networks have been widely used to model interaction among a set of oscillators. In this paper, we propose a rigorous formulation for limits of a sequence of co-evolutionary Kuramoto oscillators coupled on heterogeneous co-evolutionary networks, which receive feedback from the dynamics of the oscillators on the networks. We show under mild conditions, the mean field limit (MFL) of the co-evolutionary network exists and the sequence of co-evolutionary Kuramoto networks converges to this MFL. Such MFL is described by solutions of a generalized Vlasov type equation. We treat the graph limits as graph measures, motivated by the recent work in [Kuehn, Xu. Vlasov equations on digraph measures, JDE, 339 (2022), 261--349]. Under a mild condition on the initial graph measure, we show that the graph measures are positive over a finite time interval. In comparison to the recently emerging works on MFLs of IPS coupled on non-co-evolutionary networks (i.e., static networks or time-dependent networks independent of the dynamics of the IPS), our work seems the first to rigorously address the MFL of a co-evolutionary network model.
△ Less
Submitted 31 July, 2023; v1 submitted 3 February, 2022;
originally announced February 2022.
-
The hyperbolic umbilic singularity in fast-slow systems
Authors:
Hildeberto Jardón-Kojakhmetov,
Christian Kuehn,
Maximilian Steinert
Abstract:
Fast-slow systems with three slow variables and gradient structure in the fast variables have, generically, hyperbolic umbilic, elliptic umbilic or swallowtail singularities. In this article we provide a detailed local analysis of a fast-slow system near a hyperbolic umbilic singularity. In particular, we show that under some appropriate non-degeneracy conditions on the slow flow, the attracting s…
▽ More
Fast-slow systems with three slow variables and gradient structure in the fast variables have, generically, hyperbolic umbilic, elliptic umbilic or swallowtail singularities. In this article we provide a detailed local analysis of a fast-slow system near a hyperbolic umbilic singularity. In particular, we show that under some appropriate non-degeneracy conditions on the slow flow, the attracting slow manifolds jump onto the fast regime and fan out as they cross the hyperbolic umbilic singularity. The analysis is based on the blow-up technique, in which the hyperbolic umbilic point is blown up to a 5-dimensional sphere. Moreover, the reduced slow flow is also blown up and embedded into the blown-up fast formulation. Further, we describe how our analysis is related to classical theories such as catastrophe theory and constrained differential equations.
△ Less
Submitted 3 February, 2022;
originally announced February 2022.
-
Discrete Geometric Singular Perturbation Theory
Authors:
Samuel Jelbart,
Christian Kuehn
Abstract:
We propose a mathematical formalism for discrete multi-scale dynamical systems induced by maps which parallels the established geometric singular perturbation theory for continuous-time fast-slow systems. We identify limiting maps corresponding to both 'fast' and 'slow' iteration under the map. A notion of normal hyperbolicity is defined by a spectral gap requirement for the multipliers of the fas…
▽ More
We propose a mathematical formalism for discrete multi-scale dynamical systems induced by maps which parallels the established geometric singular perturbation theory for continuous-time fast-slow systems. We identify limiting maps corresponding to both 'fast' and 'slow' iteration under the map. A notion of normal hyperbolicity is defined by a spectral gap requirement for the multipliers of the fast limiting map along a critical fixed-point manifold $S$. We provide a set of Fenichel-like perturbation theorems by reformulating pre-existing results so that they apply near compact, normally hyperbolic submanifolds of $S$. The persistence of the critical manifold $S$, local stable/unstable manifolds $W^{s/u}_{loc}(S)$ and foliations of $W^{s/u}_{loc}(S)$ by stable/unstable fibers is described in detail. The practical utility of the resulting discrete geometric singular perturbation theory (DGSPT) is demonstrated in applications. First, we use DGSPT to identify singular geometry corresponding to excitability, relaxation, chaotic and non-chaotic bursting in a map-based neural model. Second, we derive results which relate the geometry and dynamics of fast-slow ODEs with non-trivial time-scale separation and their Euler-discretized counterpart. Finally, we show that fast-slow ODE systems with fast rotation give rise to fast-slow Poincaré maps, the geometry and dynamics of which can be described in detail using DGSPT.
△ Less
Submitted 8 November, 2022; v1 submitted 18 January, 2022;
originally announced January 2022.
-
The influence of a transport process on the epidemic threshold
Authors:
Christian Kuehn,
Jan Mölter
Abstract:
By generating transient encounters between individuals beyond their immediate social environment, transport can have a profound impact on the spreading of an epidemic. In this work, we consider epidemic dynamics in the presence of the transport process that gives rise to a multiplex network model. In addition to a static layer, the (multiplex) epidemic network consists of a second dynamic layer in…
▽ More
By generating transient encounters between individuals beyond their immediate social environment, transport can have a profound impact on the spreading of an epidemic. In this work, we consider epidemic dynamics in the presence of the transport process that gives rise to a multiplex network model. In addition to a static layer, the (multiplex) epidemic network consists of a second dynamic layer in which any two individuals are connected for the time they occupy the same site during a random walk they perform on a separate transport network. We develop a mean-field description of the stochastic network model and study the influence the transport process has on the epidemic threshold. We show that any transport process generally lowers the epidemic threshold because of the additional connections it generates. In contrast, considering also random walks of fractional order that in some sense are a more realistic model of human mobility, we find that these non-local transport dynamics raise the epidemic threshold in comparison to a classical local random walk. We also test our model on a realistic transport network (the Munich U-Bahn network), and carefully compare mean-field solutions with stochastic trajectories in a range of scenarios.
△ Less
Submitted 2 November, 2022; v1 submitted 9 December, 2021;
originally announced December 2021.
-
Stochastic Rotating Waves
Authors:
Christian Kuehn,
James MacLaurin,
Giulio Zucal
Abstract:
Stochastic dynamics has emerged as one of the key themes ranging from models in applications to theoretical foundations in mathematics. One class of stochastic dynamics problems that has received considerable attention recently are travelling wave patterns occurring in stochastic partial differential equations (SPDEs), i.e., how deterministic travelling waves behave under stochastic perturbations.…
▽ More
Stochastic dynamics has emerged as one of the key themes ranging from models in applications to theoretical foundations in mathematics. One class of stochastic dynamics problems that has received considerable attention recently are travelling wave patterns occurring in stochastic partial differential equations (SPDEs), i.e., how deterministic travelling waves behave under stochastic perturbations. In this paper, we start the mathematical study of related class of problems: stochastic rotating waves generated by SPDEs. We combine deterministic dynamics PDE techniques with methods from stochastic analysis. We establish two different approaches, the variational phase and the approximated variational phase, for defining stochastic phase variables along the rotating wave, which track the effect of noise on neutral spectral modes associated to the special Euclidean symmetry group of rotating waves. Furthermore, we prove transverse stability results for rotating waves showing that over certain time scales and for small noise, the stochastic rotating wave stays close to its deterministic counterpart.
△ Less
Submitted 13 November, 2021;
originally announced November 2021.
-
Center Manifolds for Rough Partial Differential Equations
Authors:
Christian Kuehn,
Alexandra Neamtu
Abstract:
We prove a center manifold theorem for rough partial differential equations (rough PDEs). The class of rough PDEs we consider contains as a key subclass reaction-diffusion equations driven by nonlinear multiplicative noise, where the stochastic forcing is given by a $γ$-Hölder rough path, for $γ\in(1/3,1/2]$. Our proof technique relies upon the theory of rough paths and analytic semigroups in comb…
▽ More
We prove a center manifold theorem for rough partial differential equations (rough PDEs). The class of rough PDEs we consider contains as a key subclass reaction-diffusion equations driven by nonlinear multiplicative noise, where the stochastic forcing is given by a $γ$-Hölder rough path, for $γ\in(1/3,1/2]$. Our proof technique relies upon the theory of rough paths and analytic semigroups in combination with a discretized Lyapunov-Perron-type method in a suitable scale of interpolation spaces. The resulting center manifold is a random manifold in the sense of the theory of random dynamical systems (RDS). We also illustrate our main theorem for reaction-diffusion equations as well as for the Swift-Hohenberg equation.
△ Less
Submitted 10 November, 2021; v1 submitted 2 November, 2021;
originally announced November 2021.
-
Uniting Parametric Uncertainty and Tip** Diagrams
Authors:
Kerstin Lux,
Peter Ashwin,
Richard Wood,
Christian Kuehn
Abstract:
Various subsystems of the Earth system may undergo critical transitions by passing a so-called tip** point, under sustained changes to forcing. For example, the Atlantic Meridional Overturning Circulation (AMOC) is of particular importance for North Atlantic heat transport and is thought to be potentially at risk of tip**. Given a model of such a subsystem that accurately includes the relevant…
▽ More
Various subsystems of the Earth system may undergo critical transitions by passing a so-called tip** point, under sustained changes to forcing. For example, the Atlantic Meridional Overturning Circulation (AMOC) is of particular importance for North Atlantic heat transport and is thought to be potentially at risk of tip**. Given a model of such a subsystem that accurately includes the relevant physical processes, whether tip** occurs or not, will depend on model parameters that typically are uncertain. Reducing this parametric uncertainty is important to understand the likelihood of tip** behavior being present in the system and possible tip** locations. In this letter, we develop improved estimates for the parametric uncertainty by inferring probability distributions for the model parameters based on physical constraints and by using a Bayesian inversion technique. To visualize the impact of parametric uncertainty, we extend classical tip** diagrams by visualizing probabilistic bifurcation curves according to the inferred distribution of the model parameter. Furthermore, we highlight the uncertain locations of tip** points along the probabilistic bifurcation curves. We showcase our probabilistic visualizations of the tip** behavior using a simple box-model of the AMOC, the Stommel-Cessi model [5].
△ Less
Submitted 29 October, 2021;
originally announced October 2021.
-
Continuum Limits for Adaptive Network Dynamics
Authors:
Marios Antonios Gkogkas,
Christian Kuehn,
Chuang Xu
Abstract:
Adaptive (or co-evolutionary) network dynamics, i.e., when changes of the network/graph topology are coupled with changes in the node/vertex dynamics, can give rise to rich and complex dynamical behavior. Even though adaptivity can improve the modelling of collective phenomena, it often complicates the analysis of the corresponding mathematical models significantly. For non-adaptive systems, a pos…
▽ More
Adaptive (or co-evolutionary) network dynamics, i.e., when changes of the network/graph topology are coupled with changes in the node/vertex dynamics, can give rise to rich and complex dynamical behavior. Even though adaptivity can improve the modelling of collective phenomena, it often complicates the analysis of the corresponding mathematical models significantly. For non-adaptive systems, a possible way to tackle this problem is by passing to so-called continuum or mean-field limits, which describe the system in the limit of infinitely many nodes. Although fully adaptive network dynamic models have been used a lot in recent years in applications, we are still lacking a detailed mathematical theory for large-scale adaptive network limits. For example, continuum limits for static or temporal networks are already established in the literature for certain models, yet the continuum limit of fully adaptive networks has been open so far. In this paper we introduce and rigorously justify continuum limits for sequences of adaptive Kuramoto-type network models. The resulting integro-differential equations allow us to incorporate a large class of co-evolving graphs with high density. Furthermore, we use a very general measure-theoretical framework in our proof for representing the (infinite) graph limits, thereby also providing a structural basis to tackle even larger classes of graph limits. As an application of our theory, we consider the continuum limit of an adaptive Kuramoto model directly motivated from neuroscience and studied by Berner et al.~in recent years using numerical techniques and formal stability analysis.
△ Less
Submitted 13 September, 2021;
originally announced September 2021.
-
A traveling wave bifurcation analysis of turbulent pipe flow
Authors:
Maximilian Engel,
Christian Kuehn,
Björn de Rijk
Abstract:
Using various techniques from dynamical systems theory, we rigorously study an experimentally validated model by [Barkley et al., Nature, 526:550-553, 2015], which describes the rise of turbulent pipe flow via a PDE system of reduced complexity. The fast evolution of turbulence is governed by reaction-diffusion dynamics coupled to the centerline velocity, which evolves with advection of Burgers' t…
▽ More
Using various techniques from dynamical systems theory, we rigorously study an experimentally validated model by [Barkley et al., Nature, 526:550-553, 2015], which describes the rise of turbulent pipe flow via a PDE system of reduced complexity. The fast evolution of turbulence is governed by reaction-diffusion dynamics coupled to the centerline velocity, which evolves with advection of Burgers' type and a slow relaminarization term. Applying to this model a spatial dynamics ansatz and geometric singular perturbation theory, we prove the existence of a heteroclinic loop between a turbulent and a laminar steady state and establish a cascade of bifurcations of various traveling waves mediating the transition to turbulence. The most complicated behaviour can be found in an intermediate Reynolds number regime, where the traveling waves exhibit arbitrarily long periodic-like dynamics indicating the onset of chaos. Our analysis provides a systematic mathematical approach to identifying the transition to spatio-temporal turbulent structures that may also be applicable to other models arising in fluid dynamics.
△ Less
Submitted 23 August, 2021;
originally announced August 2021.
-
Vlasov equations on digraph measures
Authors:
Christian Kuehn,
Chuang Xu
Abstract:
Many science phenomena are described as interacting particle systems (IPS). The mean field limit (MFL) of large all-to-all coupled deterministic IPS is given by the solution of a PDE, the Vlasov Equation (VE). Yet, many applications demand IPS coupled on networks/graphs. It is interesting to know, how the limit of a sequence of digraphs associated with the IPS influences the macroscopic MFL. This…
▽ More
Many science phenomena are described as interacting particle systems (IPS). The mean field limit (MFL) of large all-to-all coupled deterministic IPS is given by the solution of a PDE, the Vlasov Equation (VE). Yet, many applications demand IPS coupled on networks/graphs. It is interesting to know, how the limit of a sequence of digraphs associated with the IPS influences the macroscopic MFL. This paper studies VEs on a generalized digraph, regarded as limit of a sequence of digraphs, which we refer to as a digraph measure (DGM) to emphasize that we work with its limit via measures. We provide well-posedness and discretization of the solution of the VE by empirical distributions supported on solutions of an IPS via ODEs coupled on a sequence of digraphs converging to the given DGM. Our result extends existing results on one-dimensional Kuramoto-type networks coupled on dense graphs. Here we allow the underlying digraphs to be not necessarily dense which include many interesting graphical structures such that stars, trees and rings, which have been frequently used in many sparse network models in finance, telecommunications, physics, genetics, neuroscience, and social sciences. A key contribution of this paper is a nontrivial generalization of Neunzert's in-cell-particle approach for all-to-all coupled indistinguishable IPS with global Lipschitz continuity in Euclidean spaces to distinguishable IPS on heterogeneous digraphs with local Lipschitz continuity, via a measure-theoretic viewpoint. The approach together with the metrics is different from the known techniques in $L^p$-functions using graphons and their generalization via harmonic analysis of locally compact Abelian groups. Finally, to demonstrate the wide applicability, we apply our results to various models in higher-dimensional Euclidean spaces in epidemiology, ecology, and social sciences.
△ Less
Submitted 18 December, 2021; v1 submitted 18 July, 2021;
originally announced July 2021.
-
Random walks and Laplacians on hypergraphs: When do they match?
Authors:
Raffaella Mulas,
Christian Kuehn,
Tobias Böhle,
Jürgen Jost
Abstract:
We develop a general theory of random walks on hypergraphs which includes, as special cases, the different models that are found in literature. In particular, we introduce and analyze general random walk Laplacians for hypergraphs, and we compare them to hypergraph normalized Laplacians that are not necessarily related to random walks, but which are motivated by biological and chemical networks. W…
▽ More
We develop a general theory of random walks on hypergraphs which includes, as special cases, the different models that are found in literature. In particular, we introduce and analyze general random walk Laplacians for hypergraphs, and we compare them to hypergraph normalized Laplacians that are not necessarily related to random walks, but which are motivated by biological and chemical networks. We show that, although these two classes of Laplacians coincide in the case of graphs, they appear to have important conceptual differences in the general case. We study the spectral properties of both classes, as well as their applications to Coupled Hypergraph Maps: discrete-time dynamical systems that generalize the well-known Coupled Map Lattices on graphs. Our results also show why for some hypergraph Laplacian variants one expects more classical results from (weighted) graphs to generalize directly, while these results must fail for other hypergraph Laplacians.
△ Less
Submitted 22 June, 2021;
originally announced June 2021.
-
Warning signs for non-Markovian bifurcations: colour blindness and scaling laws
Authors:
Christian Kuehn,
Kerstin Lux,
Alexandra Neamtu
Abstract:
Warning signs for tip** points (or critical transitions) have been very actively studied. Although the theory has been applied successfully in models and in experiments for many complex systems such as for tip** in climate systems, there are ongoing debates, when warning signs can be extracted from data. In this work, we shed light on this debate by considering different types of underlying no…
▽ More
Warning signs for tip** points (or critical transitions) have been very actively studied. Although the theory has been applied successfully in models and in experiments for many complex systems such as for tip** in climate systems, there are ongoing debates, when warning signs can be extracted from data. In this work, we shed light on this debate by considering different types of underlying noise. Thereby, we significantly advance the general theory of warning signs for nonlinear stochastic dynamics. A key scenario deals with stochastic systems approaching a bifurcation point dynamically upon slow parameter variation. The stochastic fluctuations are generically able to probe the dynamics near a deterministic attractor to reveal critical slowing down. Using scaling laws near bifurcations, one can then anticipate the distance to a bifurcation. Previous warning signs results assume that the noise is Markovian, most often even white. Here, we study warning signs for non-Markovian systems including coloured noise and $α$-regular Volterra processes (of which fractional Brownian motion and the Rosenblatt process are special cases). We prove that early warning scaling laws can disappear completely or drastically change their exponent based upon the parameters controlling the noise process. This provides a clear explanation, why applying standard warning signs results to reduced models of complex systems may not agree with data-driven studies. We demonstrate our results numerically in the context of a box model of the Atlantic Meridional Overturning Circulation (AMOC).
△ Less
Submitted 15 February, 2022; v1 submitted 15 June, 2021;
originally announced June 2021.