-
Global and Local Reduced Models for Interacting, Heterogeneous Agents
Authors:
Thomas N. Thiem,
Felix P. Kemeth,
Tom Bertalan,
Carlo R. Laing,
Ioannis G. Kevrekidis
Abstract:
Large collections of coupled, heterogeneous agents can manifest complex dynamical behavior presenting difficulties for simulation and analysis. However, if the collective dynamics lie on a low-dimensional manifold then the original agent-based model may be approximated with a simplified surrogate model on and near the low-dimensional space where the dynamics live. This is typically accomplished by…
▽ More
Large collections of coupled, heterogeneous agents can manifest complex dynamical behavior presenting difficulties for simulation and analysis. However, if the collective dynamics lie on a low-dimensional manifold then the original agent-based model may be approximated with a simplified surrogate model on and near the low-dimensional space where the dynamics live. This is typically accomplished by deriving coarse variables that summarize the collective dynamics, these may take the form of either a collection of scalars or continuous fields (e.g. densities), which are then used as part of a reduced model. Analytically identifying such simplified models is challenging and has traditionally been accomplished through the use of mean-field reductions or an Ott-Antonsen ansatz, but is often impossible.
Here we present a data-driven coarse-graining methodology for discovering such reduced models. We consider two types of reduced models: globally-based models which use global information and predict dynamics using information from the whole ensemble, and locally-based models that use local information, that is, information from just a subset of agents close (close in heterogeneity space, not physical space) to an agent, to predict the dynamics of an agent. For both approaches we are able to learn laws governing the behavior of the reduced system on the low-dimensional manifold directly from time series of states from the agent-based system. A nontrivial conclusion is that the dynamics can be equally well reproduced by an all-to-all coupled as well as by a locally coupled model of the same agents.
△ Less
Submitted 19 May, 2021;
originally announced May 2021.
-
Learning emergent PDEs in a learned emergent space
Authors:
Felix P. Kemeth,
Tom Bertalan,
Thomas Thiem,
Felix Dietrich,
Sung Joon Moon,
Carlo R. Laing,
Ioannis G. Kevrekidis
Abstract:
We extract data-driven, intrinsic spatial coordinates from observations of the dynamics of large systems of coupled heterogeneous agents. These coordinates then serve as an emergent space in which to learn predictive models in the form of partial differential equations (PDEs) for the collective description of the coupled-agent system. They play the role of the independent spatial variables in this…
▽ More
We extract data-driven, intrinsic spatial coordinates from observations of the dynamics of large systems of coupled heterogeneous agents. These coordinates then serve as an emergent space in which to learn predictive models in the form of partial differential equations (PDEs) for the collective description of the coupled-agent system. They play the role of the independent spatial variables in this PDE (as opposed to the dependent, possibly also data-driven, state variables). This leads to an alternative description of the dynamics, local in these emergent coordinates, thus facilitating an alternative modeling path for complex coupled-agent systems. We illustrate this approach on a system where each agent is a limit cycle oscillator (a so-called Stuart-Landau oscillator); the agents are heterogeneous (they each have a different intrinsic frequency $ω$) and are coupled through the ensemble average of their respective variables. After fast initial transients, we show that the collective dynamics on a slow manifold can be approximated through a learned model based on local "spatial" partial derivatives in the emergent coordinates. The model is then used for prediction in time, as well as to capture collective bifurcations when system parameters vary. The proposed approach thus integrates the automatic, data-driven extraction of emergent space coordinates parametrizing the agent dynamics, with machine-learning assisted identification of an "emergent PDE" description of the dynamics in this parametrization.
△ Less
Submitted 23 December, 2020;
originally announced December 2020.
-
Emergent spaces for coupled oscillators
Authors:
Thomas N. Thiem,
Mahdi Kooshkbaghi,
Tom Bertalan,
Carlo R. Laing,
Ioannis G. Kevrekidis
Abstract:
In this paper we present a systematic, data-driven approach to discovering "bespoke" coarse variables based on manifold learning algorithms. We illustrate this methodology with the classic Kuramoto phase oscillator model, and demonstrate how our manifold learning technique can successfully identify a coarse variable that is one-to-one with the established Kuramoto order parameter. We then introduc…
▽ More
In this paper we present a systematic, data-driven approach to discovering "bespoke" coarse variables based on manifold learning algorithms. We illustrate this methodology with the classic Kuramoto phase oscillator model, and demonstrate how our manifold learning technique can successfully identify a coarse variable that is one-to-one with the established Kuramoto order parameter. We then introduce an extension of our coarse-graining methodology which enables us to learn evolution equations for the discovered coarse variables via an artificial neural network architecture templated on numerical time integrators (initial value solvers). This approach allows us to learn accurate approximations of time derivatives of state variables from sparse flow data, and hence discover useful approximate differential equation descriptions of their dynamic behavior. We demonstrate this capability by learning ODEs that agree with the known analytical expression for the Kuramoto order parameter dynamics at the continuum limit. We then show how this approach can also be used to learn the dynamics of coarse variables discovered through our manifold learning methodology. In both of these examples, we compare the results of our neural network based method to typical finite differences complemented with geometric harmonics. Finally, we present a series of computational examples illustrating how a variation of our manifold learning methodology can be used to discover sets of "effective" parameters, reduced parameter combinations, for multi-parameter models with complex coupling. We conclude with a discussion of possible extensions of this approach, including the possibility of obtaining data-driven effective partial differential equations for coarse-grained neuronal network behavior.
△ Less
Submitted 13 April, 2020;
originally announced April 2020.
-
On the Koopman operator of algorithms
Authors:
Felix Dietrich,
Thomas N. Thiem,
Ioannis G. Kevrekidis
Abstract:
A systematic mathematical framework for the study of numerical algorithms would allow comparisons, facilitate conjugacy arguments, as well as enable the discovery of improved, accelerated, data-driven algorithms. Over the course of the last century, the Koopman operator has provided a mathematical framework for the study of dynamical systems, which facilitates conjugacy arguments and can provide e…
▽ More
A systematic mathematical framework for the study of numerical algorithms would allow comparisons, facilitate conjugacy arguments, as well as enable the discovery of improved, accelerated, data-driven algorithms. Over the course of the last century, the Koopman operator has provided a mathematical framework for the study of dynamical systems, which facilitates conjugacy arguments and can provide efficient reduced descriptions. More recently, numerical approximations of the operator have enabled the analysis of a large number of deterministic and stochastic dynamical systems in a completely data-driven, essentially equation-free pipeline. Discrete or continuous time numerical algorithms (integrators, nonlinear equation solvers, optimization algorithms) are themselves dynamical systems. In this paper, we use this insight to leverage the Koopman operator framework in the data-driven study of such algorithms and discuss benefits for analysis and acceleration of numerical computation. For algorithms acting on high-dimensional spaces by quickly contracting them towards low-dimensional manifolds, we demonstrate how basis functions adapted to the data help to construct efficient reduced representations of the operator. Our illustrative examples include the gradient descent and Nesterov optimization algorithms, as well as the Newton-Raphson algorithm.
△ Less
Submitted 19 May, 2020; v1 submitted 24 July, 2019;
originally announced July 2019.
