-
Stability and Fluctuations in Complex Ecological Systems
Authors:
Eric Forgoston,
Sarah Day,
Peter C. de Ruiter,
Arjen Doelman,
Nienke Hartemink,
Alan Hastings,
Lia Hemerik,
Alexandru Hening,
Josef Hofbauer,
Sonia Kefi,
David A. Kessler,
Toni Klauschies,
Christian Kuehn,
Xiaoxiao Li,
John C. Moore,
Elly Morrien,
Anje-Margriet Neutel,
Jelena Pantel,
Sebastian J. Schreiber,
Leah B. Shaw,
Nadav Shnerb,
Eric Siero,
Laura S. Storch,
Michael A. S. Thorne,
Ingrid van de Leemput
, et al. (2 additional authors not shown)
Abstract:
From 08-12 August, 2022, 32 individuals participated in a workshop, Stability and Fluctuations in Complex Ecological Systems, at the Lorentz Center, located in Leiden, The Netherlands. An interdisciplinary dialogue between ecologists, mathematicians, and physicists provided a foundation of important problems to consider over the next 5-10 years. This paper outlines eight areas including (1) improv…
▽ More
From 08-12 August, 2022, 32 individuals participated in a workshop, Stability and Fluctuations in Complex Ecological Systems, at the Lorentz Center, located in Leiden, The Netherlands. An interdisciplinary dialogue between ecologists, mathematicians, and physicists provided a foundation of important problems to consider over the next 5-10 years. This paper outlines eight areas including (1) improving our understanding of the effect of scale, both temporal and spatial, for both deterministic and stochastic problems; (2) clarifying the different terminologies and definitions used in different scientific fields; (3) develo** a comprehensive set of data analysis techniques arising from different fields but which can be used together to improve our understanding of existing data sets; (4) having theoreticians/computational scientists collaborate closely with empirical ecologists to determine what new data should be collected; (5) improving our knowledge of how to protect and/or restore ecosystems; (6) incorporating socio-economic effects into models of ecosystems; (7) improving our understanding of the role of deterministic and stochastic fluctuations; (8) studying the current state of biodiversity at the functional level, taxa level and genome level.
△ Less
Submitted 12 June, 2023;
originally announced June 2023.
-
Knowledge-Based Learning of Nonlinear Dynamics and Chaos
Authors:
Tom Z. Jiahao,
M. Ani Hsieh,
Eric Forgoston
Abstract:
Extracting predictive models from nonlinear systems is a central task in scientific machine learning. One key problem is the reconciliation between modern data-driven approaches and first principles. Despite rapid advances in machine learning techniques, embedding domain knowledge into data-driven models remains a challenge. In this work, we present a universal learning framework for extracting pr…
▽ More
Extracting predictive models from nonlinear systems is a central task in scientific machine learning. One key problem is the reconciliation between modern data-driven approaches and first principles. Despite rapid advances in machine learning techniques, embedding domain knowledge into data-driven models remains a challenge. In this work, we present a universal learning framework for extracting predictive models from nonlinear systems based on observations. Our framework can readily incorporate first principle knowledge because it naturally models nonlinear systems as continuous-time systems. This both improves the extracted models' extrapolation power and reduces the amount of data needed for training. In addition, our framework has the advantages of robustness to observational noise and applicability to irregularly sampled data. We demonstrate the effectiveness of our scheme by learning predictive models for a wide variety of systems including a stiff Van der Pol oscillator, the Lorenz system, and the Kuramoto-Sivashinsky equation. For the Lorenz system, different types of domain knowledge are incorporated to demonstrate the strength of knowledge embedding in data-driven system identification.
△ Less
Submitted 2 December, 2021; v1 submitted 7 October, 2020;
originally announced October 2020.
-
Bridging the Gap: Machine Learning to Resolve Improperly Modeled Dynamics
Authors:
Maan Qraitem,
Dhanushka Kularatne,
Eric Forgoston,
M. Ani Hsieh
Abstract:
We present a data-driven modeling strategy to overcome improperly modeled dynamics for systems exhibiting complex spatio-temporal behaviors. We propose a Deep Learning framework to resolve the differences between the true dynamics of the system and the dynamics given by a model of the system that is either inaccurately or inadequately described. Our machine learning strategy leverages data generat…
▽ More
We present a data-driven modeling strategy to overcome improperly modeled dynamics for systems exhibiting complex spatio-temporal behaviors. We propose a Deep Learning framework to resolve the differences between the true dynamics of the system and the dynamics given by a model of the system that is either inaccurately or inadequately described. Our machine learning strategy leverages data generated from the improper system model and observational data from the actual system to create a neural network to model the dynamics of the actual system. We evaluate the proposed framework using numerical solutions obtained from three increasingly complex dynamical systems. Our results show that our system is capable of learning a data-driven model that provides accurate estimates of the system states both in previously unobserved regions as well as for future states. Our results show the power of state-of-the-art machine learning frameworks in estimating an accurate prior of the system's true dynamics that can be used for prediction up to a finite horizon.
△ Less
Submitted 23 August, 2020;
originally announced August 2020.
-
A primer on noise-induced transitions in applied dynamical systems
Authors:
Eric Forgoston,
Richard O. Moore
Abstract:
Noise plays a fundamental role in a wide variety of physical and biological dynamical systems. It can arise from an external forcing or due to random dynamics internal to the system. It is well established that even weak noise can result in large behavioral changes such as transitions between or escapes from quasi-stable states. These transitions can correspond to critical events such as failures…
▽ More
Noise plays a fundamental role in a wide variety of physical and biological dynamical systems. It can arise from an external forcing or due to random dynamics internal to the system. It is well established that even weak noise can result in large behavioral changes such as transitions between or escapes from quasi-stable states. These transitions can correspond to critical events such as failures or extinctions that make them essential phenomena to understand and quantify, despite the fact that their occurrence is rare. This article will provide an overview of the theory underlying the dynamics of rare events for stochastic models along with some example applications.
△ Less
Submitted 3 August, 2019; v1 submitted 10 November, 2017;
originally announced December 2017.
-
Model Reduction in Stochastic Environments
Authors:
Eric Forgoston,
Lora Billings,
Ira B. Schwartz
Abstract:
We present a general theory of stochastic model reduction which is based on a normal form coordinate transform method of A.J. Roberts. This nonlinear, stochastic projection allows for the deterministic and stochastic dynamics to interact correctly on the lower-dimensional manifold so that the dynamics predicted by the reduced, stochastic system agrees well with the dynamics predicted by the origin…
▽ More
We present a general theory of stochastic model reduction which is based on a normal form coordinate transform method of A.J. Roberts. This nonlinear, stochastic projection allows for the deterministic and stochastic dynamics to interact correctly on the lower-dimensional manifold so that the dynamics predicted by the reduced, stochastic system agrees well with the dynamics predicted by the original, high-dimensional stochastic system. The method may be applied to any system with well-separated time scales. In this article, we consider a physical problem that involves a singularly perturbed Duffing oscillator as well as a biological problem that involves the prediction of infectious disease outbreaks.
△ Less
Submitted 20 November, 2017;
originally announced November 2017.
-
Analysis and control of pre-extinction dynamics in stochastic populations
Authors:
Garrett Nieddu,
Lora Billings,
Eric Forgoston
Abstract:
We consider a stochastic population model where the intrinsic or demographic noise causes cycling between states before the population eventually goes extinct. A master equation approach coupled with a WKB (Wentzel-Kramers-Brillouin) approximation is used to construct the optimal path to extinction. In addition, a probabilistic argument is used to understand the pre-extinction dynamics and approxi…
▽ More
We consider a stochastic population model where the intrinsic or demographic noise causes cycling between states before the population eventually goes extinct. A master equation approach coupled with a WKB (Wentzel-Kramers-Brillouin) approximation is used to construct the optimal path to extinction. In addition, a probabilistic argument is used to understand the pre-extinction dynamics and approximate the mean time to extinction. Analytical results agree well with numerical Monte Carlo simulations. A control method is implemented to decrease the mean time to extinction. Analytical results quantify the effectiveness of the control and agree well with numerical simulations.
△ Less
Submitted 11 December, 2014;
originally announced December 2014.
-
Inferring unobserved multistrain epidemic sub-populations using synchronization dynamics
Authors:
Eric Forgoston,
Leah B. Shaw,
Ira B. Schwartz
Abstract:
A new method is proposed to infer unobserved epidemic sub-populations by exploiting the synchronization properties of multistrain epidemic models. A model for dengue fever is driven by simulated data from secondary infective populations. Primary infective populations in the driven system synchronize to the correct values from the driver system. Most hospital cases of dengue are secondary infection…
▽ More
A new method is proposed to infer unobserved epidemic sub-populations by exploiting the synchronization properties of multistrain epidemic models. A model for dengue fever is driven by simulated data from secondary infective populations. Primary infective populations in the driven system synchronize to the correct values from the driver system. Most hospital cases of dengue are secondary infections, so this method provides a way to deduce unobserved primary infection levels. We derive center manifold equations that relate the driven system to the driver system and thus motivate the use of synchronization to predict unobserved primary infectives. Synchronization stability between primary and secondary infections is demonstrated through numerical measurements of conditional Lyapunov exponents and through time series simulations.
△ Less
Submitted 30 October, 2014;
originally announced October 2014.
-
Predicting unobserved exposures from seasonal epidemic data
Authors:
Eric Forgoston,
Ira B. Schwartz
Abstract:
We consider a stochastic Susceptible-Exposed-Infected-Recovered (SEIR) epidemiological model with a contact rate that fluctuates seasonally. Through the use of a nonlinear, stochastic projection, we are able to analytically determine the lower dimensional manifold on which the deterministic and stochastic dynamics correctly interact. Our method produces a low dimensional stochastic model that capt…
▽ More
We consider a stochastic Susceptible-Exposed-Infected-Recovered (SEIR) epidemiological model with a contact rate that fluctuates seasonally. Through the use of a nonlinear, stochastic projection, we are able to analytically determine the lower dimensional manifold on which the deterministic and stochastic dynamics correctly interact. Our method produces a low dimensional stochastic model that captures the same timing of disease outbreak and the same amplitude and phase of recurrent behavior seen in the high dimensional model. Given seasonal epidemic data consisting of the number of infectious individuals, our method enables a data-based model prediction of the number of unobserved exposed individuals over very long times.
△ Less
Submitted 10 September, 2013;
originally announced September 2013.
-
Distributed allocation of mobile sensing swarms in gyre flows
Authors:
Kenneth Mallory,
M. Ani Hsieh,
Eric Forgoston,
Ira B. Schwartz
Abstract:
We address the synthesis of distributed control policies to enable a swarm of homogeneous mobile sensors to maintain a desired spatial distribution in a geophysical flow environment, or workspace. In this article, we assume the mobile sensors (or robots) have a "map" of the environment denoting the locations of the Lagrangian coherent structures or LCS boundaries. Based on this information, we des…
▽ More
We address the synthesis of distributed control policies to enable a swarm of homogeneous mobile sensors to maintain a desired spatial distribution in a geophysical flow environment, or workspace. In this article, we assume the mobile sensors (or robots) have a "map" of the environment denoting the locations of the Lagrangian coherent structures or LCS boundaries. Based on this information, we design agent-level hybrid control policies that leverage the surrounding fluid dynamics and inherent environmental noise to enable the team to maintain a desired distribution in the workspace. We establish the stability properties of the ensemble dynamics of the distributed control policies. Since realistic quasi-geostrophic ocean models predict double-gyre flow solutions, we use a wind-driven multi-gyre flow model to verify the feasibility of the proposed distributed control strategy and compare the proposed control strategy with a baseline deterministic allocation strategy. Lastly, we validate the control strategy using actual flow data obtained by our coherent structure experimental testbed.
△ Less
Submitted 16 September, 2013; v1 submitted 4 March, 2013;
originally announced March 2013.
-
Coherent Pattern Prediction in Swarms of Delay-Coupled Agents
Authors:
Luis Mier-y-Teran-Romero,
Eric Forgoston,
Ira B. Schwartz
Abstract:
We consider a general swarm model of self-propelling agents interacting through a pairwise potential in the presence of noise and communication time delay. Previous work [Phys. Rev. E 77, 035203(R) (2008)] has shown that a communication time delay in the swarm induces a pattern bifurcation that depends on the size of the coupling amplitude. We extend these results by completely unfolding the bifur…
▽ More
We consider a general swarm model of self-propelling agents interacting through a pairwise potential in the presence of noise and communication time delay. Previous work [Phys. Rev. E 77, 035203(R) (2008)] has shown that a communication time delay in the swarm induces a pattern bifurcation that depends on the size of the coupling amplitude. We extend these results by completely unfolding the bifurcation structure of the mean field approximation. Our analysis reveals a direct correspondence between the different dynamical behaviors found in different regions of the coupling-time delay plane with the different classes of simulated coherent swarm patterns. We derive the spatio-temporal scales of the swarm structures, and also demonstrate how the complicated interplay of coupling strength, time delay, noise intensity, and choice of initial conditions can affect the swarm. In particular, our studies show that for sufficiently large values of the coupling strength and/or the time delay, there is a noise intensity threshold that forces a transition of the swarm from a misaligned state into an aligned state. We show that this alignment transition exhibits hysteresis when the noise intensity is taken to be time dependent.
△ Less
Submitted 1 May, 2012;
originally announced May 2012.
-
Robotic Manifold Tracking of Coherent Structures in Flows
Authors:
M. Ani Hsieh,
Eric Forgoston,
T. William Mather,
Ira B. Schwartz
Abstract:
Tracking Lagrangian coherent structures in dynamical systems is important for many applications such as oceanography and weather prediction. In this paper, we present a collaborative robotic control strategy designed to track stable and unstable manifolds. The technique does not require global information about the fluid dynamics, and is based on local sensing, prediction, and correction. The coll…
▽ More
Tracking Lagrangian coherent structures in dynamical systems is important for many applications such as oceanography and weather prediction. In this paper, we present a collaborative robotic control strategy designed to track stable and unstable manifolds. The technique does not require global information about the fluid dynamics, and is based on local sensing, prediction, and correction. The collaborative control strategy is implemented on a team of three robots to track coherent structures and manifolds on static flows as well as a noisy time-dependent model of a wind-driven double-gyre often seen in the ocean. We present simulation and experimental results and discuss theoretical guarantees of the collaborative tracking strategy.
△ Less
Submitted 20 April, 2012;
originally announced April 2012.
-
Noise, Bifurcations, and Modeling of Interacting Particle Systems
Authors:
Luis Mier-y-Teran-Romero,
Eric Forgoston,
Ira B. Schwartz
Abstract:
We consider the stochastic patterns of a system of communicating, or coupled, self-propelled particles in the presence of noise and communication time delay. For sufficiently large environmental noise, there exists a transition between a translating state and a rotating state with stationary center of mass. Time delayed communication creates a bifurcation pattern dependent on the coupling amplitud…
▽ More
We consider the stochastic patterns of a system of communicating, or coupled, self-propelled particles in the presence of noise and communication time delay. For sufficiently large environmental noise, there exists a transition between a translating state and a rotating state with stationary center of mass. Time delayed communication creates a bifurcation pattern dependent on the coupling amplitude between particles. Using a mean field model in the large number limit, we show how the complete bifurcation unfolds in the presence of communication delay and coupling amplitude. Relative to the center of mass, the patterns can then be described as transitions between translation, rotation about a stationary point, or a rotating swarm, where the center of mass undergoes a Hopf bifurcation from steady state to a limit cycle. Examples of some of the stochastic patterns will be given for large numbers of particles.
△ Less
Submitted 20 April, 2012;
originally announced April 2012.
-
Converging towards the optimal path to extinction
Authors:
Ira B. Schwartz,
Eric Forgoston,
Simone Bianco,
Leah B. Shaw
Abstract:
Extinction appears ubiquitously in many fields, including chemical reactions, population biology, evolution, and epidemiology. Even though extinction as a random process is a rare event, its occurrence is observed in large finite populations. Extinction occurs when fluctuations due to random transitions act as an effective force which drives one or more components or species to vanish. Although th…
▽ More
Extinction appears ubiquitously in many fields, including chemical reactions, population biology, evolution, and epidemiology. Even though extinction as a random process is a rare event, its occurrence is observed in large finite populations. Extinction occurs when fluctuations due to random transitions act as an effective force which drives one or more components or species to vanish. Although there are many random paths to an extinct state, there is an optimal path that maximizes the probability to extinction. In this article, we show that the optimal path is associated with the dynamical systems idea of having maximum sensitive dependence to initial conditions. Using the equivalence between the sensitive dependence and the path to extinction, we show that the dynamical systems picture of extinction evolves naturally toward the optimal path in several stochastic models of epidemics.
△ Less
Submitted 20 December, 2011;
originally announced December 2011.
-
Set-based corral control in stochastic dynamical systems: Making almost invariant sets more invariant
Authors:
Eric Forgoston,
Lora Billings,
Philip Yecko,
Ira B. Schwartz
Abstract:
We consider the problem of stochastic prediction and control in a time-dependent stochastic environment, such as the ocean, where escape from an almost invariant region occurs due to random fluctuations. We determine high-probability control-actuation sets by computing regions of uncertainty, almost invariant sets, and Lagrangian Coherent Structures. The combination of geometric and probabilistic…
▽ More
We consider the problem of stochastic prediction and control in a time-dependent stochastic environment, such as the ocean, where escape from an almost invariant region occurs due to random fluctuations. We determine high-probability control-actuation sets by computing regions of uncertainty, almost invariant sets, and Lagrangian Coherent Structures. The combination of geometric and probabilistic methods allows us to design regions of control that provide an increase in loitering time while minimizing the amount of control actuation. We show how the loitering time in almost invariant sets scales exponentially with respect to the control actuation, causing an exponential increase in loitering times with only small changes in actuation force. The result is that the control actuation makes almost invariant sets more invariant.
△ Less
Submitted 14 January, 2011;
originally announced January 2011.
-
Maximal Sensitive Dependence and the Optimal Path to Epidemic Extinction
Authors:
Eric Forgoston,
Simone Bianco,
Leah B. Shaw,
Ira B. Schwartz
Abstract:
Extinction of an epidemic or a species is a rare event that occurs due to a large, rare stochastic fluctuation. Although the extinction process is dynamically unstable, it follows an optimal path that maximizes the probability of extinction. We show that the optimal path is also directly related to the finite-time Lyapunov exponents of the underlying dynamical system in that the optimal path dis…
▽ More
Extinction of an epidemic or a species is a rare event that occurs due to a large, rare stochastic fluctuation. Although the extinction process is dynamically unstable, it follows an optimal path that maximizes the probability of extinction. We show that the optimal path is also directly related to the finite-time Lyapunov exponents of the underlying dynamical system in that the optimal path displays maximum sensitivity to initial conditions. We consider several stochastic epidemic models, and examine the extinction process in a dynamical systems framework. Using the dynamics of the finite-time Lyapunov exponents as a constructive tool, we demonstrate that the dynamical systems viewpoint of extinction evolves naturally toward the optimal path.
△ Less
Submitted 24 March, 2010; v1 submitted 3 March, 2010;
originally announced March 2010.
-
Accurate Noise Projection for Reduced Stochastic Epidemic Models
Authors:
Eric Forgoston,
Lora Billings,
Ira B. Schwartz
Abstract:
We consider a stochastic Susceptible-Exposed-Infected-Recovered (SEIR) epidemiological model. Through the use of a normal form coordinate transform, we are able to analytically derive the stochastic center manifold along with the associated, reduced set of stochastic evolution equations. The transformation correctly projects both the dynamics and the noise onto the center manifold. Therefore, th…
▽ More
We consider a stochastic Susceptible-Exposed-Infected-Recovered (SEIR) epidemiological model. Through the use of a normal form coordinate transform, we are able to analytically derive the stochastic center manifold along with the associated, reduced set of stochastic evolution equations. The transformation correctly projects both the dynamics and the noise onto the center manifold. Therefore, the solution of this reduced stochastic dynamical system yields excellent agreement, both in amplitude and phase, with the solution of the original stochastic system for a temporal scale that is orders of magnitude longer than the typical relaxation time. This new method allows for improved time series prediction of the number of infectious cases when modeling the spread of disease in a population. Numerical solutions of the fluctuations of the SEIR model are considered in the infinite population limit using a Langevin equation approach, as well as in a finite population simulated as a Markov process.
△ Less
Submitted 23 September, 2009; v1 submitted 5 March, 2009;
originally announced March 2009.
-
Escape Rates in a Stochastic Environment with Multiple Scales
Authors:
Eric Forgoston,
Ira B. Schwartz
Abstract:
We consider a stochastic environment with two time scales and outline a general theory that compares two methods to reduce the dimension of the original system. The first method involves the computation of the underlying deterministic center manifold followed by a naive replacement of the stochastic term. The second method allows one to more accurately describe the stochastic effects and involve…
▽ More
We consider a stochastic environment with two time scales and outline a general theory that compares two methods to reduce the dimension of the original system. The first method involves the computation of the underlying deterministic center manifold followed by a naive replacement of the stochastic term. The second method allows one to more accurately describe the stochastic effects and involves the derivation of a normal form coordinate transform that is used to find the stochastic center manifold. The results of both methods are used along with the path integral formalism of large fluctuation theory to predict the escape rate from one basin of attraction to another. The general theory is applied to the example of a surface flow described by a generic, singularly perturbed, damped, nonlinear oscillator with additive, Gaussian noise. We show how both nonlinear reduction methods compare in escape rate scaling. Additionally, the center manifolds are shown to predict high pre-history probability regions of escape. The theoretical results are confirmed using numerical computation of the mean escape time and escape prehistory, and we briefly discuss the extension of the theory to stochastic control.
△ Less
Submitted 2 July, 2009; v1 submitted 8 September, 2008;
originally announced September 2008.
-
Delay Induced Instabilities in Self-Propelling Swarms
Authors:
Eric Forgoston,
Ira B. Schwartz
Abstract:
We consider a general model of self-propelling particles interacting through a pairwise attractive force in the presence of noise and communication time delay. Previous work by Erdmann, et al. [Phys. Rev. E {\bf 71}, 051904 (2205)] has shown that a large enough noise intensity will cause a translating swarm of individuals to transition to a rotating swarm with a stationary center of mass. We sho…
▽ More
We consider a general model of self-propelling particles interacting through a pairwise attractive force in the presence of noise and communication time delay. Previous work by Erdmann, et al. [Phys. Rev. E {\bf 71}, 051904 (2205)] has shown that a large enough noise intensity will cause a translating swarm of individuals to transition to a rotating swarm with a stationary center of mass. We show that with the addition of a time delay, the model possesses a transition that depends on the size of the coupling amplitude. This transition is independent of the initial swarm state (traveling or rotating) and is characterized by the alignment of all of the individuals along with a swarm oscillation. By considering the mean field equations without noise, we show that the time delay induced transition is associated with a Hopf bifurcation. The analytical result yields good agreement with numerical computations of the value of the coupling parameter at the Hopf point.
△ Less
Submitted 25 February, 2008; v1 submitted 18 December, 2007;
originally announced December 2007.