-
Early Warning Signals for Bifurcations Embedded in High Dimensions
Authors:
Daniel Dylewsky,
Madhur Anand,
Chris T. Bauch
Abstract:
Recent work has highlighted the utility of methods for early warning signal detection in dynamic systems approaching critical tip** thresholds. Often these tip** points resemble local bifurcations, whose low dimensional dynamics can play out on a manifold embedded in a much higher dimensional state space. In many cases of practical relevance, the form of this embedding is poorly understood or…
▽ More
Recent work has highlighted the utility of methods for early warning signal detection in dynamic systems approaching critical tip** thresholds. Often these tip** points resemble local bifurcations, whose low dimensional dynamics can play out on a manifold embedded in a much higher dimensional state space. In many cases of practical relevance, the form of this embedding is poorly understood or entirely unknown. This paper explores how measurement of the critical phenomena that generically precede such bifurcations can be used to make inferences about the properties of their embeddings, and, conversely, how prior knowledge about the mechanism of bifurcation can robustify predictions of an oncoming tip** event. These modes of analysis are first demonstrated on a simple fluid flow system undergoing a Hopf bifurcation. The same approach is then applied to data associated with the West African monsoon shift, with results corroborated by existing models of the same system. This example highlights the effectiveness of the methodology even when applied to complex climate data, and demonstrates how a well-resolved spatial structure associated with the onset of atmospheric instability can be inferred purely from time series measurements.
△ Less
Submitted 26 February, 2024; v1 submitted 15 February, 2024;
originally announced February 2024.
-
Predicting discrete-time bifurcations with deep learning
Authors:
Thomas M. Bury,
Daniel Dylewsky,
Chris T. Bauch,
Madhur Anand,
Leon Glass,
Alvin Shrier,
Gil Bub
Abstract:
Many natural and man-made systems are prone to critical transitions -- abrupt and potentially devastating changes in dynamics. Deep learning classifiers can provide an early warning signal (EWS) for critical transitions by learning generic features of bifurcations (dynamical instabilities) from large simulated training data sets. So far, classifiers have only been trained to predict continuous-tim…
▽ More
Many natural and man-made systems are prone to critical transitions -- abrupt and potentially devastating changes in dynamics. Deep learning classifiers can provide an early warning signal (EWS) for critical transitions by learning generic features of bifurcations (dynamical instabilities) from large simulated training data sets. So far, classifiers have only been trained to predict continuous-time bifurcations, ignoring rich dynamics unique to discrete-time bifurcations. Here, we train a deep learning classifier to provide an EWS for the five local discrete-time bifurcations of codimension-1. We test the classifier on simulation data from discrete-time models used in physiology, economics and ecology, as well as experimental data of spontaneously beating chick-heart aggregates that undergo a period-doubling bifurcation. The classifier outperforms commonly used EWS under a wide range of noise intensities and rates of approach to the bifurcation. It also predicts the correct bifurcation in most cases, with particularly high accuracy for the period-doubling, Neimark-Sacker and fold bifurcations. Deep learning as a tool for bifurcation prediction is still in its nascence and has the potential to transform the way we monitor systems for critical transitions.
△ Less
Submitted 8 February, 2024; v1 submitted 16 March, 2023;
originally announced March 2023.
-
Universal Early Warning Signals of Phase Transitions in Climate Systems
Authors:
Daniel Dylewsky,
Timothy M. Lenton,
Marten Scheffer,
Thomas M. Bury,
Christopher G. Fletcher,
Madhur Anand,
Chris T. Bauch
Abstract:
The potential for complex systems to exhibit tip** points in which an equilibrium state undergoes a sudden and often irreversible shift is well established, but prediction of these events using standard forecast modeling techniques is quite difficult. This has led to the development of an alternative suite of methods that seek to identify signatures of critical phenomena in data, which are expec…
▽ More
The potential for complex systems to exhibit tip** points in which an equilibrium state undergoes a sudden and often irreversible shift is well established, but prediction of these events using standard forecast modeling techniques is quite difficult. This has led to the development of an alternative suite of methods that seek to identify signatures of critical phenomena in data, which are expected to occur in advance of many classes of dynamical bifurcation. Crucially, the manifestations of these critical phenomena are generic across a variety of systems, meaning that data-intensive deep learning methods can be trained on (abundant) synthetic data and plausibly prove effective when transferred to (more limited) empirical data sets. This paper provides a proof of concept for this approach as applied to lattice phase transitions: a deep neural network trained exclusively on 2D Ising model phase transitions is tested on a number of real and simulated climate systems with considerable success. Its accuracy frequently surpasses that of conventional statistical indicators, with performance shown to be consistently improved by the inclusion of spatial indicators. Tools such as this may offer valuable insight into climate tip** events, as remote sensing measurements provide increasingly abundant data on complex geospatially-resolved Earth systems.
△ Less
Submitted 5 December, 2022; v1 submitted 31 May, 2022;
originally announced June 2022.
-
Stochastically forced ensemble dynamic mode decomposition for forecasting and analysis of near-periodic systems
Authors:
Daniel Dylewsky,
David Barajas-Solano,
Tong Ma,
Alexandre M. Tartakovsky,
J. Nathan Kutz
Abstract:
Time series forecasting remains a central challenge problem in almost all scientific disciplines. We introduce a novel load forecasting method in which observed dynamics are modeled as a forced linear system using Dynamic Mode Decomposition (DMD) in time delay coordinates. Central to this approach is the insight that grid load, like many observables on complex real-world systems, has an "almost-pe…
▽ More
Time series forecasting remains a central challenge problem in almost all scientific disciplines. We introduce a novel load forecasting method in which observed dynamics are modeled as a forced linear system using Dynamic Mode Decomposition (DMD) in time delay coordinates. Central to this approach is the insight that grid load, like many observables on complex real-world systems, has an "almost-periodic" character, i.e., a continuous Fourier spectrum punctuated by dominant peaks, which capture regular (e.g., daily or weekly) recurrences in the dynamics. The forecasting method presented takes advantage of this property by (i) regressing to a deterministic linear model whose eigenspectrum maps onto those peaks, and (ii) simultaneously learning a stochastic Gaussian process regression (GPR) process to actuate this system. Our forecasting algorithm is compared against state-of-the-art forecasting techniques not using additional explanatory variables and is shown to produce superior performance. Moreover, its use of linear intrinsic dynamics offers a number of desirable properties in terms of interpretability and parsimony. Results are presented for a test case using load data from an electrical grid. Load forecasting is an essential challenge in power systems engineering, with major implications for real-time control, pricing, maintenance, and security decisions.
△ Less
Submitted 9 July, 2021; v1 submitted 8 October, 2020;
originally announced October 2020.
-
Sparse Identification of Slow Timescale Dynamics
Authors:
Jason J. Bramburger,
Daniel Dylewsky,
J. Nathan Kutz
Abstract:
Multiscale phenomena that evolve on multiple distinct timescales are prevalent throughout the sciences. It is often the case that the governing equations of the persistent and approximately periodic fast scales are prescribed, while the emergent slow scale evolution is unknown. Yet the course-grained, slow scale dynamics is often of greatest interest in practice. In this work we present an accurat…
▽ More
Multiscale phenomena that evolve on multiple distinct timescales are prevalent throughout the sciences. It is often the case that the governing equations of the persistent and approximately periodic fast scales are prescribed, while the emergent slow scale evolution is unknown. Yet the course-grained, slow scale dynamics is often of greatest interest in practice. In this work we present an accurate and efficient method for extracting the slow timescale dynamics from signals exhibiting multiple timescales that are amenable to averaging. The method relies on tracking the signal at evenly-spaced intervals with length given by the period of the fast timescale, which is discovered using clustering techniques in conjunction with the dynamic mode decomposition. Sparse regression techniques are then used to discover a map** which describes iterations from one data point to the next. We show that for sufficiently disparate timescales this discovered map** can be used to discover the continuous-time slow dynamics, thus providing a novel tool for extracting dynamics on multiple timescales.
△ Less
Submitted 18 July, 2020; v1 submitted 1 June, 2020;
originally announced June 2020.
-
Principal component trajectories for modeling spectrally-continuous dynamics as forced linear systems
Authors:
Daniel Dylewsky,
Eurika Kaiser,
Steven L. Brunton,
J. Nathan Kutz
Abstract:
Delay embeddings of time series data have emerged as a promising coordinate basis for data-driven estimation of the Koopman operator, which seeks a linear representation for observed nonlinear dynamics. Recent work has demonstrated the efficacy of Dynamic Mode Decomposition (DMD) for obtaining finite-dimensional Koopman approximations in delay coordinates. In this paper we demonstrate how nonlinea…
▽ More
Delay embeddings of time series data have emerged as a promising coordinate basis for data-driven estimation of the Koopman operator, which seeks a linear representation for observed nonlinear dynamics. Recent work has demonstrated the efficacy of Dynamic Mode Decomposition (DMD) for obtaining finite-dimensional Koopman approximations in delay coordinates. In this paper we demonstrate how nonlinear dynamics with sparse Fourier spectra can be (i) represented by a superposition of principal component trajectories (PCT) and (ii) modeled by DMD in this coordinate space. For continuous or mixed (discrete and continuous) spectra, DMD can be augmented with an external forcing term. We present a method for learning linear control models in delay coordinates while simultaneously discovering the corresponding exogeneous forcing signal in a fully unsupervised manner. This extends the existing DMD with control (DMDc) algorithm to cases where a control signal is not known a priori. We provide examples to validate the learned forcing against a known ground truth and illustrate their statistical similarity. Finally we offer a demonstration of this method applied to real-world power grid load data to show its utility for diagnostics and interpretation on systems in which somewhat periodic behavior is strongly forced by unknown and unmeasurable environmental variables.
△ Less
Submitted 12 January, 2022; v1 submitted 28 May, 2020;
originally announced May 2020.
-
Dynamic mode decomposition for multiscale nonlinear physics
Authors:
Daniel Dylewsky,
Molei Tao,
J. Nathan Kutz
Abstract:
We present a data-driven method for separating complex, multiscale systems into their constituent time-scale components using a recursive implementation of dynamic mode decomposition (DMD). Local linear models are built from windowed subsets of the data, and dominant time scales are discovered using spectral clustering on their eigenvalues. This approach produces time series data for each identifi…
▽ More
We present a data-driven method for separating complex, multiscale systems into their constituent time-scale components using a recursive implementation of dynamic mode decomposition (DMD). Local linear models are built from windowed subsets of the data, and dominant time scales are discovered using spectral clustering on their eigenvalues. This approach produces time series data for each identified component, which sum to a faithful reconstruction of the input signal. It differs from most other methods in the field of multiresolution analysis (MRA) in that it 1) accounts for spatial and temporal coherencies simultaneously, making it more robust to scale overlap between components, and 2) yields a closed-form expression for local dynamics at each scale, which can be used for short-term prediction of any or all components. Our technique is an extension of multi-resolution dynamic mode decomposition (mrDMD), generalized to treat a broader variety of multiscale systems and more faithfully reconstruct their isolated components. In this paper we present an overview of our algorithm and its results on two example physical systems, and briefly discuss some advantages and potential forecasting applications for the technique.
△ Less
Submitted 20 June, 2019; v1 submitted 25 March, 2019;
originally announced March 2019.
-
Engineering Structural Robustness in Power Grid Networks Susceptible to Coherent Swing Instability
Authors:
Daniel Dylewsky,
Xiu Yang,
Alexandre Tartakovsky,
J. Nathan Kutz
Abstract:
Networked power grid systems are susceptible to a phenomenon known as Coherent Swing Instability (CSI), in which a subset of machines in the grid lose synchrony with the rest of the network. We develop network level evaluation metrics to (i) identify community substructures in the power grid network, (ii) determine weak points in the network that are particularly sensitive to CSI, and (iii) produc…
▽ More
Networked power grid systems are susceptible to a phenomenon known as Coherent Swing Instability (CSI), in which a subset of machines in the grid lose synchrony with the rest of the network. We develop network level evaluation metrics to (i) identify community substructures in the power grid network, (ii) determine weak points in the network that are particularly sensitive to CSI, and (iii) produce an engineering approach for the addition of transmission lines to reduce the incidences of CSI in existing networks, or design new power grid networks that are robust to CSI by their network design. For simulations on a reduced model for the American Northeast power grid, where a block of buses representing the New England region exhibit a strong propensity for CSI, we show that modifying the network's connectivity structure can markedly improve the grid's resilience to CSI. Our analysis provides a versatile diagnostic tool for evaluating the efficacy of adding lines to a power grid which is known to be prone to CSI. This is a particularly relevant problem in large-scale power systems, where improving stability and robustness to interruptions by increasing overall network connectivity is not feasible due to financial and infrastructural constraints.
△ Less
Submitted 22 May, 2019; v1 submitted 24 May, 2018;
originally announced May 2018.
-
Physics at a 100 TeV pp collider: beyond the Standard Model phenomena
Authors:
T. Golling,
M. Hance,
P. Harris,
M. L. Mangano,
M. McCullough,
F. Moortgat,
P. Schwaller,
R. Torre,
P. Agrawal,
D. S. M. Alves,
S. Antusch,
A. Arbey,
B. Auerbach,
G. Bambhaniya,
M. Battaglia,
M. Bauer,
P. S. Bhupal Dev,
A. Boveia,
J. Bramante,
O. Buchmueller,
M. Buschmann,
J. Chakrabortty,
M. Chala,
S. Chekanov,
C. -Y. Chen
, et al. (89 additional authors not shown)
Abstract:
This report summarises the physics opportunities in the search and study of physics beyond the Standard Model at a 100 TeV pp collider.
This report summarises the physics opportunities in the search and study of physics beyond the Standard Model at a 100 TeV pp collider.
△ Less
Submitted 2 June, 2016;
originally announced June 2016.
-
Exact calculation of phonon effects on spin squeezing
Authors:
D. Dylewsky,
J. K. Freericks,
M. L. Wall,
A. M. Rey,
M. Foss-Feig
Abstract:
Theoretical models of spins coupled to bosons provide a simple setting for studying a broad range of important phenomena in many-body physics, from virtually mediated interactions to decoherence and thermalization. In many atomic, molecular, and optical systems, such models also underlie the most successful attempts to engineer strong, long-ranged interactions for the purpose of entanglement gener…
▽ More
Theoretical models of spins coupled to bosons provide a simple setting for studying a broad range of important phenomena in many-body physics, from virtually mediated interactions to decoherence and thermalization. In many atomic, molecular, and optical systems, such models also underlie the most successful attempts to engineer strong, long-ranged interactions for the purpose of entanglement generation. Especially when the coupling between the spins and bosons is strong---such that it cannot be treated perturbatively---the properties of such models are extremely challenging to calculate theoretically. Here, exact analytical expressions for nonequilibrium spin-spin correlation functions are derived for a specific model of spins coupled to bosons. The spatial structure of the coupling between spins and bosons is completely arbitrary, and thus the solution can be applied to systems in any number of dimensions. The explicit and nonperturbative inclusion of the bosons enables the study of entanglement generation (in the form of spin squeezing) even when the bosons are driven strongly and near-resonantly, and thus provides a quantitative view of the breakdown of adiabatic elimination that inevitably occurs as one pushes towards the fastest entanglement generation possible. The solution also helps elucidate the effect of finite temperature on spin squeezing. The model considered is relevant to a variety of atomic, molecular, and optical systems, such as atoms in cavities or trapped ions. As an explicit example, the results are used to quantify phonon effects in trapped ion quantum simulators, which are expected to become increasingly important as these experiments push towards larger numbers of ions.
△ Less
Submitted 16 October, 2015;
originally announced October 2015.