Showing 1–6 of 6 results for author: Gelbrecht, M

Model adaptive phase space reconstruction

Authors: Jayesh M. Dhadphale, K. Hauke Kraemer, Maximilian Gelbrecht, Jürgen Kurths, Norbert Marwan, R. I. Sujith

Abstract: Phase space reconstruction (PSR) methods allow for the analysis of low-dimensional data with methods from dynamical system theory, but their application to prediction models, like those from machine learning (ML), is limited. Therefore, we present here a model adaptive phase space reconstruction (MAPSR) method that unifies the process of PSR with the modeling of the dynamical system. MAPSR is a di… ▽ More Phase space reconstruction (PSR) methods allow for the analysis of low-dimensional data with methods from dynamical system theory, but their application to prediction models, like those from machine learning (ML), is limited. Therefore, we present here a model adaptive phase space reconstruction (MAPSR) method that unifies the process of PSR with the modeling of the dynamical system. MAPSR is a differentiable PSR method that enables the use of ML methods and is based on the idea of time delay embedding. For achieving differentiable, continuous, real-valued delays, which can be optimized using gradient descent, the discrete time signal is converted to a continuous time signal. The delay vector, which stores all potential embedding delays and the trainable parameters of the model, are simultaneously updated to achieve an optimal time delay embedding for the observed system. MAPSR does not rely on any threshold or statistical criterion for determining the dimension and the set of delay values for the embedding process. The quality of the reconstruction is evaluated by the prediction loss. We apply the proposed approach to uni- and multivariate time series stemming from regular and chaotic dynamical systems and a turbulent combustor to test the generalizability of the method and compare our results with established PSR methods. We find that for the Lorenz system, the model trained with the MAPSR method is able to predict chaotic time series for nearly 7 to 8 Lyapunov time scales, which is found to be much better compared to other PSR methods (AMI-FNN and PECUZAL methods). For the univariate time series from the turbulent combustor, the long-term prediction error of the model trained using the MAPSR method stays in between that of AMI-FNN and PECUZAL methods for the regime of chaos, and for the regime of intermittency, the MAPSR method outperforms the AMI-FNN and PECUZAL methods. △ Less

Submitted 20 December, 2023; originally announced December 2023.

Stabilized Neural Differential Equations for Learning Dynamics with Explicit Constraints

Authors: Alistair White, Niki Kilbertus, Maximilian Gelbrecht, Niklas Boers

Abstract: Many successful methods to learn dynamical systems from data have recently been introduced. However, ensuring that the inferred dynamics preserve known constraints, such as conservation laws or restrictions on the allowed system states, remains challenging. We propose stabilized neural differential equations (SNDEs), a method to enforce arbitrary manifold constraints for neural differential equati… ▽ More Many successful methods to learn dynamical systems from data have recently been introduced. However, ensuring that the inferred dynamics preserve known constraints, such as conservation laws or restrictions on the allowed system states, remains challenging. We propose stabilized neural differential equations (SNDEs), a method to enforce arbitrary manifold constraints for neural differential equations. Our approach is based on a stabilization term that, when added to the original dynamics, renders the constraint manifold provably asymptotically stable. Due to its simplicity, our method is compatible with all common neural differential equation (NDE) models and broadly applicable. In extensive empirical evaluations, we demonstrate that SNDEs outperform existing methods while broadening the types of constraints that can be incorporated into NDE training. △ Less

Submitted 15 February, 2024; v1 submitted 16 June, 2023; originally announced June 2023.

Comments: 22 pages, 8 figures. Accepted at NeurIPS 2023

Differentiable Programming for Earth System Modeling

Authors: Maximilian Gelbrecht, Alistair White, Sebastian Bathiany, Niklas Boers

Abstract: Earth System Models (ESMs) are the primary tools for investigating future Earth system states at time scales from decades to centuries, especially in response to anthropogenic greenhouse gas release. State-of-the-art ESMs can reproduce the observational global mean temperature anomalies of the last 150 years. Nevertheless, ESMs need further improvements, most importantly regarding (i) the large sp… ▽ More Earth System Models (ESMs) are the primary tools for investigating future Earth system states at time scales from decades to centuries, especially in response to anthropogenic greenhouse gas release. State-of-the-art ESMs can reproduce the observational global mean temperature anomalies of the last 150 years. Nevertheless, ESMs need further improvements, most importantly regarding (i) the large spread in their estimates of climate sensitivity, i.e., the temperature response to increases in atmospheric greenhouse gases, (ii) the modeled spatial patterns of key variables such as temperature and precipitation, (iii) their representation of extreme weather events, and (iv) their representation of multistable Earth system components and their ability to predict associated abrupt transitions. Here, we argue that making ESMs automatically differentiable has huge potential to advance ESMs, especially with respect to these key shortcomings. First, automatic differentiability would allow objective calibration of ESMs, i.e., the selection of optimal values with respect to a cost function for a large number of free parameters, which are currently tuned mostly manually. Second, recent advances in Machine Learning (ML) and in the amount, accuracy, and resolution of observational data promise to be helpful with at least some of the above aspects because ML may be used to incorporate additional information from observations into ESMs. Automatic differentiability is an essential ingredient in the construction of such hybrid models, combining process-based ESMs with ML components. We document recent work showcasing the potential of automatic differentiation for a new generation of substantially improved, data-informed ESMs. △ Less

Submitted 2 June, 2023; v1 submitted 29 August, 2022; originally announced August 2022.

Comments: 17 pages, 2 figures

Journal ref: Geoscientific Model Development, 2023, Volume 16, Issue 11, 3123-3135

Analysis of a bistable climate toy model with physics-based machine learning methods

Authors: Maximilian Gelbrecht, Valerio Lucarini, Niklas Boers, Jürgen Kurths

Abstract: We propose a comprehensive framework able to address both the predictability of the first and of the second kind for high-dimensional chaotic models. For this purpose, we analyse the properties of a newly introduced multistable climate toy model constructed by coupling the Lorenz '96 model with a zero-dimensional energy balance model. First, the attractors of the system are identified with Monte C… ▽ More We propose a comprehensive framework able to address both the predictability of the first and of the second kind for high-dimensional chaotic models. For this purpose, we analyse the properties of a newly introduced multistable climate toy model constructed by coupling the Lorenz '96 model with a zero-dimensional energy balance model. First, the attractors of the system are identified with Monte Carlo Basin Bifurcation Analysis. Additionally, we are able to detect the Melancholia state separating the two attractors. Then, Neural Ordinary Differential Equations are applied in order to predict the future state of the system in both of the identified attractors. △ Less

Submitted 28 June, 2021; v1 submitted 13 November, 2020; originally announced November 2020.

Comments: 17 pages, 7 figures. Eur. Phys. J. Spec. Top. (2021)

Basin stability and limit cycles in a conceptual model for climate tip** cascades

Authors: Nico Wunderling, Maximilian Gelbrecht, Ricarda Winkelmann, Jürgen Kurths, Jonathan Donges

Abstract: Tip** elements in the climate system are large-scale subregions of the Earth that might possess threshold behavior under global warming with large potential impacts on human societies. Here, we study a subset of five tip** elements and their interactions in a conceptual and easily extendable framework: the Greenland and West Antarctic Ice Sheets, the Atlantic Meridional Overturning Circulation… ▽ More Tip** elements in the climate system are large-scale subregions of the Earth that might possess threshold behavior under global warming with large potential impacts on human societies. Here, we study a subset of five tip** elements and their interactions in a conceptual and easily extendable framework: the Greenland and West Antarctic Ice Sheets, the Atlantic Meridional Overturning Circulation (AMOC), the El-Nino Southern Oscillation (ENSO) and the Amazon rainforest. In this nonlinear and multistable system, we perform a basin stability analysis to detect its stable states and their associated Earth system resilience. Using this approach, we perform a system-wide and comprehensive robustness analysis with more than 3.5 billion ensemble members. Further, we investigate dynamic regimes where some of the states lose stability and oscillations appear using a newly developed basin bifurcation analysis methodology. Our results reveal that the state of four or five tipped elements has the largest basin volume for large levels of global warming beyond 4 °C above pre-industrial climate conditions. For lower levels of warming, states including disintegrated ice sheets on West Antarctica and Greenland have higher basin volume than other state configurations. Therefore in our model, we find that the large ice sheets are of particular importance for Earth system resilience. We also detect the emergence of limit cycles for 0.6% of all ensemble members at rare parameter combinations. Such limit cycle oscillations mainly occur between the Greenland Ice Sheet and AMOC (86%), due to their negative feedback coupling. These limit cycles point to possibly dangerous internal modes of variability in the climate system that could have played a role in paleoclimatic dynamics such as those unfolding during the Pleistocene ice age cycles. △ Less

Submitted 10 November, 2020; v1 submitted 14 September, 2020; originally announced September 2020.

Comments: 50 pages, 10 figures, 2 tables

Monte Carlo Basin Bifurcation Analysis

Authors: Maximilian Gelbrecht, Jürgen Kurths, Frank Hellmann

Abstract: Many high-dimensional complex systems exhibit an enormously complex landscape of possible asymptotic states. Here, we present a numerical approach geared towards analyzing such systems. It is situated between the classical analysis with macroscopic order parameters and a more thorough, detailed bifurcation analysis. With our machine learning method, based on random sampling and clustering methods,… ▽ More Many high-dimensional complex systems exhibit an enormously complex landscape of possible asymptotic states. Here, we present a numerical approach geared towards analyzing such systems. It is situated between the classical analysis with macroscopic order parameters and a more thorough, detailed bifurcation analysis. With our machine learning method, based on random sampling and clustering methods, we are able to characterize the different asymptotic states or classes thereof and even their basins of attraction. In order to do this, suitable, easy to compute, statistics of trajectories with randomly generated initial conditions and parameters are clustered by an algorithm such as DBSCAN. Due to its modular and flexible nature, our method has a wide range of possible applications. Typical applications are oscillator networks, but it is not limited only to ordinary differential equation systems, every complex system yielding trajectories, such as maps or agent-based models, can be analyzed, as we show by applying it the Dodds-Watts model, a generalized SIRS-model. A second order Kuramoto model and a Stuart-Landau oscillator network, each exhibiting a complex multistable regime, are shown as well. The method is available to use as a package for the Julia language. △ Less

Submitted 14 October, 2019; originally announced October 2019.