Showing 1–11 of 11 results for author: Kevrekidis, Y

Data-driven cold starting of good reservoirs

Authors: Lyudmila Grigoryeva, Boumediene Hamzi, Felix P. Kemeth, Yannis Kevrekidis, G Manjunath, Juan-Pablo Ortega, Matthys J. Steynberg

Abstract: Using short histories of observations from a dynamical system, a workflow for the post-training initialization of reservoir computing systems is described. This strategy is called cold-starting, and it is based on a map called the starting map, which is determined by an appropriately short history of observations that maps to a unique initial condition in the reservoir space. The time series gener… ▽ More Using short histories of observations from a dynamical system, a workflow for the post-training initialization of reservoir computing systems is described. This strategy is called cold-starting, and it is based on a map called the starting map, which is determined by an appropriately short history of observations that maps to a unique initial condition in the reservoir space. The time series generated by the reservoir system using that initial state can be used to run the system in autonomous mode, to produce accurate forecasts of the time series under consideration immediately. By utilizing this map, the lengthy "washouts" that are necessary to initialize reservoir systems can be eliminated, enabling the generation of forecasts using any selection of appropriately short histories of the observations. △ Less

Submitted 15 March, 2024; originally announced March 2024.

Comments: 21 pages, 9 figures

Social Physics of Bacteria: Avoidance of an Information Black Hole

Authors: Trung V. Phan, Shengkai Li, Domenic Ferreris, Ryan Morris, Julia Bos, Buming Gou, Stephano Martiniani, Paul Chaikin, Yannis G. Kevrekidis, Robert H. Austin

Abstract: Social physics explores responses to information exchange in a social network, and can be mapped down to bacterial collective signaling. Here, we explore how social inter-bacterial communication includes coordination of response to communication loss, as opposed to solitary searching for food, with collective response emergence at the population level. We present a 2-dimensional enclosed microflui… ▽ More Social physics explores responses to information exchange in a social network, and can be mapped down to bacterial collective signaling. Here, we explore how social inter-bacterial communication includes coordination of response to communication loss, as opposed to solitary searching for food, with collective response emergence at the population level. We present a 2-dimensional enclosed microfluidic environment that utilizes concentric rings of funnel ratchets, which direct motile E.coli bacteria towards a sole exit hole, an information ``black hole'', passage into the black hole irreversibly sweeps the bacteria away via hydrodynamic flow. We show that the spatiotemporal evolution of entropy production reveals how bacteria avoid crossing the hydrodynamic black hole information horizon. △ Less

Submitted 29 January, 2024; originally announced January 2024.

Tip** points in overturning circulation mediated by ocean mixing and the configuration and magnitude of the hydrological cycle: A simple model

Authors: Anand Gnanadesikan, Gianluca Fabiani, **gwen Liu, Renske Gelderloos, G. Jay Brett, Yannis Kevrekidis, Thomas Haine, Marie-Aude Pradal, Constantinos Siettos, Jennifer Sleeman

Abstract: The current configuration of the ocean overturning involves upwelling predominantly in the Southern Ocean and sinking predominantly in the Atlantic basin. The reasons for this remain unclear, as both models and paleoclimatic observations suggest that sinking can sometimes occur in the Pacific. We present a six-box model of the overturning in which temperature, salinity and low-latitude pycnocline… ▽ More The current configuration of the ocean overturning involves upwelling predominantly in the Southern Ocean and sinking predominantly in the Atlantic basin. The reasons for this remain unclear, as both models and paleoclimatic observations suggest that sinking can sometimes occur in the Pacific. We present a six-box model of the overturning in which temperature, salinity and low-latitude pycnocline depths are allowed to vary prognostically in both the Atlantic and Pacific. The overturning is driven by temperature, winds, and mixing and modulated by the hydrological cycle. In each basin there are three possible flow regimes, depending on whether low-latitude water flowing into northern surface boxes is transformed into dense deep water, somewhat lighter intermediate water, or light water that is returned at the surface. The resulting model combines insights from a number of previous studies and allows for nine possible global flow regimes. For the modern ocean, we find that although the interbasin atmospheric freshwater flux suppresses Pacific sinking, the equator-to-pole flux enhances it. When atmospheric temperatures are held fixed, seven possible flow regimes can be accessed by changing the amplitude and configuration of the modern hydrological cycle . North Pacific overturning can strengthen with either increases or decreases in the hydrological cycle, as well as under reversal of the interbasin freshwater flux. Tip**-point behavior of both transient and equilibrium states is modulated by parameters such as the poorly constrained lateral diffusive mixing. If hydrological cycle amplitude is varied consistently with global temperature, northern polar amplification is necessary for the Atlantic overturning to collapse △ Less

Submitted 7 August, 2023; originally announced August 2023.

Comments: 38 pages, 10 figures, Submitted to Journal of Physical Oceanography

A Generative Adversarial Network for Climate Tip** Point Discovery (TIP-GAN)

Authors: Jennifer Sleeman, David Chung, Anand Gnanadesikan, Jay Brett, Yannis Kevrekidis, Marisa Hughes, Thomas Haine, Marie-Aude Pradal, Renske Gelderloos, Chace Ashcraft, Caroline Tang, Anshu Saksena, Larry White

Abstract: We propose a new Tip** Point Generative Adversarial Network (TIP-GAN) for better characterizing potential climate tip** points in Earth system models. We describe an adversarial game to explore the parameter space of these models, detect upcoming tip** points, and discover the drivers of tip** points. In this setup, a set of generators learn to construct model configurations that will invo… ▽ More We propose a new Tip** Point Generative Adversarial Network (TIP-GAN) for better characterizing potential climate tip** points in Earth system models. We describe an adversarial game to explore the parameter space of these models, detect upcoming tip** points, and discover the drivers of tip** points. In this setup, a set of generators learn to construct model configurations that will invoke a climate tip** point. The discriminator learns to identify which generators are generating each model configuration and whether a given configuration will lead to a tip** point. The discriminator is trained using an oracle (a surrogate climate model) to test if a generated model configuration leads to a tip** point or not. We demonstrate the application of this GAN to invoke the collapse of the Atlantic Meridional Overturning Circulation (AMOC). We share experimental results of modifying the loss functions and the number of generators to exploit the area of uncertainty in model state space near a climate tip** point. In addition, we show that our trained discriminator can predict AMOC collapse with a high degree of accuracy without the use of the oracle. This approach could generalize to other tip** points, and could augment climate modeling research by directing users interested in studying tip** points to parameter sets likely to induce said tip** points in their computationally intensive climate models. △ Less

Submitted 16 February, 2023; originally announced February 2023.

Using Artificial Intelligence to aid Scientific Discovery of Climate Tip** Points

Authors: Jennifer Sleeman, David Chung, Chace Ashcraft, Jay Brett, Anand Gnanadesikan, Yannis Kevrekidis, Marisa Hughes, Thomas Haine, Marie-Aude Pradal, Renske Gelderloos, Caroline Tang, Anshu Saksena, Larry White

Abstract: We propose a hybrid Artificial Intelligence (AI) climate modeling approach that enables climate modelers in scientific discovery using a climate-targeted simulation methodology based on a novel combination of deep neural networks and mathematical methods for modeling dynamical systems. The simulations are grounded by a neuro-symbolic language that both enables question answering of what is learned… ▽ More We propose a hybrid Artificial Intelligence (AI) climate modeling approach that enables climate modelers in scientific discovery using a climate-targeted simulation methodology based on a novel combination of deep neural networks and mathematical methods for modeling dynamical systems. The simulations are grounded by a neuro-symbolic language that both enables question answering of what is learned by the AI methods and provides a means of explainability. We describe how this methodology can be applied to the discovery of climate tip** points and, in particular, the collapse of the Atlantic Meridional Overturning Circulation (AMOC). We show how this methodology is able to predict AMOC collapse with a high degree of accuracy using a surrogate climate model for ocean interaction. We also show preliminary results of neuro-symbolic method performance when translating between natural language questions and symbolically learned representations. Our AI methodology shows promising early results, potentially enabling faster climate tip** point related research that would otherwise be computationally infeasible. △ Less

Submitted 14 February, 2023; originally announced February 2023.

Comments: This is the preprint of work presented at the 2022 AAAI Fall Symposium Series, Third Symposium on Knowledge-Guided ML, November 2022

Accurate and efficient multiscale simulation of a heterogeneous elastic beam via computation on small sparse patches

Authors: A. J. Roberts, Thien Tran-Duc, J. E. Bunder, Yannis Kevrekidis

Abstract: Modern `smart' materials have complex microscale structure, often with unknown macroscale closure. The Equation-Free Patch Scheme empowers us to non-intrusively, efficiently, and accurately simulate over large scales through computations on only small well-separated patches of the microscale system. Here the microscale system is a solid beam of random heterogeneous elasticity. The continuing chall… ▽ More Modern `smart' materials have complex microscale structure, often with unknown macroscale closure. The Equation-Free Patch Scheme empowers us to non-intrusively, efficiently, and accurately simulate over large scales through computations on only small well-separated patches of the microscale system. Here the microscale system is a solid beam of random heterogeneous elasticity. The continuing challenge is to compute the given physics on just the microscale patches, and couple the patches across un-simulated macroscale space, in order to establish efficiency, accuracy, consistency, and stability on the macroscale. Dynamical systems theory supports the scheme. This research program is to develop a systematic non-intrusive approach, both computationally and analytically proven, to model and compute accurately macroscale system levels of general complex physical and engineering systems. △ Less

Submitted 20 January, 2023; originally announced January 2023.

Benchmarking optimality of time series classification methods in distinguishing diffusions

Authors: Zehong Zhang, Fei Lu, Esther Xu Fei, Terry Lyons, Yannis Kevrekidis, Tom Woolf

Abstract: Statistical optimality benchmarking is crucial for analyzing and designing time series classification (TSC) algorithms. This study proposes to benchmark the optimality of TSC algorithms in distinguishing diffusion processes by the likelihood ratio test (LRT). The LRT is an optimal classifier by the Neyman-Pearson lemma. The LRT benchmarks are computationally efficient because the LRT does not need… ▽ More Statistical optimality benchmarking is crucial for analyzing and designing time series classification (TSC) algorithms. This study proposes to benchmark the optimality of TSC algorithms in distinguishing diffusion processes by the likelihood ratio test (LRT). The LRT is an optimal classifier by the Neyman-Pearson lemma. The LRT benchmarks are computationally efficient because the LRT does not need training, and the diffusion processes can be efficiently simulated and are flexible to reflect the specific features of real-world applications. We demonstrate the benchmarking with three widely-used TSC algorithms: random forest, ResNet, and ROCKET. These algorithms can achieve the LRT optimality for univariate time series and multivariate Gaussian processes. However, these model-agnostic algorithms are suboptimal in classifying high-dimensional nonlinear multivariate time series. Additionally, the LRT benchmark provides tools to analyze the dependence of classification accuracy on the time length, dimension, temporal sampling frequency, and randomness of the time series. △ Less

Submitted 11 April, 2023; v1 submitted 30 January, 2023; originally announced January 2023.

Comments: 23 pages, 8 figures

MSC Class: 62M02; 62M10; 62M20

Unsupervised learning of observation functions in state-space models by nonparametric moment methods

Authors: Qingci An, Yannis Kevrekidis, Fei Lu, Mauro Maggioni

Abstract: We investigate the unsupervised learning of non-invertible observation functions in nonlinear state-space models. Assuming abundant data of the observation process along with the distribution of the state process, we introduce a nonparametric generalized moment method to estimate the observation function via constrained regression. The major challenge comes from the non-invertibility of the observ… ▽ More We investigate the unsupervised learning of non-invertible observation functions in nonlinear state-space models. Assuming abundant data of the observation process along with the distribution of the state process, we introduce a nonparametric generalized moment method to estimate the observation function via constrained regression. The major challenge comes from the non-invertibility of the observation function and the lack of data pairs between the state and observation. We address the fundamental issue of identifiability from quadratic loss functionals and show that the function space of identifiability is the closure of a RKHS that is intrinsic to the state process. Numerical results show that the first two moments and temporal correlations, along with upper and lower bounds, can identify functions ranging from piecewise polynomials to smooth functions, leading to convergent estimators. The limitations of this method, such as non-identifiability due to symmetry and stationarity, are also discussed. △ Less

Submitted 11 July, 2022; originally announced July 2022.

MSC Class: 62G05; 68Q32; 62M15

Applications of Koopman Mode Analysis to Neural Networks

Authors: Iva Manojlović, Maria Fonoberova, Ryan Mohr, Aleksandr Andrejčuk, Zlatko Drmač, Yannis Kevrekidis, Igor Mezić

Abstract: We consider the training process of a neural network as a dynamical system acting on the high-dimensional weight space. Each epoch is an application of the map induced by the optimization algorithm and the loss function. Using this induced map, we can apply observables on the weight space and measure their evolution. The evolution of the observables are given by the Koopman operator associated wit… ▽ More We consider the training process of a neural network as a dynamical system acting on the high-dimensional weight space. Each epoch is an application of the map induced by the optimization algorithm and the loss function. Using this induced map, we can apply observables on the weight space and measure their evolution. The evolution of the observables are given by the Koopman operator associated with the induced dynamical system. We use the spectrum and modes of the Koopman operator to realize the above objectives. Our methods can help to, a priori, determine the network depth; determine if we have a bad initialization of the network weights, allowing a restart before training too long; speeding up the training time. Additionally, our methods help enable noise rejection and improve robustness. We show how the Koopman spectrum can be used to determine the number of layers required for the architecture. Additionally, we show how we can elucidate the convergence versus non-convergence of the training process by monitoring the spectrum, in particular, how the existence of eigenvalues clustering around 1 determines when to terminate the learning process. We also show how using Koopman modes we can selectively prune the network to speed up the training procedure. Finally, we show that incorporating loss functions based on negative Sobolev norms can allow for the reconstruction of a multi-scale signal polluted by very large amounts of noise. △ Less

Submitted 21 June, 2020; originally announced June 2020.

ACM Class: I.2.6

Apparent hysteresis in a driven system with self-organized drag

Authors: Mikko Haataja, David J. Srolovitz, Yannis G. Kevrekidis

Abstract: Interaction between extended defects and impurities lies at the heart of many physical phenomena in materials science. Here we revisit the ubiquitous problem of the driven motion of an extended defect in a field of mobile impurities, which self-organize to cause drag on the defect. Under a wide range of external conditions (e.g. drive), the defect undergoes a transition from slow to fast motion.… ▽ More Interaction between extended defects and impurities lies at the heart of many physical phenomena in materials science. Here we revisit the ubiquitous problem of the driven motion of an extended defect in a field of mobile impurities, which self-organize to cause drag on the defect. Under a wide range of external conditions (e.g. drive), the defect undergoes a transition from slow to fast motion. This transition is commonly hysteretic: the defect either moves slow or fast, depending on the initial condition. We explore such hysteresis via a kinetic Monte Carlo spin simulation combined with computational coarse-graining. Obtaining bifurcation diagrams (stable and unstable branches), we map behavior regimes in parameter space. Estimating fast-slow switching times, we determine whether a simulation or experiment will exhibit hysteresis depending on observation conditions. We believe our approach is applicable to quantifying hysteresis in a wide range of physical contexts. △ Less

Submitted 20 October, 2003; originally announced October 2003.

Comments: 11 pages (preprint format), 4 color figures in separate files

The Autohumidification Polymer Electrolyte Membrane Fuel Cell

Authors: J. B. Benziger, J. Moxley, S. Tulyani, A. Turner, A. B. Bocarsly, Y. G. Kevrekidis

Abstract: A PEM fuel cell was specially constructed to determine kinetics under conditions of well-defined gas phase composition and cell temperature. Steady state multiplicity was discovered in the autohumidification PEM fuel cell, resulting from a balance between water production and water removal. Ignition was observed in the PEM fuel cell for a critical water activity of about 0.1. Ignition is a conse… ▽ More A PEM fuel cell was specially constructed to determine kinetics under conditions of well-defined gas phase composition and cell temperature. Steady state multiplicity was discovered in the autohumidification PEM fuel cell, resulting from a balance between water production and water removal. Ignition was observed in the PEM fuel cell for a critical water activity of about 0.1. Ignition is a consequence of the exponential increase of proton conductivity with water activity, which creates an autocatalytic feedback between the water production and the proton conduction. The steady state current in the ignited state decreases with increasing temperature between 50 to 105 deg C. At temperatures greater than 70 deg C five steady states were observed in the PEM fuel cell. The steady state performance has been followed with variable load resistance and hysteresis loops have been mapped. The dynamics of transitions between steady states are slow about 10^3 to 10^4 s. These slow dynamics are suggested to result from a coupling of mechanical and chemical properties of the membrane electrode assembly due to swelling of the membrane with water absorption. △ Less

Submitted 16 June, 2003; originally announced June 2003.

Comments: 32 pages, 17 figures