-
Statistical Mechanics of Dynamical System Identification
Authors:
Andrei A. Klishin,
Joseph Bakarji,
J. Nathan Kutz,
Krithika Manohar
Abstract:
Recovering dynamical equations from observed noisy data is the central challenge of system identification. We develop a statistical mechanical approach to analyze sparse equation discovery algorithms, which typically balance data fit and parsimony through a trial-and-error selection of hyperparameters. In this framework, statistical mechanics offers tools to analyze the interplay between complexit…
▽ More
Recovering dynamical equations from observed noisy data is the central challenge of system identification. We develop a statistical mechanical approach to analyze sparse equation discovery algorithms, which typically balance data fit and parsimony through a trial-and-error selection of hyperparameters. In this framework, statistical mechanics offers tools to analyze the interplay between complexity and fitness, in analogy to that done between entropy and energy. To establish this analogy, we define the optimization procedure as a two-level Bayesian inference problem that separates variable selection from coefficient values and enables the computation of the posterior parameter distribution in closed form. A key advantage of employing statistical mechanical concepts, such as free energy and the partition function, is in the quantification of uncertainty, especially in in the low-data limit; frequently encountered in real-world applications. As the data volume increases, our approach mirrors the thermodynamic limit, leading to distinct sparsity- and noise-induced phase transitions that delineate correct from incorrect identification. This perspective of sparse equation discovery, is versatile and can be adapted to various other equation discovery algorithms.
△ Less
Submitted 3 March, 2024;
originally announced March 2024.
-
Data-Induced Interactions of Sparse Sensors
Authors:
Andrei A. Klishin,
J. Nathan Kutz,
Krithika Manohar
Abstract:
Large-dimensional empirical data in science and engineering frequently has low-rank structure and can be represented as a combination of just a few eigenmodes. Because of this structure, we can use just a few spatially localized sensor measurements to reconstruct the full state of a complex system. The quality of this reconstruction, especially in the presence of sensor noise, depends significantl…
▽ More
Large-dimensional empirical data in science and engineering frequently has low-rank structure and can be represented as a combination of just a few eigenmodes. Because of this structure, we can use just a few spatially localized sensor measurements to reconstruct the full state of a complex system. The quality of this reconstruction, especially in the presence of sensor noise, depends significantly on the spatial configuration of the sensors. Multiple algorithms based on gappy interpolation and QR factorization have been proposed to optimize sensor placement. Here, instead of an algorithm that outputs a singular "optimal" sensor configuration, we take a thermodynamic view to compute the full landscape of sensor interactions induced by the training data. The landscape takes the form of the Ising model in statistical physics, and accounts for both the data variance captured at each sensor location and the crosstalk between sensors. Map** out these data-induced sensor interactions allows combining them with external selection criteria and anticipating sensor replacement impacts.
△ Less
Submitted 21 July, 2023;
originally announced July 2023.
-
Data-driven discovery and extrapolation of parameterized pattern-forming dynamics
Authors:
Zachary G. Nicolaou,
Guanyu Huo,
Yihui Chen,
Steven L. Brunton,
J. Nathan Kutz
Abstract:
Pattern-forming systems can exhibit a diverse array of complex behaviors as external parameters are varied, enabling a variety of useful functions in biological and engineered systems. First-principles derivations of the underlying transitions can be characterized using bifurcation theory on model systems whose governing equations are known. In contrast, data-driven methods for more complicated an…
▽ More
Pattern-forming systems can exhibit a diverse array of complex behaviors as external parameters are varied, enabling a variety of useful functions in biological and engineered systems. First-principles derivations of the underlying transitions can be characterized using bifurcation theory on model systems whose governing equations are known. In contrast, data-driven methods for more complicated and realistic systems whose governing evolution dynamics are unknown have only recently been developed. Here we develop a data-driven approach, the {\em sparse identification for nonlinear dynamics with control parameters} (SINDyCP), to discover dynamics for systems with adjustable control parameters, such as an external driving strength. We demonstrate the method on systems of varying complexity, ranging from discrete maps to systems of partial differential equations. To mitigate the impact of measurement noise, we also develop a weak formulation of SINDyCP and assess its performance on noisy data. We demonstrate applications including the discovery of universal pattern-formation equations, and their bifurcation dependencies, directly from data accessible from experiments and the extrapolation of predictions beyond the weakly nonlinear regime near the onset of an instability.
△ Less
Submitted 16 November, 2023; v1 submitted 6 January, 2023;
originally announced January 2023.
-
Machine Learning in Heterogeneous Porous Materials
Authors:
Marta D'Elia,
Hang Deng,
Cedric Fraces,
Krishna Garikipati,
Lori Graham-Brady,
Amanda Howard,
George Karniadakis,
Vahid Keshavarzzadeh,
Robert M. Kirby,
Nathan Kutz,
Chunhui Li,
Xing Liu,
Hannah Lu,
Pania Newell,
Daniel O'Malley,
Masa Prodanovic,
Gowri Srinivasan,
Alexandre Tartakovsky,
Daniel M. Tartakovsky,
Hamdi Tchelepi,
Bozo Vazic,
Hari Viswanathan,
Hongkyu Yoon,
Piotr Zarzycki
Abstract:
The "Workshop on Machine learning in heterogeneous porous materials" brought together international scientific communities of applied mathematics, porous media, and material sciences with experts in the areas of heterogeneous materials, machine learning (ML) and applied mathematics to identify how ML can advance materials research. Within the scope of ML and materials research, the goal of the wor…
▽ More
The "Workshop on Machine learning in heterogeneous porous materials" brought together international scientific communities of applied mathematics, porous media, and material sciences with experts in the areas of heterogeneous materials, machine learning (ML) and applied mathematics to identify how ML can advance materials research. Within the scope of ML and materials research, the goal of the workshop was to discuss the state-of-the-art in each community, promote crosstalk and accelerate multi-disciplinary collaborative research, and identify challenges and opportunities. As the end result, four topic areas were identified: ML in predicting materials properties, and discovery and design of novel materials, ML in porous and fractured media and time-dependent phenomena, Multi-scale modeling in heterogeneous porous materials via ML, and Discovery of materials constitutive laws and new governing equations. This workshop was part of the AmeriMech Symposium series sponsored by the National Academies of Sciences, Engineering and Medicine and the U.S. National Committee on Theoretical and Applied Mechanics.
△ Less
Submitted 4 February, 2022;
originally announced February 2022.
-
Feedback through graph motifs relates structure and function in complex networks
Authors:
Yu Hu,
Steven L. Brunton,
Nicholas Cain,
Stefan Mihalas,
J. Nathan Kutz,
Eric Shea-Brown
Abstract:
In physics, biology and engineering, network systems abound. How does the connectivity of a network system combine with the behavior of its individual components to determine its collective function? We approach this question for networks with linear time-invariant dynamics by relating internal network feedbacks to the statistical prevalence of connectivity motifs, a set of surprisingly simple and…
▽ More
In physics, biology and engineering, network systems abound. How does the connectivity of a network system combine with the behavior of its individual components to determine its collective function? We approach this question for networks with linear time-invariant dynamics by relating internal network feedbacks to the statistical prevalence of connectivity motifs, a set of surprisingly simple and local statistics of connectivity. This results in a reduced order model of the network input-output dynamics in terms of motifs structures. As an example, the new formulation dramatically simplifies the classic Erdos-Renyi graph, reducing the overall network behavior to one proportional feedback wrapped around the dynamics of a single node. For general networks, higher-order motifs systematically provide further layers and types of feedback to regulate the network response. Thus, the local connectivity shapes temporal and spectral processing by the network as a whole, and we show how this enables robust, yet tunable, functionality such as extending the time constant with which networks remember past signals. The theory also extends to networks composed from heterogeneous nodes with distinct dynamics and connectivity, and patterned input to (and readout from) subsets of nodes. These statistical descriptions provide a powerful theoretical framework to understand the functionality of real-world network systems, as we illustrate with examples including the mouse brain connectome.
△ Less
Submitted 18 December, 2018; v1 submitted 29 May, 2016;
originally announced May 2016.
-
Atomic Interactions in Precision Interferometry Using Bose-Einstein Condensates
Authors:
Alan O. Jamison,
J. Nathan Kutz,
Subhadeep Gupta
Abstract:
We present theoretical tools for predicting and reducing the effects of atomic interactions in Bose-Einstein condensate (BEC) interferometry experiments. To address mean-field shifts during free propagation, we derive a robust scaling solution that reduces the three-dimensional Gross-Pitaevskii equation to a set of three simple differential equations valid for any interaction strength. To model th…
▽ More
We present theoretical tools for predicting and reducing the effects of atomic interactions in Bose-Einstein condensate (BEC) interferometry experiments. To address mean-field shifts during free propagation, we derive a robust scaling solution that reduces the three-dimensional Gross-Pitaevskii equation to a set of three simple differential equations valid for any interaction strength. To model the other common components of a BEC interferometer---condensate splitting, manipulation, and recombination---we generalize the slowly-varying envelope reduction, providing both analytic handles and dramatically improved simulations. Applying these tools to a BEC interferometer to measure the fine structure constant (Gupta, et al., 2002), we find agreement with the results of the original experiment and demonstrate that atomic interactions do not preclude measurement to better than part-per-billion accuracy, even for atomic species with relatively large scattering lengths. These tools help make BEC interferometry a viable choice for a broad class of precision measurements.
△ Less
Submitted 26 August, 2011; v1 submitted 8 March, 2011;
originally announced March 2011.
-
Exact nonstationary solutions to the mean-field equations of motion for two-component Bose-Einstein condensates in periodic potentials
Authors:
R. Mark Bradley,
Bernard Deconinck,
J. Nathan Kutz
Abstract:
We study the dynamics of two-component Bose-Einstein condensates in periodic potentials in one dimension. Elliptic potentials which have the sinusoidal optical potential as a special case are considered. We construct exact nonstationary solutions to the mean-field equations of motion. Among the solutions are two types of temporally-periodic solutions -- in one type there are condensate oscillati…
▽ More
We study the dynamics of two-component Bose-Einstein condensates in periodic potentials in one dimension. Elliptic potentials which have the sinusoidal optical potential as a special case are considered. We construct exact nonstationary solutions to the mean-field equations of motion. Among the solutions are two types of temporally-periodic solutions -- in one type there are condensate oscillations between neighboring potential wells, while in the other the condensates oscillate from side to side within the wells. Our numerical studies of the stability of these solutions suggests the existence of one-parameter families of stable nonstationary solutions.
△ Less
Submitted 21 March, 2004;
originally announced March 2004.
-
Singular instability of exact stationary solutions of the nonlocal Gross-Pitaevskii equation
Authors:
Bernard Deconinck,
J. Nathan Kutz
Abstract:
In this paper we show numerically that for nonlinear Schrodinger type systems the presence of nonlocal perturbations can lead to a beyond-all-orders instability of stable solutions of the local equation. For the specific case of the nonlocal one-dimensional Gross-Pitaevskii equation with an external standing light wave potential, we construct exact stationary solutions for an arbitrary interacti…
▽ More
In this paper we show numerically that for nonlinear Schrodinger type systems the presence of nonlocal perturbations can lead to a beyond-all-orders instability of stable solutions of the local equation. For the specific case of the nonlocal one-dimensional Gross-Pitaevskii equation with an external standing light wave potential, we construct exact stationary solutions for an arbitrary interaction kernel. As the nonlocal and local equations approach each other (by letting an appropriate small parameter $ε\to 0$), we compare the dynamics of the respective solutions. By considering the time of onset of instability, the singular nature of the inclusion of nonlocality is demonstrated, independent of the form of the interaction kernel.
△ Less
Submitted 22 August, 2002;
originally announced August 2002.
-
Bose-Einstein condensates in a one-dimensional double square well: Analytical solutions of the Nonlinear Schrödinger equation and tunneling splittings
Authors:
K. W. Mahmud,
J. N. Kutz,
W. P. Reinhardt
Abstract:
We present a representative set of analytic stationary state solutions of the Nonlinear Schrödinger equation for a symmetric double square well potential for both attractive and repulsive nonlinearity. In addition to the usual symmetry preserving even and odd states, nonlinearity introduces quite exotic symmetry breaking solutions - among them are trains of solitons with different number and siz…
▽ More
We present a representative set of analytic stationary state solutions of the Nonlinear Schrödinger equation for a symmetric double square well potential for both attractive and repulsive nonlinearity. In addition to the usual symmetry preserving even and odd states, nonlinearity introduces quite exotic symmetry breaking solutions - among them are trains of solitons with different number and sizes of density lumps in the two wells. We use the symmetry breaking localized solutions to form macroscopic quantum superpositions states and explore a simple model for the exponentially small tunneling splitting.
△ Less
Submitted 6 February, 2003; v1 submitted 26 June, 2002;
originally announced June 2002.
-
Dynamics and Stability of Bose-Einstein Condensates: the Nonlinear Schrodinger Equation with Periodic Potential
Authors:
Bernard Deconinck,
Bela A. Frigyik,
J. Nathan Kutz
Abstract:
The cubic nonlinear Schrodinger equation with a lattice potential is used to model a periodic dilute gas Bose-Einstein condensate. Both two- and three-dimensional condensates are considered, for atomic species with either repulsive or attractive interactions. A family of exact solutions and corresponding potential is presented in terms of elliptic functions. The dynamical stability of these exac…
▽ More
The cubic nonlinear Schrodinger equation with a lattice potential is used to model a periodic dilute gas Bose-Einstein condensate. Both two- and three-dimensional condensates are considered, for atomic species with either repulsive or attractive interactions. A family of exact solutions and corresponding potential is presented in terms of elliptic functions. The dynamical stability of these exact solutions is examined using both analytical and numerical methods. For condensates with repulsive atomic interactions, all stable, trivial-phase solutions are off-set from the zero level. For condensates with attractive atomic interactions, no stable solutions are found, in contrast to the one-dimensional case.
△ Less
Submitted 12 June, 2001;
originally announced June 2001.
-
Stability of exact solutions of the defocusing nonlinear Schrodinger equation with periodic potential in two dimensions
Authors:
Bernard Deconinck,
Bela A. Frigyik,
J. Nathan Kutz
Abstract:
The cubic nonlinear Schrodinger equation with repulsive nonlinearity and elliptic function potential in two-dimensions models a repulsive dilute gas Bose--Einstein condensate in a lattice potential. A family of exact stationary solutions is presented and its stability is examined using analytical and numerical methods. All stable trivial-phase solutions are off-set from the zero level. Our resul…
▽ More
The cubic nonlinear Schrodinger equation with repulsive nonlinearity and elliptic function potential in two-dimensions models a repulsive dilute gas Bose--Einstein condensate in a lattice potential. A family of exact stationary solutions is presented and its stability is examined using analytical and numerical methods. All stable trivial-phase solutions are off-set from the zero level. Our results imply that a large number of condensed atoms is sufficient to form a stable, periodic condensate.
△ Less
Submitted 31 January, 2001;
originally announced January 2001.
-
Stability of Attractive Bose-Einstein Condensates in a Periodic Potential
Authors:
J. C. Bronski,
L. D. Carr,
R. Carretero-Gonzalez,
B. Deconinck,
J. N. Kutz,
K. Promislow
Abstract:
Using a standing light wave trap, a stable quasi-one-dimensional attractive dilute-gas Bose-Einstein condensate can be realized. In a mean-field approximation, this phenomenon is modeled by the cubic nonlinear Schrödinger equation with attractive nonlinearity and an elliptic function potential of which a standing light wave is a special case. New families of stationary solutions are presented. S…
▽ More
Using a standing light wave trap, a stable quasi-one-dimensional attractive dilute-gas Bose-Einstein condensate can be realized. In a mean-field approximation, this phenomenon is modeled by the cubic nonlinear Schrödinger equation with attractive nonlinearity and an elliptic function potential of which a standing light wave is a special case. New families of stationary solutions are presented. Some of these solutions have neither an analog in the linear Schrödinger equation nor in the integrable nonlinear Schrödinger equation. Their stability is examined using analytic and numerical methods. Trivial-phase solutions are experimentally stable provided they have nodes and their density is localized in the troughs of the potential. Stable time-periodic solutions are also examined.
△ Less
Submitted 6 December, 2000;
originally announced December 2000.
-
Stability of Repulsive Bose-Einstein Condensates in a Periodic Potential
Authors:
J. C. Bronski,
L. D. Carr,
B. Deconinck,
J. N. Kutz,
K. Promislow
Abstract:
The cubic nonlinear Schrödinger equation with repulsive nonlinearity and an elliptic function potential models a quasi-one-dimensional repulsive dilute gas Bose-Einstein condensate trapped in a standing light wave. New families of stationary solutions are presented. Some of these solutions have neither an analog in the linear Schrödinger equation nor in the integrable nonlinear Schrödinger equat…
▽ More
The cubic nonlinear Schrödinger equation with repulsive nonlinearity and an elliptic function potential models a quasi-one-dimensional repulsive dilute gas Bose-Einstein condensate trapped in a standing light wave. New families of stationary solutions are presented. Some of these solutions have neither an analog in the linear Schrödinger equation nor in the integrable nonlinear Schrödinger equation. Their stability is examined using analytic and numerical methods. All trivial-phase stable solutions are deformations of the ground state of the linear Schrödinger equation. Our results show that a large number of condensed atoms is sufficient to form a stable, periodic condensate. Physically, this implies stability of states near the Thomas-Fermi limit.
△ Less
Submitted 5 October, 2000;
originally announced October 2000.
-
Bose-Einstein condensates in standing waves: The cubic nonlinear Schroedinger equation with a periodic potential
Authors:
Jared C. Bronski,
Lincoln D. Carr,
Bernard Deconinck,
J. Nathan Kutz
Abstract:
We present a new family of stationary solutions to the cubic nonlinear Schroedinger equation with a Jacobian elliptic function potential. In the limit of a sinusoidal potential our solutions model a dilute gas Bose-Einstein condensate trapped in a standing light wave. Provided the ratio of the height of the variations of the condensate to its DC offset is small enough, both trivial phase and non…
▽ More
We present a new family of stationary solutions to the cubic nonlinear Schroedinger equation with a Jacobian elliptic function potential. In the limit of a sinusoidal potential our solutions model a dilute gas Bose-Einstein condensate trapped in a standing light wave. Provided the ratio of the height of the variations of the condensate to its DC offset is small enough, both trivial phase and nontrivial phase solutions are shown to be stable. Numerical simulations suggest such stationary states are experimentally observable.
△ Less
Submitted 11 July, 2000;
originally announced July 2000.
-
Stability of stationary states in the cubic nonlinear Schroedinger equation: applications to the Bose-Einstein condensate
Authors:
Lincoln D. Carr,
J. Nathan Kutz,
William P. Reinhardt
Abstract:
The stability properties and perturbation-induced dynamics of the full set of stationary states of the nonlinear Schroedinger equation are investigated numerically in two physical contexts: periodic solutions on a ring and confinement by a harmonic potential. Our comprehensive studies emphasize physical interpretations useful to experimentalists. Perturbation by stochastic white noise, phase eng…
▽ More
The stability properties and perturbation-induced dynamics of the full set of stationary states of the nonlinear Schroedinger equation are investigated numerically in two physical contexts: periodic solutions on a ring and confinement by a harmonic potential. Our comprehensive studies emphasize physical interpretations useful to experimentalists. Perturbation by stochastic white noise, phase engineering, and higher order nonlinearity are considered. We treat both attractive and repulsive nonlinearity and illustrate the soliton-train nature of the stationary states.
△ Less
Submitted 6 July, 2000;
originally announced July 2000.