-
Attractor Stability in Finite Asynchronous Biological System Models
Authors:
Henning S. Mortveit,
Ryan Pederson
Abstract:
We present mathematical techniques for exhaustive studies of long-term dynamics of asynchronous biological system models. Specifically, we extend the notion of $κ$-equivalence developed for graph dynamical systems to support systematic analysis of all possible attractor configurations that can be generated when varying the asynchronous update order (Macauley and Mortveit (2009)). We extend earlier…
▽ More
We present mathematical techniques for exhaustive studies of long-term dynamics of asynchronous biological system models. Specifically, we extend the notion of $κ$-equivalence developed for graph dynamical systems to support systematic analysis of all possible attractor configurations that can be generated when varying the asynchronous update order (Macauley and Mortveit (2009)). We extend earlier work by Veliz-Cuba and Stigler (2011), Goles et al. (2014), and others by comparing long-term dynamics up to topological conjugation: rather than comparing the exact states and their transitions on attractors, we only compare the attractor structures. In general, obtaining this information is computationally intractable. Here, we adapt and apply combinatorial theory for dynamical systems to develop computational methods that greatly reduce this computational cost. We give a detailed algorithm and apply it to ($i$) the lac operon model for Escherichia coli proposed by Veliz-Cuba and Stigler (2011), and ($ii$) the regulatory network involved in the control of the cell cycle and cell differentiation in the Caenorhabditis elegans vulva precursor cells proposed by Weinstein et al. (2015). In both cases, we uncover all possible limit cycle structures for these networks under sequential updates. Specifically, for the lac operon model, rather than examining all $10! > 3.6 \cdot 10^6$ sequential update orders, we demonstrate that it is sufficient to consider $344$ representative update orders, and, more notably, that these $344$ representatives give rise to $4$ distinct attractor structures. A similar analysis performed for the C. elegans model demonstrates that it has precisely $125$ distinct attractor structures. We conclude with observations on the variety and distribution of the models' attractor structures and use the results to discuss their robustness.
△ Less
Submitted 24 August, 2022;
originally announced August 2022.
-
How Well Does Kohn-Sham Regularizer Work for Weakly Correlated Systems?
Authors:
Bhupalee Kalita,
Ryan Pederson,
Jielun Chen,
Li Li,
Kieron Burke
Abstract:
Kohn-Sham regularizer (KSR) is a differentiable machine learning approach to finding the exchange-correlation functional in Kohn-Sham density functional theory (DFT) that works for strongly correlated systems. Here we test KSR for weak correlation. We propose spin-adapted KSR (sKSR) with trainable local, semilocal, and nonlocal approximations found by minimizing density and total energy loss. We a…
▽ More
Kohn-Sham regularizer (KSR) is a differentiable machine learning approach to finding the exchange-correlation functional in Kohn-Sham density functional theory (DFT) that works for strongly correlated systems. Here we test KSR for weak correlation. We propose spin-adapted KSR (sKSR) with trainable local, semilocal, and nonlocal approximations found by minimizing density and total energy loss. We assess the atoms-to-molecules generalizability by training on one-dimensional (1D) H, He, Li, Be, Be$^{++}$ and testing on 1D hydrogen chains, LiH, BeH$_2$, and helium hydride complexes. The generalization error from our semilocal approximation is comparable to other differentiable approaches, but our nonlocal functional outperforms any existing machine learning functionals, predicting ground-state energies of test systems with a mean absolute error of 2.7 milli-Hartrees.
△ Less
Submitted 21 March, 2022; v1 submitted 27 October, 2021;
originally announced October 2021.
-
Kohn-Sham equations as regularizer: building prior knowledge into machine-learned physics
Authors:
Li Li,
Stephan Hoyer,
Ryan Pederson,
Ruoxi Sun,
Ekin D. Cubuk,
Patrick Riley,
Kieron Burke
Abstract:
Including prior knowledge is important for effective machine learning models in physics, and is usually achieved by explicitly adding loss terms or constraints on model architectures. Prior knowledge embedded in the physics computation itself rarely draws attention. We show that solving the Kohn-Sham equations when training neural networks for the exchange-correlation functional provides an implic…
▽ More
Including prior knowledge is important for effective machine learning models in physics, and is usually achieved by explicitly adding loss terms or constraints on model architectures. Prior knowledge embedded in the physics computation itself rarely draws attention. We show that solving the Kohn-Sham equations when training neural networks for the exchange-correlation functional provides an implicit regularization that greatly improves generalization. Two separations suffice for learning the entire one-dimensional H$_2$ dissociation curve within chemical accuracy, including the strongly correlated region. Our models also generalize to unseen types of molecules and overcome self-interaction error.
△ Less
Submitted 17 November, 2020; v1 submitted 17 September, 2020;
originally announced September 2020.
