-
Let's do the time-warp-attend: Learning topological invariants of dynamical systems
Authors:
Noa Moriel,
Matthew Ricci,
Mor Nitzan
Abstract:
Dynamical systems across the sciences, from electrical circuits to ecological networks, undergo qualitative and often catastrophic changes in behavior, called bifurcations, when their underlying parameters cross a threshold. Existing methods predict oncoming catastrophes in individual systems but are primarily time-series-based and struggle both to categorize qualitative dynamical regimes across d…
▽ More
Dynamical systems across the sciences, from electrical circuits to ecological networks, undergo qualitative and often catastrophic changes in behavior, called bifurcations, when their underlying parameters cross a threshold. Existing methods predict oncoming catastrophes in individual systems but are primarily time-series-based and struggle both to categorize qualitative dynamical regimes across diverse systems and to generalize to real data. To address this challenge, we propose a data-driven, physically-informed deep-learning framework for classifying dynamical regimes and characterizing bifurcation boundaries based on the extraction of topologically invariant features. We focus on the paradigmatic case of the supercritical Hopf bifurcation, which is used to model periodic dynamics across a wide range of applications. Our convolutional attention method is trained with data augmentations that encourage the learning of topological invariants which can be used to detect bifurcation boundaries in unseen systems and to design models of biological systems like oscillatory gene regulatory networks. We further demonstrate our method's use in analyzing real data by recovering distinct proliferation and differentiation dynamics along pancreatic endocrinogenesis trajectory in gene expression space based on single-cell data. Our method provides valuable insights into the qualitative, long-term behavior of a wide range of dynamical systems, and can detect bifurcations or catastrophic transitions in large-scale physical and biological systems.
△ Less
Submitted 21 March, 2024; v1 submitted 14 December, 2023;
originally announced December 2023.
-
Phase2vec: Dynamical systems embedding with a physics-informed convolutional network
Authors:
Matthew Ricci,
Noa Moriel,
Zoe Piran,
Mor Nitzan
Abstract:
Dynamical systems are found in innumerable forms across the physical and biological sciences, yet all these systems fall naturally into universal equivalence classes: conservative or dissipative, stable or unstable, compressible or incompressible. Predicting these classes from data remains an essential open challenge in computational physics at which existing time-series classification methods str…
▽ More
Dynamical systems are found in innumerable forms across the physical and biological sciences, yet all these systems fall naturally into universal equivalence classes: conservative or dissipative, stable or unstable, compressible or incompressible. Predicting these classes from data remains an essential open challenge in computational physics at which existing time-series classification methods struggle. Here, we propose, \texttt{phase2vec}, an embedding method that learns high-quality, physically-meaningful representations of 2D dynamical systems without supervision. Our embeddings are produced by a convolutional backbone that extracts geometric features from flow data and minimizes a physically-informed vector field reconstruction loss. In an auxiliary training period, embeddings are optimized so that they robustly encode the equations of unseen data over and above the performance of a per-equation fitting method. The trained architecture can not only predict the equations of unseen data, but also, crucially, learns embeddings that respect the underlying semantics of the embedded physical systems. We validate the quality of learned embeddings investigating the extent to which physical categories of input data can be decoded from embeddings compared to standard blackbox classifiers and state-of-the-art time series classification techniques. We find that our embeddings encode important physical properties of the underlying data, including the stability of fixed points, conservation of energy, and the incompressibility of flows, with greater fidelity than competing methods. We finally apply our embeddings to the analysis of meteorological data, showing we can detect climatically meaningful features. Collectively, our results demonstrate the viability of embedding approaches for the discovery of dynamical features in physical systems.
△ Less
Submitted 26 February, 2023; v1 submitted 7 December, 2022;
originally announced December 2022.
-
Optimizing testing policies for detecting COVID-19 outbreaks
Authors:
Janni Yuval,
Mor Nitzan,
Neta Ravid Tannenbaum,
Boaz Barak
Abstract:
The COVID-19 pandemic poses challenges for continuing economic activity while reducing health risks. While these challenges can be mitigated through testing, testing budget is often limited. Here we study how institutions, such as nursing homes, should utilize a fixed test budget for early detection of an outbreak. Using an extended network-SEIR model, we show that given a certain budget of tests,…
▽ More
The COVID-19 pandemic poses challenges for continuing economic activity while reducing health risks. While these challenges can be mitigated through testing, testing budget is often limited. Here we study how institutions, such as nursing homes, should utilize a fixed test budget for early detection of an outbreak. Using an extended network-SEIR model, we show that given a certain budget of tests, it is generally better to test smaller subgroups of the population frequently than to test larger groups but less frequently. The numerical results are consistent with an analytical expression we derive for the size of the outbreak at detection in an exponential spread model. Our work provides a simple guideline for institutions: distribute your total tests over several batches instead of using them all at once. We expect that in the appropriate scenarios, this easy-to-implement policy recommendation will lead to earlier detection and better mitigation of local COVID-19 outbreaks.
△ Less
Submitted 1 January, 2021; v1 submitted 9 July, 2020;
originally announced July 2020.
-
Unified framework for modeling multivariate distributions in biological sequences
Authors:
Justas Dauparas,
Haobo Wang,
Avi Swartz,
Peter Koo,
Mor Nitzan,
Sergey Ovchinnikov
Abstract:
Revealing the functional sites of biological sequences, such as evolutionary conserved, structurally interacting or co-evolving protein sites, is a fundamental, and yet challenging task. Different frameworks and models were developed to approach this challenge, including Position-Specific Scoring Matrices, Markov Random Fields, Multivariate Gaussian models and most recently Autoencoders. Each of t…
▽ More
Revealing the functional sites of biological sequences, such as evolutionary conserved, structurally interacting or co-evolving protein sites, is a fundamental, and yet challenging task. Different frameworks and models were developed to approach this challenge, including Position-Specific Scoring Matrices, Markov Random Fields, Multivariate Gaussian models and most recently Autoencoders. Each of these methods has certain advantages, and while they have generated a set of insights for better biological predictions, these have been restricted to the corresponding methods and were difficult to translate to the complementary domains. Here we propose a unified framework for the above-mentioned models, that allows for interpretable transformations between the different methods and naturally incorporates the advantages and insight gained individually in the different communities. We show how, by using the unified framework, we are able to achieve state-of-the-art performance for protein structure prediction, while enhancing interpretability of the prediction process.
△ Less
Submitted 6 June, 2019;
originally announced June 2019.
-
Statistical Optimal Transport via Factored Couplings
Authors:
Aden Forrow,
Jan-Christian Hütter,
Mor Nitzan,
Philippe Rigollet,
Geoffrey Schiebinger,
Jonathan Weed
Abstract:
We propose a new method to estimate Wasserstein distances and optimal transport plans between two probability distributions from samples in high dimension. Unlike plug-in rules that simply replace the true distributions by their empirical counterparts, our method promotes couplings with low transport rank, a new structural assumption that is similar to the nonnegative rank of a matrix. Regularizin…
▽ More
We propose a new method to estimate Wasserstein distances and optimal transport plans between two probability distributions from samples in high dimension. Unlike plug-in rules that simply replace the true distributions by their empirical counterparts, our method promotes couplings with low transport rank, a new structural assumption that is similar to the nonnegative rank of a matrix. Regularizing based on this assumption leads to drastic improvements on high-dimensional data for various tasks, including domain adaptation in single-cell RNA sequencing data. These findings are supported by a theoretical analysis that indicates that the transport rank is key in overcoming the curse of dimensionality inherent to data-driven optimal transport.
△ Less
Submitted 9 November, 2018; v1 submitted 19 June, 2018;
originally announced June 2018.
-
Model-free inference of direct network interactions from nonlinear collective dynamics
Authors:
Jose Casadiego,
Mor Nitzan,
Sarah Hallerberg,
Marc Timme
Abstract:
The topology of interactions in network dynamical systems fundamentally underlies their function. Accelerating technological progress creates massively available data about collective nonlinear dynamics in physical, biological, and technological systems. Detecting direct interaction patterns from those dynamics still constitutes a major open problem. In particular, current nonlinear dynamics appro…
▽ More
The topology of interactions in network dynamical systems fundamentally underlies their function. Accelerating technological progress creates massively available data about collective nonlinear dynamics in physical, biological, and technological systems. Detecting direct interaction patterns from those dynamics still constitutes a major open problem. In particular, current nonlinear dynamics approaches mostly require to know a priori a model of the (often high dimensional) system dynamics. Here we develop a model-independent framework for inferring direct interactions solely from recording the nonlinear collective dynamics generated. Introducing an explicit dependency matrix in combination with a block-orthogonal regression algorithm, the approach works reliably across many dynamical regimes, including transient dynamics toward steady states, periodic and non-periodic dynamics, and chaos. Together with its capabilities to reveal network (two point) as well as hypernetwork (e.g., three point) interactions, this framework may thus open up nonlinear dynamics options of inferring direct interaction patterns across systems where no model is known.
△ Less
Submitted 17 January, 2018;
originally announced January 2018.
-
Revealing physical interaction networks from statistics of collective dynamics
Authors:
Mor Nitzan,
Jose Casadiego,
Marc Timme
Abstract:
Revealing physical interactions in complex systems from observed collective dynamics constitutes a fundamental inverse problem in science. Current reconstruction methods require access to a system's model or dynamical data at a level of detail often not available. We exploit changes in invariant measures, in particular distributions of sampled states of the system in response to driving signals, a…
▽ More
Revealing physical interactions in complex systems from observed collective dynamics constitutes a fundamental inverse problem in science. Current reconstruction methods require access to a system's model or dynamical data at a level of detail often not available. We exploit changes in invariant measures, in particular distributions of sampled states of the system in response to driving signals, and use compressed sensing to reveal physical interaction networks. Dynamical observations following driving suffice to infer physical connectivity even if they are temporally disordered, are acquired at large sampling intervals, and stem from different experiments. Testing various nonlinear dynamic processes emerging on artificial and real network topologies indicates high reconstruction quality for existence as well as type of interactions. These results advance our ability to reveal physical interaction networks in complex synthetic and natural systems.
△ Less
Submitted 17 January, 2018;
originally announced January 2018.
-
Flexible Level-1 Consensus Ensuring Stable Social Choice: Analysis and Algorithms
Authors:
Mor Nitzan,
Shmuel Nitzan,
Erel Segal-Halevi
Abstract:
Level-1 Consensus is a property of a preference-profile. Intuitively, it means that there exists a preference relation which induces an ordering of all other preferences such that frequent preferences are those that are more similar to it. This is a desirable property, since it enhances the stability of social choice by guaranteeing that there exists a Condorcet winner and it is elected by all sco…
▽ More
Level-1 Consensus is a property of a preference-profile. Intuitively, it means that there exists a preference relation which induces an ordering of all other preferences such that frequent preferences are those that are more similar to it. This is a desirable property, since it enhances the stability of social choice by guaranteeing that there exists a Condorcet winner and it is elected by all scoring rules.
In this paper, we present an algorithm for checking whether a given preference profile exhibits level-1 consensus. We apply this algorithm to a large number of preference profiles, both real and randomly-generated, and find that level-1 consensus is very improbable. We support these empirical findings theoretically, by showing that, under the impartial culture assumption, the probability of level-1 consensus approaches zero when the number of individuals approaches infinity.
Motivated by these observations, we show that the level-1 consensus property can be weakened while retaining its stability implications. We call this weaker property Flexible Consensus. We show, both empirically and theoretically, that it is considerably more probable than the original level-1 consensus. In particular, under the impartial culture assumption, the probability for Flexible Consensus converges to a positive number when the number of individuals approaches infinity.
△ Less
Submitted 19 December, 2017; v1 submitted 20 April, 2017;
originally announced April 2017.
-
Distance distribution in configuration model networks
Authors:
Mor Nitzan,
Eytan Katzav,
Reimer Kühn,
Ofer Biham
Abstract:
We present analytical results for the distribution of shortest path lengths between random pairs of nodes in configuration model networks. The results, which are based on recursion equations, are shown to be in good agreement with numerical simulations for networks with degenerate, binomial and power-law degree distributions. The mean, mode and variance of the distribution of shortest path lengths…
▽ More
We present analytical results for the distribution of shortest path lengths between random pairs of nodes in configuration model networks. The results, which are based on recursion equations, are shown to be in good agreement with numerical simulations for networks with degenerate, binomial and power-law degree distributions. The mean, mode and variance of the distribution of shortest path lengths are also evaluated. These results provide expressions for central measures and dispersion measures of the distribution of shortest path lengths in terms of moments of the degree distribution, illuminating the connection between the two distributions.
△ Less
Submitted 5 June, 2016; v1 submitted 14 March, 2016;
originally announced March 2016.
-
Analytical results for the distribution of shortest path lengths in random networks
Authors:
Eytan Katzav,
Mor Nitzan,
Daniel ben-Avraham,
P. L. Krapivsky,
Reimer Kühn,
Nathan Ross,
Ofer Biham
Abstract:
We present two complementary analytical approaches for calculating the distribution of shortest path lengths in Erdos-Rényi networks, based on recursion equations for the shells around a reference node and for the paths originating from it. The results are in agreement with numerical simulations for a broad range of network sizes and connectivities. The average and standard deviation of the distri…
▽ More
We present two complementary analytical approaches for calculating the distribution of shortest path lengths in Erdos-Rényi networks, based on recursion equations for the shells around a reference node and for the paths originating from it. The results are in agreement with numerical simulations for a broad range of network sizes and connectivities. The average and standard deviation of the distribution are also obtained. In the case that the mean degree scales as $N^α$ with the network size, the distribution becomes extremely narrow in the asymptotic limit, namely almost all pairs of nodes are equidistant, at distance $d=\lfloor 1/α\rfloor$ from each other. The distribution of shortest path lengths between nodes of degree $m$ and the rest of the network is calculated. Its average is shown to be a monotonically decreasing function of $m$, providing an interesting relation between a local property and a global property of the network. The methodology presented here can be applied to more general classes of networks.
△ Less
Submitted 9 August, 2015; v1 submitted 3 April, 2015;
originally announced April 2015.
-
Stochastic analysis of bistability in coherent mixed feedback loops combining transcriptional and post-transcriptional regulations
Authors:
Mor Nitzan,
Yishai Shimoni,
Oded Rosolio,
Hanah Margalit,
Ofer Biham
Abstract:
Mixed feedback loops combining transcriptional and post-transcriptional regulations are common in cellular regulatory networks. They consist of two genes, encoding a transcription factor and a small non-coding RNA (sRNA), which mutually regulate each other's expression. We present a theoretical and numerical study of coherent mixed feedback loops of this type, in which both regulations are negativ…
▽ More
Mixed feedback loops combining transcriptional and post-transcriptional regulations are common in cellular regulatory networks. They consist of two genes, encoding a transcription factor and a small non-coding RNA (sRNA), which mutually regulate each other's expression. We present a theoretical and numerical study of coherent mixed feedback loops of this type, in which both regulations are negative. Under suitable conditions, these feedback loops are expected to exhibit bistability, namely two stable states, one dominated by the transcriptional repressor and the other dominated by the sRNA. We use deterministic methods based on rate equation models, in order to identify the range of parameters in which bistability takes place. However, the deterministic models do not account for the finite lifetimes of the bistable states and the spontaneous, fluctuation-driven transitions between them. Therefore, we use stochastic methods to calculate the average lifetimes of the two states. It is found that these lifetimes strongly depend on rate coefficients such as the transcription rates of the transcriptional repressor and the sRNA. In particular, we show that the fraction of time the system spends in the sRNA dominated state follows a monotonically decreasing sigmoid function of the transcriptional repressor transcription rate. The biological relevance of these results is discussed in the context of such mixed feedback loops in {\it Escherichia coli}.
△ Less
Submitted 2 December, 2014;
originally announced December 2014.