Showing 1–50 of 161 results for author: Muñoz, M Á

Networks with many structural scales: a Renormalization Group perspective

Authors: Anna Poggialini, Pablo Villegas, Miguel A. Muñoz, Andrea Gabrielli

Abstract: Scale invariance profoundly influences the dynamics and structure of complex systems, spanning from critical phenomena to network architecture. Here, we propose a precise definition of scale-invariant networks by leveraging the concept of a constant entropy loss rate across scales in a renormalization-group coarse-graining setting. This framework enables us to differentiate between scale-free and… ▽ More Scale invariance profoundly influences the dynamics and structure of complex systems, spanning from critical phenomena to network architecture. Here, we propose a precise definition of scale-invariant networks by leveraging the concept of a constant entropy loss rate across scales in a renormalization-group coarse-graining setting. This framework enables us to differentiate between scale-free and scale-invariant networks, revealing distinct characteristics within each class. Furthermore, we offer a comprehensive inventory of genuinely scale-invariant networks, both natural and artificially constructed, demonstrating, e.g., that the human connectome exhibits notable features of scale invariance. Our findings open new avenues for exploring the scale-invariant structural properties crucial in biological and socio-technological systems. △ Less

Submitted 27 June, 2024; originally announced June 2024.

Comments: 6 pages, 4 figures and Supplemental Material

Frequency-dependent covariance reveals critical spatio-temporal patterns of synchronized activity in the human brain

Authors: Rubén Calvo, Carles Martorell, Guillermo B. Morales, Serena Di Santo, Miguel A. Muñoz

Abstract: Recent analyses combining advanced theoretical techniques and high-quality data from thousands of simultaneously recorded neurons provide strong support for the hypothesis that neural dynamics operate near the edge of instability across regions in the brain. However, these analyses, as well as related studies, often fail to capture the intricate temporal structure of brain activity as they primari… ▽ More Recent analyses combining advanced theoretical techniques and high-quality data from thousands of simultaneously recorded neurons provide strong support for the hypothesis that neural dynamics operate near the edge of instability across regions in the brain. However, these analyses, as well as related studies, often fail to capture the intricate temporal structure of brain activity as they primarily rely on time-integrated measurements across neurons. In this study, we present a novel framework designed to explore signatures of criticality across diverse frequency bands and construct a much more comprehensive description of brain activity. Additionally, we introduce a method for projecting brain activity onto a basis of spatio-temporal patterns, facilitating time-dependent dimensionality reduction. Applying this framework to a magnetoencephalography dataset, we observe significant differences in both criticality signatures and spatio-temporal activity patterns between healthy subjects and individuals with Parkinson's disease. △ Less

Submitted 22 March, 2024; originally announced March 2024.

Characterising harmful data sources when constructing multi-fidelity surrogate models

Authors: Nicolau Andrés-Thió, Mario Andrés Muñoz, Kate Smith-Miles

Abstract: Surrogate modelling techniques have seen growing attention in recent years when applied to both modelling and optimisation of industrial design problems. These techniques are highly relevant when assessing the performance of a particular design carries a high cost, as the overall cost can be mitigated via the construction of a model to be queried in lieu of the available high-cost source. The cons… ▽ More Surrogate modelling techniques have seen growing attention in recent years when applied to both modelling and optimisation of industrial design problems. These techniques are highly relevant when assessing the performance of a particular design carries a high cost, as the overall cost can be mitigated via the construction of a model to be queried in lieu of the available high-cost source. The construction of these models can sometimes employ other sources of information which are both cheaper and less accurate. The existence of these sources however poses the question of which sources should be used when constructing a model. Recent studies have attempted to characterise harmful data sources to guide practitioners in choosing when to ignore a certain source. These studies have done so in a synthetic setting, characterising sources using a large amount of data that is not available in practice. Some of these studies have also been shown to potentially suffer from bias in the benchmarks used in the analysis. In this study, we present a characterisation of harmful low-fidelity sources using only the limited data available to train a surrogate model. We employ recently developed benchmark filtering techniques to conduct a bias-free assessment, providing objectively varied benchmark suites of different sizes for future research. Analysing one of these benchmark suites with the technique known as Instance Space Analysis, we provide an intuitive visualisation of when a low-fidelity source should be used and use this analysis to provide guidelines that can be used in an applied industrial setting. △ Less

Submitted 12 March, 2024; originally announced March 2024.

Dynamically selected steady states and criticality in non-reciprocal networks

Authors: Carles Martorell, Rubén Calvo, Alessia Annibale, Miguel A. Muñoz

Abstract: Diverse equilibrium systems with heterogeneous interactions lie at the edge of stability. Such marginally stable states are dynamically selected as the most abundant ones or as those with the largest basins of attraction. On the other hand, systems with non-reciprocal (or asymmetric) interactions are inherently out of equilibrium, and exhibit a rich variety of steady states, including fixed points… ▽ More Diverse equilibrium systems with heterogeneous interactions lie at the edge of stability. Such marginally stable states are dynamically selected as the most abundant ones or as those with the largest basins of attraction. On the other hand, systems with non-reciprocal (or asymmetric) interactions are inherently out of equilibrium, and exhibit a rich variety of steady states, including fixed points, limit cycles and chaotic trajectories. How are steady states dynamically selected away from equilibrium? We address this question in a simple neural network model, with a tunable level of non-reciprocity. Our study reveals different types of ordered phases and it shows how non-equilibrium steady states are selected in each phase. In the spin-glass region, the system exhibits marginally stable behaviour for reciprocal (or symmetric) interactions and it smoothly transitions to chaotic dynamics, as the non-reciprocity (or asymmetry) in the couplings increases. Such region, on the other hand, shrinks and eventually disappears when couplings become anti-symmetric. Our results are relevant to advance the knowledge of disordered systems beyond the paradigm of reciprocal couplings, and to develop an interface between statistical physics of equilibrium spin-glasses and dynamical systems theory. △ Less

Submitted 19 December, 2023; originally announced December 2023.

Instance Space Analysis of Search-Based Software Testing

Authors: Neelofar Neelofar, Kate Smith-Miles, Mario Andres Munoz, Aldeida Aleti

Abstract: Search-based software testing (SBST) is now a mature area, with numerous techniques developed to tackle the challenging task of software testing. SBST techniques have shown promising results and have been successfully applied in the industry to automatically generate test cases for large and complex software systems. Their effectiveness, however, is problem-dependent. In this paper, we revisit the… ▽ More Search-based software testing (SBST) is now a mature area, with numerous techniques developed to tackle the challenging task of software testing. SBST techniques have shown promising results and have been successfully applied in the industry to automatically generate test cases for large and complex software systems. Their effectiveness, however, is problem-dependent. In this paper, we revisit the problem of objective performance evaluation of SBST techniques considering recent methodological advances -- in the form of Instance Space Analysis (ISA) -- enabling the strengths and weaknesses of SBST techniques to be visualized and assessed across the broadest possible space of problem instances (software classes) from common benchmark datasets. We identify features of SBST problems that explain why a particular instance is hard for an SBST technique, reveal areas of hard and easy problems in the instance space of existing benchmark datasets, and identify the strengths and weaknesses of state-of-the-art SBST techniques. In addition, we examine the diversity and quality of common benchmark datasets used in experimental evaluations. △ Less

Submitted 4 December, 2023; originally announced December 2023.

Journal ref: IEEE Transactions on Software Engineering, 49(4), 2642-2660 (2022)

From asynchronous states to Griffiths phases and back: structural heterogeneity and homeostasis in excitatory-inhibitory networks

Authors: Jorge Pretel, Victor Buendía, Joaquín J. Torres, Miguel A. Muñoz

Abstract: Balanced neural networks -- in which excitatory and inhibitory inputs compensate each other on average -- give rise to a dynamical phase dominated by fluctuations called asynchronous state, crucial for brain functioning. However, structural disorder -- which is inherent to random networks -- can hinder such an excitation-inhibition balance. Indeed, structural and synaptic heterogeneities can gener… ▽ More Balanced neural networks -- in which excitatory and inhibitory inputs compensate each other on average -- give rise to a dynamical phase dominated by fluctuations called asynchronous state, crucial for brain functioning. However, structural disorder -- which is inherent to random networks -- can hinder such an excitation-inhibition balance. Indeed, structural and synaptic heterogeneities can generate extended regions in phase space akin to critical points, called Griffiths phases, with dynamical features very different from those of asynchronous states. Here, we study a simple neural-network model with tunable levels of heterogeneity able to display these two types of dynamical regimes -- i.e., asynchronous states and Griffiths phases -- putting them together within a single phase diagram. Using this simple model, we are able to emphasize the crucial role played by synaptic plasticity and homeostasis to re-establish balance in intrinsically heterogeneous networks. Overall, we shed light onto how diverse dynamical regimes, each with different functional advantages, can emerge from a given network as a result of self-organizing homeostatic mechanisms. △ Less

Submitted 3 March, 2024; v1 submitted 3 October, 2023; originally announced October 2023.

Soft trade-offs and the stochastic emergence of diversification in E. coli evolution experiments

Authors: Roberto Corral López, Samir Suweis, Sandro Azaele, Miguel A. Muñoz

Abstract: Laboratory experiments of bacterial colonies (e.g., \emph{Escherichia coli}) under well-controlled conditions often lead to evolutionary diversification in which (at least) two ecotypes, each one specialized in the consumption of a different set of metabolic resources, branch out from an initially monomorphic population. Empirical evidence suggests that, even under fixed and stable conditions, suc… ▽ More Laboratory experiments of bacterial colonies (e.g., \emph{Escherichia coli}) under well-controlled conditions often lead to evolutionary diversification in which (at least) two ecotypes, each one specialized in the consumption of a different set of metabolic resources, branch out from an initially monomorphic population. Empirical evidence suggests that, even under fixed and stable conditions, such an ``evolutionary branching'' occurs in a stochastic way, meaning that: (i) it is observed in a significant fraction, but not all, of the experimental repetitions, (ii) it may emerge at broadly diverse times, and (iii) the relative abundances of the resulting subpopulations are variable across experiments. Theoretical approaches shedding light on the possible emergence of evolutionary branching in this type of conditions have been previously developed within the theory of ``adaptive dynamics''. Such approaches are typically deterministic -- or incorporate at most demographic or finite-size fluctuations which become negligible for the extremely large populations of these experiments -- and, thus, do not permit to reproduce the empirically observed large degree of variability. Here, we make further progress and shed new light on the stochastic nature of evolutionary outcomes by introducing the idea of ``soft'' trade-offs (as opposed to ``hard'' ones). This introduces a natural new source of stochasticity which allows one to account for the empirically observed variability as well as to make predictions for the likelihood of evolutionary branching to be observed, thus hel** to bridge the gap between theory and experiments. △ Less

Submitted 20 July, 2023; originally announced July 2023.

Unveiling the intrinsic dynamics of biological and artificial neural networks: from criticality to optimal representations

Authors: Guillermo B. Morales, Serena Di Santo, Miguel A. Muñoz

Abstract: Deciphering the underpinnings of the dynamical processes leading to information transmission, processing, and storing in the brain is a crucial challenge in neuroscience. An inspiring but speculative theoretical idea is that such dynamics should operate at the brink of a phase transition, i.e., at the edge between different collective phases, to entail a rich dynamical repertoire and optimize func… ▽ More Deciphering the underpinnings of the dynamical processes leading to information transmission, processing, and storing in the brain is a crucial challenge in neuroscience. An inspiring but speculative theoretical idea is that such dynamics should operate at the brink of a phase transition, i.e., at the edge between different collective phases, to entail a rich dynamical repertoire and optimize functional capabilities. In recent years, research guided by the advent of high-throughput data and new theoretical developments has contributed to making a quantitative validation of such a hypothesis. Here we review recent advances in this field, stressing our contributions. In particular, we use data from thousands of individually recorded neurons in the mouse brain and tools such as a phenomenological renormalization group analysis, theory of disordered systems, and random matrix theory. These combined approaches provide novel evidence of quasi-universal scaling and near-critical behavior emerging in different brain regions. Moreover, we design artificial neural networks under the reservoir-computing paradigm and show that their internal dynamical states become near critical when we tune the networks for optimal performance. These results not only open new perspectives for understanding the ultimate principles guiding brain function but also towards the development of brain-inspired, neuromorphic computation. △ Less

Submitted 20 July, 2023; originally announced July 2023.

Algorithm Instance Footprint: Separating Easily Solvable and Challenging Problem Instances

Authors: Ana Nikolikj, Sašo Džeroski, Mario Andrés Muñoz, Carola Doerr, Peter Korošec, Tome Eftimov

Abstract: In black-box optimization, it is essential to understand why an algorithm instance works on a set of problem instances while failing on others and provide explanations of its behavior. We propose a methodology for formulating an algorithm instance footprint that consists of a set of problem instances that are easy to be solved and a set of problem instances that are difficult to be solved, for an… ▽ More In black-box optimization, it is essential to understand why an algorithm instance works on a set of problem instances while failing on others and provide explanations of its behavior. We propose a methodology for formulating an algorithm instance footprint that consists of a set of problem instances that are easy to be solved and a set of problem instances that are difficult to be solved, for an algorithm instance. This behavior of the algorithm instance is further linked to the landscape properties of the problem instances to provide explanations of which properties make some problem instances easy or challenging. The proposed methodology uses meta-representations that embed the landscape properties of the problem instances and the performance of the algorithm into the same vector space. These meta-representations are obtained by training a supervised machine learning regression model for algorithm performance prediction and applying model explainability techniques to assess the importance of the landscape features to the performance predictions. Next, deterministic clustering of the meta-representations demonstrates that using them captures algorithm performance across the space and detects regions of poor and good algorithm performance, together with an explanation of which landscape properties are leading to it. △ Less

Submitted 1 June, 2023; originally announced June 2023.

Comments: To appear at GECCO 2023

Sparse species interactions reproduce abundance correlation patterns in microbial communities

Authors: José Camacho-Mateu, Aniello Lampo, Matteo Sireci, Miguel Ángel Muñoz, José A. Cuesta

Abstract: During the last decades macroecology has identified broad-scale patterns of abundances and diversity of microbial communities and put forward some potential explanations for them. However, these advances are not paralleled by a full understanding of the dynamical processes behind them. In particular, abundance fluctuations of different species are found to be correlated, both across time and acros… ▽ More During the last decades macroecology has identified broad-scale patterns of abundances and diversity of microbial communities and put forward some potential explanations for them. However, these advances are not paralleled by a full understanding of the dynamical processes behind them. In particular, abundance fluctuations of different species are found to be correlated, both across time and across communities in metagenomic samples. Reproducing such correlations through appropriate population models remains an open challenge. The present paper tackles this problem and points to sparse species interactions as a necessary mechanism to account for them. Specifically, we discuss several possibilities to include interactions in population models and recognize Lotka-Volterra constants as a successful ansatz. For this, we design a Bayesian inference algorithm to extract sets of interaction constants able to reproduce empirical probability distributions of pairwise correlations for diverse biomes. Importantly, the inferred models still reproduce well-known single-species macroecological patterns concerning abundance fluctuations across both species and communities. Endorsed by the agreement with the empirically observed phenomenology, our analyses provide insights on the properties of the networks of microbial interactions, revealing that sparsity is a crucial feature. △ Less

Submitted 6 December, 2023; v1 submitted 30 May, 2023; originally announced May 2023.

Journal ref: PNAS Vol. 121 (5) e2309575121 (2024)

Unconventional criticality, scaling breakdown, and diverse universality classes in the Wilson-Cowan model of neural dynamics

Authors: Helena Christina Piuvezam, Bóris Marin, Mauro Copelli, Miguel A. Muñoz

Abstract: The Wilson-Cowan model constitutes a paradigmatic approach to understanding the collective dynamics of networks of excitatory and inhibitory units. It has been profusely used in the literature to analyze the possible phases of neural networks at a mean-field level, e.g., assuming large fully-connected networks. Moreover, its stochastic counterpart allows one to study fluctuation-induced phenomena,… ▽ More The Wilson-Cowan model constitutes a paradigmatic approach to understanding the collective dynamics of networks of excitatory and inhibitory units. It has been profusely used in the literature to analyze the possible phases of neural networks at a mean-field level, e.g., assuming large fully-connected networks. Moreover, its stochastic counterpart allows one to study fluctuation-induced phenomena, such as avalanches. Here, we revisit the stochastic Wilson-Cowan model paying special attention to the possible phase transitions between quiescent and active phases. We unveil eight possible types of phase transitions, including continuous ones with scaling behavior belonging to known universality classes -- such as directed percolation and tricritical directed percolation -- as well as novel ones. In particular, we show that under some special circumstances, at a so-called Hopf tricritical directed percolation transition, rather unconventional behavior including an anomalous breakdown of scaling emerges. These results broaden our knowledge of the possible types of critical behavior in networks of excitatory and inhibitory units and are of relevance to understanding avalanche dynamics in actual neuronal recordings. From a more general perspective, these results help extend the theory of non-equilibrium phase transitions into quiescent or absorbing states. △ Less

Submitted 17 January, 2023; originally announced January 2023.

Comments: 19 pages, 11 figures

Anomalous finite-size scaling in higher-order processes with absorbing states

Authors: Alessandro Vezzani, Miguel A. Muñoz, Raffaella Burioni

Abstract: We study standard and higher-order birth-death processes on fully connected networks, within the perspective of large-deviation theory (also referred to as Wentzel-Kramers-Brillouin (WKB) method in some contexts). We obtain a general expression for the leading and next-to-leading terms of the stationary probability distribution of the fraction of "active" sites, as a function of parameters and net… ▽ More We study standard and higher-order birth-death processes on fully connected networks, within the perspective of large-deviation theory (also referred to as Wentzel-Kramers-Brillouin (WKB) method in some contexts). We obtain a general expression for the leading and next-to-leading terms of the stationary probability distribution of the fraction of "active" sites, as a function of parameters and network size $N$. We reproduce several results from the literature and, in particular, we derive all the moments of the stationary distribution for the $q$-susceptible-infected-susceptible ($q-SIS$) model, i.e., a high-order epidemic model requiring of $q$ active ("infected") sites to activate an additional one. We uncover a very rich scenario for the fluctuations of the fraction of active sites, with non-trivial finite-size-scaling properties. In particular, we show that the variance-to-mean ratio diverges at criticality for $[1 \leq q\leq 3]$, with a maximal variability at $q=2$, confirming that complex-contagion processes can exhibit peculiar scaling features including wild variability and that the leading-order in a large-deviation approach does not suffice to describe them: next-to-leading terms are essential to capture the intrinsic singularity at the origin of systems with absorbing states. △ Less

Submitted 4 January, 2023; v1 submitted 7 October, 2022; originally announced October 2022.

Comments: 10 pages, 4 figures

Journal ref: Phys. Rev. E 107, 014105 (2023)

Online Decision Making for Trading Wind Energy

Authors: Miguel Angel Muñoz, Pierre Pinson, Jalal Kazempour

Abstract: We propose and develop a new algorithm for trading wind energy in electricity markets, within an online learning and optimization framework. In particular, we combine a component-wise adaptive variant of the gradient descent algorithm with recent advances in the feature-driven newsvendor model. This results in an online offering approach capable of leveraging data-rich environments, while adapting… ▽ More We propose and develop a new algorithm for trading wind energy in electricity markets, within an online learning and optimization framework. In particular, we combine a component-wise adaptive variant of the gradient descent algorithm with recent advances in the feature-driven newsvendor model. This results in an online offering approach capable of leveraging data-rich environments, while adapting to the nonstationary characteristics of energy generation and electricity markets, also with a minimal computational burden. The performance of our approach is analyzed based on several numerical experiments, showing both better adaptability to nonstationary uncertain parameters and significant economic gains. △ Less

Submitted 19 May, 2023; v1 submitted 5 September, 2022; originally announced September 2022.

Autocorrelations from emergent bistability in homeostatic spiking neural networks on neuromorphic hardware

Authors: Benjamin Cramer, Markus Kreft, Sebastian Billaudelle, Vitali Karasenko, Aron Leibfried, Eric Müller, Philipp Spilger, Johannes Weis, Johannes Schemmel, Miguel A. Muñoz, Viola Priesemann, Johannes Zierenberg

Abstract: A unique feature of neuromorphic computing is that memory is an implicit part of processing through traces of past information in the system's collective dynamics. The extent of memory about past inputs is commonly quantified by the autocorrelation time of collective dynamics. Based on past experimental evidence, a potential explanation for the underlying autocorrelations are close-to-critical flu… ▽ More A unique feature of neuromorphic computing is that memory is an implicit part of processing through traces of past information in the system's collective dynamics. The extent of memory about past inputs is commonly quantified by the autocorrelation time of collective dynamics. Based on past experimental evidence, a potential explanation for the underlying autocorrelations are close-to-critical fluctuations. Here, we show for self-organized networks of excitatory and inhibitory leaky integrate-and-fire neurons that autocorrelations can originate from emergent bistability upon reducing external input strength. We identify the bistability as a fluctuation-induced stochastic switching between metastable active and quiescent states in the vicinity of a non-equilibrium phase transition. This bistability occurs for networks with fixed heterogeneous weights as a consequence of homeostatic self-organization during development. Specifically, in our experiments on neuromorphic hardware and in computer simulations, the emergent bistability gives rise to autocorrelation times exceeding 500 ms despite single-neuron timescales of only 20 ms. Our results provide the first verification of biologically compatible autocorrelation times in networks of leaky integrate-and-fire neurons, which here are not generated by close-to-critical fluctuations but by emergent bistability in homeostatically regulated networks. Our results thereby constitute a new, complementary mechanism for emergent autocorrelations in networks of spiking neurons, with implications for biological and artificial networks, and introduces the general paradigm of fluctuation-induced bistability for driven systems with absorbing states. △ Less

Submitted 17 August, 2022; originally announced August 2022.

Depinning in the quenched Kardar-Parisi-Zhang class I: Map**s, simulations and algorithm

Authors: Gauthier Mukerjee, Juan A. Bonachela, Miguel A. Muñoz, Kay Joerg Wiese

Abstract: Depinning of elastic systems advancing on disordered media can usually be described by the quenched Edwards-Wilkinson equation (qEW). However, additional ingredients such as anharmonicity and forces that can not be derived from a potential energy may generate a different scaling behavior at depinning. The most experimentally relevant is the Kardar-Parisi-Zhang (KPZ) term, proportional to the squar… ▽ More Depinning of elastic systems advancing on disordered media can usually be described by the quenched Edwards-Wilkinson equation (qEW). However, additional ingredients such as anharmonicity and forces that can not be derived from a potential energy may generate a different scaling behavior at depinning. The most experimentally relevant is the Kardar-Parisi-Zhang (KPZ) term, proportional to the square of the slope at each site, which drives the critical behavior into the so-called quenched KPZ (qKPZ) universality class. We study this universality class both numerically and analytically: by using exact map**s we show that at least for $d=1,2$ this class encompasses not only the qKPZ equation itself, but also anharmonic depinning and a well-known class of cellular automata introduced by Tang and Leschhorn. We develop scaling arguments for all critical exponents, including size and duration of avalanches. The scale is set by the confining potential strength $m^2$. This allows us to estimate numerically these exponents as well as the $m$-dependent effective force correlator $Δ(w)$, and its correlation length $ρ:= Δ(0)/|Δ'(0^+)|$. Finally we present a new algorithm to numerically estimate the effective ($m$-dependent) elasticity $c$, and the effective KPZ non-linearity $λ$. This allows us to define a dimensionless universal KPZ amplitude ${\cal A}:=ρλ/c$, which takes the value ${\cal A}=1.10(2)$ in all systems considered in $d=1$. This proves that qKPZ is the effective field theory for all these models. Our work paves the way for a deeper understanding of depinning in the qKPZ class, and in particular, for the construction of a field theory that we describe in a companion paper. △ Less

Submitted 21 April, 2023; v1 submitted 17 July, 2022; originally announced July 2022.

Comments: companion paper to arXiv:2207.09037. 19 pages, 17 figures. v2: accepted version

Modular architecture facilitates noise-driven control of synchrony in neuronal networks

Authors: Hideaki Yamamoto, F. Paul Spitzner, Taiki Takemuro, Victor Buendía, Carla Morante, Tomohiro Konno, Shigeo Sato, Ayumi Hirano-Iwata, Viola Priesemann, Miguel A. Muñoz, Johannes Zierenberg, Jordi Soriano

Abstract: Brain functions require both segregated processing of information in specialized circuits, as well as integration across circuits to perform high-level information processing. One possible way to implement these seemingly opposing demands is by flexibly switching between synchronous and less synchronous states. Understanding how complex synchronization patterns are controlled by the interaction of… ▽ More Brain functions require both segregated processing of information in specialized circuits, as well as integration across circuits to perform high-level information processing. One possible way to implement these seemingly opposing demands is by flexibly switching between synchronous and less synchronous states. Understanding how complex synchronization patterns are controlled by the interaction of network architecture and external perturbations is thus a central challenge in neuroscience, but the mechanisms behind such interactions remain elusive. Here, we utilise precision neuroengineering to manipulate cultured neuronal networks and show that a modular architecture facilitates desynchronization upon asynchronous stimulation, making external noise a control parameter of synchrony. Using spiking neuron models, we then demonstrate that external noise can reduce the level of available synaptic resources, which make intermodular interactions more stochastic and thereby facilitates the breakdown of synchrony. Finally, the phenomenology of stochastic intermodular interactions is formulated into a mesoscopic model that incorporates a state-dependent gating mechanism for signal propagation. Taken together, our results demonstrate a network mechanism by which asynchronous inputs tune the inherent dynamical state in structured networks of excitable units. △ Less

Submitted 21 May, 2022; originally announced May 2022.

Comments: 23 pages, 5 figures

Journal ref: Sci. Adv. 9, eade1755 (2023)

The excitatory-inhibitory branching process: a parsimonious view of cortical asynchronous states, excitability, and criticality

Authors: Roberto Corral López, Victor Buendía, Miguel A. Muñoz

Abstract: The branching process is the minimal model for propagation dynamics, avalanches and criticality, broadly used in neuroscience. A simple extension of it, adding inhibitory nodes, induces a much-richer phenomenology, including, an intermediate phase, between quiescence and saturation, that exhibits the key features of "asynchronous states" in cortical networks. Remarkably, in the inhibition-dominate… ▽ More The branching process is the minimal model for propagation dynamics, avalanches and criticality, broadly used in neuroscience. A simple extension of it, adding inhibitory nodes, induces a much-richer phenomenology, including, an intermediate phase, between quiescence and saturation, that exhibits the key features of "asynchronous states" in cortical networks. Remarkably, in the inhibition-dominated case, it exhibits an extremely-rich phase diagram, that captures a wealth of non-trivial features of spontaneous brain activity, such as collective excitability, hysteresis, tilted avalanche shapes, and partial synchronization, allowing us to rationalize striking empirical findings within a common and parsimonious framework. △ Less

Submitted 7 July, 2022; v1 submitted 30 March, 2022; originally announced March 2022.

An Instance Space Analysis of Constrained Multi-Objective Optimization Problems

Authors: Hanan Alsouly, Michael Kirley, Mario Andrés Muñoz

Abstract: Multi-objective optimization problems with constraints (CMOPs) are generally considered more challenging than those without constraints. This in part can be attributed to the creation of infeasible regions generated by the constraint functions, and/or the interaction between constraints and objectives. In this paper, we explore the relationship between constrained multi-objective evolutionary algo… ▽ More Multi-objective optimization problems with constraints (CMOPs) are generally considered more challenging than those without constraints. This in part can be attributed to the creation of infeasible regions generated by the constraint functions, and/or the interaction between constraints and objectives. In this paper, we explore the relationship between constrained multi-objective evolutionary algorithms (CMOEAs) performance and CMOP instances characteristics using Instance Space Analysis (ISA). To do this, we extend recent work focused on the use of Landscape Analysis features to characterise CMOP. Specifically, we scrutinise the multi-objective landscape and introduce new features to describe the multi-objective-violation landscape, formed by the interaction between constraint violation and multi-objective fitness. Detailed evaluation of problem-algorithm footprints spanning six CMOP benchmark suites and fifteen CMOEAs, illustrates that ISA can effectively capture the strength and weakness of the CMOEAs. We conclude that two key characteristics, the isolation of non-dominate set and the correlation between constraints and objectives evolvability, have the greatest impact on algorithm performance. However, the current benchmarks problems do not provide enough diversity to fully reveal the efficacy of CMOEAs evaluated. △ Less

Submitted 1 March, 2022; originally announced March 2022.

Journal ref: IEEE Transactions on Evolutionary Computation, 27(5)1427-1439, 2023

Quasi-universal scaling in mouse-brain neuronal activity stems from edge-of-instability critical dynamics

Authors: Guillermo B. Morales, Serena Di Santo, Miguel A. Munoz

Abstract: The brain is in a state of perpetual reverberant neural activity, even in the absence of specific tasks or stimuli. Shedding light on the origin and functional significance of such a dynamical state is essential to understanding how the brain transmits, processes, and stores information. An inspiring, albeit controversial, conjecture proposes that some statistical characteristics of empirically ob… ▽ More The brain is in a state of perpetual reverberant neural activity, even in the absence of specific tasks or stimuli. Shedding light on the origin and functional significance of such a dynamical state is essential to understanding how the brain transmits, processes, and stores information. An inspiring, albeit controversial, conjecture proposes that some statistical characteristics of empirically observed neuronal activity can be understood by assuming that brain networks operate in a dynamical regime near the edge of a phase transition. Moreover, the resulting critical behavior, with its concomitant scale invariance, is assumed to carry crucial functional advantages. Here, we present a data-driven analysis based on simultaneous high-throughput recordings of the activity of thousands of individual neurons in various regions of the mouse brain. To analyze these data, we synergistically combine cutting-edge methods for the study of brain activity (such as a phenomenological renormalization group approach and techniques that infer the general dynamical state of a neural population), while designing complementary tools. This strategy allows us to uncover strong signatures of scale invariance that is "quasi-universal" across brain regions and reveal that all these areas operate, to a greater or lesser extent, near the edge of instability. Furthermore, this framework allows us to distinguish between quasi-universal background activity and non-universal input-related activity. Taken together, this study provides strong evidence that brain networks actually operate in a critical regime which, among other functional advantages, provides them with a scale-invariant substrate of activity covariances that can sustain optimal input representations. △ Less

Submitted 7 July, 2022; v1 submitted 23 November, 2021; originally announced November 2021.

Comments: 22 pages, 5 figures

The broad edge of synchronisation: Griffiths effects and collective phenomena in brain networks

Authors: Victor Buendía, Pablo Villegas, Raffaella Burioni, Miguel A. Muñoz

Abstract: Many of the amazing functional capabilities of the brain are collective properties stemming from the interactions of large sets of individual neurons. In particular, the most salient collective phenomena in brain activity are oscillations, which require the synchronous activation of many neurons. Here, we analyse parsimonious dynamical models of neural synchronisation running on top of synthetic n… ▽ More Many of the amazing functional capabilities of the brain are collective properties stemming from the interactions of large sets of individual neurons. In particular, the most salient collective phenomena in brain activity are oscillations, which require the synchronous activation of many neurons. Here, we analyse parsimonious dynamical models of neural synchronisation running on top of synthetic networks that capture essential aspects of the actual brain anatomical connectivity such as a hierarchical-modular and core-periphery structure. These models reveal the emergence of complex collective states with intermediate and flexible levels of synchronisation, halfway in the synchronous-asynchronous spectrum. These states are best described as broad Griffiths-like phases, i.e. an extension of standard critical points that emerge in structurally heterogeneous systems. We analyse different routes (bifurcations) to synchronisation and stress the relevance of 'hybrid-type transitions' to generate rich dynamical patterns. Overall, our results illustrate the complex interplay between structure and dynamics, underlining key aspects leading to rich collective states needed to sustain brain functionality. △ Less

Submitted 24 September, 2021; originally announced September 2021.

Comments: 13 pages, 2 figures. Accepted to be published in Philos. Trans. Royal Soc. A

Journal ref: Phil. Trans. R. Soc. A.380: 20200424 (2022)

Phenotypic-dependent variability and the emergence of tolerance in bacterial populations

Authors: José Camacho Mateu, Matteo Sireci, Miguel A. Muñoz

Abstract: Ecological and evolutionary dynamics have been historically regarded as unfolding at broadly separated timescales. However, these two types of processes are nowadays well documented to much more tightly than traditionally assumed, especially in communities of microorganisms. With this motivation in mind, here we scrutinize recent experimental results showing evidence of rapid evolution of toleranc… ▽ More Ecological and evolutionary dynamics have been historically regarded as unfolding at broadly separated timescales. However, these two types of processes are nowadays well documented to much more tightly than traditionally assumed, especially in communities of microorganisms. With this motivation in mind, here we scrutinize recent experimental results showing evidence of rapid evolution of tolerance by lag in bacterial populations that are periodically exposed to antibiotic stress in laboratory conditions. In particular, the distribution of single-cell lag times evolves its average value to approximately fit the antibiotic-exposure time. Moreover, the distribution develops right skewed heavy tails, revealing the presence of individuals with anomalously large lag times. Here, we develop a parsimonious individual-based model mimicking the actual demographic processes of the experimental setup. Individuals are characterized by a single phenotypic trait: their intrinsic lag time, which is transmitted with variation to the progeny. The model (in a version in which the amplitude of phenotypic variations grows with the parentś lag time) is able to reproduce quite well the key empirical observations. Furthermore, we develop a general mathematical framework allowing us to describe with good accuracy the properties of the stochastic model by means of a macroscopic equation, which generalizes the Crow Kimura equation in population genetics. From a broader perspective, this work represents a benchmark for the mathematical framework designed to tackle much more general eco-evolutionary problems, thus paving the road to further research avenues. △ Less

Submitted 6 October, 2021; v1 submitted 17 September, 2021; originally announced September 2021.

Prescribing net demand for two-stage electricity generation scheduling

Authors: Juan M. Morales, Miguel Á. Muñoz, Salvador Pineda

Abstract: We consider a two-stage generation scheduling problem comprising a forward dispatch and a real-time re-dispatch. The former must be conducted facing an uncertain net demand that includes non-dispatchable electricity consumption and renewable power generation. The latter copes with the plausible deviations with respect to the forward schedule by making use of balancing power during the actual opera… ▽ More We consider a two-stage generation scheduling problem comprising a forward dispatch and a real-time re-dispatch. The former must be conducted facing an uncertain net demand that includes non-dispatchable electricity consumption and renewable power generation. The latter copes with the plausible deviations with respect to the forward schedule by making use of balancing power during the actual operation of the system. Standard industry practice deals with the uncertain net demand in the forward stage by replacing it with a good estimate of its conditional expectation (usually referred to as a point forecast), so as to minimize the need for balancing power in real time. However, it is well known that the cost structure of a power system is highly asymmetric and dependent on its operating point, with the result that minimizing the amount of power imbalances is not necessarily aligned with minimizing operating costs. In this paper, we propose a bilevel program to construct, from the available historical data, a prescription of the net demand that does account for the power system's cost asymmetry. Furthermore, to accommodate the strong dependence of this cost on the power system's operating point, we use clustering to tailor the proposed prescription to the foreseen net-demand regime. By way of an illustrative example and a more realistic case study based on the European power system, we show that our approach leads to substantial cost savings compared to the customary way of doing. △ Less

Submitted 17 April, 2023; v1 submitted 2 August, 2021; originally announced August 2021.

Journal ref: Operations Research Perspectives, Vol. 10, 100268 (2023)

Optimal input representation in neural systems at the edge of chaos

Authors: Guillermo B. Morales, Miguel A. Muñoz

Abstract: Shedding light onto how biological systems represent, process and store information in noisy environments is a key and challenging goal. A stimulating, though controversial, hypothesis poses that operating in dynamical regimes near the edge of a phase transition, i.e. at criticality or the "edge of chaos", can provide information-processing living systems with important operational advantages, cre… ▽ More Shedding light onto how biological systems represent, process and store information in noisy environments is a key and challenging goal. A stimulating, though controversial, hypothesis poses that operating in dynamical regimes near the edge of a phase transition, i.e. at criticality or the "edge of chaos", can provide information-processing living systems with important operational advantages, creating, e.g., an optimal trade-off between robustness and flexibility. Here, we elaborate on a recent theoretical result, which establishes that the spectrum of covariance matrices of neural networks representing complex inputs in a robust way needs to decay as a power-law of the rank, with an exponent close to unity, a result that has been indeed experimentally verified in neurons of the mouse visual cortex. Aimed at understanding and mimicking these results, we construct an artificial neural network and train it to classify images. Remarkably, we find that the best performance in such a task is obtained when the network operates near the critical point, at which the eigenspectrum of the covariance matrix follows the very same statistics as actual neurons do. Thus, we conclude that operating near criticality can also have -- besides the usually alleged virtues -- the advantage of allowing for flexible, robust and efficient input representations. △ Less

Submitted 12 July, 2021; originally announced July 2021.

Measles-induced immune amnesia and its effects in concurrent epidemics

Authors: Guillermo B. Morales, Miguel A. Muñoz

Abstract: It has been recently discovered that the measles virus can wipe out the adaptive immune system, destroying B lymphocytes and reducing the diversity of non-specific B cells of the infected host. In particular, this implies that previously acquired immunization from vaccination or direct exposition to other pathogens could be erased in a phenomenon named "immune amnesia", whose effects can become pa… ▽ More It has been recently discovered that the measles virus can wipe out the adaptive immune system, destroying B lymphocytes and reducing the diversity of non-specific B cells of the infected host. In particular, this implies that previously acquired immunization from vaccination or direct exposition to other pathogens could be erased in a phenomenon named "immune amnesia", whose effects can become particularly worrisome given the actual rise of anti-vaccination movements. Here we present the first attempt to incorporate immune amnesia into standard models of epidemic spreading. In particular, we analyze diverse variants of a model that describes the spreading of two concurrent pathogens causing measles and another generic disease: the SIR-IA model. Analytical and computational studies confirm that immune amnesia can indeed have important consequences for epidemic spreading, significantly altering the vaccination coverage required to reach herd-immunity for concurring infectious diseases. More specifically, we uncover the existence of novel propagating and endemic phases which are induced by immune amnesia, that appear both in fully-connected and more structured networks, such as random networks and power-law degree-distributed ones. In particular, the transitions from a quiescent state into these novel phases can become rather abrupt in some cases that we specifically analyze. Furthermore, we discuss the meaning and consequences of our results and their relation with, e.g., immunization strategies, together with the possibility that explosive types of transitions may emerge, making immune-amnesia effects particularly dramatic. This work opens the door to further developments and analyses of immune amnesia effects, contributing, more generally, to the theory of interacting epidemics on complex networks. △ Less

Submitted 14 January, 2021; originally announced January 2021.

Small variation in dynamic functional connectivity in cerebellar networks

Authors: Izaro Fernandez-Iriondo, Antonio Jimenez-Marin, Ibai Diez, Paolo Bonifazi, Stephan P. Swinnen, Miguel A. Muñoz, Jesus M. Cortes

Abstract: Brain networks can be defined and explored through their connectivity. Here, we analyzed the relationship between structural connectivity (SC) across 2,514 regions that cover the entire brain and brainstem, and their dynamic functional connectivity (DFC). To do so, we focused on a combination of two metrics: the first assesses the degree of SC-DFC similarity and the second is the intrinsic variabi… ▽ More Brain networks can be defined and explored through their connectivity. Here, we analyzed the relationship between structural connectivity (SC) across 2,514 regions that cover the entire brain and brainstem, and their dynamic functional connectivity (DFC). To do so, we focused on a combination of two metrics: the first assesses the degree of SC-DFC similarity and the second is the intrinsic variability of the DFC networks over time. Overall, we found that cerebellar networks have a smaller DFC variability than other networks in the brain. Moreover, the internal structure of the cerebellum could be clearly divided in two distinct posterior and anterior parts, the latter also connected to the brainstem. The mechanism to maintain small variability of the DFC in the posterior part of the cerebellum is consistent with another of our findings, namely, that this structure exhibits the highest SC-DFC similarity relative to the other networks studied. By contrast, the anterior part of the cerebellum also exhibits small DFC variability but it has the lowest SC-DFC similarity, suggesting a different mechanism is at play. Because this structure connects to the brainstem, which regulates sleep cycles, cardiac and respiratory functioning, we suggest that such critical functionality drives the low variability in the DFC. Overall, the low variability detected in DFC expands our current knowledge of cerebellar networks, which are extremely rich and complex, participating in a wide range of cognitive functions, from movement control and coordination to executive function or emotional regulation. Moreover, the association between such low variability and structure suggests that differentiated computational principles can be applied in the cerebellum as opposed to other structures, such as the cerebral cortex. △ Less

Submitted 26 November, 2020; originally announced November 2020.

Comments: 19 pages, 6 figures

Hybrid-type synchronization transitions: where marginal coherence, scale-free avalanches, and bistability live together

Authors: Victor Buendía, Pablo Villegas, Raffaella Burioni, Miguel A. Muñoz

Abstract: The human cortex is never at rest but in a state of sparse and noisy neural activity that can be detected at broadly diverse resolution scales. It has been conjectured that such a state is best described as a critical dynamical process -- whose nature is still not fully understood -- where scale-free avalanches of activity emerge at the edge of a phase transition. In particular, some works suggest… ▽ More The human cortex is never at rest but in a state of sparse and noisy neural activity that can be detected at broadly diverse resolution scales. It has been conjectured that such a state is best described as a critical dynamical process -- whose nature is still not fully understood -- where scale-free avalanches of activity emerge at the edge of a phase transition. In particular, some works suggest that this is most likely a synchronization transition, separating synchronous from asynchronous phases. Here, by investigating a simplified model of coupled excitable oscillators describing the cortex dynamics at a mesoscopic level, we investigate the possible nature of such a synchronization phase transition. Within our modeling approach, we conclude that -- in order to reproduce all key empirical observations, such as scale-free avalanches and bistability, on which fundamental functional advantages rely -- the transition to collective oscillatory behavior needs to be of an unconventional hybrid type, with mixed features of type-I and type-II excitability, opening the possibility for a particularly rich dynamical repertoire. △ Less

Submitted 13 May, 2021; v1 submitted 6 November, 2020; originally announced November 2020.

Comments: 7 pages, 4 figures, and Supplementary Information. Accepted to be published in PRR

Journal ref: Phys. Rev. Research 3, 023224 (2021)

A bilevel framework for decision-making under uncertainty with contextual information

Authors: Miguel Angel Muñoz, Salvador Pineda, Juan Miguel Morales

Abstract: In this paper, we propose a novel approach for data-driven decision-making under uncertainty in the presence of contextual information. Given a finite collection of observations of the uncertain parameters and potential explanatory variables (i.e., the contextual information), our approach fits a parametric model to those data that is specifically tailored to maximizing the decision value, while a… ▽ More In this paper, we propose a novel approach for data-driven decision-making under uncertainty in the presence of contextual information. Given a finite collection of observations of the uncertain parameters and potential explanatory variables (i.e., the contextual information), our approach fits a parametric model to those data that is specifically tailored to maximizing the decision value, while accounting for possible feasibility constraints. From a mathematical point of view, our framework translates into a bilevel program, for which we provide both a fast regularization procedure and a big-M-based reformulation that can be solved using off-the-shelf optimization solvers. We showcase the benefits of moving from the traditional scheme for model estimation (based on statistical quality metrics) to decision-guided prediction using three different practical problems. We also compare our approach with existing ones in a realistic case study that considers a strategic power producer that participates in the Iberian electricity market. Finally, we use these numerical simulations to analyze the conditions (in terms of the firm's cost structure and production capacity) under which our approach proves to be more advantageous to the producer. △ Less

Submitted 17 September, 2021; v1 submitted 4 August, 2020; originally announced August 2020.

Anomalous Lifshitz dimension in hierarchical networks of brain connectivity

Authors: Samaneh Esfandiary, Ali Safari, Jakob Renner, Paolo Moretti, Miguel Ángel Muñoz

Abstract: The spectral dimension is a generalization of the Euclidean dimension and quantifies the propensity of a network to transmit and diffuse information. We show that, in hierarchical-modular network models of the brain, dynamics are anomalously slow and the spectral dimension is not defined. Inspired by Anderson localization in quantum systems, we relate the localization of neural activity - essentia… ▽ More The spectral dimension is a generalization of the Euclidean dimension and quantifies the propensity of a network to transmit and diffuse information. We show that, in hierarchical-modular network models of the brain, dynamics are anomalously slow and the spectral dimension is not defined. Inspired by Anderson localization in quantum systems, we relate the localization of neural activity - essential to embed brain functionality - to the network spectrum and to the existence of an anomalous "Lifshitz dimension". In a broader context, our results help shedding light on the relationship between structure and function in biological information-processing complex networks. △ Less

Submitted 27 August, 2020; v1 submitted 22 July, 2020; originally announced July 2020.

Comments: 6 pages, 3 figures

Feedback mechanisms for self-organization to the edge of a phase transition

Authors: Victor Buendía, Serena di Santo, Juan A. Bonachela, Miguel A. Muñoz

Abstract: Scale-free outbursts of activity are commonly observed in physical, geological, and biological systems. The idea of self-organized criticality (SOC), introduced back in 1987 by Bak, Tang and Wiesenfeld suggests that, under certain circumstances, natural systems can seemingly self-tune to a critical state with its concomitant power-laws and scaling. Theoretical progress allowed for a rationalizatio… ▽ More Scale-free outbursts of activity are commonly observed in physical, geological, and biological systems. The idea of self-organized criticality (SOC), introduced back in 1987 by Bak, Tang and Wiesenfeld suggests that, under certain circumstances, natural systems can seemingly self-tune to a critical state with its concomitant power-laws and scaling. Theoretical progress allowed for a rationalization of how SOC works by relating its critical properties to those of a standard non-equilibrium second-order phase transition that separates an active state in which dynamical activity reverberates indefinitely, from an absorbing or quiescent state where activity eventually ceases. Here, we briefly review these ideas as well as a recent closely-related concept: self-organized bistability (SOB). In SOB, the very same type of feedback operates in a system characterized by a discontinuos phase transition, which has no critical point but instead presents bistability between active and quiescent states. SOB also leads to scale-invariant avalanches of activity but, in this case, with a different type of scaling and coexisting with anomalously large outbursts. Moreover, SOB explains experiments with real sandpiles more closely than SOC. We review similarities and differences between SOC and SOB by presenting and analyzing them under a common theoretical framework, covering recent results as well as possible future developments. We also discuss other related concepts for "imperfect" self-organization such as "self-organized quasi-criticality" and "self-organized collective oscillations", of relevance in e.g. neuroscience, with the aim of providing an overview of feedback mechanisms for self-organization to the edge of a phase transition. △ Less

Submitted 4 June, 2020; originally announced June 2020.

Persistence of hierarchical network organization and emergent topologies in models of functional connectivity

Authors: Ali Safari, Paolo Moretti, Ibai Diez, Jesus M. Cortes, Miguel Ángel Muñoz

Abstract: Functional networks provide a topological description of activity patterns in the brain, as they stem from the propagation of neural activity on the underlying anatomical or structural network of synaptic connections. This latter is well known to be organized in hierarchical and modular way. While it is assumed that structural networks shape their functional counterparts, it is also hypothesized t… ▽ More Functional networks provide a topological description of activity patterns in the brain, as they stem from the propagation of neural activity on the underlying anatomical or structural network of synaptic connections. This latter is well known to be organized in hierarchical and modular way. While it is assumed that structural networks shape their functional counterparts, it is also hypothesized that alterations of brain dynamics come with transformations of functional connectivity. In this computational study, we introduce a novel methodology to monitor the persistence and breakdown of hierarchical order in functional networks, generated from computational models of activity spreading on both synthetic and real structural connectomes. We show that hierarchical connectivity appears in functional networks in a persistent way if the dynamics is set to be in the quasi-critical regime associated with optimal processing capabilities and normal brain function, while it breaks down in other (supercritical) dynamical regimes, often associated with pathological conditions. Our results offer important clues for the study of optimal neurocomputing architectures and processes, which are capable of controlling patterns of activity and information flow. We conclude that functional connectivity patterns achieve optimal balance between local specialized processing (i.e. segregation) and global integration by inheriting the hierarchical organization of the underlying structural architecture. △ Less

Submitted 10 February, 2021; v1 submitted 10 March, 2020; originally announced March 2020.

Comments: 5 figures. Accepted for publication in Neurocomputing

Classes of critical avalanche dynamics in complex networks

Authors: Filippo Radicchi, Claudio Castellano, Alessandro Flammini, Miguel A. Muñoz, Daniele Notarmuzi

Abstract: Dynamical processes exhibiting absorbing states are essential in the modeling of a large variety of situations from material science to epidemiology and social sciences. Such processes exhibit the possibility of avalanching behavior upon slow driving. Here, we study the distribution of sizes and durations of avalanches for well-known dynamical processes on complex networks. We find that all analyz… ▽ More Dynamical processes exhibiting absorbing states are essential in the modeling of a large variety of situations from material science to epidemiology and social sciences. Such processes exhibit the possibility of avalanching behavior upon slow driving. Here, we study the distribution of sizes and durations of avalanches for well-known dynamical processes on complex networks. We find that all analyzed models display a similar critical behavior, characterized by the presence of two distinct regimes. At small scales, sizes and durations of avalanches exhibit distributions that are dependent on the network topology and the model dynamics. At asymptotically large scales instead -- irrespective of the type of dynamics and of the topology of the underlying network -- sizes and durations of avalanches are characterized by power-law distributions with the exponents of the standard mean-field critical branching process. △ Less

Submitted 31 July, 2020; v1 submitted 26 February, 2020; originally announced February 2020.

Comments: 10 pages, 4 figures, Supplemental Material available at this http://homes.sice.indiana.edu/filiradi/Mypapers/Avalanches/SM.pdf

Journal ref: Phys. Rev. Research 2, 033171 (2020)

Evolution in the Debian GNU/Linux software network: analogies and differences with gene regulatory networks

Authors: Pablo Villegas, Miguel A. Muñoz, Juan A. Bonachela

Abstract: Biological networks exhibit intricate architectures deemed to be crucial for their functionality. In particular, gene regulatory networks, which play a key role in information processing in the cell, display non-trivial architectural features such as scale-free degree distributions, high modularity, and low average distance between connected genes. Such networks result from complex evolutionary an… ▽ More Biological networks exhibit intricate architectures deemed to be crucial for their functionality. In particular, gene regulatory networks, which play a key role in information processing in the cell, display non-trivial architectural features such as scale-free degree distributions, high modularity, and low average distance between connected genes. Such networks result from complex evolutionary and adaptive processes difficult to track down empirically. On the other hand, there exists detailed information on the developmental (or evolutionary) stages of open-software networks that result from self-organized growth across versions. Here, we study the evolution of the Debian GNU/Linux software network, focusing on the changes of key structural and statistical features over time. Our results show that evolution has led to a network structure in which the out-degree distribution is scale-free and the in-degree distribution is a stretched exponential. In addition, while modularity, directionality of information flow, and average distance between elements grew, vulnerability decreased over time. These features resemble closely those currently shown by gene regulatory networks, suggesting the existence of common adaptive pathways for the architectural design of information-processing networks. Differences in other hierarchical aspects point to system-specific solutions to similar evolutionary challenges. △ Less

Submitted 20 January, 2020; originally announced January 2020.

Comments: 15 pages 8 figures

Journal ref: J. R. Soc. Interface 17: 20190845 (2020)

Intermittent percolation and the scale-free distribution of vegetation clusters

Authors: Paula Villa Martín, Virginia Domínguez-García, Miguel A. Muñoz

Abstract: Understanding the causes and effects of spatial vegetation patterns is a fundamental problem in ecology, especially because these can be used as early predictors of catastrophic shifts such as desertification processes. Empirical studies of the vegetation cover in some areas such as drylands and semiarid regions have revealed the existence of vegetation patches of broadly diverse sizes. In particu… ▽ More Understanding the causes and effects of spatial vegetation patterns is a fundamental problem in ecology, especially because these can be used as early predictors of catastrophic shifts such as desertification processes. Empirical studies of the vegetation cover in some areas such as drylands and semiarid regions have revealed the existence of vegetation patches of broadly diverse sizes. In particular, the probability distribution of patch sizes can be fitted by a power law, i.e. vegetation patches are approximately scale free up to some maximum size. Different explanatory mechanisms, such as plant-plant interactions and plant-water feedback loops have been proposed to rationalize the emergence of such scale-free patterns, yet a full understanding has not been reached. Using a simple model for vegetation dynamics, we show that environmental temporal variability -- a well-recognized feature of semiarid environments -- promotes in a robust way (i.e. for a wide range of parameter values) the emergence of vegetation patches with broadly distributed cluster sizes. Furthermore, this result is related to a percolation phenomenon that occurs in an intermittent or fluctuating way. The model also reveals that the power-law exponents fitting the tails of the probability distributions depend on the overall vegetation-cover density, in agreement with empirical observations. This supports the idea that environmental variability plays a key role in the formation of scale-free vegetation patterns. From a practical viewpoint, this may be of importance to predict the effects that changes in environmental conditions may have in real ecosystems. From a theoretical side, our study sheds new light on a novel type of percolation phenomena occurring under temporally-varying external conditions, that still needs further work to be fully characterized. △ Less

Submitted 18 June, 2020; v1 submitted 17 December, 2019; originally announced December 2019.

Self-organized bistability and its possible relevance for brain dynamics

Authors: Victor Buendía, Serena di Santo, Pablo Villegas, Raffaella Burioni, Miguel A. Muñoz

Abstract: Self-organized bistability (SOB) is the counterpart of 'self-organized criticality' (SOC), for systems tuning themselves to the edge of bistability of a discontinuous phase transition, rather than to the critical point of a continuous one. The equations defining the mathematical theory of SOB turn out to bear strong resemblance to a (Landau-Ginzburg) theory recently proposed to analyze the dynamic… ▽ More Self-organized bistability (SOB) is the counterpart of 'self-organized criticality' (SOC), for systems tuning themselves to the edge of bistability of a discontinuous phase transition, rather than to the critical point of a continuous one. The equations defining the mathematical theory of SOB turn out to bear strong resemblance to a (Landau-Ginzburg) theory recently proposed to analyze the dynamics of the cerebral cortex. This theory describes the neuronal activity of coupled mesoscopic patches of cortex, homeostatically regulated by short-term synaptic plasticity. The theory for cortex dynamics entails, however, some significant differences with respect to SOB, including the lack of a (bulk) conservation law, the absence of a perfect separation of timescales and, the fact that in the former, but not in the second, there is a parameter that controls the overall system state (in blatant contrast with the very idea of self-organization). Here, we scrutinize --by employing a combination of analytical and computational tools-- the analogies and differences between both theories and explore whether in some limit SOB can play an important role to explain the emergence of scale-invariant neuronal avalanches observed empirically in the cortex. We conclude that, actually, in the limit of infinitely slow synaptic-dynamics, the two theories become identical, but the timescales required for the self-organization mechanism to be effective do not seem to be biologically plausible. We discuss the key differences between self-organization mechanisms with/without conservation and with/without infinitely separated timescales. In particular, we introduce the concept of 'self-organized collective oscillations' and scrutinize the implications of our findings in neuroscience, shedding new light into the problems of scale invariance and oscillations in cortical dynamics. △ Less

Submitted 10 March, 2020; v1 submitted 13 November, 2019; originally announced November 2019.

Comments: 6 figures

Journal ref: Phys. Rev. Research 2, 013318 (2020)

Feature-driven Improvement of Renewable Energy Forecasting and Trading

Authors: Miguel Á. Muñoz, Juan M. Morales, Salvador Pineda

Abstract: Inspired from recent insights into the common ground of machine learning, optimization and decision-making, this paper proposes an easy-to-implement, but effective procedure to enhance both the quality of renewable energy forecasts and the competitive edge of renewable energy producers in electricity markets with a dual-price settlement of imbalances. The quality and economic gains brought by the… ▽ More Inspired from recent insights into the common ground of machine learning, optimization and decision-making, this paper proposes an easy-to-implement, but effective procedure to enhance both the quality of renewable energy forecasts and the competitive edge of renewable energy producers in electricity markets with a dual-price settlement of imbalances. The quality and economic gains brought by the proposed procedure essentially stem from the utilization of valuable predictors (also known as features) in a data-driven newsvendor model that renders a computationally inexpensive linear program. We illustrate the proposed procedure and numerically assess its benefits on a realistic case study that considers the aggregate wind power production in the Danish DK1 bidding zone as the variable to be predicted and traded. Within this context, our procedure leverages, among others, spatial information in the form of wind power forecasts issued by transmission system operators (TSO) in surrounding bidding zones and publicly available in online platforms. We show that our method is able to improve the quality of the wind power forecast issued by the Danish TSO by several percentage points (when measured in terms of the mean absolute or the root mean square error) and to significantly reduce the balancing costs incurred by the wind power producer. △ Less

Submitted 16 January, 2020; v1 submitted 17 July, 2019; originally announced July 2019.

Comments: 10 pages, 6 figures

Burstiness in activity-driven networks and the epidemic threshold

Authors: Marco Mancastroppa, Alessandro Vezzani, Miguel A. Muñoz, Raffaella Burioni

Abstract: We study the effect of heterogeneous temporal activations on epidemic spreading in temporal networks. We focus on the susceptible-infected-susceptible (SIS) model on activity-driven networks with burstiness. By using an activity-based mean-field approach, we derive a closed analytical form for the epidemic threshold for arbitrary activity and inter-event time distributions. We show that, as expect… ▽ More We study the effect of heterogeneous temporal activations on epidemic spreading in temporal networks. We focus on the susceptible-infected-susceptible (SIS) model on activity-driven networks with burstiness. By using an activity-based mean-field approach, we derive a closed analytical form for the epidemic threshold for arbitrary activity and inter-event time distributions. We show that, as expected, burstiness lowers the epidemic threshold while its effect on prevalence is twofold. In low-infective systems burstiness raises the average infection probability, while it weakens epidemic spreading for high infectivity. Our results can help clarify the conflicting effects of burstiness reported in the literature. We also discuss the scaling properties at the transition, showing that they are not affected by burstiness. △ Less

Submitted 27 May, 2019; v1 submitted 27 March, 2019; originally announced March 2019.

Comments: 23 pages, 11 figures

Journal ref: J. Stat. Mech. (2019) 053502

Time-series thresholding and the definition of avalanche size

Authors: Pablo Villegas, Serena di Santo, Raffaella Burioni, Miguel A. Muñoz

Abstract: Avalanches whose sizes and durations are distributed as power laws appear in many contexts. Here, we show that there is a hidden peril in thresholding continuous times series --either from empirical or synthetic data-- for the detection of avalanches. In particular, we consider two possible alternative definitions of avalanche size used e.g. in the empirical determination of avalanche exponents in… ▽ More Avalanches whose sizes and durations are distributed as power laws appear in many contexts. Here, we show that there is a hidden peril in thresholding continuous times series --either from empirical or synthetic data-- for the detection of avalanches. In particular, we consider two possible alternative definitions of avalanche size used e.g. in the empirical determination of avalanche exponents in the analysis of neural-activity data. By performing analytical and computational studies of an Ornstein-Uhlenbeck process (taken as a guiding example) we show that if (i) relatively large threshold values are employed to determine the beginning and ending of avalanches and if (ii) --as sometimes done in the literature-- avalanche sizes are defined as the total area (above zero) of the avalanche, then true asymptotic scaling behavior is not seen, instead the observations are dominated by transient effects. These can induce misinterpretations of the resulting scaling regimes as well as to a wrong assignation of universality classes. △ Less

Submitted 10 September, 2019; v1 submitted 27 February, 2019; originally announced February 2019.

Comments: 4 figures, 6 pages. Accepted to be published in PRE

Journal ref: Phys. Rev. E 100, 012133 (2019)

Jensen's force and the statistical mechanics of cortical asynchronous states

Authors: Victor Buendía, Pablo Villegas, Serena di Santo, Alessandro Vezzani, Raffaella Burioni, Miguel A. Muñoz

Abstract: The cortex exhibits self-sustained highly-irregular activity even under resting conditions, whose origin and function need to be fully understood. It is believed that this can be described as an "asynchronous state" stemming from the balance between excitation and inhibition, with important consequences for information-processing, though a competing hypothesis claims it stems from critical dynamic… ▽ More The cortex exhibits self-sustained highly-irregular activity even under resting conditions, whose origin and function need to be fully understood. It is believed that this can be described as an "asynchronous state" stemming from the balance between excitation and inhibition, with important consequences for information-processing, though a competing hypothesis claims it stems from critical dynamics. By analyzing a parsimonious neural-network model with excitatory and inhibitory interactions, we elucidate a noise-induced mechanism called "Jensen's force" responsible for the emergence of a novel phase of arbitrarily-low but self-sustained activity, which reproduces all the experimental features of asynchronous states. The simplicity of our framework allows for a deep understanding of asynchronous states from a broad statistical-mechanics perspective and of the phase transitions to other standard phases it exhibits, opening the door to reconcile, asynchronous-state and critical-state hypotheses. We argue that Jensen's forces are measurable experimentally and might be relevant in contexts beyond neuroscience. △ Less

Submitted 24 January, 2019; originally announced January 2019.

Journal ref: Sci. Rep. 9, 15183 (2019)

Eco-evolutionary Model of Rapid Phenotypic Diversification in Species-Rich Communities

Authors: Paula Villa Martín, Jorge Hidalgo, Rafael Rubio de Casas, Miguel A. Muñoz

Abstract: Evolutionary and ecosystem dynamics are often treated as different processes --operating at separate timescales-- even if evidence reveals that rapid evolutionary changes can feed back into ecological interactions. A recent long-term field experiment has explicitly shown that communities of competing plant species can experience very fast phenotypic diversification, and that this gives rise to enh… ▽ More Evolutionary and ecosystem dynamics are often treated as different processes --operating at separate timescales-- even if evidence reveals that rapid evolutionary changes can feed back into ecological interactions. A recent long-term field experiment has explicitly shown that communities of competing plant species can experience very fast phenotypic diversification, and that this gives rise to enhanced complementarity in resource exploitation and to enlarged ecosystem-level productivity. Here, we build on progress made in recent years in the integration of eco-evolutionary dynamics, and present a computational approach aimed at describing these empirical findings in detail. In particular we model a community of organisms of different but similar species evolving in time through mechanisms of birth, competition, sexual reproduction, descent with modification, and death. Based on simple rules, this model provides a rationalization for the emergence of rapid phenotypic diversification in species-rich communities. Furthermore, it also leads to non-trivial predictions about long-term phenotypic change and ecological interactions. Our results illustrate that the presence of highly specialized, non-competing species leads to very stable communities and reveals that phenotypically equivalent species occupying the same niche may emerge and coexist for very long times. Thus, the framework presented here provides a simple approach --complementing existing theories, but specifically devised to account for the specificities of the recent empirical findings for plant communities-- to explain the collective emergence of diversification at a community level, and paves the way to further scrutinize the intimate entanglement of ecological and evolutionary processes, especially in species-rich communities. △ Less

Submitted 3 October, 2018; originally announced October 2018.

Journal ref: PLoS computational biology, 2016, vol. 12, no 10, p. e1005139

Bet-hedging strategies in expanding populations

Authors: Paula Villa Martín, Miguel A. Muñoz, Simone Pigolotti

Abstract: In ecology, species can mitigate their extinction risks in uncertain environments by diversifying individual phenotypes. This observation is quantified by the theory of bet-hedging, which provides a reason for the degree of phenotypic diversity observed even in clonal populations. The theory of bet-hedging in well-mixed populations is rather well developed. However, many species underwent range ex… ▽ More In ecology, species can mitigate their extinction risks in uncertain environments by diversifying individual phenotypes. This observation is quantified by the theory of bet-hedging, which provides a reason for the degree of phenotypic diversity observed even in clonal populations. The theory of bet-hedging in well-mixed populations is rather well developed. However, many species underwent range expansions during their evolutionary history, and the importance of phenotypic diversity in such scenarios still needs to be understood. In this paper, we develop a theory of bet-hedging for populations colonizing new, unknown environments that fluctuate either in space or time. In this case, we find that bet-hedging is a more favorable strategy than in well-mixed populations. For slow rates of variation, temporal and spatial fluctuations lead to different outcomes. In spatially fluctuating environments, bet-hedging is favored compared to temporally fluctuating environments. In the limit of frequent environmental variation, no opportunity for bet-hedging exists, regardless of the nature of the environmental fluctuations. For the same model, bet-hedging is never an advantageous strategy in the well-mixed case, supporting the view that range expansions strongly promote diversification. These conclusions are robust against stochasticity induced by finite population sizes. Our findings shed light on the importance of phenotypic heterogeneity in range expansions, paving the way to novel approaches to understand how biodiversity emerges and is maintained. △ Less

Submitted 2 October, 2018; originally announced October 2018.

Limited role of spatial self-structuring in emergent trade-offs during pathogen evolution

Authors: Victor Buendía, Miguel A. Muñoz, Susanna Manrubia

Abstract: Pathogen transmission and virulence are main evolutionary variables broadly assumed to be linked through trade-offs. In well-mixed populations, these trade-offs are often ascribed to physiological restrictions, while populations with spatial self-structuring might evolve emergent trade-offs. Here, we reexamine a model of the latter kind proposed by Ballegooijen and Boerlijst with the aim of charac… ▽ More Pathogen transmission and virulence are main evolutionary variables broadly assumed to be linked through trade-offs. In well-mixed populations, these trade-offs are often ascribed to physiological restrictions, while populations with spatial self-structuring might evolve emergent trade-offs. Here, we reexamine a model of the latter kind proposed by Ballegooijen and Boerlijst with the aim of characterising the mechanisms causing the emergence of the trade-off and its structural robustness. Using invadability criteria, we establish the conditions under which an evolutionary feedback between transmission and virulence mediated by pattern formation can poise the system to a critical boundary separating a disordered state (without emergent trade-off) from a self-structured phase (where the trade-off emerges), and analytically calculate the functional shape of the boundary in a certain approximation. Beyond evolutionary parameters, the success of an invasion depends on the size and spatial structure of the invading and invaded populations. Spatial self-structuring is often destroyed when hosts are mobile, changing the evolutionary dynamics to those of a well-mixed population. In a metapopulation scenario, the systematic extinction of the pathogen in the disordered phase may counteract the disruptive effect of host mobility, favour pattern formation and therefore recover the emergent trade-off. △ Less

Submitted 23 April, 2018; originally announced April 2018.

Non-normality, reactivity, and intrinsic stochasticity in neural dynamics: a non-equilibrium potential approach

Authors: Serena di Santo, Pablo Villegas, Raffaella Burioni, Miguel A. Muñoz

Abstract: Intrinsic stochasticity can induce highly non-trivial effects on dynamical systems, including stochastic and coherence resonance, noise induced bistability, noise-induced oscillations, to name but a few. In this paper we revisit a mechanism first investigated in the context of neuroscience by which relatively small demographic (intrinsic) fluctuations can lead to the emergence of avalanching behav… ▽ More Intrinsic stochasticity can induce highly non-trivial effects on dynamical systems, including stochastic and coherence resonance, noise induced bistability, noise-induced oscillations, to name but a few. In this paper we revisit a mechanism first investigated in the context of neuroscience by which relatively small demographic (intrinsic) fluctuations can lead to the emergence of avalanching behavior in systems that are deterministically characterized by a single stable fixed point (up state). The anomalously large response of such systems to stochasticity stems (or is strongly associated with) the existence of a "non-normal" stability matrix at the deterministic fixed point, which may induce the system to be "reactive". Here, we further investigate this mechanism by exploring the interplay between non-normality and intrinsic (demographic) stochasticity, by employing a number of analytical and computational approaches. We establish, in particular, that the resulting dynamics in this type of systems cannot be simply derived from a scalar potential but, additionally, one needs to consider a curl flux which describes the essential non-equilibrium nature of this type of noisy non-normal systems. Moreover, we shed further light on the origin of the phenomenon, introduce the novel concept of "non-linear reactivity", and rationalize of the observed the value of the emerging avalanche exponents. △ Less

Submitted 6 June, 2018; v1 submitted 21 March, 2018; originally announced March 2018.

Comments: 26 pages, 11 figures

Journal ref: J. Stat. Mech. (2018) 073402

Landau-Ginzburg theory of cortex dynamics: Scale-free avalanches emerge at the edge of synchronization

Authors: Serena di Santo, Pablo Villegas, Raffaella Burioni, Miguel A. Muñoz

Abstract: Understanding the origin, nature, and functional significance of complex patterns of neural activity, as recorded by diverse electrophysiological and neuroimaging techniques, is a central challenge in neuroscience. Such patterns include collective oscillations emerging out of neural synchronization as well as highly heterogeneous outbursts of activity interspersed by periods of quiescence, called… ▽ More Understanding the origin, nature, and functional significance of complex patterns of neural activity, as recorded by diverse electrophysiological and neuroimaging techniques, is a central challenge in neuroscience. Such patterns include collective oscillations emerging out of neural synchronization as well as highly heterogeneous outbursts of activity interspersed by periods of quiescence, called "neuronal avalanches." Much debate has been generated about the possible scale invariance or criticality of such avalanches and its relevance for brain function. Aimed at shedding light onto this, here we analyze the large-scale collective properties of the cortex by using a mesoscopic approach following the principle of parsimony of Landau-Ginzburg. Our model is similar to that of Wilson-Cowan for neural dynamics but crucially, includes stochasticity and space; synaptic plasticity and inhibition are considered as possible regulatory mechanisms. Detailed analyses uncover a phase diagram including down-state, synchronous, asynchronous, and up-state phases and reveal that empirical findings for neuronal avalanches are consistently reproduced by tuning our model to the edge of synchronization. This reveals that the putative criticality of cortical dynamics does not correspond to a quiescent-to-active phase transition as usually assumed in theoretical approaches but to a synchronization phase transition, at which incipient oscillations and scale-free avalanches coexist. Furthermore, our model also accounts for up and down states as they occur (e.g., during deep sleep). This approach constitutes a framework to rationalize the possible collective phases and phase transitions of cortical networks in simple terms, thus hel** to shed light on basic aspects of brain functioning from a very broad perspective. △ Less

Submitted 31 January, 2018; originally announced January 2018.

Comments: Pre-print version of the paper published in Proc. Natl. Acad. Sci. USA

Colloquium: Criticality and dynamical scaling in living systems

Authors: Miguel A. Munoz

Abstract: A celebrated and controversial hypothesis conjectures that some biological systems --parts, aspects, or groups of them-- may extract important functional benefits from operating at the edge of instability, halfway between order and disorder, i.e. in the vicinity of the critical point of a phase transition. Criticality has been argued to provide biological systems with an optimal balance between ro… ▽ More A celebrated and controversial hypothesis conjectures that some biological systems --parts, aspects, or groups of them-- may extract important functional benefits from operating at the edge of instability, halfway between order and disorder, i.e. in the vicinity of the critical point of a phase transition. Criticality has been argued to provide biological systems with an optimal balance between robustness against perturbations and flexibility to adapt to changing conditions, as well as to confer on them optimal computational capabilities, huge dynamical repertoires, unparalleled sensitivity to stimuli, etc. Criticality, with its concomitant scale invariance, can be conjectured to emerge in living systems as the result of adaptive and evolutionary processes that, for reasons to be fully elucidated, select for it as a template upon which higher layers of complexity can rest. This hypothesis is very suggestive as it proposes that criticality could constitute a general and common organizing strategy in biology stemming from the physics of phase transitions. However, despite its thrilling implications, this is still in its embryonic state as a well-founded theory and, as such, it has elicited some healthy skepticism. From the experimental side, the advent of high-throughput technologies has created new prospects in the exploration of biological systems, and empirical evidence in favor of criticality has proliferated, with examples ranging from endogenous brain activity and gene-expression patterns, to flocks of birds and insect-colony foraging, to name but a few... △ Less

Submitted 15 May, 2018; v1 submitted 12 December, 2017; originally announced December 2017.

Comments: To appear in REVIEW OF MODERN PHYSICS

Stochastic spatial models in ecology: a statistical physics approach

Authors: Simone Pigolotti, Massimo Cencini, Daniel Molina, Miguel A. Muñoz

Abstract: Ecosystems display a complex spatial organization. Ecologists have long tried to characterize them by looking at how different measures of biodiversity change across spatial scales. Ecological neutral theory has provided simple predictions accounting for general empirical patterns in communities of competing species. However, while neutral theory in well-mixed ecosystems is mathematically well und… ▽ More Ecosystems display a complex spatial organization. Ecologists have long tried to characterize them by looking at how different measures of biodiversity change across spatial scales. Ecological neutral theory has provided simple predictions accounting for general empirical patterns in communities of competing species. However, while neutral theory in well-mixed ecosystems is mathematically well understood, spatial models still present several open problems, limiting the quantitative understanding of spatial biodiversity. In this review, we discuss the state of the art in spatial neutral theory. We emphasize the connection between spatial ecological models and the physics of non-equilibrium phase transitions and how concepts developed in statistical physics translate in population dynamics, and vice versa. We focus on non-trivial scaling laws arising at the critical dimension D = 2 of spatial neutral models, and their relevance for biological populations inhabiting two-dimensional environments. We conclude by discussing models incorporating non-neutral effects in the form of spatial and temporal disorder, and analyze how their predictions deviate from those of purely neutral theories. △ Less

Submitted 11 December, 2017; v1 submitted 11 August, 2017; originally announced August 2017.

Comments: 18 pages, 12 figures. Included in the special edition "Statistical Theory of Biological Evolution" of Journal of Statistical Physics

Impact of environmental colored noise in single-species population dynamics

Authors: Tommaso Spanio, Jorge Hidalgo, Miguel A. Muñoz

Abstract: Variability on external conditions has important consequences for the dynamics and the organization of biological systems. In many cases, the characteristic timescale of environmental changes as well as their correlations play a fundamental role in the way living systems adapt and respond to it. A proper mathematical approach to understand population dynamics, thus, requires approaches more refine… ▽ More Variability on external conditions has important consequences for the dynamics and the organization of biological systems. In many cases, the characteristic timescale of environmental changes as well as their correlations play a fundamental role in the way living systems adapt and respond to it. A proper mathematical approach to understand population dynamics, thus, requires approaches more refined than, e.g., simple white-noise approximations. To shed further light onto this problem, in this paper we propose a unifying framework based on different analytical and numerical tools available to deal with "colored" environmental noise. In particular, we employ a "unified colored noise approximation" to map the original problem into an effective one with white noise, and then we apply a standard path integral approach to gain analytical understanding. For the sake of specificity, we present our approach using as a guideline a variation of the contact process--which can also be seen as a birth-death process of the Malthus-Verhulst class--where the propagation or birth rate varies stochastically in time. Our approach allows us to tackle in a systematic manner some of the relevant questions concerning population dynamics under environmental variability, such as determining the stationary population density, establishing the conditions under which a population may become extinct, and estimating extinction times. We focus on the emerging phase diagram and its possible phase transitions, underlying how these are affected by the presence of environmental noise time-correlations. △ Less

Submitted 2 October, 2017; v1 submitted 12 July, 2017; originally announced July 2017.

Comments: 10 pages, 3 figures

Journal ref: Phys. Rev. E 96, 042301 (2017)

Topological dimension tunes activity patterns in hierarchical modular network models

Authors: Ali Safari, Paolo Moretti, Miguel A. Muñoz

Abstract: Connectivity patterns of relevance in neuroscience and systems biology can be encoded in hierarchical modular networks (HMNs). Moreover, recent studies highlight the role of hierarchical modular organization in sha** brain activity patterns, providing an excellent substrate to promote both the segregation and integration of neural information. Here we propose an extensive numerical analysis of t… ▽ More Connectivity patterns of relevance in neuroscience and systems biology can be encoded in hierarchical modular networks (HMNs). Moreover, recent studies highlight the role of hierarchical modular organization in sha** brain activity patterns, providing an excellent substrate to promote both the segregation and integration of neural information. Here we propose an extensive numerical analysis of the critical spreading rate (or "epidemic" threshold) --separating a phase with endemic persistent activity from one in which activity ceases-- on diverse HMNs. By employing analytical and computational techniques we determine the nature of such a threshold and scrutinize how it depends on general structural features of the underlying HMN. We critically discuss the extent to which current graph-spectral methods can be applied to predict the onset of spreading in HMNs, and we propose the network topological dimension as a relevant and unifying structural parameter, controlling the epidemic threshold. △ Less

Submitted 23 May, 2017; originally announced May 2017.

Comments: 8 pages, 5 figures

Neutral theory and scale-free neural dynamics

Authors: Matteo Martinello, Jorge Hidalgo, Serena di Santo, Amos Maritan, Dietmar Plenz, Miguel A. Muñoz

Abstract: Avalanches of electrochemical activity in brain networks have been empirically reported to obey scale-invariant behavior --characterized by power-law distributions up to some upper cut-off-- both in vitro and in vivo. Elucidating whether such scaling laws stem from the underlying neural dynamics operating at the edge of a phase transition is a fascinating possibility, as systems poised at critical… ▽ More Avalanches of electrochemical activity in brain networks have been empirically reported to obey scale-invariant behavior --characterized by power-law distributions up to some upper cut-off-- both in vitro and in vivo. Elucidating whether such scaling laws stem from the underlying neural dynamics operating at the edge of a phase transition is a fascinating possibility, as systems poised at criticality have been argued to exhibit a number of important functional advantages. Here we employ a well-known model for neural dynamics with synaptic plasticity, to elucidate an alternative scenario in which neuronal avalanches can coexist, overlap** in time, but still remaining scale-free. Remarkably their scale-invariance does not stem from underlying criticality nor self-organization at the edge of a continuous phase transition. Instead, it emerges from the fact that perturbations to the system exhibit a neutral drift --guided by demographic fluctuations-- with respect to endogenous spontaneous activity. Such a neutral dynamics --similar to the one in neutral theories of population genetics-- implies marginal propagation of activity, characterized by power-law distributed causal avalanches. Importantly, our results underline the importance of considering causal information --on which neuron triggers the firing of which-- to properly estimate the statistics of avalanches of neural activity. We discuss the implications of these findings both in modeling and to elucidate experimental observations, as well as its possible consequences for actual neural dynamics and information processing in actual neural networks. △ Less

Submitted 15 March, 2017; originally announced March 2017.

Comments: Main text: 8 pages, 3 figures. Supplementary information: 5 pages, 4 figures

Journal ref: Phys. Rev. X 7, 041071 (2017)

A simple unified view of branching process statistics: random walks in balanced logarithmic potentials

Authors: Serena di Santo, Pablo Villegas, Rafaella Burioni, Miguel A. Muñoz

Abstract: We revisit the problem of deriving the mean-field values of avalanche critical exponents in systems with absorbing states. These are well-known to coincide with those of an un-biased branching process. Here, we show that for at least 4 different universality classes (directed percolation, dynamical percolation, the voter model or compact directed percolation class, and the Manna class of stochasti… ▽ More We revisit the problem of deriving the mean-field values of avalanche critical exponents in systems with absorbing states. These are well-known to coincide with those of an un-biased branching process. Here, we show that for at least 4 different universality classes (directed percolation, dynamical percolation, the voter model or compact directed percolation class, and the Manna class of stochastic sandpiles) this common result can be obtained by map** the corresponding Langevin equations describing each of these classes into a random walker confined close to the origin by a logarithmic potential. Many of the results derived here appear in the literature as independently derived for individual universality classes or for the branching process. However, the emergence of non-universal continuously-varying exponent values --which, as shown here, stems fro the presence of small external driving, that might induce avalanche merging-- has not been noticed (or emphasized) in the past. We believe that a simple an unified perspective as the one presented here can (i) help to clarify the overall picture, (ii) underline the super-universality of the behavior as well as the dependence on external driving, and (iii) help avoiding the common existing confusion between un-biased branching processes (equivalent to a random walker in a balanced logarithmic potential) and standard (un-confined) random walkers. △ Less

Submitted 21 February, 2017; v1 submitted 21 December, 2016; originally announced December 2016.

Comments: 6 pages, 3 figures, 1 table

Journal ref: Phys. Rev. E 95, 032115 (2017)

Intrinsic noise and deviations from criticality in Boolean gene-regulatory networks

Authors: Pablo Villegas, José Ruiz-Franco, Jorge Hidalgo, Miguel A. Muñoz

Abstract: Gene regulatory networks can be successfully modeled as Boolean networks. A much discussed hypothesis says that such model networks reproduce empirical findings the best if they are tuned to operate at criticality, i.e. at the borderline between their ordered and disordered phases. Critical networks have been argued to lead to a number of functional advantages such as maximal dynamical range, maxi… ▽ More Gene regulatory networks can be successfully modeled as Boolean networks. A much discussed hypothesis says that such model networks reproduce empirical findings the best if they are tuned to operate at criticality, i.e. at the borderline between their ordered and disordered phases. Critical networks have been argued to lead to a number of functional advantages such as maximal dynamical range, maximal sensitivity to environmental changes, as well as to an excellent trade off between stability and flexibility. Here, we study the effect of noise within the context of Boolean networks trained to learn complex tasks under supervision. We verify that quasi-critical networks are the ones learning in the fastest possible way --even for asynchronous updating rules-- and that the larger the task complexity the smaller the distance to criticality. On the other hand, when additional sources of intrinsic noise in the network states and/or in its wiring pattern are introduced, the optimally performing networks become clearly subcritical. These results suggest that in order to compensate for inherent stochasticity, regulatory and other type of biological networks might become subcritical rather than being critical, all the most if the task to be performed has limited complexity. △ Less

Submitted 10 June, 2016; originally announced June 2016.

Comments: 14 pages, 6 figures and 1 table. Submitted to Scientific Reports

Journal ref: Scientific Reports 6, 34743 (2016)