-
Integrated Information Decomposition Unveils Major Structural Traits of $In$ $Silico$ and $In$ $Vitro$ Neuronal Networks
Authors:
Gustavo Menesse,
Akke Mats Houben,
Jordi Soriano,
Joaquin J. Torres
Abstract:
The properties of complex networked systems arise from the interplay between the dynamics of their elements and the underlying topology. Thus, to understand their behaviour, it is crucial to convene as much information as possible about their topological organization. However, in a large systems such as neuronal networks, the reconstruction of such topology is usually carried out from the informat…
▽ More
The properties of complex networked systems arise from the interplay between the dynamics of their elements and the underlying topology. Thus, to understand their behaviour, it is crucial to convene as much information as possible about their topological organization. However, in a large systems such as neuronal networks, the reconstruction of such topology is usually carried out from the information encoded in the dynamics on the network, such as spike train time series, and by measuring the Transfer Entropy between system elements. The topological information recovered by these methods does not necessarily capture the connectivity layout, but rather the causal flow of information between elements. New theoretical frameworks, such as Integrated Information Decomposition ($Φ$-ID), allow to explore the modes in which information can flow between parts of a system, opening a rich landscape of interactions between network topology, dynamics and information. Here, we apply $Φ$-ID on $in$ $silico$ and $in$ $vitro$ data to decompose the usual Transfer Entropy measure into different modes of information transfer, namely synergistic, redundant or unique. We demonstrate that the unique information transfer is the most relevant measure to uncover structural topological details from network activity data, while redundant information only introduces residual information for this application. Although the retrieved network connectivity is still functional, it captures more details of the underlying structural topology by avoiding to take into account emergent high-order interactions and information redundancy between elements, which are important for the functional behavior, but mask the detection of direct simple interactions between elements constituted by the structural network topology.
△ Less
Submitted 17 June, 2024; v1 submitted 30 January, 2024;
originally announced January 2024.
-
Information dynamics efficiently discriminates high $γ$-rhythms in EEG brain waves
Authors:
Gustavo Menesse,
Joaquin J. Torres
Abstract:
Discriminating between physiological waves, linked to functional brain properties, and pathological waves, due to brain malfunction, is problematic, e. g., for high-frequency oscillations (HFO) as high $γ$ waves. Brain rhythms observed in EEG can also be observed in excitatory/inhibitory (E/I) NN models. Such models allow to study the relationship between waves and neuronal circuit functions, whic…
▽ More
Discriminating between physiological waves, linked to functional brain properties, and pathological waves, due to brain malfunction, is problematic, e. g., for high-frequency oscillations (HFO) as high $γ$ waves. Brain rhythms observed in EEG can also be observed in excitatory/inhibitory (E/I) NN models. Such models allow to study the relationship between waves and neuronal circuit functions, which could lead to fundamental insights to discriminating waves. To address this and other questions, we explore the emergence of high gamma rhythms in an E/I balanced neural population of integrated and fire neurons with short-term synaptic plasticity. This model generates a rich repertoire of EEG-like rhythms, including high-frequency excitatory and inhibitory oscillations. Using the integrated information decomposition framework (Phi-ID), we explore the information dynamics of the network and its relationship with excitatory and inhibitory activity and high-frequency rhythms. In regions where high gamma rhythms emerge only in the excitatory population, we see informational properties in the network more favorable for computation and processing information, corresponding then to functional regimes. However, regions where high gamma rhythms also emerge in the inhibitory population present lower mutual information in general, and the system becomes less predictable, a fact that can be linked to a less functional or ``pathological" regime. In the second case, we observe that both excitatory and inhibitory populations oscillate with the same dominant frequency, which is higher than in the first case. Higher frequency oscillations and synchronization are commonly associated with epileptic seizures so adopting an information dynamics approach could help differentiate between high-frequency oscillations related to cognitive functions from those related to neuronal disorders such as epilepsy.
△ Less
Submitted 23 November, 2023;
originally announced November 2023.
-
From asynchronous states to Griffiths phases and back: structural heterogeneity and homeostasis in excitatory-inhibitory networks
Authors:
Jorge Pretel,
Victor Buendía,
Joaquín J. Torres,
Miguel A. Muñoz
Abstract:
Balanced neural networks -- in which excitatory and inhibitory inputs compensate each other on average -- give rise to a dynamical phase dominated by fluctuations called asynchronous state, crucial for brain functioning. However, structural disorder -- which is inherent to random networks -- can hinder such an excitation-inhibition balance. Indeed, structural and synaptic heterogeneities can gener…
▽ More
Balanced neural networks -- in which excitatory and inhibitory inputs compensate each other on average -- give rise to a dynamical phase dominated by fluctuations called asynchronous state, crucial for brain functioning. However, structural disorder -- which is inherent to random networks -- can hinder such an excitation-inhibition balance. Indeed, structural and synaptic heterogeneities can generate extended regions in phase space akin to critical points, called Griffiths phases, with dynamical features very different from those of asynchronous states. Here, we study a simple neural-network model with tunable levels of heterogeneity able to display these two types of dynamical regimes -- i.e., asynchronous states and Griffiths phases -- putting them together within a single phase diagram. Using this simple model, we are able to emphasize the crucial role played by synaptic plasticity and homeostasis to re-establish balance in intrinsically heterogeneous networks. Overall, we shed light onto how diverse dynamical regimes, each with different functional advantages, can emerge from a given network as a result of self-organizing homeostatic mechanisms.
△ Less
Submitted 3 March, 2024; v1 submitted 3 October, 2023;
originally announced October 2023.
-
EEGs disclose significant brain activity correlated with synaptic fickleness
Authors:
Jorge Pretel,
Joaquin J. Torres,
J. Marro
Abstract:
We here study a network of synaptic relations mingling excitatory and inhibitory neuron nodes that displays oscillations quite similar to electroencephalogram (EEG) brain waves, and identify abrupt variations brought about by swift synaptic mediations. We thus conclude that corresponding changes in EEG series surely come from the slowdown of the activity in neuron populations due to synaptic restr…
▽ More
We here study a network of synaptic relations mingling excitatory and inhibitory neuron nodes that displays oscillations quite similar to electroencephalogram (EEG) brain waves, and identify abrupt variations brought about by swift synaptic mediations. We thus conclude that corresponding changes in EEG series surely come from the slowdown of the activity in neuron populations due to synaptic restrictions. The latter happens to generate an imbalance between excitation and inhibition causing a quick explosive increase of excitatory activity, which turns out to be a (first-order) transition among dynamic mental phases. Besides, near this phase transition, our model system exhibits waves with a strong component in the so-called \textit{delta-theta domain} that coexist with fast oscillations. These findings provide a simple explanation for the observed \textit{delta-gamma} and \textit{theta-gamma modulation} in actual brains, and open a serious and versatile path to understand deeply large amounts of apparently erratic, easily accessible brain data.
△ Less
Submitted 16 February, 2021; v1 submitted 13 February, 2021;
originally announced February 2021.
-
Emergence of Brain Rhythms: Model Interpretation of EEG Data
Authors:
Javier A. Galadí,
Joaquín J. Torres,
J. Marro
Abstract:
Electroencephalography (EEG) monitors ---by either intrusive or noninvasive electrodes--- time and frequency variations and spectral content of voltage fluctuations or waves, known as brain rhythms, which in some way uncover activity during both rest periods and specific events in which the subject is under stimulus. This is a useful tool to explore brain behavior, as it complements imaging techni…
▽ More
Electroencephalography (EEG) monitors ---by either intrusive or noninvasive electrodes--- time and frequency variations and spectral content of voltage fluctuations or waves, known as brain rhythms, which in some way uncover activity during both rest periods and specific events in which the subject is under stimulus. This is a useful tool to explore brain behavior, as it complements imaging techniques that have a poorer temporal resolution. We here approach the understanding of EEG data from first principles by studying a networked model of excitatory and inhibitory neurons which generates a variety of comparable waves. In fact, we thus reproduce $α$, $β,$ $γ$ and other rhythms as observed by EEG, and identify the details of the respectively involved complex phenomena, including a precise relationship between an input and the collective response to it. It ensues the potentiality of our model to better understand actual mind mechanisms and its possible disorders, and we also describe kind of stochastic resonance phenomena which locate main qualitative changes of mental behavior in (e.g.) humans. We also discuss the plausible use of these findings to design deep learning algorithms to detect the occurence of phase transitions in the brain and to analyse its consequences.
△ Less
Submitted 11 March, 2019;
originally announced March 2019.
-
Theory for Inverse Stochastic Resonance in Nature
Authors:
Joaquín J. Torres,
Muhammet Uzuntarla,
J. Marro
Abstract:
The inverse stochastic resonance (ISR) phenomenon consists in an unexpected depression in the response of a system under external noise, e.g., as observed in the behavior of the mean-firing rate in some pacemaker neurons in the presence of moderate values of noise. A possible requirement for such behavior is the existence of a bistable regime in the behavior of these neurons. We here explore theor…
▽ More
The inverse stochastic resonance (ISR) phenomenon consists in an unexpected depression in the response of a system under external noise, e.g., as observed in the behavior of the mean-firing rate in some pacemaker neurons in the presence of moderate values of noise. A possible requirement for such behavior is the existence of a bistable regime in the behavior of these neurons. We here explore theoretically the possible emergence of this behavior in a general bistable system, and conclude on conditions the potential function which drives the dynamics must accomplish. We show that such an intriguing, and apparently widely observed, phenomenon ensues in the case of an asymmetric potential function when the high activity minimum state of the system is metastable with the largest basin of attraction and the low activity state is the global minimum with a smaller basin of attraction. We discuss on the relevance of such a picture to understand the ISR features and to predict its general appearance in other natural systems that share the requirements described here. Finally, we report another intriguing non-standard stochastic resonance in our system, which occurs in the absence of any weak signal input into the system and whose emergence can be explained, with the ISR, within our theoretical framework in this paper in terms of the shape of the potential function.
△ Less
Submitted 30 October, 2018;
originally announced October 2018.
-
Synchronization-Induced Spike Termination in Networks of Bistable Neurons
Authors:
Muhammet Uzuntarla,
Joaquin J. Torres,
Ali Çalım,
Ernest Barreto
Abstract:
We observe and study a self-organized phenomenon whereby the activity in a network of spiking neurons spontaneously terminates. We consider different types of populations, consisting of bistable model neurons connected electrically by gap junctions, or by either excitatory or inhibitory synapses, in a scale-free connection topology. We find that strongly synchronized population spiking events lead…
▽ More
We observe and study a self-organized phenomenon whereby the activity in a network of spiking neurons spontaneously terminates. We consider different types of populations, consisting of bistable model neurons connected electrically by gap junctions, or by either excitatory or inhibitory synapses, in a scale-free connection topology. We find that strongly synchronized population spiking events lead to complete cessation of activity in excitatory networks, but not in gap junction or inhibitory networks. We identify the underlying mechanism responsible for this phenomenon by examining the particular shape of the excitatory postsynaptic currents that arise in the neurons. We also examine the effects of the synaptic time constant, coupling strength, and channel noise on the occurrence of the phenomenon.
△ Less
Submitted 21 November, 2018; v1 submitted 11 June, 2018;
originally announced June 2018.
-
Complex Network Geometry and Frustrated Synchronization
Authors:
Ana P. Millán,
Joaquín J. Torres,
Ginestra Bianconi
Abstract:
The dynamics of networks of neuronal cultures has been recently shown to be strongly dependent on the network geometry and in particular on their dimensionality. However, this phenomenon has been so far mostly unexplored from the theoretical point of view. Here we reveal the rich interplay between network geometry and synchronization of coupled oscillators in the context of a simplicial complex mo…
▽ More
The dynamics of networks of neuronal cultures has been recently shown to be strongly dependent on the network geometry and in particular on their dimensionality. However, this phenomenon has been so far mostly unexplored from the theoretical point of view. Here we reveal the rich interplay between network geometry and synchronization of coupled oscillators in the context of a simplicial complex model of manifolds called Complex Network Manifold. The networks generated by this model combine small world properties (infinite Hausdorff dimension) and a high modular structure with finite and tunable spectral dimension. We show that the networks display frustrated synchronization for a wide range of the coupling strength of the oscillators, and that the synchronization properties are directly affected by the spectral dimension of the network.
△ Less
Submitted 30 June, 2018; v1 submitted 1 February, 2018;
originally announced February 2018.
-
Decoupled molecules with binding polynomials of bidegree (n,2)
Authors:
Yue Ren,
Johannes W. R. Martini,
Jacinta Torres
Abstract:
We present a result on the number of decoupled molecules for systems binding two different types of ligands. In the case of $n$ and $2$ binding sites respectively, we show that, generically, there are $2(n!)^{2}$ decoupled molecules with the same binding polynomial. For molecules with more binding sites for the second ligand, we provide computational results.
We present a result on the number of decoupled molecules for systems binding two different types of ligands. In the case of $n$ and $2$ binding sites respectively, we show that, generically, there are $2(n!)^{2}$ decoupled molecules with the same binding polynomial. For molecules with more binding sites for the second ligand, we provide computational results.
△ Less
Submitted 18 November, 2017;
originally announced November 2017.
-
Double Inverse Stochastic Resonance with Dynamic Synapses
Authors:
M. Uzuntarla,
J. J. Torres,
P. So,
M. Ozer,
E. Barreto
Abstract:
We investigate the behavior of a model neuron that receives a biophysically-realistic noisy post-synaptic current based on uncorrelated spiking activity from a large number of afferents. We show that, with static synapses, such noise can give rise to inverse stochastic resonance (ISR) as a function of the presynaptic firing rate. We compare this to the case with dynamic synapses that feature short…
▽ More
We investigate the behavior of a model neuron that receives a biophysically-realistic noisy post-synaptic current based on uncorrelated spiking activity from a large number of afferents. We show that, with static synapses, such noise can give rise to inverse stochastic resonance (ISR) as a function of the presynaptic firing rate. We compare this to the case with dynamic synapses that feature short-term synaptic plasticity, and show that the interval of presynaptic firing rate over which ISR exists can be extended or diminished. We consider both short-term depression and facilitation. Interestingly, we find that a double inverse stochastic resonance (DISR), with two distinct wells centered at different presynaptic firing rates, can appear.
△ Less
Submitted 23 December, 2016;
originally announced December 2016.
-
Emergence of low noise \emph{frustrated} states in E/I balanced neural networks
Authors:
Ibon Recio,
Joaquín J. Torres
Abstract:
We study emerging phenomena in binary neural networks where, with a probability c synaptic intensities are chosen according with a Hebbian prescription, and with probability (1-c) there is an extra random contribution to synaptic weights. This new term, randomly taken from a Gaussian bimodal distribution, balances the synaptic population in the network so that one has 80-20 relation in E/I populat…
▽ More
We study emerging phenomena in binary neural networks where, with a probability c synaptic intensities are chosen according with a Hebbian prescription, and with probability (1-c) there is an extra random contribution to synaptic weights. This new term, randomly taken from a Gaussian bimodal distribution, balances the synaptic population in the network so that one has 80-20 relation in E/I population ratio, mimicking the balance observed in mammals cortex. For some regions of the relevant parameters, our system depicts standard memory (at low temperature) and non-memory attractors (at high temperature). However, as c decreases and the level of the underlying noise also decreases below a certain temperature T_t, a kind of memory-frustrated state, which resembles spin-glass behavior, sharply emerges. Contrary to what occurs in Hopfield-like neural networks, the frustrated state appears here even in the limit of the loading parameter alpha-->0. Moreover, we observed that the frustrated state in fact corresponds to two states of non-vanishing activity uncorrelated with stored memories, associated, respectively, to a high activity or Up state and to a low activity or Down state. Using a linear stability analysis, we found regions in the space of relevant parameters for locally stable steady states and demonstrated that frustrated states coexist with memory attractors below T_t. Then, multistability between memory and frustrated states is present for relatively small c, and metastability of memory attractors can emerge as c decreases even more. We studied our system using standard mean-field techniques and with Monte Carlo simulations, obtaining a perfect agreement between theory and simulations. Our study can be useful to ...
△ Less
Submitted 23 August, 2016;
originally announced August 2016.
-
Effects of dynamic synapses on noise-delayed response latency of a single neuron
Authors:
M. Uzuntarla,
M. Ozer,
U. Ileri,
A. Calim,
J. J. Torres
Abstract:
Noise-delayed decay (NDD) phenomenon emerges when the first-spike latency of a periodically forced stochastic neuron exhibits a maximum for a particular range of noise intensity. Here, we investigate the latency response dynamics of a single Hodgkin-Huxley neuron that is subject to both a suprathreshold periodic stimulus and a background activity arriving through dynamic synapses. We study the fir…
▽ More
Noise-delayed decay (NDD) phenomenon emerges when the first-spike latency of a periodically forced stochastic neuron exhibits a maximum for a particular range of noise intensity. Here, we investigate the latency response dynamics of a single Hodgkin-Huxley neuron that is subject to both a suprathreshold periodic stimulus and a background activity arriving through dynamic synapses. We study the first spike latency response as a function of the presynaptic firing rate f. This constitutes a more realistic scenario than previous works, since f provides a suitable biophysically realistic parameter to control the level of activity in actual neural systems. We first report on the emergence of classical NDD behavior as a function of f for the limit of static synapses. Secondly, we show that when short-term depression and facilitation mechanisms are included at synapses, different NDD features can be found due to the their modulatory effect on synaptic current fluctuations. For example a new intriguing double NDD (DNDD) behavior occurs for different sets of relevant synaptic parameters. Moreover, depending on the balance between synaptic depression and synaptic facilitation, single NDD or DNDD can prevails, in such a way that synaptic facilitation favors the emergence of DNDD whereas synaptic depression favors the existence of single NDD. This is the first time it has been reported the existence of DNDD effect in response latency dynamics of a neuron.
△ Less
Submitted 28 September, 2015;
originally announced September 2015.
-
Endocytic proteins drive vesicle growth via instability in high membrane tension environment
Authors:
Nikhil Walani,
Jennifer Torres,
Ashutosh Agrawal
Abstract:
Clathrin-mediated endocytosis (CME) is a key pathway for transporting cargo into cells via membrane vesicles. It plays an integral role in nutrient import, signal transduction, neurotransmission and cellular entry of pathogens and drug-carrying nanoparticles. As CME entails substantial local remodeling of the plasma membrane, the presence of membrane tension offers resistance to bending and hence,…
▽ More
Clathrin-mediated endocytosis (CME) is a key pathway for transporting cargo into cells via membrane vesicles. It plays an integral role in nutrient import, signal transduction, neurotransmission and cellular entry of pathogens and drug-carrying nanoparticles. As CME entails substantial local remodeling of the plasma membrane, the presence of membrane tension offers resistance to bending and hence, vesicle formation. Experiments show that in such high tension conditions, actin dynamics is required to carry out CME successfully. In this study, we build upon these pioneering experimental studies to provide fundamental mechanistic insights into the roles of two key endocytic proteins, namely, actin and BAR proteins in driving vesicle formation in high membrane tension environment. Our study reveals a new actin force induced `snap-through instability' that triggers a rapid shape transition from a shallow invagination to a highly invaginated tubular structure. We show that the association of BAR proteins stabilizes vesicles and induces a milder instability. In addition, we present a new counterintuitive role of BAR depolymerization in regulating the shape evolution of vesicles. We show that the dissociation of BAR proteins, supported by actin-BAR synergy, leads to considerable elongation and squeezing of vesicles. Going beyond the membrane geometry, we put forth a new stress-based perspective for the onset of vesicle scission and predict the shapes and composition of detached vesicles. We present the snap-through transition and the high in-plane stress as possible explanations for the intriguing direct transformation of broad and shallow invaginations into detached vesicles in BAR mutant yeast cells.
△ Less
Submitted 14 February, 2015; v1 submitted 5 February, 2015;
originally announced February 2015.
-
Efficient transmission of subthreshold signals in complex networks of spiking neurons
Authors:
Joaquin J. Torres,
Irene Elices,
J. Marro
Abstract:
We investigate the efficient transmission and processing of weak, subthreshold signals in a realistic neural medium in the presence of different levels of the underlying noise. Assuming Hebbian weights for maximal synaptic conductances -- that naturally balances the network with excitatory and inhibitory synapses -- and considering short-term synaptic plasticity affecting such conductances, we fou…
▽ More
We investigate the efficient transmission and processing of weak, subthreshold signals in a realistic neural medium in the presence of different levels of the underlying noise. Assuming Hebbian weights for maximal synaptic conductances -- that naturally balances the network with excitatory and inhibitory synapses -- and considering short-term synaptic plasticity affecting such conductances, we found different dynamic phases in the system. This includes a memory phase where population of neurons remain synchronized, an oscillatory phase where transitions between different synchronized populations of neurons appears and an asynchronous or noisy phase. When a weak stimulus input is applied to each neuron, increasing the level of noise in the medium we found an efficient transmission of such stimuli around the transition and critical points separating different phases for well-defined different levels of stochasticity in the system. We proved that this intriguing phenomenon is quite robust, as it occurs in different situations including several types of synaptic plasticity, different type and number of stored patterns and diverse network topologies, namely, diluted networks and complex topologies such as scale-free and small-world networks. We conclude that the robustness of the phenomenon in different realistic scenarios, including spiking neurons, short-term synaptic plasticity and complex networks topologies, make very likely that it could also occur in actual neural systems as recent psycho-physical experiments suggest.
△ Less
Submitted 29 January, 2015; v1 submitted 15 October, 2014;
originally announced October 2014.
-
Short-term synaptic facilitation improves information retrieval in noisy neural networks
Authors:
J. F. Mejias,
B. Hernandez-Gomez,
J. J. Torres
Abstract:
Short-term synaptic depression and facilitation have been found to greatly influence the performance of autoassociative neural networks. However, only partial results, focused for instance on the computation of the maximum storage capacity at zero temperature, have been obtained to date. In this work, we extended the study of the effect of these synaptic mechanisms on autoassociative neural networ…
▽ More
Short-term synaptic depression and facilitation have been found to greatly influence the performance of autoassociative neural networks. However, only partial results, focused for instance on the computation of the maximum storage capacity at zero temperature, have been obtained to date. In this work, we extended the study of the effect of these synaptic mechanisms on autoassociative neural networks to more realistic and general conditions, including the presence of noise in the system. In particular, we characterized the behavior of the system by means of its phase diagrams, and we concluded that synaptic facilitation significantly enlarges the region of good retrieval performance of the network. We also found that networks with facilitating synapses may have critical temperatures substantially higher than those of standard autoassociative networks, thus allowing neural networks to perform better under high-noise conditions.
△ Less
Submitted 17 February, 2012; v1 submitted 27 January, 2012;
originally announced January 2012.
-
Can intrinsic noise induce various resonant peaks?
Authors:
J. J. Torres,
J. Marro,
J. F. Mejias
Abstract:
We theoretically describe how weak signals may be efficiently transmitted throughout more than one frequency range in noisy excitable media by kind of stochastic multiresonance. This serves us here to reinterpret recent experiments in neuroscience, and to suggest that many other systems in nature might be able to exhibit several resonances. In fact, the observed behavior happens in our (network) m…
▽ More
We theoretically describe how weak signals may be efficiently transmitted throughout more than one frequency range in noisy excitable media by kind of stochastic multiresonance. This serves us here to reinterpret recent experiments in neuroscience, and to suggest that many other systems in nature might be able to exhibit several resonances. In fact, the observed behavior happens in our (network) model as a result of competition between (1) changes in the transmitted signals as if the units were varying their activation threshold, and (2) adaptive noise realized in the model as rapid activity-dependent fluctuations of the connection intensities. These two conditions are indeed known to characterize heterogeneously networked systems of excitable units, e.g., sets of neurons and synapses in the brain. Our results may find application also in the design of detector devices.
△ Less
Submitted 6 April, 2011;
originally announced April 2011.
-
Enhancing neural-network performance via assortativity
Authors:
Sebastiano de Franciscis,
Samuel Johnson,
Joaquín J. Torres
Abstract:
The performance of attractor neural networks has been shown to depend crucially on the heterogeneity of the underlying topology. We take this analysis a step further by examining the effect of degree-degree correlations -- or assortativity -- on neural-network behavior. We make use of a method recently put forward for studying correlated networks and dynamics thereon, both analytically and computa…
▽ More
The performance of attractor neural networks has been shown to depend crucially on the heterogeneity of the underlying topology. We take this analysis a step further by examining the effect of degree-degree correlations -- or assortativity -- on neural-network behavior. We make use of a method recently put forward for studying correlated networks and dynamics thereon, both analytically and computationally, which is independent of how the topology may have evolved. We show how the robustness to noise is greatly enhanced in assortative (positively correlated) neural networks, especially if it is the hub neurons that store the information.
△ Less
Submitted 8 December, 2010;
originally announced December 2010.
-
Irregular dynamics in up and down cortical states
Authors:
Jorge F. Mejias,
Hilbert J. Kappen,
Joaquin J. Torres
Abstract:
Complex coherent dynamics is present in a wide variety of neural systems. A typical example is the voltage transitions between up and down states observed in cortical areas in the brain. In this work, we study this phenomenon via a biologically motivated stochastic model of up and down transitions. The model is constituted by a simple bistable rate model, where the synaptic current is modulated by…
▽ More
Complex coherent dynamics is present in a wide variety of neural systems. A typical example is the voltage transitions between up and down states observed in cortical areas in the brain. In this work, we study this phenomenon via a biologically motivated stochastic model of up and down transitions. The model is constituted by a simple bistable rate model, where the synaptic current is modulated by short-term synaptic processes which introduce stochasticity and temporal correlations. A complete analysis of our model, both with mean-field approaches and numerical simulations, shows the appearance of complex transitions between high (up) and low (down) neural activity states, driven by the synaptic noise, with permanence times in the up state distributed according to a power-law. We show that the experimentally observed large fluctuation in up and down permanence times can be explained as the result of sufficiently noisy dynamical synapses with sufficiently large recovery times. Static synapses cannot account for this behavior, nor can dynamical synapses in the absence of noise.
△ Less
Submitted 20 July, 2010;
originally announced July 2010.
-
Robust short-term memory without synaptic learning
Authors:
Samuel Johnson,
J. Marro,
Joaquín J. Torres
Abstract:
Short-term memory in the brain cannot in general be explained the way long-term memory can -- as a gradual modification of synaptic weights -- since it takes place too quickly. Theories based on some form of cellular bistability, however, do not seem able to account for the fact that noisy neurons can collectively store information in a robust manner. We show how a sufficiently clustered network o…
▽ More
Short-term memory in the brain cannot in general be explained the way long-term memory can -- as a gradual modification of synaptic weights -- since it takes place too quickly. Theories based on some form of cellular bistability, however, do not seem able to account for the fact that noisy neurons can collectively store information in a robust manner. We show how a sufficiently clustered network of simple model neurons can be instantly induced into metastable states capable of retaining information for a short time (a few seconds). The mechanism is robust to different network topologies and kinds of neural model. This could constitute a viable means available to the brain for sensory and/or short-term memory with no need of synaptic learning. Relevant phenomena described by neurobiology and psychology, such as local synchronization of synaptic inputs and power-law statistics of forgetting avalanches, emerge naturally from this mechanism, and we suggest possible experiments to test its viability in more biological settings.
△ Less
Submitted 30 January, 2013; v1 submitted 19 July, 2010;
originally announced July 2010.
-
Self-organization without conservation: Are neuronal avalanches generically critical?
Authors:
Juan A. Bonachela,
Sebastiano de Franciscis,
Joaquin J. Torres,
Miguel A. Munoz
Abstract:
Recent experiments on cortical neural networks have revealed the existence of well-defined avalanches of electrical activity. Such avalanches have been claimed to be generically scale-invariant -- i.e. power-law distributed -- with many exciting implications in Neuroscience. Recently, a self-organized model has been proposed by Levina, Herrmann and Geisel to justify such an empirical finding. Gi…
▽ More
Recent experiments on cortical neural networks have revealed the existence of well-defined avalanches of electrical activity. Such avalanches have been claimed to be generically scale-invariant -- i.e. power-law distributed -- with many exciting implications in Neuroscience. Recently, a self-organized model has been proposed by Levina, Herrmann and Geisel to justify such an empirical finding. Given that (i) neural dynamics is dissipative and (ii) there is a loading mechanism "charging" progressively the background synaptic strength, this model/dynamics is very similar in spirit to forest-fire and earthquake models, archetypical examples of non-conserving self-organization, which have been recently shown to lack true criticality. Here we show that cortical neural networks obeying (i) and (ii) are not generically critical; unless parameters are fine tuned, their dynamics is either sub- or super-critical, even if the pseudo-critical region is relatively broad. This conclusion seems to be in agreement with the most recent experimental observations. The main implication of our work is that, if future experimental research on cortical networks were to support that truly critical avalanches are the norm and not the exception, then one should look for more elaborate (adaptive/evolutionary) explanations, beyond simple self-organization, to account for this.
△ Less
Submitted 19 January, 2010;
originally announced January 2010.
-
Emergence of resonances in neural systems: the interplay between threshold adaptation and short-term synaptic plasticity
Authors:
Jorge F. Mejias,
Joaquin J. Torres
Abstract:
In this work we study the detection of weak stimuli by spiking neurons in the presence of certain level of noisy background neural activity. Our study has focused in the realistic assumption that the synapses in the network present activity-dependent processes, such as short-term synaptic depression and facilitation. Employing mean-field techniques as well as numerical simulations, we found that…
▽ More
In this work we study the detection of weak stimuli by spiking neurons in the presence of certain level of noisy background neural activity. Our study has focused in the realistic assumption that the synapses in the network present activity-dependent processes, such as short-term synaptic depression and facilitation. Employing mean-field techniques as well as numerical simulations, we found that there are two possible noise levels which optimize signal transmission. This new finding is in contrast with the classical theory of stochastic resonance which is able to predict only one optimal level of noise. We found that the complex interplay between the nonlinear dynamics of the neuron threshold and the activity-dependent synaptic mechanisms is responsible for this new phenomenology. Our results are confirmed by employing a more realistic FitzHugh-Nagumo neuron model, which displays threshold variability, as well as by considering more realistic synaptic models. We support our findings with recent experimental data of stochastic resonance in the human tactile blink reflex.
△ Less
Submitted 3 June, 2009;
originally announced June 2009.
-
Evolving Networks and the Development of Neural Systems
Authors:
Samuel Johnson,
J. Marro,
Joaquin J. Torres
Abstract:
It is now generally assumed that the heterogeneity of most networks in nature probably arises via preferential attachment of some sort. However, the origin of various other topological features, such as degree-degree correlations and related characteristics, is often not clear and attributed to specific functional requirements. We show how it is possible to analyse a very general scenario in whi…
▽ More
It is now generally assumed that the heterogeneity of most networks in nature probably arises via preferential attachment of some sort. However, the origin of various other topological features, such as degree-degree correlations and related characteristics, is often not clear and attributed to specific functional requirements. We show how it is possible to analyse a very general scenario in which nodes gain or lose edges according to any (e.g., nonlinear) functions of local and/or global degree information. Applying our method to two rather different examples of brain development -- synaptic pruning in humans and the neural network of the worm C. Elegans -- we find that simple biologically motivated assumptions lead to very good agreement with experimental data. In particular, many nontrivial topological features of the worm's brain arise naturally at a critical point.
△ Less
Submitted 27 January, 2010; v1 submitted 24 May, 2009;
originally announced May 2009.
-
Maximum memory capacity on neural networks with short-term depression and facilitation
Authors:
Jorge F. Mejias,
Joaquin J. Torres
Abstract:
In this work we study, analytically and employing Monte Carlo simulations, the influence of the competition between several activity-dependent synaptic processes, such as short-term synaptic facilitation and depression, on the maximum memory storage capacity in a neural network. In contrast with the case of synaptic depression, which drastically reduces the capacity of the network to store and r…
▽ More
In this work we study, analytically and employing Monte Carlo simulations, the influence of the competition between several activity-dependent synaptic processes, such as short-term synaptic facilitation and depression, on the maximum memory storage capacity in a neural network. In contrast with the case of synaptic depression, which drastically reduces the capacity of the network to store and retrieve "static" activity patterns, synaptic facilitation enhances the storage capacity in different contexts. In particular, we found optimal values of the relevant synaptic parameters (such as the neurotransmitter release probability or the characteristic facilitation time constant) for which the storage capacity can be maximal and similar to the one obtained with static synapses, that is, without activity-dependent processes. We conclude that depressing synapses with a certain level of facilitation allow to recover the good retrieval properties of networks with static synapses while maintaining the nonlinear characteristics of dynamic synapses, convenient for information processing and coding.
△ Less
Submitted 11 September, 2008;
originally announced September 2008.
-
The role of synaptic facilitation in coincidence spike detection
Authors:
Jorge F. Mejias,
Joaquin J. Torres
Abstract:
Using a realistic model of activity dependent dynamical synapses and a standard integrate and fire neuron model we study, both analytically and numerically, the conditions in which a postsynaptic neuron efficiently detects temporal coincidences of spikes arriving at certain frequency from N different afferents. We extend a previous work that only considers synaptic depression as the most importa…
▽ More
Using a realistic model of activity dependent dynamical synapses and a standard integrate and fire neuron model we study, both analytically and numerically, the conditions in which a postsynaptic neuron efficiently detects temporal coincidences of spikes arriving at certain frequency from N different afferents. We extend a previous work that only considers synaptic depression as the most important mechanism in the transmission of information through synapses, to a more general situation including also synaptic facilitation. Our study shows that: 1) facilitation enhances the detection of correlated signals arriving from a subset of presynaptic excitatory neurons, with different degrees of correlation among this subset, and 2) the presence of facilitation allows for a better detection of firing rate changes. Finally, we also observed that facilitation determines the existence of an optimal input frequency which allows the best performance for a wide (maximum) range of the neuron firing threshold. This optimal frequency can be controlled by means of facilitation parameters.
△ Less
Submitted 3 May, 2006;
originally announced May 2006.
-
Instability of attractors in autoassociative networks with bioinspired fast synaptic noise
Authors:
J. J. Torres,
J. M. Cortes,
J. Marro
Abstract:
We studied autoassociative networks in which synapses are noisy on a time scale much shorter that the one for the neuron dynamics. In our model a presynaptic noise causes postsynaptic depression as recently observed in neurobiological systems. This results in a nonequilibrium condition in which the network sensitivity to an external stimulus is enhanced. In particular, the fixed points are quali…
▽ More
We studied autoassociative networks in which synapses are noisy on a time scale much shorter that the one for the neuron dynamics. In our model a presynaptic noise causes postsynaptic depression as recently observed in neurobiological systems. This results in a nonequilibrium condition in which the network sensitivity to an external stimulus is enhanced. In particular, the fixed points are qualitatively modified, and the system may easily scape from the attractors. As a result, in addition to pattern recognition, the model is useful for class identification and categorization.
△ Less
Submitted 16 April, 2006;
originally announced April 2006.
-
Chaotic hop** between attractors in neural networks
Authors:
J. Marro,
J. J. Torres,
J. M. Cortes
Abstract:
We present a neurobiologically--inspired stochastic cellular automaton whose state jumps with time between the attractors corresponding to a series of stored patterns. The jum** varies from regular to chaotic as the model parameters are modified. The resulting irregular behavior, which mimics the state of attention in which a systems shows a great adaptability to changing stimulus, is a conseq…
▽ More
We present a neurobiologically--inspired stochastic cellular automaton whose state jumps with time between the attractors corresponding to a series of stored patterns. The jum** varies from regular to chaotic as the model parameters are modified. The resulting irregular behavior, which mimics the state of attention in which a systems shows a great adaptability to changing stimulus, is a consequence in the model of short--time presynaptic noise which induces synaptic depression. We discuss results from both a mean--field analysis and Monte Carlo simulations.
△ Less
Submitted 16 April, 2006;
originally announced April 2006.
-
Competition between synaptic depression and facilitation in attractor neural networks
Authors:
J. J. Torres,
J. M. Cortes,
J. Marro,
H. J. Kappen
Abstract:
We study the effect of competition between short-term synaptic depression and facilitation on the dynamical properties of attractor neural networks, using Monte Carlo simulation and a mean field analysis. Depending on the balance between depression, facilitation and the noise, the network displays different behaviours, including associative memory and switching of the activity between different…
▽ More
We study the effect of competition between short-term synaptic depression and facilitation on the dynamical properties of attractor neural networks, using Monte Carlo simulation and a mean field analysis. Depending on the balance between depression, facilitation and the noise, the network displays different behaviours, including associative memory and switching of the activity between different attractors. We conclude that synaptic facilitation enhances the attractor instability in a way that (i) intensifies the system adaptability to external stimuli, which is in agreement with experiments, and (ii) favours the retrieval of information with less error during short--time intervals.
△ Less
Submitted 16 April, 2006;
originally announced April 2006.
-
Algorithms for identification and categorization
Authors:
J. M. Cortes,
P. L. Garrido,
H. J. Kappen,
J. Marro,
C. Morillas,
D. Navidad,
J. J. Torres
Abstract:
The main features of a family of efficient algorithms for recognition and classification of complex patterns are briefly reviewed. They are inspired in the observation that fast synaptic noise is essential for some of the processing of information in the brain.
The main features of a family of efficient algorithms for recognition and classification of complex patterns are briefly reviewed. They are inspired in the observation that fast synaptic noise is essential for some of the processing of information in the brain.
△ Less
Submitted 16 April, 2006;
originally announced April 2006.
-
Control of neural chaos by synaptic noise
Authors:
J. M. Cortes,
J. Marro,
J. J. Torres
Abstract:
We studied neural automata -or neurobiologically inspired cellular automata- which exhibits chaotic itinerancy among the different stored patterns or memories. This is a consequence of activity-dependent synaptic fluctuations, which continuously destabilize the attractor and induce irregular hop** to other possible attractors. The nature of the resulting irregularity depends on the dynamic det…
▽ More
We studied neural automata -or neurobiologically inspired cellular automata- which exhibits chaotic itinerancy among the different stored patterns or memories. This is a consequence of activity-dependent synaptic fluctuations, which continuously destabilize the attractor and induce irregular hop** to other possible attractors. The nature of the resulting irregularity depends on the dynamic details, namely, on the intensity of the synaptic noise and on the number of sites of the network that are synchronously updated at each time step. Varying these details, different regimes occur from regular to chaotic. In the absence of external agents, the chaotic behavior may turn regular after tuning the noise intensity. It is argued that a similar mechanism might be at the origin of the self-control of chaos in natural systems.
△ Less
Submitted 1 October, 2005;
originally announced October 2005.
-
Effects of fast presynaptic noise in attractor neural networks
Authors:
J. M. Cortes,
J. J. Torres,
J. Marro,
P. L. Garrido,
H. J. Kappen
Abstract:
We study both analytically and numerically the effect of presynaptic noise on the transmission of information in attractor neural networks. The noise occurs on a very short-time scale compared to that for the neuron dynamics and it produces short-time synaptic depression. This is inspired in recent neurobiological findings that show that synaptic strength may either increase or decrease on a sho…
▽ More
We study both analytically and numerically the effect of presynaptic noise on the transmission of information in attractor neural networks. The noise occurs on a very short-time scale compared to that for the neuron dynamics and it produces short-time synaptic depression. This is inspired in recent neurobiological findings that show that synaptic strength may either increase or decrease on a short-time scale depending on presynaptic activity. We thus describe a mechanism by which fast presynaptic noise enhances the neural network sensitivity to an external stimulus. The reason for this is that, in general, the presynaptic noise induces nonequilibrium behavior and, consequently, the space of fixed points is qualitatively modified in such a way that the system can easily scape from the attractor. As a result, the model shows, in addition to pattern recognition, class identification and categorization, which may be relevant to the understanding of some of the brain complex tasks.
△ Less
Submitted 13 August, 2005;
originally announced August 2005.
