Showing 1–31 of 31 results for author: Cortes, J M

Disentangling high order effects in the transfer entropy

Authors: Sebastiano Stramaglia, Luca Faes, Jesus M. Cortes, Daniele Marinazzo

Abstract: Transfer Entropy (TE), the primary method for determining directed information flow within a network system, can exhibit bias - either in deficiency or excess - during both pairwise and conditioned calculations, owing to high-order dependencies among the dynamic processes under consideration and the remaining processes in the system used for conditioning. Here, we propose a novel approach. Instead… ▽ More Transfer Entropy (TE), the primary method for determining directed information flow within a network system, can exhibit bias - either in deficiency or excess - during both pairwise and conditioned calculations, owing to high-order dependencies among the dynamic processes under consideration and the remaining processes in the system used for conditioning. Here, we propose a novel approach. Instead of conditioning TE on all network processes except the driver and target, as in its fully conditioned version, or not conditioning at all, as in the pairwise approach, our method searches for both the multiplets of variables that maximize information flow and those that minimize it. This provides a decomposition of TE into unique, redundant, and synergistic atoms. Our approach enables the quantification of the relative importance of high-order effects compared to pure two-body effects in information transfer between two processes, while also highlighting the processes that contribute to building these high-order effects alongside the driver. We demonstrate the application of our approach in climatology by analyzing data from El Niño and the Southern Oscillation. △ Less

Submitted 13 February, 2024; v1 submitted 5 February, 2024; originally announced February 2024.

Small variation in dynamic functional connectivity in cerebellar networks

Authors: Izaro Fernandez-Iriondo, Antonio Jimenez-Marin, Ibai Diez, Paolo Bonifazi, Stephan P. Swinnen, Miguel A. Muñoz, Jesus M. Cortes

Abstract: Brain networks can be defined and explored through their connectivity. Here, we analyzed the relationship between structural connectivity (SC) across 2,514 regions that cover the entire brain and brainstem, and their dynamic functional connectivity (DFC). To do so, we focused on a combination of two metrics: the first assesses the degree of SC-DFC similarity and the second is the intrinsic variabi… ▽ More Brain networks can be defined and explored through their connectivity. Here, we analyzed the relationship between structural connectivity (SC) across 2,514 regions that cover the entire brain and brainstem, and their dynamic functional connectivity (DFC). To do so, we focused on a combination of two metrics: the first assesses the degree of SC-DFC similarity and the second is the intrinsic variability of the DFC networks over time. Overall, we found that cerebellar networks have a smaller DFC variability than other networks in the brain. Moreover, the internal structure of the cerebellum could be clearly divided in two distinct posterior and anterior parts, the latter also connected to the brainstem. The mechanism to maintain small variability of the DFC in the posterior part of the cerebellum is consistent with another of our findings, namely, that this structure exhibits the highest SC-DFC similarity relative to the other networks studied. By contrast, the anterior part of the cerebellum also exhibits small DFC variability but it has the lowest SC-DFC similarity, suggesting a different mechanism is at play. Because this structure connects to the brainstem, which regulates sleep cycles, cardiac and respiratory functioning, we suggest that such critical functionality drives the low variability in the DFC. Overall, the low variability detected in DFC expands our current knowledge of cerebellar networks, which are extremely rich and complex, participating in a wide range of cognitive functions, from movement control and coordination to executive function or emotional regulation. Moreover, the association between such low variability and structure suggests that differentiated computational principles can be applied in the cerebellum as opposed to other structures, such as the cerebral cortex. △ Less

Submitted 26 November, 2020; originally announced November 2020.

Comments: 19 pages, 6 figures

Persistence of hierarchical network organization and emergent topologies in models of functional connectivity

Authors: Ali Safari, Paolo Moretti, Ibai Diez, Jesus M. Cortes, Miguel Ángel Muñoz

Abstract: Functional networks provide a topological description of activity patterns in the brain, as they stem from the propagation of neural activity on the underlying anatomical or structural network of synaptic connections. This latter is well known to be organized in hierarchical and modular way. While it is assumed that structural networks shape their functional counterparts, it is also hypothesized t… ▽ More Functional networks provide a topological description of activity patterns in the brain, as they stem from the propagation of neural activity on the underlying anatomical or structural network of synaptic connections. This latter is well known to be organized in hierarchical and modular way. While it is assumed that structural networks shape their functional counterparts, it is also hypothesized that alterations of brain dynamics come with transformations of functional connectivity. In this computational study, we introduce a novel methodology to monitor the persistence and breakdown of hierarchical order in functional networks, generated from computational models of activity spreading on both synthetic and real structural connectomes. We show that hierarchical connectivity appears in functional networks in a persistent way if the dynamics is set to be in the quasi-critical regime associated with optimal processing capabilities and normal brain function, while it breaks down in other (supercritical) dynamical regimes, often associated with pathological conditions. Our results offer important clues for the study of optimal neurocomputing architectures and processes, which are capable of controlling patterns of activity and information flow. We conclude that functional connectivity patterns achieve optimal balance between local specialized processing (i.e. segregation) and global integration by inheriting the hierarchical organization of the underlying structural architecture. △ Less

Submitted 10 February, 2021; v1 submitted 10 March, 2020; originally announced March 2020.

Comments: 5 figures. Accepted for publication in Neurocomputing

Consensus clustering approach to group brain connectivity matrices

Authors: Javier Rasero, Mario Pellicoro, Leonardo Angelini, Jesus M. Cortes, Daniele Marinazzo, Sebastiano Stramaglia

Abstract: A novel approach rooted on the notion of consensus clustering, a strategy developed for community detection in complex networks, is proposed to cope with the heterogeneity that characterizes connectivity matrices in health and disease. The method can be summarized as follows: (i) define, for each node, a distance matrix for the set of subjects by comparing the connectivity pattern of that node i… ▽ More A novel approach rooted on the notion of consensus clustering, a strategy developed for community detection in complex networks, is proposed to cope with the heterogeneity that characterizes connectivity matrices in health and disease. The method can be summarized as follows: (i) define, for each node, a distance matrix for the set of subjects by comparing the connectivity pattern of that node in all pairs of subjects; (ii) cluster the distance matrix for each node; (iii) build the consensus network from the corresponding partitions; (iv) extract groups of subjects by finding the communities of the consensus network thus obtained. Differently from the previous implementations of consensus clustering, we thus propose to use the consensus strategy to combine the information arising from the connectivity patterns of each node. The proposed approach may be seen either as an exploratory technique or as an unsupervised pre-training step to help the subsequent construction of a supervised classifier. Applications on a toy model and two real data sets, show the effectiveness of the proposed methodology, which represents heterogeneity of a set of subjects in terms of a weighted network, the consensus matrix. △ Less

Submitted 8 May, 2017; v1 submitted 12 December, 2016; originally announced December 2016.

Information and long term memory in calcium signals

Authors: Ildefonso M. De la Fuente, Iker Malaina, Alberto Perez-Samartin, Jesus M. Cortes, Asier Erramuzpe, Maria Dolores Boyano, Carlos Bringas, Maria Fedetz, Luis Martinez

Abstract: Unicellular organisms are open metabolic systems that need to process information about their external environment in order to survive. In most types of tissues and organisms, cells use calcium signaling to carry information from the extracellular side of the plasma membrane to the different metabolic targets of their internal medium. This information might be encoded in the amplitude, frequency,… ▽ More Unicellular organisms are open metabolic systems that need to process information about their external environment in order to survive. In most types of tissues and organisms, cells use calcium signaling to carry information from the extracellular side of the plasma membrane to the different metabolic targets of their internal medium. This information might be encoded in the amplitude, frequency, duration, waveform or timing of the calcium oscillations. Thus, specific information coming from extracellular stimuli can be encoded in the calcium signal and decoded again later in different locations within the cell. Despite its cellular importance, little is known about the quantitative informative properties of the calcium concentration dynamics inside the cell. In order to understand some of these informational properties, we have studied experimental Ca2+ series of Xenopus laevis oocytes under different external pH stimulus. The data has been analyzed by means of information-theoretic approaches such as Conditional Entropy, Information Retention, and other non-linear dynamics tools such as the power spectra, the Largest Lyapunov exponent and the bridge detrended Scaled Window Variance analysis. We have quantified the biomolecular information flows of the experimental data in bits, and essential aspects of the information contained in the experimental calcium fluxes have been exhaustively analyzed. Our main result shows that inside all the studied intracellular Ca2+ flows a highly organized informational structure emerge, which exhibit deterministic chaotic behavior, long term memory and complex oscillations of the uncertainty reduction based on past values. The understanding of the informational properties of calcium signals is one of the key elements to elucidate the physiological functional coupling of the cell and the integrative dynamics of cellular life. △ Less

Submitted 7 June, 2015; originally announced June 2015.

Comments: 35 pages and 7 figures

Information flow between resting state networks

Authors: Ibai Diez, Asier Erramuzpe, Inaki Escudero, Beatriz Mateos, Alberto Cabrera, Daniele Marinazzo, Ernesto J. Sanz-Arigita, Sebastiano Stramaglia, Jesus M. Cortes

Abstract: The resting brain dynamics self-organizes into a finite number of correlated patterns known as resting state networks (RSNs). It is well known that techniques like independent component analysis can separate the brain activity at rest to provide such RSNs, but the specific pattern of interaction between RSNs is not yet fully understood. To this aim, we propose here a novel method to compute the in… ▽ More The resting brain dynamics self-organizes into a finite number of correlated patterns known as resting state networks (RSNs). It is well known that techniques like independent component analysis can separate the brain activity at rest to provide such RSNs, but the specific pattern of interaction between RSNs is not yet fully understood. To this aim, we propose here a novel method to compute the information flow (IF) between different RSNs from resting state magnetic resonance imaging. After haemodynamic response function blind deconvolution of all voxel signals, and under the hypothesis that RSNs define regions of interest, our method first uses principal component analysis to reduce dimensionality in each RSN to next compute IF (estimated here in terms of Transfer Entropy) between the different RSNs by systematically increasing k (the number of principal components used in the calculation). When k = 1, this method is equivalent to computing IF using the average of all voxel activities in each RSN. For k greater than one our method calculates the k-multivariate IF between the different RSNs. We find that the average IF among RSNs is dimension-dependent, increasing from k =1 (i.e., the average voxels activity) up to a maximum occurring at k =5 to finally decay to zero for k greater than 10. This suggests that a small number of components (close to 5) is sufficient to describe the IF pattern between RSNs. Our method - addressing differences in IF between RSNs for any generic data - can be used for group comparison in health or disease. To illustrate this, we have calculated the interRSNs IF in a dataset of Alzheimer's Disease (AD) to find that the most significant differences between AD and controls occurred for k =2, in addition to AD showing increased IF w.r.t. controls. △ Less

Submitted 13 May, 2015; originally announced May 2015.

Comments: 47 pages, 5 figures, 4 tables, 3 supplementary figures. Accepted for publication in Brain Connectivity in its current form

Synergetic and redundant information flow detected by unnormalized Granger causality: application to resting state fMRI

Authors: Sebastiano Stramaglia, Leonardo Angelini, Guorong Wu, Jesus M. Cortés, Luca Faes, Daniele Marinazzo

Abstract: Objectives: We develop a framework for the analysis of synergy and redundancy in the pattern of information flow between subsystems of a complex network. Methods: The presence of redundancy and/or synergy in multivariate time series data renders difficult to estimate the neat flow of information from each driver variable to a given target. We show that adopting an unnormalized definition of Grange… ▽ More Objectives: We develop a framework for the analysis of synergy and redundancy in the pattern of information flow between subsystems of a complex network. Methods: The presence of redundancy and/or synergy in multivariate time series data renders difficult to estimate the neat flow of information from each driver variable to a given target. We show that adopting an unnormalized definition of Granger causality one may put in evidence redundant multiplets of variables influencing the target by maximizing the total Granger causality to a given target, over all the possible partitions of the set of driving variables. Consequently we introduce a pairwise index of synergy which is zero when two independent sources additively influence the future state of the system, differently from previous definitions of synergy. Results: We report the application of the proposed approach to resting state fMRI data from the Human Connectome Project, showing that redundant pairs of regions arise mainly due to space contiguity and interhemispheric symmetry, whilst synergy occurs mainly between non-homologous pairs of regions in opposite hemispheres. Conclusions: Redundancy and synergy, in healthy resting brains, display characteristic patterns, revealed by the proposed approach. Significance: The pairwise synergy index, here introduced, maps the informational character of the system at hand into a weighted complex network: the same approach can be applied to other complex systems whose normal state corresponds to a balance between redundant and synergetic circuits. △ Less

Submitted 16 May, 2016; v1 submitted 14 April, 2015; originally announced April 2015.

Comments: 6 figures. arXiv admin note: text overlap with arXiv:1403.5156

Journal ref: Published in IEEE Transactions on Biomedical Engineering, 2016

A novel brain partition highlights the modular skeleton shared by structure and function

Authors: Ibai Diez, Paolo Bonifazi, Iñaki Escudero, Beatriz Mateos, Miguel A. Muñoz, Sebastiano Stramaglia, Jesus M. Cortes

Abstract: Elucidating the intricate relationship between brain structure and function, both in healthy and pathological conditions, is a key challenge for modern neuroscience. Recent technical and methodological progress in neuroimaging has helped advance our understanding of this important issue, with diffusion weighted images providing information about structural connectivity (SC) and functional magnetic… ▽ More Elucidating the intricate relationship between brain structure and function, both in healthy and pathological conditions, is a key challenge for modern neuroscience. Recent technical and methodological progress in neuroimaging has helped advance our understanding of this important issue, with diffusion weighted images providing information about structural connectivity (SC) and functional magnetic resonance imaging shedding light on resting state functional connectivity (rsFC). However, comparing these two distinct datasets, each of which can be encoded into a different complex network, is by no means trivial as pairwise link-to-link comparisons represent a relatively restricted perspective and provide only limited information. Thus, we have adopted a more integrative systems approach, exploiting theoretical graph analyses to study both SC and rsFC datasets gathered independently from healthy human subjects. The aim is to find the main architectural traits shared by the structural and functional networks by paying special attention to their common hierarchical modular organization. This approach allows us to identify a common skeleton from which a new, optimal, brain partition can be extracted, with modules sharing both structure and function. We describe these emerging common structure-function modules (SFMs) in detail. In addition, we compare SFMs with the classical Resting State Networks derived from independent component analysis of rs-fMRI functional activity, as well as with anatomical parcellations in the Automated Anatomical Labeling atlas and with the Broadmann partition, highlighting their similitude and differences. The unveiling of SFMs brings to light the strong correspondence between brain structure and resting-state dynamics. △ Less

Submitted 30 April, 2015; v1 submitted 29 October, 2014; originally announced October 2014.

Comments: Accepted in Nature Scientific Reports. 56 pages, 15 figures

Identification of redundant and synergetic circuits in triplets of electrophysiological data

Authors: Asier Erramuzpe, Guillermo J. Ortega, Jesus Pastor, Rafael G. de Sola, Daniele Marinazzo, Sebastiano Stramaglia, Jesus M. Cortes

Abstract: Neural systems are comprised of interacting units, and relevant information regarding their function or malfunction can be inferred by analyzing the statistical dependencies between the activity of each unit. Whilst correlations and mutual information are commonly used to characterize these dependencies, our objective here is to extend interactions to triplets of variables to better detect and cha… ▽ More Neural systems are comprised of interacting units, and relevant information regarding their function or malfunction can be inferred by analyzing the statistical dependencies between the activity of each unit. Whilst correlations and mutual information are commonly used to characterize these dependencies, our objective here is to extend interactions to triplets of variables to better detect and characterize dynamic information transfer. Our approach relies on the measure of interaction information (II). The sign of II provides information as to the extent to which the interaction of variables in triplets is redundant (R) or synergetic (S). Here, based on this approach, we calculated the R and S status for triplets of electrophysiological data recorded from drug-resistant patients with mesial temporal lobe epilepsy in order to study the spatial organization and dynamics of R and S close to the epileptogenic zone (the area responsible for seizure propagation). In terms of spatial organization, our results show that R matched the epileptogenic zone while S was distributed more in the surrounding area. In relation to dynamics, R made the largest contribution to high frequency bands (14-100Hz), whilst S was expressed more strongly at lower frequencies (1-7Hz). Thus, applying interaction information to such clinical data reveals new aspects of epileptogenic structure in terms of the nature (redundancy vs. synergy) and dynamics (fast vs. slow rhythms) of the interactions. We expect this methodology, robust and simple, can reveal new aspects beyond pair-interactions in networks of interacting units in other setups with multi-recording data sets (and thus, not necessarily in epilepsy, the pathology we have approached here). △ Less

Submitted 10 September, 2015; v1 submitted 27 April, 2014; originally announced April 2014.

Comments: 31 pages, 6 figures, 3 supplementary figures. To appear in the Journal of Neural Engineering in its current form

Synergy and redundancy in the Granger causal analysis of dynamical networks

Authors: Sebastiano Stramaglia, Jesus M. Cortes, Daniele Marinazzo

Abstract: We analyze by means of Granger causality the effect of synergy and redundancy in the inference (from time series data) of the information flow between subsystems of a complex network. Whilst we show that fully conditioned Granger causality is not affected by synergy, the pairwise analysis fails to put in evidence synergetic effects. In cases when the number of samples is low, thus making the ful… ▽ More We analyze by means of Granger causality the effect of synergy and redundancy in the inference (from time series data) of the information flow between subsystems of a complex network. Whilst we show that fully conditioned Granger causality is not affected by synergy, the pairwise analysis fails to put in evidence synergetic effects. In cases when the number of samples is low, thus making the fully conditioned approach unfeasible, we show that partially conditioned Granger causality is an effective approach if the set of conditioning variables is properly chosen. We consider here two different strategies (based either on informational content for the candidate driver or on selecting the variables with highest pairwise influences) for partially conditioned Granger causality and show that depending on the data structure either one or the other might be valid. On the other hand, we observe that fully conditioned approaches do not work well in presence of redundancy, thus suggesting the strategy of separating the pairwise links in two subsets: those corresponding to indirect connections of the fully conditioned Granger causality (which should thus be excluded) and links that can be ascribed to redundancy effects and, together with the results from the fully connected approach, provide a better description of the causality pattern in presence of redundancy. We finally apply these methods to two different real datasets. First, analyzing electrophysiological data from an epileptic brain, we show that synergetic effects are dominant just before seizure occurrences. Second, our analysis applied to gene expression time series from HeLa culture shows that the underlying regulatory networks are characterized by both redundancy and synergy. △ Less

Submitted 31 July, 2014; v1 submitted 20 March, 2014; originally announced March 2014.

PSN: Portfolio Social Network

Authors: Jordi M. Cortes, Sarwat Nizamani, Nasrullah Memon

Abstract: In this paper we present a web-based information system which is a portfolio social network (PSN) that provides solutions to recruiters and job seekers. The proposed system enables users to create portfolios so that he/she can add his specializations with piece of code, if any, specifically for software engineers, which is accessible online. The unique feature of the system is to enable the recrui… ▽ More In this paper we present a web-based information system which is a portfolio social network (PSN) that provides solutions to recruiters and job seekers. The proposed system enables users to create portfolios so that he/she can add his specializations with piece of code, if any, specifically for software engineers, which is accessible online. The unique feature of the system is to enable the recruiters to quickly view the prominent skills of the users. A comparative analysis of the proposed system with the state of the art systems is presented. The comparative study reveals that the proposed system has advanced functionalities. △ Less

Submitted 6 December, 2013; originally announced December 2013.

Journal ref: IJCEE 2014 Vol.6 (1): 12-15 ISSN: 1793-8163

Disruption of transfer entropy and inter-hemispheric brain functional connectivity in patients with disorder of consciousness

Authors: Verónica Mäki-Marttunen, Ibai Diez, Jesus M. Cortes, Dante R. Chialvo, Mirta Villarreal

Abstract: Severe traumatic brain injury can lead to disorders of consciousness (DOC) characterized by deficit in conscious awareness and cognitive impairment including coma, vegetative state, minimally consciousness, and lock-in syndrome. Of crucial importance is to find objective markers that can account for the large-scale disturbances of brain function to help the diagnosis and prognosis of DOC patients… ▽ More Severe traumatic brain injury can lead to disorders of consciousness (DOC) characterized by deficit in conscious awareness and cognitive impairment including coma, vegetative state, minimally consciousness, and lock-in syndrome. Of crucial importance is to find objective markers that can account for the large-scale disturbances of brain function to help the diagnosis and prognosis of DOC patients and eventually the prediction of the coma outcome. Following recent studies suggesting that the functional organization of brain networks can be altered in comatose patients, this work analyzes brain functional connectivity (FC) networks obtained from resting-state functional magnetic resonance imaging (rs-fMRI). Two approaches are used to estimate the FC: the Partial Correlation (PC) and the Transfer Entropy (TE). Both the PC and the TE show significant statistical differences between the group of patients and control subjects; in brief, the inter-hemispheric PC and the intra-hemispheric TE account for such differences. Overall, these results suggest two possible rs-fMRI markers useful to design new strategies for the management and neuropsychological rehabilitation of DOC patients. △ Less

Submitted 11 October, 2013; originally announced October 2013.

Comments: 25 pages; 4 figures; 3 tables; 1 supplementary figure; 4 supplementary tables; accepted for publication in Frontiers in Neuroinformatics

Short-term synaptic plasticity in the deterministic Tsodyks-Markram model leads to unpredictable network dynamics

Authors: Jesus M Cortes, Mathieu Desroches, Serafim Rodrigues, Romain Veltz, Miguel A. Munoz, Terrence J. Sejnowski

Abstract: Short-Term Synaptic Plasticity (STSP) strongly affects the neural dynamics of cortical networks. The Tsodyks and Markram (TM) model for STSP accurately accounts for a wide range of physiological responses at different types of cortical synapses. Here, we report for the first time a route to chaotic behavior via a Shilnikov homoclinic bifurcation that dynamically organises some of the responses in… ▽ More Short-Term Synaptic Plasticity (STSP) strongly affects the neural dynamics of cortical networks. The Tsodyks and Markram (TM) model for STSP accurately accounts for a wide range of physiological responses at different types of cortical synapses. Here, we report for the first time a route to chaotic behavior via a Shilnikov homoclinic bifurcation that dynamically organises some of the responses in the TM model. In particular, the presence of such a homoclinic bifurcation strongly affects the shape of the trajectories in the phase space and induces highly irregular transient dynamics; indeed, in the vicinity of the Shilnikov homoclinic bifurcation, the number of population spikes and their precise timing are unpredictable and highly sensitive to the initial conditions. Such an irregular deterministic dynamics has its counterpart in stochastic/network versions of the TM model: the existence of the Shilnikov homoclinic bifurcation generates complex and irregular spiking patterns and --acting as a sort of springboard-- facilitates transitions between the down-state and unstable periodic orbits. The interplay between the (deterministic) homoclinic bifurcation and stochastic effects may give rise to some of the complex dynamics observed in neural systems. △ Less

Submitted 30 September, 2013; originally announced September 2013.

Comments: Published in PNAS (Early edition) sept. 2013

Information transfer of an Ising model on a brain network

Authors: Daniele Marinazzo, Mario Pellicoro, Guorong Wu, Leonardo Angelini, Jesus M Cortes, Sebastiano Stramaglia

Abstract: We implement the Ising model on a structural connectivity matrix describing the brain at a coarse scale. Tuning the model temperature to its critical value, i.e. at the susceptibility peak, we find a maximal amount of total information transfer between the spin variables. At this point the amount of information that can be redistributed by some nodes reaches a limit and the net dynamics exhibits s… ▽ More We implement the Ising model on a structural connectivity matrix describing the brain at a coarse scale. Tuning the model temperature to its critical value, i.e. at the susceptibility peak, we find a maximal amount of total information transfer between the spin variables. At this point the amount of information that can be redistributed by some nodes reaches a limit and the net dynamics exhibits signature of the law of diminishing marginal returns, a fundamental principle connected to saturated levels of production. Our results extend the recent analysis of dynamical oscillators models on the connectome structure, taking into account lagged and directional influences, focusing only on the nodes that are more prone to became bottlenecks of information. The ratio between the outgoing and the incoming information at each node is related to the number of incoming links. △ Less

Submitted 1 September, 2013; v1 submitted 15 February, 2013; originally announced February 2013.

Stochastic Amplification of Fluctuations in Cortical Up-states

Authors: Jorge Hidalgo, Luis F. Seoane, Jesus M. Cortes, Miguel A. Munoz

Abstract: Cortical neurons are bistable; as a consequence their local field potentials can fluctuate between quiescent and active states, generating slow 0.5-2 Hz oscillations which are widely known as transitions between Up and Down States. Despite a large number of studies on Up-Down transitions, deciphering its nature, mechanisms and function are still today challenging tasks. In this paper we focus on r… ▽ More Cortical neurons are bistable; as a consequence their local field potentials can fluctuate between quiescent and active states, generating slow 0.5-2 Hz oscillations which are widely known as transitions between Up and Down States. Despite a large number of studies on Up-Down transitions, deciphering its nature, mechanisms and function are still today challenging tasks. In this paper we focus on recent experimental evidence, showing that a class of spontaneous oscillations can emerge within the Up states. In particular, a non-trivial peak around 20 Hz appears in their associated power-spectra, what produces an enhancement of the activity power for higher frequencies (in the 30-90 Hz band). Moreover, this rhythm within Ups seems to be an emergent or collective phenomenon given that individual neurons do not lock to it as they remain mostly unsynchronized. Remarkably, similar oscillations (and the concomitant peak in the spectrum) do not appear in the Down states. Here we shed light on these findings by using different computational models for the dynamics of cortical networks in presence of different levels of physiological complexity. Our conclusion, supported by both theory and simulations, is that the collective phenomenon of "stochastic amplification of fluctuations" -previously described in other contexts such as Ecology and Epidemiology-- explains in an elegant and parsimonious manner, beyond model-dependent details, this extra-rhythm emerging only in the Up states but not in the Downs. △ Less

Submitted 20 June, 2012; originally announced June 2012.

Comments: main text: 24 pages, 3 figures; supporting information: 16 pages, 7 figures. Accepted for publication in PLoS ONE

The effect of neural adaptation of population coding accuracy

Authors: J. M. Cortes, D. Marinazzo, P. Series, M. W. Oram, T. J. Sejnowski, M. C. W. van Rossum

Abstract: Most neurons in the primary visual cortex initially respond vigorously when a preferred stimulus is presented, but adapt as stimulation continues. The functional consequences of adaptation are unclear. Typically a reduction of firing rate would reduce single neuron accuracy as less spikes are available for decoding, but it has been suggested that on the population level, adaptation increases codin… ▽ More Most neurons in the primary visual cortex initially respond vigorously when a preferred stimulus is presented, but adapt as stimulation continues. The functional consequences of adaptation are unclear. Typically a reduction of firing rate would reduce single neuron accuracy as less spikes are available for decoding, but it has been suggested that on the population level, adaptation increases coding accuracy. This question requires careful analysis as adaptation not only changes the firing rates of neurons, but also the neural variability and correlations between neurons, which affect coding accuracy as well. We calculate the coding accuracy using a computational model that implements two forms of adaptation: spike frequency adaptation and synaptic adaptation in the form of short-term synaptic plasticity. We find that the net effect of adaptation is subtle and heterogeneous. Depending on adaptation mechanism and test stimulus, adaptation can either increase or decrease coding accuracy. We discuss the neurophysiological and psychophysical implications of the findings and relate it to published experimental data. △ Less

Submitted 14 March, 2011; originally announced March 2011.

Comments: 35 pages, 8 figures

Quantitative Analysis of the Effective Functional Structure in Yeast Glycolysis

Authors: Jesus M. Cortes, Ildefonso M. De la Fuente

Abstract: Yeast glycolysis is considered the prototype of dissipative biochemical oscillators. In cellular conditions, under sinusoidal source of glucose, the activity of glycolytic enzymes can display either periodic, quasiperiodic or chaotic behavior. In order to quantify the functional connectivity for the glycolytic enzymes in dissipative conditions we have analyzed different catalytic patterns using… ▽ More Yeast glycolysis is considered the prototype of dissipative biochemical oscillators. In cellular conditions, under sinusoidal source of glucose, the activity of glycolytic enzymes can display either periodic, quasiperiodic or chaotic behavior. In order to quantify the functional connectivity for the glycolytic enzymes in dissipative conditions we have analyzed different catalytic patterns using the non-linear statistical tool of Transfer Entropy. The data were obtained by means of a yeast glycolytic model formed by three delay differential equations where the enzymatic speed functions of the irreversible stages have been explicitly considered. These enzymatic activity functions were previously modeled and tested experimentally by other different groups. In agreement with experimental conditions, the studied time series corresponded to a quasi-periodic route to chaos. The results of the analysis are three-fold: first, in addition to the classical topological structure characterized by the specific location of enzymes, substrates, products and feedback regulatory metabolites, an effective functional structure emerges in the modeled glycolytic system, which is dynamical and characterized by notable variations of the functional interactions. Second, the dynamical structure exhibits a metabolic invariant which constrains the functional attributes of the enzymes. Finally, in accordance with the classical biochemical studies, our numerical analysis reveals in a quantitative manner that the enzyme phosphofructokinase is the key-core of the metabolic system, behaving for all conditions as the main source of the effective causal flows in yeast glycolysis. △ Less

Submitted 16 January, 2011; v1 submitted 19 September, 2010; originally announced September 2010.

Comments: Biologically improved

Instabilities in Attractor Networks with Fast Synaptic Fluctuations and Partial Updating of the Neurons Activity

Authors: J. J. Torres, J. Marro, J. M. Cortes, B. Wemmenhove

Abstract: We present and study a probabilistic neural automaton in which the fraction of simultaneously-updated neurons is a parameter, rho (0, 1) . For small rho, there is relaxation towards one of the attractors and a great sensibility to external stimuli and, for rho >= rho_c, itinerancy among attractors. Tuning rho in this regime, oscillations may abruptly change from regular to chaotic and vice versa… ▽ More We present and study a probabilistic neural automaton in which the fraction of simultaneously-updated neurons is a parameter, rho (0, 1) . For small rho, there is relaxation towards one of the attractors and a great sensibility to external stimuli and, for rho >= rho_c, itinerancy among attractors. Tuning rho in this regime, oscillations may abruptly change from regular to chaotic and vice versa, which allows one to control the efficiency of the searching process. We argue on the similarity of the model behavior with recent observations and on the possible role of chaos in neurobiology. △ Less

Submitted 8 May, 2008; originally announced May 2008.

Comments: 19 pages, 5 figures

Complex Networks: Time-Dependent Connections and Silent Nodes

Authors: J. Marro, J. J. Torres, J. M. Cortes

Abstract: We studied, both analytically and numerically, complex excitable networks, in which connections are time dependent and some of the nodes remain silent at each time step. More specifically, (a) there is a heterogenous distribution of connection weights and, depending on the current degree of order, some connections are reinforced/weakened with strength Phi on short-time scales, and (b) only a fra… ▽ More We studied, both analytically and numerically, complex excitable networks, in which connections are time dependent and some of the nodes remain silent at each time step. More specifically, (a) there is a heterogenous distribution of connection weights and, depending on the current degree of order, some connections are reinforced/weakened with strength Phi on short-time scales, and (b) only a fraction rho of nodes are simultaneously active. The resulting dynamics has attractors which, for a range of Phi values and rho exceeding a threshold, become unstable, the instability depending critically on the value of rho. We observe that (i) the activity describes a trajectory in which the close neighborhood of some of the attractors is constantly visited, (ii) the number of attractors visited increases with rho, and (iii) the trajectory may change from regular to chaotic and vice versa as rho is, even slightly modified. Furthermore, (iv) time series show a power-law spectra under conditions in which the attractors' space is most efficiently explored. We argue on the possible qualitative relevance of this phenomenology to networks in several natural contexts. △ Less

Submitted 17 October, 2007; originally announced October 2007.

Comments: 12 pages, 7 figures

Dynamics and robustness of familiarity memory

Authors: J. M. Cortes, A. Greve, A. B. Barrett, M. C. W. van Rossum

Abstract: When one is presented with an item or a face, one can sometimes have a sense of recognition without being able to recall where or when one has encountered it before. This sense of recognition is known as familiarity. Following previous computational models of familiarity memory we investigate the dynamical properties of familiarity discrimination, and contrast two different familiarity discrimin… ▽ More When one is presented with an item or a face, one can sometimes have a sense of recognition without being able to recall where or when one has encountered it before. This sense of recognition is known as familiarity. Following previous computational models of familiarity memory we investigate the dynamical properties of familiarity discrimination, and contrast two different familiarity discriminators: one based on the energy of the neural network, and the other based on the time derivative of the energy. We show how the familiarity signal decays after a stimulus is presented, and examine the robustness of the familiarity discriminator in the presence of random fluctuations in neural activity. For both discriminators we establish, via a combined method of signal-to-noise ratio and mean field analysis, how the maximum number of successfully discriminated stimuli depends on the noise level. △ Less

Submitted 6 October, 2007; originally announced October 2007.

Comments: 22 pages, 3 figures

Hysteresis and bi-stability by an interplay of calcium oscillations and action potential firing

Authors: J. M. A. M. Kusters, J. M. Cortes, W. P. M. van Meerwijk, D. L. Ypey, A. P. R. Theuvenet, C. C. A. M. Gielen

Abstract: Many cell types exhibit oscillatory activity, such as repetitive action potential firing due to the Hodgkin-Huxley dynamics of ion channels in the cell membrane or reveal intracellular inositol triphosphate (IP$_3$) mediated calcium oscillations (CaOs) by calcium-induced calcium release channels (IP$_3$-receptor) in the membrane of the endoplasmic reticulum (ER). The dynamics of the excitable me… ▽ More Many cell types exhibit oscillatory activity, such as repetitive action potential firing due to the Hodgkin-Huxley dynamics of ion channels in the cell membrane or reveal intracellular inositol triphosphate (IP$_3$) mediated calcium oscillations (CaOs) by calcium-induced calcium release channels (IP$_3$-receptor) in the membrane of the endoplasmic reticulum (ER). The dynamics of the excitable membrane and that of the IP$_3$-mediated CaOs have been the subject of many studies. However, the interaction between the excitable cell membrane and IP$_3$-mediated CaOs, which are coupled by cytosolic calcium which affects the dynamics of both, has not been studied. This study for the first time applied stability analysis to investigate the dynamic behavior of a model, which includes both an excitable membrane and an intracellular IP$_3$-mediated calcium oscillator. Taking the IP$_3$ concentration as a control parameter, the model exhibits a novel rich spectrum of stable and unstable states with hysteresis. The four stable states of the model correspond in detail to previously reported growth-state dependent states of the membrane potential of normal rat kidney fibroblasts in cell culture. The hysteresis is most pronounced for experimentally observed parameter values of the model, suggesting a functional importance of hysteresis. This study shows that the four growth-dependent cell states may not reflect the behavior of cells that have differentiated into different cell types with different properties, but simply reflect four different states of a single cell type, that is characterized by a single model. △ Less

Submitted 31 July, 2006; originally announced July 2006.

Comments: 29 pages, 6 figures

Instability of attractors in autoassociative networks with bioinspired fast synaptic noise

Authors: J. J. Torres, J. M. Cortes, J. Marro

Abstract: We studied autoassociative networks in which synapses are noisy on a time scale much shorter that the one for the neuron dynamics. In our model a presynaptic noise causes postsynaptic depression as recently observed in neurobiological systems. This results in a nonequilibrium condition in which the network sensitivity to an external stimulus is enhanced. In particular, the fixed points are quali… ▽ More We studied autoassociative networks in which synapses are noisy on a time scale much shorter that the one for the neuron dynamics. In our model a presynaptic noise causes postsynaptic depression as recently observed in neurobiological systems. This results in a nonequilibrium condition in which the network sensitivity to an external stimulus is enhanced. In particular, the fixed points are qualitatively modified, and the system may easily scape from the attractors. As a result, in addition to pattern recognition, the model is useful for class identification and categorization. △ Less

Submitted 16 April, 2006; originally announced April 2006.

Comments: 6 pages, 2 figures

Journal ref: LNCS 3512: 161-167, 2005

Chaotic hop** between attractors in neural networks

Authors: J. Marro, J. J. Torres, J. M. Cortes

Abstract: We present a neurobiologically--inspired stochastic cellular automaton whose state jumps with time between the attractors corresponding to a series of stored patterns. The jum** varies from regular to chaotic as the model parameters are modified. The resulting irregular behavior, which mimics the state of attention in which a systems shows a great adaptability to changing stimulus, is a conseq… ▽ More We present a neurobiologically--inspired stochastic cellular automaton whose state jumps with time between the attractors corresponding to a series of stored patterns. The jum** varies from regular to chaotic as the model parameters are modified. The resulting irregular behavior, which mimics the state of attention in which a systems shows a great adaptability to changing stimulus, is a consequence in the model of short--time presynaptic noise which induces synaptic depression. We discuss results from both a mean--field analysis and Monte Carlo simulations. △ Less

Submitted 16 April, 2006; originally announced April 2006.

Comments: 12 pages, 5 figures

Competition between synaptic depression and facilitation in attractor neural networks

Authors: J. J. Torres, J. M. Cortes, J. Marro, H. J. Kappen

Abstract: We study the effect of competition between short-term synaptic depression and facilitation on the dynamical properties of attractor neural networks, using Monte Carlo simulation and a mean field analysis. Depending on the balance between depression, facilitation and the noise, the network displays different behaviours, including associative memory and switching of the activity between different… ▽ More We study the effect of competition between short-term synaptic depression and facilitation on the dynamical properties of attractor neural networks, using Monte Carlo simulation and a mean field analysis. Depending on the balance between depression, facilitation and the noise, the network displays different behaviours, including associative memory and switching of the activity between different attractors. We conclude that synaptic facilitation enhances the attractor instability in a way that (i) intensifies the system adaptability to external stimuli, which is in agreement with experiments, and (ii) favours the retrieval of information with less error during short--time intervals. △ Less

Submitted 16 April, 2006; originally announced April 2006.

Comments: 14 pages, 7 figures

Algorithms for identification and categorization

Authors: J. M. Cortes, P. L. Garrido, H. J. Kappen, J. Marro, C. Morillas, D. Navidad, J. J. Torres

Abstract: The main features of a family of efficient algorithms for recognition and classification of complex patterns are briefly reviewed. They are inspired in the observation that fast synaptic noise is essential for some of the processing of information in the brain. The main features of a family of efficient algorithms for recognition and classification of complex patterns are briefly reviewed. They are inspired in the observation that fast synaptic noise is essential for some of the processing of information in the brain. △ Less

Submitted 16 April, 2006; originally announced April 2006.

Comments: 6 pages, 5 figures

Journal ref: AIP Conference Proceedings 779: 178-184, 2005

Sensitivity, Itinerancy and Chaos in Partly-Synchronized Weighted Networks

Authors: J. Marro, J. J. Torres, J. M. Cortes, B. Wemmenhove

Abstract: We present exact results, as well as some illustrative Monte Carlo simulations, concerning a stochastic network with weighted connections in which the fraction of nodes that are dynamically synchronized is a parameter. This allows one to describe from single-node kinetics to simultaneous updating of all the variables at each time unit. An example of the former limit is the well-known sequential… ▽ More We present exact results, as well as some illustrative Monte Carlo simulations, concerning a stochastic network with weighted connections in which the fraction of nodes that are dynamically synchronized is a parameter. This allows one to describe from single-node kinetics to simultaneous updating of all the variables at each time unit. An example of the former limit is the well-known sequential updating of spins in kinetic magnetic models whereas the latter limit is common for updating complex cellular automata. The emergent behavior changes dramatically as the parameter is varied. For small values, we observed relaxation towards one of the attractors and a great sensibility to external stimuli, and for large synchronization, itinerancy as in heteroclinic paths among attractors; tuning the parameter in this regime, the oscillations with time may abruptly change from regular to chaotic and vice versa. We show how these observations, which may be relevant concerning computational strategies, closely resemble some actual situations related to both searching and states of attention in the brain. △ Less

Submitted 28 April, 2006; originally announced April 2006.

Comments: 16 pages, 5 figures

Control of neural chaos by synaptic noise

Authors: J. M. Cortes, J. Marro, J. J. Torres

Abstract: We studied neural automata -or neurobiologically inspired cellular automata- which exhibits chaotic itinerancy among the different stored patterns or memories. This is a consequence of activity-dependent synaptic fluctuations, which continuously destabilize the attractor and induce irregular hop** to other possible attractors. The nature of the resulting irregularity depends on the dynamic det… ▽ More We studied neural automata -or neurobiologically inspired cellular automata- which exhibits chaotic itinerancy among the different stored patterns or memories. This is a consequence of activity-dependent synaptic fluctuations, which continuously destabilize the attractor and induce irregular hop** to other possible attractors. The nature of the resulting irregularity depends on the dynamic details, namely, on the intensity of the synaptic noise and on the number of sites of the network that are synchronously updated at each time step. Varying these details, different regimes occur from regular to chaotic. In the absence of external agents, the chaotic behavior may turn regular after tuning the noise intensity. It is argued that a similar mechanism might be at the origin of the self-control of chaos in natural systems. △ Less

Submitted 1 October, 2005; originally announced October 2005.

Comments: 6 pages, 3 figures. To appear in Biosystems, 2005

Switching between memories in neural automata with synaptic noise

Authors: J. M. Cortes, P. L. Garrido, J. Marro, J. J. Torres

Abstract: We present a stochastic neural automata in which activity fluctuations and synaptic intensities evolve at different temperature, the latter moving through a set of stored patterns. The network thus exhibits various retrieval phases, including one which depicts continuous switching between attractors. The switching may be either random or more complex, depending on the system parameters values. We present a stochastic neural automata in which activity fluctuations and synaptic intensities evolve at different temperature, the latter moving through a set of stored patterns. The network thus exhibits various retrieval phases, including one which depicts continuous switching between attractors. The switching may be either random or more complex, depending on the system parameters values. △ Less

Submitted 1 October, 2005; originally announced October 2005.

Comments: 4 pages, 3 figures

Journal ref: Neurocomputing 58-60: 67-71, 2004

Effects of fast presynaptic noise in attractor neural networks

Authors: J. M. Cortes, J. J. Torres, J. Marro, P. L. Garrido, H. J. Kappen

Abstract: We study both analytically and numerically the effect of presynaptic noise on the transmission of information in attractor neural networks. The noise occurs on a very short-time scale compared to that for the neuron dynamics and it produces short-time synaptic depression. This is inspired in recent neurobiological findings that show that synaptic strength may either increase or decrease on a sho… ▽ More We study both analytically and numerically the effect of presynaptic noise on the transmission of information in attractor neural networks. The noise occurs on a very short-time scale compared to that for the neuron dynamics and it produces short-time synaptic depression. This is inspired in recent neurobiological findings that show that synaptic strength may either increase or decrease on a short-time scale depending on presynaptic activity. We thus describe a mechanism by which fast presynaptic noise enhances the neural network sensitivity to an external stimulus. The reason for this is that, in general, the presynaptic noise induces nonequilibrium behavior and, consequently, the space of fixed points is qualitatively modified in such a way that the system can easily scape from the attractor. As a result, the model shows, in addition to pattern recognition, class identification and categorization, which may be relevant to the understanding of some of the brain complex tasks. △ Less

Submitted 13 August, 2005; originally announced August 2005.

Comments: 12 pages, 6 figures. To appear in Neural Computation, 2005

Effects of Static and Dynamic Disorder on the Performance of Neural Automata

Authors: J. J. Torres, J. Marro, P. L. Garrido, J. M. Cortes, F. Ramos, M. A. Munoz

Abstract: We report on both analytical and numerical results concerning stochastic Hopfield--like neural automata exhibiting the following (biologically inspired) features: (1) Neurons and synapses evolve in time as in contact with respective baths at different temperatures. (2) The connectivity between neurons may be tuned from full connection to high random dilution or to the case of networks with the s… ▽ More We report on both analytical and numerical results concerning stochastic Hopfield--like neural automata exhibiting the following (biologically inspired) features: (1) Neurons and synapses evolve in time as in contact with respective baths at different temperatures. (2) The connectivity between neurons may be tuned from full connection to high random dilution or to the case of networks with the small--world property and/or scale-free architecture. (3) There is synaptic kinetics simulating repeated scanning of the stored patterns. Though these features may apparently result in additional disorder, the model exhibits, for a wide range of parameter values, an extraordinary computational performance, and some of the qualitative behaviors observed in natural systems. In particular, we illustrate here very efficient and robust associative memory, and jum** between pattern attractors. △ Less

Submitted 9 December, 2003; originally announced December 2003.

Comments: 7 pages. 3 figures

Modeling Nonequilibrium Phase Transitions and Critical Behavior in Complex Systems

Authors: J. Marro, J. M. Cortes, Pablo I. Hurtado

Abstract: We comment on some recent, yet unpublished results concerning instabilities in complex systems and their applications. In particular, we briefly describe main observations during extensive computer simulations of two lattice nonequilibrium models. One exhibits robust and efficient processes of pattern recognition under synaptic coherent activity; the second example exhibits interesting critical… ▽ More We comment on some recent, yet unpublished results concerning instabilities in complex systems and their applications. In particular, we briefly describe main observations during extensive computer simulations of two lattice nonequilibrium models. One exhibits robust and efficient processes of pattern recognition under synaptic coherent activity; the second example exhibits interesting critical behavior and simulates nucleation and spinodal decomposition processes in driven fluids. △ Less

Submitted 13 September, 2002; originally announced September 2002.

Comments: 6 pages, 4 figures

Journal ref: Comp. Phys. Comm. 147, 115 (2002)