Showing 1–20 of 20 results for author: Faes, L

Disentangling high order effects in the transfer entropy

Authors: Sebastiano Stramaglia, Luca Faes, Jesus M. Cortes, Daniele Marinazzo

Abstract: Transfer Entropy (TE), the primary method for determining directed information flow within a network system, can exhibit bias - either in deficiency or excess - during both pairwise and conditioned calculations, owing to high-order dependencies among the dynamic processes under consideration and the remaining processes in the system used for conditioning. Here, we propose a novel approach. Instead… ▽ More Transfer Entropy (TE), the primary method for determining directed information flow within a network system, can exhibit bias - either in deficiency or excess - during both pairwise and conditioned calculations, owing to high-order dependencies among the dynamic processes under consideration and the remaining processes in the system used for conditioning. Here, we propose a novel approach. Instead of conditioning TE on all network processes except the driver and target, as in its fully conditioned version, or not conditioning at all, as in the pairwise approach, our method searches for both the multiplets of variables that maximize information flow and those that minimize it. This provides a decomposition of TE into unique, redundant, and synergistic atoms. Our approach enables the quantification of the relative importance of high-order effects compared to pure two-body effects in information transfer between two processes, while also highlighting the processes that contribute to building these high-order effects alongside the driver. We demonstrate the application of our approach in climatology by analyzing data from El Niño and the Southern Oscillation. △ Less

Submitted 13 February, 2024; v1 submitted 5 February, 2024; originally announced February 2024.

Measuring hierarchically-organized interactions in dynamic networks through spectral entropy rates: theory, estimation, and illustrative application to physiological networks

Authors: Laura Sparacino, Yuri Antonacci, Gorana Mijatovic, Luca Faes

Abstract: Recent advances in signal processing and information theory are boosting the development of new approaches for the data-driven modelling of complex network systems. In the fields of Network Physiology and Network Neuroscience where the signals of interest are often rich of oscillatory content, the spectral representation of network systems is essential to ascribe the analyzed interactions to speci… ▽ More Recent advances in signal processing and information theory are boosting the development of new approaches for the data-driven modelling of complex network systems. In the fields of Network Physiology and Network Neuroscience where the signals of interest are often rich of oscillatory content, the spectral representation of network systems is essential to ascribe the analyzed interactions to specific oscillations with physiological meaning. In this context, the present work formalizes a coherent framework which integrates several information dynamics approaches to quantify node-specific, pairwise and higher-order interactions in network systems. The framework establishes a hierarchical organization of interactions of different order using measures of entropy rate, mutual information rate and O-information rate, to quantify respectively the dynamics of individual nodes, the links between pairs of nodes, and the redundant/synergistic hyperlinks between groups of nodes. All measures are formulated in the time domain, and then expanded to the spectral domain to obtain frequency-specific information. The practical computation of all measures is favored presenting a toolbox that implements their parametric and non-parametric estimation, and includes approaches to assess their statistical significance. The framework is illustrated first using theoretical examples where the properties of the measures are displayed in benchmark simulated network systems, and then applied to representative examples of multivariate time series in the context of Network Neuroscience and Network Physiology. △ Less

Submitted 20 January, 2024; originally announced January 2024.

Assessing High-Order Links in Cardiovascular and Respiratory Networks via Static and Dynamic Information Measures

Authors: Gorana Mijatovic, Laura Sparacino, Yuri Antonacci, Michal Javorka, Daniele Marinazzo, Sebastiano Stramaglia, Luca Faes

Abstract: The network representation is becoming increasingly popular for the description of cardiovascular interactions based on the analysis of multiple simultaneously collected variables. However, the traditional methods to assess network links based on pairwise interaction measures cannot reveal high-order effects involving more than two nodes, and are not appropriate to infer the underlying network top… ▽ More The network representation is becoming increasingly popular for the description of cardiovascular interactions based on the analysis of multiple simultaneously collected variables. However, the traditional methods to assess network links based on pairwise interaction measures cannot reveal high-order effects involving more than two nodes, and are not appropriate to infer the underlying network topology. To address these limitations, here we introduce a framework which combines the assessment of high-order interactions with statistical inference for the characterization of the functional links sustaining physiological networks. The framework develops information-theoretic measures quantifying how two nodes interact in a redundant or synergistic way with the rest of the network, and employs these measures for reconstructing the functional structure of the network. The measures are implemented for both static and dynamic networks mapped respectively by random variables and random processes using plug-in and model-based entropy estimators. The validation on theoretical and numerical simulated networks documents the ability of the framework to represent high-order interactions as networks and to detect statistical structures associated to cascade, common drive and common target effects. The application to cardiovascular networks mapped by the beat-to-beat variability of heart rate, respiration, arterial pressure, cardiac output and vascular resistance allowed noninvasive characterization of several mechanisms of cardiovascular control operating in resting state and during orthostatic stress. Our approach brings to new comprehensive assessment of physiological interactions and complements existing strategies for the classification of pathophysiological states. △ Less

Submitted 10 January, 2024; originally announced January 2024.

Comments: 14 pages, 8 figures

A method to assess Granger causality, isolation and autonomy in the time and frequency domains: theory and application to cerebrovascular variability

Authors: Laura Sparacino, Yuri Antonacci, Chiara Barà, Angela Valenti, Alberto Porta, Luca Faes

Abstract: Concepts of Granger causality (GC) and Granger autonomy (GA) are central to assess the dynamics of coupled physiologic processes. While causality measures have been already proposed and applied in time and frequency domains, measures quantifying self-dependencies are still limited to the time-domain formulation and lack of a clear spectral representation. We embed into the classical linear paramet… ▽ More Concepts of Granger causality (GC) and Granger autonomy (GA) are central to assess the dynamics of coupled physiologic processes. While causality measures have been already proposed and applied in time and frequency domains, measures quantifying self-dependencies are still limited to the time-domain formulation and lack of a clear spectral representation. We embed into the classical linear parametric framework for computing GC from a driver random process X to a target process Y a measure of Granger Isolation (GI) quantifying the part of the dynamics of Y not originating from X, and a new spectral measure of GA assessing frequency-specific patterns of self-dependencies in Y. The measures are illustrated in theoretical simulations and applied to time series of mean arterial pressure and cerebral blood flow velocity obtained in subjects prone to develop postural syncope and healthy controls. Simulations show that GI is complementary to GC but not trivially related to it, while GA reflects the regularity of the internal dynamics of the analyzed target process. In the application to cerebrovascular interactions, spectral GA quantified the physiological response to postural stress of slow cerebral blood flow oscillations, while spectral GC and GI detected an altered response to postural stress in subjects prone to syncope, likely related to impaired cerebral autoregulation. The new spectral measures of GI and GA are useful complements to GC for the analysis of interacting oscillatory processes, and detect physiological and pathological responses to postural stress which cannot be traced in the time domain. The assessment of causality, isolation and autonomy opens new perspectives for the analysis of coupled biological processes in both physiological and clinical investigations. △ Less

Submitted 18 July, 2023; originally announced July 2023.

Gradients of O-information: low-order descriptors of high-order dependencies

Authors: Tomas Scagliarini, Davide Nuzzi, Yuri Antonacci, Luca Faes, Fernando E. Rosas, Daniele Marinazzo, Sebastiano Stramaglia

Abstract: O-information is an information-theoretic metric that captures the overall balance between redundant and synergistic information shared by groups of three or more variables. To complement the global assessment provided by this metric, here we propose the gradients of the O-information as low-order descriptors that can characterise how high-order effects are localised across a system of interest. W… ▽ More O-information is an information-theoretic metric that captures the overall balance between redundant and synergistic information shared by groups of three or more variables. To complement the global assessment provided by this metric, here we propose the gradients of the O-information as low-order descriptors that can characterise how high-order effects are localised across a system of interest. We illustrate the capabilities of the proposed framework by revealing the role of specific spins in Ising models with frustration, and on practical data analysis on US macroeconomic data. Our theoretical and empirical analyses demonstrate the potential of these gradients to highlight the contribution of variables in forming high-order informational circuits △ Less

Submitted 1 July, 2022; originally announced July 2022.

Comments: 4 pages + supplementary material, 3 figures

Multiscale Partial Information Decomposition of Dynamic Processes with Short and Long-range correlations: Theory and Application to Cardiovascular Control

Authors: Helder Pinto, Riccardo Pernice, Maria Eduarda Silva, Michal Javorka, Luca Faes, Ana Paula Rocha

Abstract: Heart rate variability results from the combined activity of several physiological systems, including the cardiac, vascular, and respiratory systems which have their own internal regulation, but also interact with each other to preserve the homeostatic function. These control mechanisms operate across multiple temporal scales, resulting in the simultaneous presence of short-term dynamics and long-… ▽ More Heart rate variability results from the combined activity of several physiological systems, including the cardiac, vascular, and respiratory systems which have their own internal regulation, but also interact with each other to preserve the homeostatic function. These control mechanisms operate across multiple temporal scales, resulting in the simultaneous presence of short-term dynamics and long-range correlations. The Network Physiology framework provides statistical tools based on information theory able to quantify structural aspects of multivariate and multiscale interconnected mechanisms driving the dynamics of complex physiological networks. In this work, the multiscale representation of Transfer Entropy from Systolic Arterial Pressure (S) and Respiration (R) to Heart Period (H) and of its decomposition into unique, redundant and synergistic contributions is obtained using a Vector AutoRegressive Fractionally Integrated (VARFI) framework for Gaussian processes. This novel approach allows to quantify the directed information flow accounting for the simultaneous presence of short-term dynamics and long-range correlations among the analyzed processes. The approach is first illustrated in simulated VARFI processes and then applied to H, S and R time series measured in healthy subjects monitored at rest and during mental and postural stress. Our results highlight the dependence of the information transfer on the balance between short-term and long-range correlations in coupled dynamical systems, which cannot be observed using standard methods that do not consider long-range correlations. The proposed methodology shows that postural stress induces larger redundant effects at short time scales and mental stress induces larger cardiovascular information transfer at longer time scales. △ Less

Submitted 29 April, 2022; originally announced April 2022.

A Framework for the Time- and Frequency-Domain Assessment of High-Order Interactions in Brain and Physiological Networks

Authors: Luca Faes, Gorana Mijatovic, Yuri Antonacci, Riccardo Pernice, Chiara Barà, Laura Sparacino, Marco Sammartino, Alberto Porta, Daniele Marinazzo, Sebastiano Stramaglia

Abstract: While the standard network description of complex systems is based on quantifying links between pairs of system units, higher-order interactions (HOIs) involving three or more units play a major role in governing the collective network behavior. This work introduces an approach to quantify pairwise and HOIs for multivariate rhythmic processes interacting across multiple time scales. We define the… ▽ More While the standard network description of complex systems is based on quantifying links between pairs of system units, higher-order interactions (HOIs) involving three or more units play a major role in governing the collective network behavior. This work introduces an approach to quantify pairwise and HOIs for multivariate rhythmic processes interacting across multiple time scales. We define the so-called O-information rate (OIR) as a new metric to assess HOIs for multivariate time series, and propose a framework to decompose it into measures quantifying Granger-causal and instantaneous influences, as well as to expand it in the frequency domain. The framework exploits the spectral representation of vector autoregressive and state-space models to assess synergistic and redundant interactions among groups of processes, both in specific bands and in the time domain after whole-band integration. Validation on simulated networks illustrates how the spectral OIR can highlight redundant and synergistic HOIs emerging at specific frequencies but not using time-domain measures. The application to physiological networks described by heart period, arterial pressure and respiration measured in healthy subjects during paced breathing, and to brain networks described by ECoG signals acquired in an animal experiment during anesthesia, document the capability of our approach to identify informational circuits relevant to well-defined cardiovascular oscillations and brain rhythms and related to specific physiological mechanisms of autonomic control and altered consciousness. The proposed framework allows a hierarchically-organized evaluation of time- and frequency-domain interactions in networks mapped by multivariate time series, and its high flexibility and scalability make it suitable to investigate networks beyond pairwise interactions in neuroscience, physiology and other fields. △ Less

Submitted 8 February, 2022; originally announced February 2022.

An information-theoretic framework to measure the dynamic interaction between neural spike trains

Authors: Gorana Mijatovic, Yuri Antonacci, Tatjana Loncar-Turukalo, Ludovico Minati, Luca Faes

Abstract: Understanding the interaction patterns among simultaneous recordings of spike trains from multiple neuronal units is a key topic in neuroscience. However, an optimal approach of assessing these interactions has not been established, as existing methods either do not consider the inherent point process nature of spike trains or are based on parametric assumptions that may lead to wrong inferences i… ▽ More Understanding the interaction patterns among simultaneous recordings of spike trains from multiple neuronal units is a key topic in neuroscience. However, an optimal approach of assessing these interactions has not been established, as existing methods either do not consider the inherent point process nature of spike trains or are based on parametric assumptions that may lead to wrong inferences if not met. This work presents a framework, grounded in the field of information dynamics, for the model-free, continuous-time estimation of both undirected (symmetric) and directed (causal) interactions between pairs of spike trains. The framework decomposes the overall information exchanged dynamically between two point processes X and Y as the sum of the dynamic mutual information (dMI) between the histories of X and Y, plus the transfer entropy (TE) along the directions X->Y and Y->X. Building on recent work which derived theoretical expressions and consistent estimators for the TE in continuous time, we develop algorithms for estimating efficiently all measures in our framework through nearest neighbor statistics. These algorithms are validated in simulations of independent and coupled spike train processes, showing the accuracy of dMI and TE in the assessment of undirected and directed interactions even for weakly coupled and short realizations, and proving the superiority of the continuous-time estimator over the discrete-time method. Then, the usefulness of the framework is illustrated in a real data scenario of recordings from in-vitro preparations of spontaneously-growing cultures of cortical neurons, where we show the ability of dMI and TE to identify how the networks of undirected and directed spike train interactions change their topology through maturation of the neuronal cultures. △ Less

Submitted 15 December, 2020; originally announced December 2020.

Comments: 12 pages, 7 figures; supplementary material at www.lucafaes.net/TEMI.html

Local Granger Causality

Authors: Sebastiano Stramaglia, Tomas Scagliarini, Yuri Antonacci, Luca Faes

Abstract: Granger causality is a statistical notion of causal influence based on prediction via vector autoregression. For Gaussian variables it is equivalent to transfer entropy, an information-theoretic measure of time-directed information transfer between jointly dependent processes. We exploit such equivalence and calculate exactly the 'local Granger causality', i.e. the profile of the information trans… ▽ More Granger causality is a statistical notion of causal influence based on prediction via vector autoregression. For Gaussian variables it is equivalent to transfer entropy, an information-theoretic measure of time-directed information transfer between jointly dependent processes. We exploit such equivalence and calculate exactly the 'local Granger causality', i.e. the profile of the information transfer at each discrete time point in Gaussian processes; in this frame Granger causality is the average of its local version. Our approach offers a robust and computationally fast method to follow the information transfer along the time history of linear stochastic processes, as well as of nonlinear complex systems studied in the Gaussian approximation. △ Less

Submitted 26 October, 2020; originally announced October 2020.

Comments: 4 figures

Journal ref: Phys. Rev. E 103, 020102 (2021)

Comparison of Methods for the Assessment of Nonlinearity in Short-Term Heart Rate Variability under different Physiopathological States

Authors: Luca Faes, Manuel Gòmez-Extremera, Riccardo Pernice, Pedro Carpena, Giandomenico Nollo, Alberto Porta, Pedro Bernaola-Galvàn

Abstract: Despite the widespread diffusion of nonlinear methods for heart rate variability (HRV) analysis, the presence and the extent to which nonlinear dynamics contribute to short-term HRV is still controversial. This work aims at testing the hypothesis that different types of nonlinearity can be observed in HRV depending on the method adopted and on the physiopathological state. Two entropy-based measur… ▽ More Despite the widespread diffusion of nonlinear methods for heart rate variability (HRV) analysis, the presence and the extent to which nonlinear dynamics contribute to short-term HRV is still controversial. This work aims at testing the hypothesis that different types of nonlinearity can be observed in HRV depending on the method adopted and on the physiopathological state. Two entropy-based measures of time series complexity (normalized complexity index, NCI) and regularity (information storage, IS), and a measure quantifying deviations from linear correlations in a time series (Gaussian linear contrast, GLC), are applied to short HRV recordings obtained in young (Y) and old (O) healthy subjects and in myocardial infarction (MI) patients monitored in the resting supine position and in the upright position reached through head-up tilt. The method of surrogate data is employed to detect the presence of and quantify the contribution of nonlinear dynamics to HRV. We find that the three measures differ both in their variations across groups and conditions and in the number and strength of nonlinear HRV dynamics detected: at rest, IS reveals a significantly lower number of nonlinear dynamics in Y, whereas during tilt GLC reveals significantly stronger nonlinear HRV dynamics in MI; in the transition from rest to tilt, all measures detect a significant weakening of nonlinear HRV dynamics in Y, while only GLC detects a significant strengthening of such dynamics in MI. These results suggest that distinct dynamic structures, detected with different sensitivity by nonlinear measures, lie beneath short-term HRV in different physiological states and pathological conditions. △ Less

Submitted 13 June, 2019; originally announced June 2019.

Multiscale Information Storage of Linear Long-Range Correlated Stochastic Processes

Authors: Luca Faes, Margarida Almeida Pereira, Maria Eduarda Silva, Riccardo Pernice, Alessandro Busacca, Michal Javorka, Ana Paula Rocha

Abstract: Information storage, reflecting the capability of a dynamical system to keep predictable information during its evolution over time, is a key element of intrinsic distributed computation, useful for the description of the dynamical complexity of several physical and biological processes. Here we introduce a parametric framework which allows to compute information storage across multiple time scale… ▽ More Information storage, reflecting the capability of a dynamical system to keep predictable information during its evolution over time, is a key element of intrinsic distributed computation, useful for the description of the dynamical complexity of several physical and biological processes. Here we introduce a parametric framework which allows to compute information storage across multiple time scales in stochastic processes displaying both short-term dynamics and long-range correlations (LRC). The framework exploits the theory of state space models to provide the multiscale representation of linear fractionally integrated autoregressive (ARFI) processes, from which information storage is computed at any given time scale relating the process variance to the prediction error variance. This enables the theoretical assessment and a computationally reliable quantification of a complexity measure which incorporates the effects of LRC together with that of short-term dynamics. The proposed measure is first assessed in simulated ARFI processes reproducing different types of autoregressive (AR) dynamics and different degrees of LRC, studying both the theoretical values and the finite sample performance. We find that LRC alter substantially the complexity of ARFI processes even at short time scales, and that reliable estimation of complexity can be achieved at longer time scales only when LRC are properly modeled. Then, we assess multiscale information storage in physiological time series measured in humans during resting state and postural stress, revealing unprecedented responses to stress of the complexity of heart period and systolic arterial pressure variability, which are related to the different role played by LRC in the two conditions. △ Less

Submitted 13 November, 2018; originally announced November 2018.

Journal ref: Phys. Rev. E 99, 032115 (2019)

Apparent remote synchronization of amplitudes: a demodulation and interference effect

Authors: Ludovico Minati, Luca Faes, Mattia Frasca, Pawel Oswiecimka, Stanislaw Drozdz

Abstract: A form of "remote synchronization" was recently described wherein amplitude fluctuations across a ring of non-identical, non-linear electronic oscillators become entrained into spatially-structured patterns. According to linear models and mutual information, synchronization and causality dip at a certain distance, then recover before eventually fading. Here, the underlying mechanism is finally elu… ▽ More A form of "remote synchronization" was recently described wherein amplitude fluctuations across a ring of non-identical, non-linear electronic oscillators become entrained into spatially-structured patterns. According to linear models and mutual information, synchronization and causality dip at a certain distance, then recover before eventually fading. Here, the underlying mechanism is finally elucidated through novel experiments and simulations. The system non-linearity is found to have a dual role: it supports chaotic dynamics, and it enables energy exchange between the lower and higher sidebands of a predominant frequency. This frequency acts as carrier signal in an arrangement resembling standard amplitude modulation, wherein the lower sideband and the demodulated baseband signals spectrally overlap. Due to a spatially-dependent phase relationship, at a certain distance near-complete destructive interference occurs between them, causing the observed dip. Methods suitable for detecting non-trivial entrainment, such as transfer entropy and the auxiliary system approach, nevertheless reveal that synchronization and causality actually decrease with distance monotonically. Remoteness is, therefore, arguably only apparent, as also reflected in the propagation of external perturbations. These results demonstrate a complex mechanism of dynamical interdependence, and exemplify how it can lead to incorrectly inferring synchronization and causality. △ Less

Submitted 23 June, 2018; v1 submitted 26 February, 2018; originally announced February 2018.

Journal ref: Chaos 28, 063124 (2018)

On the interpretability and computational reliability of frequency-domain Granger causality

Authors: Luca Faes, Sebastiano Stramaglia, Daniele Marinazzo

Abstract: This is a comment to the paper 'A study of problems encountered in Granger causality analysis from a neuroscience perspective'. We agree that interpretation issues of Granger Causality in Neuroscience exist (partially due to the historical unfortunate use of the name 'causality', as nicely described in previous literature). On the other hand we think that the paper uses a formulation of Granger ca… ▽ More This is a comment to the paper 'A study of problems encountered in Granger causality analysis from a neuroscience perspective'. We agree that interpretation issues of Granger Causality in Neuroscience exist (partially due to the historical unfortunate use of the name 'causality', as nicely described in previous literature). On the other hand we think that the paper uses a formulation of Granger causality which is outdated (albeit still used), and in doing so it dismisses the measure based on a suboptimal use of it. Furthermore, since data from simulated systems are used, the pitfalls that are found with the used formulation are intended to be general, and not limited to neuroscience. It would be a pity if this paper, even written in good faith, became a wildcard against all possible applications of Granger Causality, regardless of the hard work of colleagues aiming to seriously address the methodological and interpretation pitfalls. In order to provide a balanced view, we replicated their simulations used the updated State Space implementation, proposed already some years ago, in which the pitfalls are mitigated or directly solved. △ Less

Submitted 23 August, 2017; originally announced August 2017.

Multiscale Granger causality analysis by à trous wavelet transform

Authors: Sebastiano Stramaglia, Iege Bassez, Luca Faes, Daniele Marinazzo

Abstract: Since interactions in neural systems occur across multiple temporal scales, it is likely that information flow will exhibit a multiscale structure, thus requiring a multiscale generalization of classical temporal precedence causality analysis like Granger's approach. However, the computation of multiscale measures of information dynamics is complicated by theoretical and practical issues such as f… ▽ More Since interactions in neural systems occur across multiple temporal scales, it is likely that information flow will exhibit a multiscale structure, thus requiring a multiscale generalization of classical temporal precedence causality analysis like Granger's approach. However, the computation of multiscale measures of information dynamics is complicated by theoretical and practical issues such as filtering and undersampling: to overcome these problems, we propose a wavelet-based approach for multiscale Granger causality (GC) analysis, which is characterized by the following properties: (i) only the candidate driver variable is wavelet transformed (ii) the decomposition is performed using the à trous wavelet transform with cubic B-spline filter. We measure GC, at a given scale, by including the wavelet coefficients of the driver times series, at that scale, in the regression model of the target. To validate our method, we apply it to publicly available scalp EEG signals, and we find that the condition of closed eyes, at rest, is characterized by an enhanced GC among channels at slow scales w.r.t. eye open condition, whilst the standard Granger causality is not significantly different in the two conditions. △ Less

Submitted 12 July, 2017; originally announced July 2017.

Comments: 4 pages, 3 figures

Multiscale Information Decomposition: Exact Computation for Multivariate Gaussian Processes

Authors: Luca Faes, Daniele Marinazzo, Sebastiano Stramaglia

Abstract: Exploiting the theory of state space models, we derive the exact expressions of the information transfer, as well as redundant and synergistic transfer, for coupled Gaussian processes observed at multiple temporal scales. All of the terms, constituting the frameworks known as interaction information decomposition and partial information decomposition, can thus be analytically obtained for differen… ▽ More Exploiting the theory of state space models, we derive the exact expressions of the information transfer, as well as redundant and synergistic transfer, for coupled Gaussian processes observed at multiple temporal scales. All of the terms, constituting the frameworks known as interaction information decomposition and partial information decomposition, can thus be analytically obtained for different time scales from the parameters of the VAR model that fits the processes. We report the application of the proposed methodology firstly to benchmark Gaussian systems, showing that this class of systems may generate patterns of information decomposition characterized by mainly redundant or synergistic information transfer persisting across multiple time scales or even by the alternating prevalence of redundant and synergistic source interaction depending on the time scale. Then, we apply our method to an important topic in neuroscience, i.e., the detection of causal interactions in human epilepsy networks, for which we show the relevance of partial information decomposition to the detection of multiscale information transfer spreading from the seizure onset zone. △ Less

Submitted 18 August, 2017; v1 submitted 21 June, 2017; originally announced June 2017.

Journal ref: Entropy, 19, 408 (2017)

Multiscale Granger causality

Authors: Luca Faes, Giandomenico Nollo, Sebastiano Stramaglia, Daniele Marinazzo

Abstract: In the study of complex physical and biological systems represented by multivariate stochastic processes, an issue of great relevance is the description of the system dynamics spanning multiple temporal scales. While methods to assess the dynamic complexity of individual processes at different time scales are well-established, multiscale analysis of directed interactions has never been formalized… ▽ More In the study of complex physical and biological systems represented by multivariate stochastic processes, an issue of great relevance is the description of the system dynamics spanning multiple temporal scales. While methods to assess the dynamic complexity of individual processes at different time scales are well-established, multiscale analysis of directed interactions has never been formalized theoretically, and empirical evaluations are complicated by practical issues such as filtering and downsampling. Here we extend the very popular measure of Granger causality (GC), a prominent tool for assessing directed lagged interactions between joint processes, to quantify information transfer across multiple time scales. We show that the multiscale processing of a vector autoregressive (AR) process introduces a moving average (MA) component, and describe how to represent the resulting ARMA process using state space (SS) models and to combine the SS model parameters for computing exact GC values at arbitrarily large time scales. We exploit the theoretical formulation to identify peculiar features of multiscale GC in basic AR processes, and demonstrate with numerical simulations the much larger estimation accuracy of the SS approach compared with pure AR modeling of filtered and downsampled data. The improved computational reliability is exploited to disclose meaningful multiscale patterns of information transfer between global temperature and carbon dioxide concentration time series, both in paleoclimate and in recent years. △ Less

Submitted 25 October, 2017; v1 submitted 24 March, 2017; originally announced March 2017.

Journal ref: Phys. Rev. E 96, 042150 (2017)

Critical comments on EEG sensor space dynamical connectivity analysis

Authors: Frederik van de Steen, Luca Faes, Esin Karahan, Jitkomut Songsiri, Pedro Antonio Valdes Sosa, Daniele Marinazzo

Abstract: Many different analysis techniques have been developed and applied to EEG recordings that allow one to investigate how different brain areas interact. One particular class of methods, based on the linear parametric representation of multiple interacting time series, is widely used to study causal connectivity in the brain. However, the results obtained by these methods should be interpreted with g… ▽ More Many different analysis techniques have been developed and applied to EEG recordings that allow one to investigate how different brain areas interact. One particular class of methods, based on the linear parametric representation of multiple interacting time series, is widely used to study causal connectivity in the brain. However, the results obtained by these methods should be interpreted with great care. The goal of this paper is to show, both theoretically and using simulations, that results obtained by applying causal connectivity measures on the sensor (scalp) time series do not allow interpretation in terms of interacting brain sources. This is because 1) the channel locations cannot be seen as an approximation of a source's anatomical location and 2) spurious connectivity can occur between sensors. Although many measures of causal connectivity derived from EEG sensor time series are affected by the latter, here we will focus on the well-known time domain index of Granger causality (GC) and on the frequency domain directed transfer function (DTF). Using the state-space framework and designing two simulation studies we show that mixing effects caused by volume conduction can lead to spurious connections, detected either by time domain GC or by DTF. Therefore, GC/DTF causal connectivity measures should be computed at the source level, or derived within analysis frameworks that model the effects of volume conduction. Since mixing effects can also occur in the source space, it is advised to combine source space analysis with connectivity measures that are robust to mixing. △ Less

Submitted 8 November, 2016; v1 submitted 13 July, 2016; originally announced July 2016.

Multiscale Analysis of Information Dynamics for Linear Multivariate Processes

Authors: Luca Faes, Alessandro Montalto, Sebastiano Stramaglia, Giandomenico Nollo, Daniele Marinazzo

Abstract: In the study of complex physical and physiological systems represented by multivariate time series, an issue of great interest is the description of the system dynamics over a range of different temporal scales. While information-theoretic approaches to the multiscale analysis of complex dynamics are being increasingly used, the theoretical properties of the applied measures are poorly understood.… ▽ More In the study of complex physical and physiological systems represented by multivariate time series, an issue of great interest is the description of the system dynamics over a range of different temporal scales. While information-theoretic approaches to the multiscale analysis of complex dynamics are being increasingly used, the theoretical properties of the applied measures are poorly understood. This study introduces for the first time a framework for the analytical computation of information dynamics for linear multivariate stochastic processes explored at different time scales. After showing that the multiscale processing of a vector autoregressive (VAR) process introduces a moving average (MA) component, we describe how to represent the resulting VARMA process using state-space (SS) models and how to exploit the SS model parameters to compute analytical measures of information storage and information transfer for the original and rescaled processes. The framework is then used to quantify multiscale information dynamics for simulated unidirectionally and bidirectionally coupled VAR processes, showing that rescaling may lead to insightful patterns of information storage and transfer but also to potentially misleading behaviors. △ Less

Submitted 24 February, 2016; v1 submitted 19 February, 2016; originally announced February 2016.

Neural Networks with Non-Uniform Embedding and Explicit Validation Phase to Assess Granger Causality

Authors: Alessandro Montalto, Sebastiano Stramaglia, Luca Faes, Giovanni Tessitore, Roberto Prevete, Daniele Marinazzo

Abstract: A challenging problem when studying a dynamical system is to find the interdependencies among its individual components. Several algorithms have been proposed to detect directed dynamical influences between time series. Two of the most used approaches are a model-free one (transfer entropy) and a model-based one (Granger causality). Several pitfalls are related to the presence or absence of assump… ▽ More A challenging problem when studying a dynamical system is to find the interdependencies among its individual components. Several algorithms have been proposed to detect directed dynamical influences between time series. Two of the most used approaches are a model-free one (transfer entropy) and a model-based one (Granger causality). Several pitfalls are related to the presence or absence of assumptions in modeling the relevant features of the data. We tried to overcome those pitfalls using a neural network approach in which a model is built without any a priori assumptions. In this sense this method can be seen as a bridge between model-free and model-based approaches. The experiments performed will show that the method presented in this work can detect the correct dynamical information flows occurring in a system of time series. Additionally we adopt a non-uniform embedding framework according to which only the past states that actually help the prediction are entered into the model, improving the prediction and avoiding the risk of overfitting. This method also leads to a further improvement with respect to traditional Granger causality approaches when redundant variables (i.e. variables sharing the same information about the future of the system) are involved. Neural networks are also able to recognize dynamics in data sets completely different from the ones used during the training phase. △ Less

Submitted 8 September, 2015; v1 submitted 1 July, 2015; originally announced July 2015.

Journal ref: Neural Networks 71, pp. 159 - 171, 2015

Synergetic and redundant information flow detected by unnormalized Granger causality: application to resting state fMRI

Authors: Sebastiano Stramaglia, Leonardo Angelini, Guorong Wu, Jesus M. Cortés, Luca Faes, Daniele Marinazzo

Abstract: Objectives: We develop a framework for the analysis of synergy and redundancy in the pattern of information flow between subsystems of a complex network. Methods: The presence of redundancy and/or synergy in multivariate time series data renders difficult to estimate the neat flow of information from each driver variable to a given target. We show that adopting an unnormalized definition of Grange… ▽ More Objectives: We develop a framework for the analysis of synergy and redundancy in the pattern of information flow between subsystems of a complex network. Methods: The presence of redundancy and/or synergy in multivariate time series data renders difficult to estimate the neat flow of information from each driver variable to a given target. We show that adopting an unnormalized definition of Granger causality one may put in evidence redundant multiplets of variables influencing the target by maximizing the total Granger causality to a given target, over all the possible partitions of the set of driving variables. Consequently we introduce a pairwise index of synergy which is zero when two independent sources additively influence the future state of the system, differently from previous definitions of synergy. Results: We report the application of the proposed approach to resting state fMRI data from the Human Connectome Project, showing that redundant pairs of regions arise mainly due to space contiguity and interhemispheric symmetry, whilst synergy occurs mainly between non-homologous pairs of regions in opposite hemispheres. Conclusions: Redundancy and synergy, in healthy resting brains, display characteristic patterns, revealed by the proposed approach. Significance: The pairwise synergy index, here introduced, maps the informational character of the system at hand into a weighted complex network: the same approach can be applied to other complex systems whose normal state corresponds to a balance between redundant and synergetic circuits. △ Less

Submitted 16 May, 2016; v1 submitted 14 April, 2015; originally announced April 2015.

Comments: 6 figures. arXiv admin note: text overlap with arXiv:1403.5156

Journal ref: Published in IEEE Transactions on Biomedical Engineering, 2016