arXiv subjects

Luca Faes

Publications and source records attributed to Luca Faes.

35 records · Page 2Linked to original sources

arXiv2023

A method to assess Granger causality, isolation and autonomy in the time and frequency domains: theory and application to cerebrovascular variability

Concepts of Granger causality (GC) and Granger autonomy (GA) are central to assess the dynamics of coupled physiologic processes. While causality measures have been already proposed and applied in time and frequency domains, measures quantifying self-dependencies are still limited to the time-domain formulation and lack of a clear spectral representation. We embed into the classical linear parametric framework for computing GC from a driver random process X to a target process Y a measure of Granger Isolation (GI) quantifying the part of the dynamics of Y not originating from X, and a new spectral measure of GA assessing frequency-specific patterns of self-dependencies in Y. The measures are illustrated in theoretical simulations and applied to time series of mean arterial pressure and cerebral blood flow velocity obtained in subjects prone to develop postural syncope and healthy controls. Simulations show that GI is complementary to GC but not trivially related to it, while GA reflects the regularity of the internal dynamics of the analyzed target process. In the application to cerebrovascular interactions, spectral GA quantified the physiological response to postural stress of slow cerebral blood flow oscillations, while spectral GC and GI detected an altered response to postural stress in subjects prone to syncope, likely related to impaired cerebral autoregulation. The new spectral measures of GI and GA are useful complements to GC for the analysis of interacting oscillatory processes, and detect physiological and pathological responses to postural stress which cannot be traced in the time domain. The assessment of causality, isolation and autonomy opens new perspectives for the analysis of coupled biological processes in both physiological and clinical investigations.

eess.SP↗

arXiv2022

Gradients of O-information: low-order descriptors of high-order dependencies

O-information is an information-theoretic metric that captures the overall balance between redundant and synergistic information shared by groups of three or more variables. To complement the global assessment provided by this metric, here we propose the gradients of the O-information as low-order descriptors that can characterise how high-order effects are localised across a system of interest. We illustrate the capabilities of the proposed framework by revealing the role of specific spins in Ising models with frustration, and on practical data analysis on US macroeconomic data. Our theoretical and empirical analyses demonstrate the potential of these gradients to highlight the contribution of variables in forming high-order informational circuits

cs.IT↗

arXiv2022

Multiscale Partial Information Decomposition of Dynamic Processes with Short and Long-range correlations: Theory and Application to Cardiovascular Control

Heart rate variability results from the combined activity of several physiological systems, including the cardiac, vascular, and respiratory systems which have their own internal regulation, but also interact with each other to preserve the homeostatic function. These control mechanisms operate across multiple temporal scales, resulting in the simultaneous presence of short-term dynamics and long-range correlations. The Network Physiology framework provides statistical tools based on information theory able to quantify structural aspects of multivariate and multiscale interconnected mechanisms driving the dynamics of complex physiological networks. In this work, the multiscale representation of Transfer Entropy from Systolic Arterial Pressure (S) and Respiration (R) to Heart Period (H) and of its decomposition into unique, redundant and synergistic contributions is obtained using a Vector AutoRegressive Fractionally Integrated (VARFI) framework for Gaussian processes. This novel approach allows to quantify the directed information flow accounting for the simultaneous presence of short-term dynamics and long-range correlations among the analyzed processes. The approach is first illustrated in simulated VARFI processes and then applied to H, S and R time series measured in healthy subjects monitored at rest and during mental and postural stress. Our results highlight the dependence of the information transfer on the balance between short-term and long-range correlations in coupled dynamical systems, which cannot be observed using standard methods that do not consider long-range correlations. The proposed methodology shows that postural stress induces larger redundant effects at short time scales and mental stress induces larger cardiovascular information transfer at longer time scales.

stat.ME↗

arXiv2022

A Framework for the Time- and Frequency-Domain Assessment of High-Order Interactions in Brain and Physiological Networks

While the standard network description of complex systems is based on quantifying links between pairs of system units, higher-order interactions (HOIs) involving three or more units play a major role in governing the collective network behavior. This work introduces an approach to quantify pairwise and HOIs for multivariate rhythmic processes interacting across multiple time scales. We define the so-called O-information rate (OIR) as a new metric to assess HOIs for multivariate time series, and propose a framework to decompose it into measures quantifying Granger-causal and instantaneous influences, as well as to expand it in the frequency domain. The framework exploits the spectral representation of vector autoregressive and state-space models to assess synergistic and redundant interactions among groups of processes, both in specific bands and in the time domain after whole-band integration. Validation on simulated networks illustrates how the spectral OIR can highlight redundant and synergistic HOIs emerging at specific frequencies but not using time-domain measures. The application to physiological networks described by heart period, arterial pressure and respiration measured in healthy subjects during paced breathing, and to brain networks described by ECoG signals acquired in an animal experiment during anesthesia, document the capability of our approach to identify informational circuits relevant to well-defined cardiovascular oscillations and brain rhythms and related to specific physiological mechanisms of autonomic control and altered consciousness. The proposed framework allows a hierarchically-organized evaluation of time- and frequency-domain interactions in networks mapped by multivariate time series, and its high flexibility and scalability make it suitable to investigate networks beyond pairwise interactions in neuroscience, physiology and other fields.

stat.ME↗

arXiv2020

An information-theoretic framework to measure the dynamic interaction between neural spike trains

Understanding the interaction patterns among simultaneous recordings of spike trains from multiple neuronal units is a key topic in neuroscience. However, an optimal approach of assessing these interactions has not been established, as existing methods either do not consider the inherent point process nature of spike trains or are based on parametric assumptions that may lead to wrong inferences if not met. This work presents a framework, grounded in the field of information dynamics, for the model-free, continuous-time estimation of both undirected (symmetric) and directed (causal) interactions between pairs of spike trains. The framework decomposes the overall information exchanged dynamically between two point processes X and Y as the sum of the dynamic mutual information (dMI) between the histories of X and Y, plus the transfer entropy (TE) along the directions X->Y and Y->X. Building on recent work which derived theoretical expressions and consistent estimators for the TE in continuous time, we develop algorithms for estimating efficiently all measures in our framework through nearest neighbor statistics. These algorithms are validated in simulations of independent and coupled spike train processes, showing the accuracy of dMI and TE in the assessment of undirected and directed interactions even for weakly coupled and short realizations, and proving the superiority of the continuous-time estimator over the discrete-time method. Then, the usefulness of the framework is illustrated in a real data scenario of recordings from in-vitro preparations of spontaneously-growing cultures of cortical neurons, where we show the ability of dMI and TE to identify how the networks of undirected and directed spike train interactions change their topology through maturation of the neuronal cultures.

q-bio.NC↗

arXiv2020

Local Granger Causality

Granger causality is a statistical notion of causal influence based on prediction via vector autoregression. For Gaussian variables it is equivalent to transfer entropy, an information-theoretic measure of time-directed information transfer between jointly dependent processes. We exploit such equivalence and calculate exactly the 'local Granger causality', i.e. the profile of the information transfer at each discrete time point in Gaussian processes; in this frame Granger causality is the average of its local version. Our approach offers a robust and computationally fast method to follow the information transfer along the time history of linear stochastic processes, as well as of nonlinear complex systems studied in the Gaussian approximation.

q-bio.QM↗

arXiv2019

Comparison of Methods for the Assessment of Nonlinearity in Short-Term Heart Rate Variability under different Physiopathological States

Despite the widespread diffusion of nonlinear methods for heart rate variability (HRV) analysis, the presence and the extent to which nonlinear dynamics contribute to short-term HRV is still controversial. This work aims at testing the hypothesis that different types of nonlinearity can be observed in HRV depending on the method adopted and on the physiopathological state. Two entropy-based measures of time series complexity (normalized complexity index, NCI) and regularity (information storage, IS), and a measure quantifying deviations from linear correlations in a time series (Gaussian linear contrast, GLC), are applied to short HRV recordings obtained in young (Y) and old (O) healthy subjects and in myocardial infarction (MI) patients monitored in the resting supine position and in the upright position reached through head-up tilt. The method of surrogate data is employed to detect the presence of and quantify the contribution of nonlinear dynamics to HRV. We find that the three measures differ both in their variations across groups and conditions and in the number and strength of nonlinear HRV dynamics detected: at rest, IS reveals a significantly lower number of nonlinear dynamics in Y, whereas during tilt GLC reveals significantly stronger nonlinear HRV dynamics in MI; in the transition from rest to tilt, all measures detect a significant weakening of nonlinear HRV dynamics in Y, while only GLC detects a significant strengthening of such dynamics in MI. These results suggest that distinct dynamic structures, detected with different sensitivity by nonlinear measures, lie beneath short-term HRV in different physiological states and pathological conditions.

stat.AP↗

arXiv2018

Multiscale Information Storage of Linear Long-Range Correlated Stochastic Processes

Information storage, reflecting the capability of a dynamical system to keep predictable information during its evolution over time, is a key element of intrinsic distributed computation, useful for the description of the dynamical complexity of several physical and biological processes. Here we introduce a parametric framework which allows to compute information storage across multiple time scales in stochastic processes displaying both short-term dynamics and long-range correlations (LRC). The framework exploits the theory of state space models to provide the multiscale representation of linear fractionally integrated autoregressive (ARFI) processes, from which information storage is computed at any given time scale relating the process variance to the prediction error variance. This enables the theoretical assessment and a computationally reliable quantification of a complexity measure which incorporates the effects of LRC together with that of short-term dynamics. The proposed measure is first assessed in simulated ARFI processes reproducing different types of autoregressive (AR) dynamics and different degrees of LRC, studying both the theoretical values and the finite sample performance. We find that LRC alter substantially the complexity of ARFI processes even at short time scales, and that reliable estimation of complexity can be achieved at longer time scales only when LRC are properly modeled. Then, we assess multiscale information storage in physiological time series measured in humans during resting state and postural stress, revealing unprecedented responses to stress of the complexity of heart period and systolic arterial pressure variability, which are related to the different role played by LRC in the two conditions.

stat.ME↗

arXiv2018

Apparent remote synchronization of amplitudes: a demodulation and interference effect

A form of "remote synchronization" was recently described wherein amplitude fluctuations across a ring of non-identical, non-linear electronic oscillators become entrained into spatially-structured patterns. According to linear models and mutual information, synchronization and causality dip at a certain distance, then recover before eventually fading. Here, the underlying mechanism is finally elucidated through novel experiments and simulations. The system non-linearity is found to have a dual role: it supports chaotic dynamics, and it enables energy exchange between the lower and higher sidebands of a predominant frequency. This frequency acts as carrier signal in an arrangement resembling standard amplitude modulation, wherein the lower sideband and the demodulated baseband signals spectrally overlap. Due to a spatially-dependent phase relationship, at a certain distance near-complete destructive interference occurs between them, causing the observed dip. Methods suitable for detecting non-trivial entrainment, such as transfer entropy and the auxiliary system approach, nevertheless reveal that synchronization and causality actually decrease with distance monotonically. Remoteness is, therefore, arguably only apparent, as also reflected in the propagation of external perturbations. These results demonstrate a complex mechanism of dynamical interdependence, and exemplify how it can lead to incorrectly inferring synchronization and causality.

nlin.CD↗

arXiv2017

Multiscale Granger causality

In the study of complex physical and biological systems represented by multivariate stochastic processes, an issue of great relevance is the description of the system dynamics spanning multiple temporal scales. While methods to assess the dynamic complexity of individual processes at different time scales are well-established, multiscale analysis of directed interactions has never been formalized theoretically, and empirical evaluations are complicated by practical issues such as filtering and downsampling. Here we extend the very popular measure of Granger causality (GC), a prominent tool for assessing directed lagged interactions between joint processes, to quantify information transfer across multiple time scales. We show that the multiscale processing of a vector autoregressive (AR) process introduces a moving average (MA) component, and describe how to represent the resulting ARMA process using state space (SS) models and to combine the SS model parameters for computing exact GC values at arbitrarily large time scales. We exploit the theoretical formulation to identify peculiar features of multiscale GC in basic AR processes, and demonstrate with numerical simulations the much larger estimation accuracy of the SS approach compared with pure AR modeling of filtered and downsampled data. The improved computational reliability is exploited to disclose meaningful multiscale patterns of information transfer between global temperature and carbon dioxide concentration time series, both in paleoclimate and in recent years.

stat.ME↗

arXiv2017

On the interpretability and computational reliability of frequency-domain Granger causality

This is a comment to the paper 'A study of problems encountered in Granger causality analysis from a neuroscience perspective'. We agree that interpretation issues of Granger Causality in Neuroscience exist (partially due to the historical unfortunate use of the name 'causality', as nicely described in previous literature). On the other hand we think that the paper uses a formulation of Granger causality which is outdated (albeit still used), and in doing so it dismisses the measure based on a suboptimal use of it. Furthermore, since data from simulated systems are used, the pitfalls that are found with the used formulation are intended to be general, and not limited to neuroscience. It would be a pity if this paper, even written in good faith, became a wildcard against all possible applications of Granger Causality, regardless of the hard work of colleagues aiming to seriously address the methodological and interpretation pitfalls. In order to provide a balanced view, we replicated their simulations used the updated State Space implementation, proposed already some years ago, in which the pitfalls are mitigated or directly solved.

stat.ME↗

arXiv2017

Multiscale Information Decomposition: Exact Computation for Multivariate Gaussian Processes

Exploiting the theory of state space models, we derive the exact expressions of the information transfer, as well as redundant and synergistic transfer, for coupled Gaussian processes observed at multiple temporal scales. All of the terms, constituting the frameworks known as interaction information decomposition and partial information decomposition, can thus be analytically obtained for different time scales from the parameters of the VAR model that fits the processes. We report the application of the proposed methodology firstly to benchmark Gaussian systems, showing that this class of systems may generate patterns of information decomposition characterized by mainly redundant or synergistic information transfer persisting across multiple time scales or even by the alternating prevalence of redundant and synergistic source interaction depending on the time scale. Then, we apply our method to an important topic in neuroscience, i.e., the detection of causal interactions in human epilepsy networks, for which we show the relevance of partial information decomposition to the detection of multiscale information transfer spreading from the seizure onset zone.

stat.ME↗

arXiv2017

Multiscale Granger causality analysis by à trous wavelet transform

Since interactions in neural systems occur across multiple temporal scales, it is likely that information flow will exhibit a multiscale structure, thus requiring a multiscale generalization of classical temporal precedence causality analysis like Granger's approach. However, the computation of multiscale measures of information dynamics is complicated by theoretical and practical issues such as filtering and undersampling: to overcome these problems, we propose a wavelet-based approach for multiscale Granger causality (GC) analysis, which is characterized by the following properties: (i) only the candidate driver variable is wavelet transformed (ii) the decomposition is performed using the à trous wavelet transform with cubic B-spline filter. We measure GC, at a given scale, by including the wavelet coefficients of the driver times series, at that scale, in the regression model of the target. To validate our method, we apply it to publicly available scalp EEG signals, and we find that the condition of closed eyes, at rest, is characterized by an enhanced GC among channels at slow scales w.r.t. eye open condition, whilst the standard Granger causality is not significantly different in the two conditions.

q-bio.QM↗

arXiv2016

Critical comments on EEG sensor space dynamical connectivity analysis

Many different analysis techniques have been developed and applied to EEG recordings that allow one to investigate how different brain areas interact. One particular class of methods, based on the linear parametric representation of multiple interacting time series, is widely used to study causal connectivity in the brain. However, the results obtained by these methods should be interpreted with great care. The goal of this paper is to show, both theoretically and using simulations, that results obtained by applying causal connectivity measures on the sensor (scalp) time series do not allow interpretation in terms of interacting brain sources. This is because 1) the channel locations cannot be seen as an approximation of a source's anatomical location and 2) spurious connectivity can occur between sensors. Although many measures of causal connectivity derived from EEG sensor time series are affected by the latter, here we will focus on the well-known time domain index of Granger causality (GC) and on the frequency domain directed transfer function (DTF). Using the state-space framework and designing two simulation studies we show that mixing effects caused by volume conduction can lead to spurious connections, detected either by time domain GC or by DTF. Therefore, GC/DTF causal connectivity measures should be computed at the source level, or derived within analysis frameworks that model the effects of volume conduction. Since mixing effects can also occur in the source space, it is advised to combine source space analysis with connectivity measures that are robust to mixing.

q-bio.NC↗

arXiv2016

Synergetic and redundant information flow detected by unnormalized Granger causality: application to resting state fMRI

Objectives: We develop a framework for the analysis of synergy and redundancy in the pattern of information flow between subsystems of a complex network. Methods: The presence of redundancy and/or synergy in multivariate time series data renders difficult to estimate the neat flow of information from each driver variable to a given target. We show that adopting an unnormalized definition of Granger causality one may put in evidence redundant multiplets of variables influencing the target by maximizing the total Granger causality to a given target, over all the possible partitions of the set of driving variables. Consequently we introduce a pairwise index of synergy which is zero when two independent sources additively influence the future state of the system, differently from previous definitions of synergy. Results: We report the application of the proposed approach to resting state fMRI data from the Human Connectome Project, showing that redundant pairs of regions arise mainly due to space contiguity and interhemispheric symmetry, whilst synergy occurs mainly between non-homologous pairs of regions in opposite hemispheres. Conclusions: Redundancy and synergy, in healthy resting brains, display characteristic patterns, revealed by the proposed approach. Significance: The pairwise synergy index, here introduced, maps the informational character of the system at hand into a weighted complex network: the same approach can be applied to other complex systems whose normal state corresponds to a balance between redundant and synergetic circuits.

cs.IT↗

arXiv2016

Multiscale Analysis of Information Dynamics for Linear Multivariate Processes

In the study of complex physical and physiological systems represented by multivariate time series, an issue of great interest is the description of the system dynamics over a range of different temporal scales. While information-theoretic approaches to the multiscale analysis of complex dynamics are being increasingly used, the theoretical properties of the applied measures are poorly understood. This study introduces for the first time a framework for the analytical computation of information dynamics for linear multivariate stochastic processes explored at different time scales. After showing that the multiscale processing of a vector autoregressive (VAR) process introduces a moving average (MA) component, we describe how to represent the resulting VARMA process using state-space (SS) models and how to exploit the SS model parameters to compute analytical measures of information storage and information transfer for the original and rescaled processes. The framework is then used to quantify multiscale information dynamics for simulated unidirectionally and bidirectionally coupled VAR processes, showing that rescaling may lead to insightful patterns of information storage and transfer but also to potentially misleading behaviors.

cs.IT↗

arXiv2015

Neural Networks with Non-Uniform Embedding and Explicit Validation Phase to Assess Granger Causality

A challenging problem when studying a dynamical system is to find the interdependencies among its individual components. Several algorithms have been proposed to detect directed dynamical influences between time series. Two of the most used approaches are a model-free one (transfer entropy) and a model-based one (Granger causality). Several pitfalls are related to the presence or absence of assumptions in modeling the relevant features of the data. We tried to overcome those pitfalls using a neural network approach in which a model is built without any a priori assumptions. In this sense this method can be seen as a bridge between model-free and model-based approaches. The experiments performed will show that the method presented in this work can detect the correct dynamical information flows occurring in a system of time series. Additionally we adopt a non-uniform embedding framework according to which only the past states that actually help the prediction are entered into the model, improving the prediction and avoiding the risk of overfitting. This method also leads to a further improvement with respect to traditional Granger causality approaches when redundant variables (i.e. variables sharing the same information about the future of the system) are involved. Neural networks are also able to recognize dynamics in data sets completely different from the ones used during the training phase.

physics.data-an↗