arXiv subjects

Anil K. Seth

Publications and source records attributed to Anil K. Seth.

23 records · Page 2Linked to original sources

arXiv2017

The free energy principle for action and perception: A mathematical review

The 'free energy principle' (FEP) has been suggested to provide a unified theory of the brain, integrating data and theory relating to action, perception, and learning. The theory and implementation of the FEP combines insights from Helmholtzian 'perception as inference', machine learning theory, and statistical thermodynamics. Here, we provide a detailed mathematical evaluation of a suggested biologically plausible implementation of the FEP that has been widely used to develop the theory. Our objectives are (i) to describe within a single article the mathematical structure of this implementation of the FEP; (ii) provide a simple but complete agent-based model utilising the FEP; (iii) disclose the assumption structure of this implementation of the FEP to help elucidate its significance for the brain sciences.

q-bio.NC↗

arXiv2016

Detectability of Granger causality for subsampled continuous-time neurophysiological processes

Granger causality is well established within the neurosciences for inference of directed functional connectivity from neurophysiological data. These data usually consist of time series which subsample a continuous-time biophysiological process. While it is well-known that subsampling can lead to imputation of spurious causal connections where none exist, here we address the equally important issue of the effects of subsampling on the ability to reliably detect causal connections which do exist. Neurophysiological processes typically feature signal propagation delays on multiple time scales; accordingly, we base our analysis on a distributed-lag, continuous-time stochastic model, and consider Granger causality in continuous time at finite prediction horizons. Via exact analytical solutions, we identify relationships among sampling frequency, underlying causal time scales and detectability of causalities. Our analysis reveals complex interactions between the time scale(s) of neural signal propagation and sampling frequency: we demonstrate that Granger causality decays exponentially as the sample time interval increases beyond causal delay times, identify detectability "black spots" and "sweet spots", and show that subsampling may sometimes improve detectability. We also demonstrate that the invariance of Granger causality under causal, invertible filtering fails at finite prediction horizons. We discuss the implications of our results for inference of Granger causality at the neural level from various neurophysiological recording modes, and emphasise that sampling rates for causal analysis of neurophysiological time series should be informed by domain-specific time scales.

stat.AP↗

arXiv2015

Granger causality for state space models

Granger causality, a popular method for determining causal influence between stochastic processes, is most commonly estimated via linear autoregressive modeling. However, this approach has a serious drawback: if the process being modeled has a moving average component, then the autoregressive model order is theoretically infinite, and in finite sample large empirical model orders may be necessary, resulting in weak Granger-causal inference. This is particularly relevant when the process has been filtered, downsampled, or observed with (additive) noise - all of which induce a moving average component and are commonplace in application domains as diverse as econometrics and the neurosciences. By contrast, the class of autoregressive moving average models - or, equivalently, linear state space models - is closed under digital filtering, downsampling (and other forms of aggregation) as well as additive observational noise. Here, we show how Granger causality, conditional and unconditional, in both time and frequency domains, may be calculated simply and directly from state space model parameters, via solution of a discrete algebraic Riccati equation. Numerical simulations demonstrate that Granger causality estimators thus derived have greater statistical power and smaller bias than pure autoregressive estimators. We conclude that the state space approach should be the default for (linear) Granger causality estimation.

math.ST↗

arXiv2010

Multivariate Granger Causality and Generalized Variance

Granger causality analysis is a popular method for inference on directed interactions in complex systems of many variables. A shortcoming of the standard framework for Granger causality is that it only allows for examination of interactions between single (univariate) variables within a system, perhaps conditioned on other variables. However, interactions do not necessarily take place between single variables, but may occur among groups, or "ensembles", of variables. In this study we establish a principled framework for Granger causality in the context of causal interactions among two or more multivariate sets of variables. Building on Geweke's seminal 1982 work, we offer new justifications for one particular form of multivariate Granger causality based on the generalized variances of residual errors. Taken together, our results support a comprehensive and theoretically consistent extension of Granger causality to the multivariate case. Treated individually, they highlight several specific advantages of the generalized variance measure, which we illustrate using applications in neuroscience as an example. We further show how the measure can be used to define "partial" Granger causality in the multivariate context and we also motivate reformulations of "causal density" and "Granger autonomy". Our results are directly applicable to experimental data and promise to reveal new types of functional relations in complex systems, neural and otherwise.

q-bio.NC↗

arXiv2009

Granger causality and transfer entropy are equivalent for Gaussian variables

Granger causality is a statistical notion of causal influence based on prediction via vector autoregression. Developed originally in the field of econometrics, it has since found application in a broader arena, particularly in neuroscience. More recently transfer entropy, an information-theoretic measure of time-directed information transfer between jointly dependent processes, has gained traction in a similarly wide field. While it has been recognized that the two concepts must be related, the exact relationship has until now not been formally described. Here we show that for Gaussian variables, Granger causality and transfer entropy are entirely equivalent, thus bridging autoregressive and information-theoretic approaches to data-driven causal inference.

math-ph↗