SearcharxivSearch

arXiv subjects

Sebastiano Stramaglia

Publications and source records attributed to Sebastiano Stramaglia.

At least 19 recordsLinked to original sources

Topological Uncertainty and Higher-Order Interactions in Spatial Networks

Environmental systems are characterized by complex spatial interactions that cannot be fully described through pairwise relationships or local uncertainty measures. We propose a unified framework combining higher-order information theory and topological data analysis to characterize the organization and uncertainty of environmental networks. Spatial entities, represented by monitoring stations or municipalities, are embedded into a Delaunay simplicial complex, and O-information is used to quantify redundancy and synergy among neighboring triplets. The resulting field of higher-order interactions is analyzed through persistent homology, enabling the identification of topological structures that remain stable across interaction scales. The methodology is applied to both an air-quality monitoring network based on weekly \(\mathrm{NO_2}\) and \(\mathrm{O_3}\) observations and a multi-hazard territorial assessment. We show that regions exhibiting strong O-information and persistent topological structures correspond to robust environmental patterns, whereas areas characterized by heterogeneous regimes and rapidly varying interactions display increased uncertainty. Building on these results, we introduce a topological uncertainty framework that integrates simplex divergence, higher-order interactions, and topological uncertainty. Our results demonstrate that uncertainty can be interpreted not only as statistical variability but also as the instability of the underlying information topology. By integrating O-information and persistent homology within a common spatial framework, the proposed approach provides a new methodology for detecting robust higher-order structures and topologically uncertain regions in environmental and multi-hazard systems.

physics.soc-ph

From Statistical to Structural Synergy: A Predictability Framework to Quantify the Effects due to High-Order Mechanisms

High-order interactions are increasingly recognized as a hallmark of collective dynamics in complex systems. The relationship between high-order behaviours (HOBs), observed as synergistic or redundant statistical dependencies, and high-order mechanisms (HOMs), related to the structural or dynamical rules of the data-generating process, remains difficult to establish from data. We introduce a predictability-based framework to disentangle these two levels of description in complex network systems. Structural synergy is defined as the excess predictive power gained when two sources are considered jointly beyond the best additive description and is estimated through polynomial regression by comparing a model with interaction terms against an additive model. Simulations show that dependencies among sources reflecting HOBs can arise even in the absence of HOMs, while synergy due to a non-additive mechanism may remain hidden when the observed synergy-redundancy balance is dominated by redundancy and become detectable only through structural synergy. Applications to climate and source-reconstructed cortical EEG dynamics reveal significant non-additive predictive components despite predominantly redundancy-dominated HOBs. These findings emphasize that HOBs and HOMs can dissociate: a system may display redundancy-dominated HOBs while still containing a significant synergistic mechanism. The proposed framework supports a mechanistically informed interpretation of complex-system dynamics and may help to identify when mechanism-based models are needed to predict the response of a system to perturbations or interventions, while also recognizing that structural synergy should be interpreted as evidence of non-additive predictive structure rather than as a direct identification of the underlying generative mechanism.

stat.ME

Dissecting Spectral Granger Causality through Partial Information Decomposition

Granger causality (GC), a popular statistical method for the inference of directional influences between time series measured from a complex network, is sensitive to high-order (non-pairwise) interactions which fundamentally shape the collective network dynamics. This work introduces Partial Decomposition of Granger Causality (PDGC), a tool eliciting redundant and synergistic causal interactions in the pattern of information flow between the subsystems of physiological networks. The tool exploits the framework of partial information decomposition to dissect the multivariate GC from a set of driver random processes to a target process into unique effects carried exclusively by each driver, redundant effects carried identically by more drivers, and synergistic effects carried jointly by some drivers but not by any of them individually. Computation is based on multivariate state-space models expanded in the frequency domain to assess PDGC both in specific bands of physiological interest and in the time domain after whole-band integration. The validation on benchmark simulations demonstrates that the measures of unique, redundant, and synergistic GC reflect the underlying causal mechanisms and are computationally reliable. The application to arterial pressure, respiration, cerebral blood velocity and heart period variability reveals striking differences in the response to postural stress of patients prone to neurally-mediated syncope compared to healthy controls. The extraction of high-order causality patterns from the spectral GC favors dissecting the mechanisms of causal influence underlying multivariate interactions among oscillatory processes in many data-driven applications of network science.

stat.ME

A Tensor Network Framework for Interpretable Graph Analysis of Brain Networks

Identifying robust neurobiological signatures of brain disorders requires machine learning approaches that combine predictive performance with interpretable representations of feature interactions. Here we introduce a quantum-inspired framework based on tensor network machine learning that learns distributed representations of gray-matter features encoded in a Matrix Product State representation, a variational ansatz originally developed for quantum many-body systems. The trained model is then used not only as a classifier but to extract quantum connected correlations between features, which encode higher-order feature interactions and which we map onto a weighted graph. This construction allows us to track, within a single representation, both: (i) the global spectral properties of the network (capturing collective learning dynamics), and (ii) node-level centrality measures (providing interpretable signatures of individual brain regions). Using repeated train-test sampling schemes, we analyze two classification tasks on structural MRI data as examples of complex brain disorders: healthy controls versus schizophrenia and versus bipolar disorder. Node-level analysis identifies a stable set of gray-matter features, most prominently Heschl gyrus, insular cortex, and frontal regions, that act as hubs across multiple centrality measures and across resamplings. These centralities display lower variability across resamplings than Shapley values, supporting the interpretive value of the network representation. The bipolar feature set emerges as a subset of the schizophrenia one, consistent with the hierarchically organized neuroanatomical alterations reported in neuroimaging studies and offering a network-based characterization of this hierarchy.

q-bio.NC

The Representational Limit of Scalar Interactions: An Interventional Decomposition

Signed pairwise interaction scores fundamentally conflate uniqueness (U), redundancy (R), and synergy (S). We prove this on a minimal 3-way XOR structural causal model: faithful indices such as Shapley-Taylor return zero per pair, whereas projective indices such as Shapley Interaction spread the third-order effect into pair scalars that conflate the three mechanisms. We introduce Stochastic Hi-Fi, a post-hoc, retraining-free predictability decomposition that estimates per-feature U/R/S profiles by interventional masked inference. The estimator provides exact interventional semantics, finite-sample Monte Carlo bounds, strict variance reduction from coupled diamond sampling, and uniform finite-vocabulary convergence. Across tabular SCMs, Stochastic Hi-Fi recovers structure missed by scalar baselines (up to 411x larger interaction-magnitude recovery ratios). It also separates redundant and synergistic heads in the GPT-2 IOI circuit. On NIH ChestX-ray14, Stochastic Hi-Fi matches GradCAM on Pointing Game and improves substantially on Deletion AUC.

stat.ML

Investigating High-Order Behaviors in Multivariate Cardiovascular Interactions via Nonlinear Prediction and Information-Theoretic Tools

Assessing the synergistic high-order behaviors (HOBs) that emerge from underlying structural mechanisms is crucial to characterize complex systems. This work leverages the combined use of predictability and information measures to detect and quantify HOBs in synthetic and physiological network systems. After providing formal definitions of mechanisms and behaviors in a complex system, measures of statistical synergy are defined as the whole-minus-sum excess of mutual predictability ($Δ_\textrm{MP}$) or mutual information ($Δ_\textrm{MI}$) obtained when considering the system as a whole rather than as a combination of its units. The two measures are computed using model-free methods based on nonlinear prediction and entropy estimation. The application to simulated linear Gaussian systems and nonlinear deterministic and stochastic dynamic systems shows that $Δ_\textrm{MP}$ tends to vanish for target variables influenced by additive effects of single independent source variables and is positive in the presence of group interactions between sources, while $Δ_\textrm{MI}$ exhibits a higher propensity to display positive values. The analysis of physiological variables shows significant values of $Δ_\textrm{MI}$ when investigating the additive effect of systolic and diastolic arterial pressure on mean arterial pressure, and of both $Δ_\textrm{MP}$ and $Δ_\textrm{MI}$ when assessing how diastolic pressure is modulated by pre-ejection and left-ventricular ejection times. HOBs can be more clearly identified by information-theoretic measures, while prediction measures are more sensitive to synergy arising from the governing rules of the system analyzed rather than from pure statistical dependencies. Quantifying HOBs through measures sensitive to structural mechanisms can provide biomarkers to assess physio-pathological alterations of cardiovascular networks.

q-bio.QM

Transfer entropy and O-information to detect grokking in tensor network multi-class classification problems

Quantum-enhanced machine learning, encompassing both quantum algorithms and quantum-inspired classical methods such as tensor networks, offers promising tools for extracting structure from complex, high-dimensional data. In this work, we study the training dynamics of Matrix Product State (MPS) classifiers applied to three-class problems, using both fashion MNIST and hyper-spectral satellite imagery as representative datasets. We investigate the phenomenon of grokking, where generalization emerges suddenly after memorization, by tracking entanglement entropy, local magnetization, and model performance across training sweeps. Additionally, we employ information theory tools to gain deeper insights: transfer entropy is used to reveal causal dependencies between label-specific quantum masks, while O-information captures the shift from synergistic to redundant correlations among class outputs. Our results show that grokking in the fashion MNIST task coincides with a sharp entanglement transition and a peak in redundant information, whereas the overfitted hyper-spectral model retains synergistic, disordered behavior. These findings highlight the relevance of high-order information dynamics in quantum-inspired learning and emphasize the distinct learning behaviors that emerge in multi-class classification, offering a principled framework to interpret generalization in quantum machine learning architectures.

quant-ph

Information-theoretic Quantification of High-order Feature Effects in Classification Problems

Understanding the contribution of individual features in predictive models remains a central goal in interpretable machine learning, and while many model-agnostic methods exist to estimate feature importance, they often fall short in capturing high-order interactions and disentangling overlapping contributions. In this work, we present an information-theoretic extension of the High-order interactions for Feature importance (Hi-Fi) method, leveraging Conditional Mutual Information (CMI) estimated via a k-Nearest Neighbor (kNN) approach working on mixed discrete and continuous random variables. Our framework decomposes feature contributions into unique, synergistic, and redundant components, offering a richer, model-independent understanding of their predictive roles. We validate the method using synthetic datasets with known Gaussian structures, where ground truth interaction patterns are analytically derived, and further test it on non-Gaussian and real-world gene expression data from TCGA-BRCA. Results indicate that the proposed estimator accurately recovers theoretical and expected findings, providing a potential use case for developing feature selection algorithms or model development based on interaction analysis.

cs.LG

Partial Information Rate Decomposition

Partial Information Decomposition (PID) is a principled and flexible method to unveil complex high-order interactions in multi-unit network systems. Though being defined exclusively for random variables, PID is ubiquitously applied to multivariate time series taken as realizations of random processes with temporal statistical structure. Here, to overcome the incorrect depiction of high-order effects by PID schemes applied to dynamic networks, we introduce the framework of Partial Information Rate Decomposition (PIRD). PIRD is first formalized applying lattice theory to decompose the information shared dynamically between a target random process and a set of source processes, and then implemented for Gaussian processes through a spectral expansion of information rates. The new framework is validated in simulated network systems and demonstrated in the practical analysis of time series from large-scale climate oscillations.

stat.ME

Decomposing Multivariate Information Rates in Networks of Random Processes

The Partial Information Decomposition (PID) framework has emerged as a powerful tool for analyzing high-order interdependencies in complex network systems. However, its application to dynamic processes remains challenging due to the implicit assumption of memorylessness, which often falls in real-world scenarios. In this work, we introduce the framework of Partial Information Rate Decomposition (PIRD) that extends PID to random processes with temporal correlations. By leveraging mutual information rate (MIR) instead of mutual information (MI), our approach decomposes the dynamic information shared by multivariate random processes into unique, redundant, and synergistic contributions obtained aggregating information rate atoms in a principled manner. To solve PIRD, we define a pointwise redundancy rate function based on the minimum MI principle applied locally in the frequency-domain representation of the processes. The framework is validated in benchmark simulations of Gaussian systems, demonstrating its advantages over traditional PID in capturing temporal correlations and showing how the spectral representation may reveal scale-specific higher-order interactions that are obscured in the time domain. Furthermore, we apply PIRD to a physiological network comprising cerebrovascular and cardiovascular variables, revealing frequency-dependent redundant information exchange during a protocol of postural stress. Our results highlight the necessity of accounting for the full temporal statistical structure and spectral content of vector random processes to meaningfully perform information decomposition in network systems with dynamic behavior such as those typically encountered in neuroscience and physiology.

stat.ME

Localizing synergies of hidden factors across complex systems: resting brain networks and HeLa gene expression profile as case studies

Factor analysis is a well-known statistical method to describe the variability of observed variables in terms of a smaller number of unobserved latent variables called factors. Even though latent factors are conceptually independent of each other, their influence on the observed variables is often joint and synergistic. We propose to quantify the synergy of the joint influence of factors on the observed variables using the O-information, a recently introduced metrics to assess high order dependencies in complex systems, in a new framework where latent factors and observed variables are jointly analyzed in terms of their joint informational character. Two case studies are reported: analyzing resting fMRI data, we find that DMN and FP networks show the highest synergy, consistently with their crucial role in higher cognitive functions; concerning HeLa cells, we find that the most synergistic gene is STK-12 (AURKB), suggesting that this gene is involved in controlling the HeLa cell cycle. We believe that this approach, representing a bridge between factor analysis and the field of high-order interactions, will find wide application across several domains.

q-bio.QM

Grokking as an entanglement transition in tensor network machine learning

Grokking is a intriguing phenomenon in machine learning where a neural network, after many training iterations with negligible improvement in generalization, suddenly achieves high accuracy on unseen data. By working in the quantum-inspired machine learning framework based on tensor networks, we numerically prove that grokking phenomenon can be related to an entanglement dynamical transition in the underlying quantum many-body systems, consisting in a one-dimensional lattice with each site hosting a qubit. Two datasets are considered as use case scenarios, namely fashion MNIST and gene expression communities of hepatocellular carcinoma. In both cases, we train Matrix Product State (MPS) to perform binary classification tasks, and we analyse the learning dynamics. We exploit measurement of qubits magnetization and correlation functions in the MPS network as a tool to identify meaningful and relevant gene subcommunities, verified by means of enrichment procedures.

quant-ph

Assessing high-order effects in feature importance via predictability decomposition

Leveraging the large body of work devoted in recent years to describe redundancy and synergy in multivariate interactions among random variables, we propose a novel approach to quantify cooperative effects in feature importance, one of the most used techniques for explainable artificial intelligence. In particular, we propose an adaptive version of a well-known metric of feature importance, named Leave One Covariate Out (LOCO), to disentangle high-order effects involving a given input feature in regression problems. LOCO is the reduction of the prediction error when the feature under consideration is added to the set of all the features used for regression. Instead of calculating the LOCO using all the features at hand, as in its standard version, our method searches for the multiplet of features that maximize LOCO and for the one that minimize it. This provides a decomposition of the LOCO as the sum of a two-body component and higher-order components (redundant and synergistic), also highlighting the features that contribute to building these high-order effects alongside the driving feature. We report the application to proton/pion discrimination from simulated detector measures by GEANT.

physics.data-an

Network Representation of Higher-Order Interactions Based on Information Dynamics

Many complex systems in science and engineering are modeled as networks whose nodes and links depict the temporal evolution of each system unit and the dynamic interaction between pairs of units, which are assessed respectively using measures of auto- and cross-correlation or variants thereof. However, a growing body of work is documenting that this standard network representation can neglect potentially crucial information shared by three or more dynamic processes in the form of higher-order interactions (HOIs). While several measures, mostly derived from information theory, are available to assess HOIs in network systems mapped by multivariate time series, none of them is able to provide a compact and detailed representation of higher-order interdependencies. In this work, we fill this gap by introducing a framework for the assessment of HOIs in dynamic network systems at different levels of resolution. The framework is grounded on the dynamic implementation of the O-information, a new measure assessing HOIs in dynamic networks, which is here used together with its local counterpart and its gradient to quantify HOIs respectively for the network as a whole, for each link, and for each node. The integration of these measures into the conventional network representation results in a tool for the representation of HOIs as networks, which is defined formally using measures of information dynamics, implemented in its linear version by using vector regression models and statistical validation techniques, illustrated in simulated network systems, and finally applied to an illustrative example in the field of network physiology.

stat.ME

A Model-Free Method to Quantify Memory Utilization in Neural Point Processes

Quantifying the predictive capacity of a neural system, intended as the capability to store information and actively use it for dynamic system evolution, is a key component of neural information processing. Information storage (IS), the main measure quantifying the active utilization of memory in a dynamic system, is only defined for discrete-time processes. While recent theoretical work laid the foundations for the continuous-time analysis of the predictive capacity stored in a process, methods for the effective computation of the related measures are needed to favor widespread utilization on neural data. This work introduces a method for the model-free estimation of the so-called memory utilization rate (MUR), the continuous-time counterpart of the IS, specifically designed to quantify the predictive capacity stored in neural point processes. The method employs nearest-neighbor entropy estimation applied to the inter-spike intervals measured from point-process realizations to quantify the extent of memory used by a spike train. An empirical procedure based on surrogate data is implemented to compensate the estimation bias and detect statistically significant levels of memory. The method is validated in simulated Poisson processes and in realistic models of coupled cortical dynamics and heartbeat dynamics. It is then applied to real spike trains reflecting central and autonomic nervous system activities: in spontaneously growing cortical neuron cultures, the MUR detected increasing memory utilization across maturation stages, associated to emergent bursting synchronized activity; in the study of the neuro-autonomic modulation of human heartbeats, the MUR reflected the sympathetic activation occurring with postural but not with mental stress. The proposed approach offers a computationally reliable tool to analyze spike train data in computational neuroscience and physiology.

q-bio.NC

Information-Theoretic Progress Measures reveal Grokking is an Emergent Phase Transition

This paper studies emergent phenomena in neural networks by focusing on grokking where models suddenly generalize after delayed memorization. To understand this phase transition, we utilize higher-order mutual information to analyze the collective behavior (synergy) and shared properties (redundancy) between neurons during training. We identify distinct phases before grokking allowing us to anticipate when it occurs. We attribute grokking to an emergent phase transition caused by the synergistic interactions between neurons as a whole. We show that weight decay and weight initialization can enhance the emergent phase.

cs.LG

Disentangling high order effects in the transfer entropy

Transfer Entropy (TE), the primary method for determining directed information flow within a network system, can exhibit bias - either in deficiency or excess - during both pairwise and conditioned calculations, owing to high-order dependencies among the dynamic processes under consideration and the remaining processes in the system used for conditioning. Here, we propose a novel approach. Instead of conditioning TE on all network processes except the driver and target, as in its fully conditioned version, or not conditioning at all, as in the pairwise approach, our method searches for both the multiplets of variables that maximize information flow and those that minimize it. This provides a decomposition of TE into unique, redundant, and synergistic atoms. Our approach enables the quantification of the relative importance of high-order effects compared to pure two-body effects in information transfer between two processes, while also highlighting the processes that contribute to building these high-order effects alongside the driver. We demonstrate the application of our approach in climatology by analyzing data from El Niño and the Southern Oscillation.

physics.data-an

Assessing High-Order Links in Cardiovascular and Respiratory Networks via Static and Dynamic Information Measures

The network representation is becoming increasingly popular for the description of cardiovascular interactions based on the analysis of multiple simultaneously collected variables. However, the traditional methods to assess network links based on pairwise interaction measures cannot reveal high-order effects involving more than two nodes, and are not appropriate to infer the underlying network topology. To address these limitations, here we introduce a framework which combines the assessment of high-order interactions with statistical inference for the characterization of the functional links sustaining physiological networks. The framework develops information-theoretic measures quantifying how two nodes interact in a redundant or synergistic way with the rest of the network, and employs these measures for reconstructing the functional structure of the network. The measures are implemented for both static and dynamic networks mapped respectively by random variables and random processes using plug-in and model-based entropy estimators. The validation on theoretical and numerical simulated networks documents the ability of the framework to represent high-order interactions as networks and to detect statistical structures associated to cascade, common drive and common target effects. The application to cardiovascular networks mapped by the beat-to-beat variability of heart rate, respiration, arterial pressure, cardiac output and vascular resistance allowed noninvasive characterization of several mechanisms of cardiovascular control operating in resting state and during orthostatic stress. Our approach brings to new comprehensive assessment of physiological interactions and complements existing strategies for the classification of pathophysiological states.

stat.ME