Searcharxiv⌕ Search

arXiv subjects

Madalina I. Sas

Publications and source records attributed to Madalina I. Sas.

2 recordsLinked to original sources

Improved estimators of causal emergence for large systems

A central challenge in the study of complex systems is the quantification of emergence -- understood as the ability of the system to exhibit collective behaviours that cannot be traced down to the individual components. While recent work has proposed practical measures to detect emergence, these approaches tend to double-count the contribution of shared components, which substantially hinders their capability to effectively study large systems. In this work, we introduce a family of improved information-theoretic measures of emergence that iteratively correct for double-counted terms. Our approach is computationally efficient and provides a controllable trade-off between computational load and sensitivity, leading to more accurate and versatile estimates of emergence. The benefits of the proposed approach are demonstrated by successfully detecting emergence in both simulated and real-world data related to flocking behaviour.

physics.soc-ph↗

Simple physical systems as a reference for multivariate information dynamics

Understanding a complex system entails capturing the non-trivial collective phenomena that arise from interactions between its different parts. Information theory is a flexible and robust framework to study such behaviours, with several measures designed to quantify and characterise the interdependencies among the system's components. However, since these estimators rely on the statistical distributions of observed quantities, it is crucial to examine the relationships between information-theoretic measures and the system's underlying mechanistic structure. To this end, here we present an information-theoretic analytical investigation of an elementary system of interactive random walkers subject to Gaussian noise. Focusing on partial information decomposition, causal emergence, and integrated information, our results help us develop some intuitions on their relationship with the physical parameters of the system. For instance, we observe that uncoupled systems can exhibit emergent properties, in a way that we suggest may be better described as ''statistically autonomous''. Overall, we observe that in this simple scenario information measures align more reliably with the system's mechanistic properties when calculated at the level of microscopic components, rather than their coarse-grained counterparts, and over timescales comparable with the system's intrinsic dynamics. Moreover, we show that approaches that separate the contributions of the system's dynamics and steady-state distribution (e.g. via causal perturbations) may help strengthen the interpretation of information-theoretic analyses.

cs.IT↗