arXiv · physics/0307072
Network information and connected correlations
Abstract
Entropy and information provide natural measures of correlation among elements in a network. We construct here the information theoretic analog of connected correlation functions: irreducible $N$--point correlation is measured by a decrease in entropy for the joint distribution of $N$ variables relative to the maximum entropy allowed by all the observed $N-1$ variable distributions. We calculate the ``connected information'' terms for several examples, and show that it also enables the decomposition of the information that is carried by a population of elements about an outside source.
Explore related subjects
Keep this discovery
Explore connections, maps & timelines
Elad Schneidman, Susanne Still, Michael J. Berry II, William Bialek. 2003-07-15. Network information and connected correlations. https://doi.org/10.1103/physrevlett.91.238701
Cite the original work for its findings. Save a collection to share your selection of sources.