Network information and connected correlations

Elad Schneidman, Susanne Still, Michael J. Berry, William Bialek

Research output: Contribution to journalArticle

171 Scopus citations

Abstract

Entropy and information provide natural measures of correlation among elements in a network. We construct here the information theoretic analog of connected correlation functions: irreducible [Formula presented]-point correlation is measured by a decrease in entropy for the joint distribution of [Formula presented] variables relative to the maximum entropy allowed by all the observed [Formula presented] variable distributions. We calculate the “connected information” terms for several examples and show that it also enables the decomposition of the information that is carried by a population of elements about an outside source.

Original languageEnglish (US)
JournalPhysical review letters
Volume91
Issue number23
DOIs
StatePublished - Jan 1 2003

All Science Journal Classification (ASJC) codes

  • Physics and Astronomy(all)

Fingerprint Dive into the research topics of 'Network information and connected correlations'. Together they form a unique fingerprint.

  • Cite this