SearcharxivSearch

arXiv · cond-mat/0106570

Statistical Mechanics and Capacity-Approaching Error-Correcting Codes

Abstract

I will show that there is a deep relation between error-correction codes and certain mathematical models of spin glasses. In particular minimum error probability decoding is equivalent to finding the ground state of the corresponding spin system. The most probable value of a symbol is related to the magnetization at a different temperature. Convolutional codes correspond to one-dimensional spin systems and Viterbi's decoding algorithm to the transfer matrix algorithm of Statistical Mechanics. I will also show how the recently discovered (or rediscovered) capacity approaching codes (turbo codes and low density parity check codes) can be analysed using statistical mechanics. It is possible to show, using statistical mechanics, that these codes allow error-free communication for signal to noise ratio above a certain threshold. This threshold depends on the particular code, and can be computed analytically in many cases.

Explore related subjects

Keep this discovery

BibTeXRIS

Nicolas Sourlas. 2001-06-27. Statistical Mechanics and Capacity-Approaching Error-Correcting Codes. https://doi.org/10.1016/s0378-4371(01)00439-3

Cite the original work for its findings. Save a collection to share your selection of sources.

KEEP EXPLORING

Related papers

Random-Matrix Theory of Quantum Size Effects on Nuclear Magnetic Resonance in Metal Particles

The distribution function of the local density of states is computed exactly for the Wigner-Dyson ensemble of random Hamiltonians. In the absence of time-reversal symmetry, precise agreement is obtained with the "supersymmetry" theory by Efetov and Prigodin of the NMR lineshape in disordered metal particles. Upon breaking time-reversal symmetry, the variance of the Knight shift in the smallest particles is reduced by a universal factor of 2/3. ***To be published in Physical Review B.****

cond-mat

Andreev Reflection In Ferromagnet-Superconductor Junctions

The transport properties of a ferromagnet-superconductor (FS) junction are studied in a scattering formulation. Andreev reflection at the FS interface is strongly affected by the exchange interaction in the ferromagnet. The conductance G_FS of a ballistic point contact between F and S can be both larger or smaller than the value G_FN with the superconductor in the normal state, depending on the ratio of the exchange and Fermi energies. If the ferromagnet contains a tunnel barrier (I), the conductance G_FIFS exhibits resonances which do not vanish in linear response -- in contrast to the Tomasch oscillations for non-ferromagnetic materials.

cond-mat

Long-Range Energy-Level Interaction in Small Metallic Particles

We consider the energy level statistics of non-interacting electrons which diffuse in a $ d $-dimensional disordered metallic conductor of characteristic Thouless energy $ E_c. $ We assume that the level distribution can be written as the Gibbs distribution of a classical one-dimensional gas of fictitious particles with a pairwise additive interaction potential $ f(\varepsilon ). $ We show that the interaction which is consistent with the known correlation function of pairs of energy levels is a logarithmic repulsion for level separations $ \varepsilon E_c, $ $ f(\varepsilon ) $ vanishes as a power law in $ \varepsilon /E_c $ with exponents $ -{1 \over 2},-2, $ and $ -{3 \over 2} $ for $ d=1,2, $ and 3, respectively. While for $ d=1,2 $ the energy-level interaction is always repulsive, in three dimensions there is long-range level attraction after the short-range logarithmic repulsion.

cond-mat