arXiv · cond-mat/0305587
A layered neural network with three-state neurons optimizing the mutual information
Abstract
The time evolution of an exactly solvable layered feedforward neural network with three-state neurons and optimizing the mutual information is studied for arbitrary synaptic noise (temperature). Detailed stationary temperature-capacity and capacity-activity phase diagrams are obtained. The model exhibits pattern retrieval, pattern-fluctuation retrieval and spin-glass phases. It is found that there is an improved performance in the form of both a larger critical capacity and information content compared with three-state Ising-type layered network models. Flow diagrams reveal that saddle-point solutions associated with fluctuation overlaps slow down considerably the flow of the network states towards the stable fixed-points.
Explore related subjects
Keep this discovery
Explore connections, maps & timelines
D. Bolle, R. Erichsen, Jr., W. K. Theumann. 2003-05-26. A layered neural network with three-state neurons optimizing the mutual information. https://doi.org/10.1016/j.physa.2003.10.033
Cite the original work for its findings. Save a collection to share your selection of sources.