arXiv · 2503.00241
Accuracy and capacity of Modern Hopfield networks with synaptic noise
Abstract
We study the retrieval accuracy and capacity of modern Hopfield networks of with two-state (Ising) spins interacting via modified Hebbian $n$-spin interactions. In particular, we consider systems where the interactions deviate from the Hebb rule through additive or multiplicative noise or through clipping or deleting interactions. We find that the capacity scales as $N^{n-1}$ with the number of spins $N$ in all cases, but with a prefactor reduced compared to the Hebbian case. For $n=2$ our results agree with the previously known results for the conventional $n = 2$ Hopfield network.
Explore related subjects
Keep this discovery
Sharba Bhattacharjee, Ivar Martin. 2025-02-28. Accuracy and capacity of Modern Hopfield networks with synaptic noise. https://arxiv.org/abs/2503.00241
Cite the original work for its findings. Save a collection to share your selection of sources.