arXiv · 2410.06269
A correspondence between Hebbian unlearning and steady states generated by nonequilibrium dynamics
Abstract
The classic paradigms for learning and memory recall focus on strengths of synaptic couplings and how these can be modulated to encode memories. In a previous paper [A. K. Behera, M. Rao, S. Sastry, and S. Vaikuntanathan, Physical Review X 13, 041043 (2023)], we demonstrated how a specific non-equilibrium modification of the dynamics of an associative memory system can lead to increase in storage capacity. In this work, using analytical theory and computational inference schemes, we show that the dynamical steady state accessed is in fact similar to those accessed after the operation of a classic unsupervised scheme for improving memory recall, Hebbian unlearning or ``dreaming". Together, our work suggests how nonequilibrium dynamics can provide an alternative route for controlling the memory encoding and recall properties of a variety of synthetic (neuromorphic) and biological systems.
Explore related subjects
Keep this discovery
Agnish Kumar Behera, Matthew Du, Uday Jagadisan, Srikanth Sastry, Madan Rao, Suriyanarayanan Vaikuntanathan. 2024-10-08. A correspondence between Hebbian unlearning and steady states generated by nonequilibrium dynamics. https://arxiv.org/abs/2410.06269
Cite the original work for its findings. Save a collection to share your selection of sources.