SearcharxivSearch

arXiv subjects

J. J. Hopfield

Publications and source records attributed to J. J. Hopfield.

2 recordsLinked to original sources

Sequence reproduction, single trial learning, and mimicry based on a mammalian-like distributed code for time

Animals learn tasks requiring a sequence of actions over time. Waiting a given time before taking an action is a simple example. Mimicry is a complex example, e.g. in humans, humming a brief tune you have just heard. Re-experiencing a sensory pattern mentally must involve reproducing a sequence of neural activities over time. In mammals, neurons in prefrontal cortex have time-dependent firing rates that vary smoothly and slowly in a stereotyped fashion. We show through modeling that a Many are Equal computation can use such slowly-varying activities to identify each timepoint in a sequence by the population pattern of activity at the timepoint. The MAE operation implemented here is facilitated by a common inhibitory conductivity due to a theta rhythm. Sequences of analog values of discrete events, exemplified by a brief tune having notes of different durations and intensities, can be learned in a single trial through STDP. An action sequence can be played back sped up, slowed down, or reversed by modulating the system that generates the slowly changing stereotyped activities. Synaptic adaptation and cellular post-hyperpolarization rebound contribute to robustness. An ability to mimic a sequence only seconds after observing it requires the STDP to be effective within seconds.

q-bio.NC

Searching for memories, Sudoku, implicit check-bits, and the iterative use of not-always-correct rapid neural computation

The algorithms that simple feedback neural circuits representing a brain area can rapidly carry out are often adequate to solve only easy problems, and for more difficult problems can return incorrect answers. A new excitatory-inhibitory circuit model of associative memory displays the common human problem of failing to rapidly find a memory when only a small clue is present. The memory model and a related computational network for solving Sudoku puzzles produce answers that contain implicit check-bits in the representation of information across neurons, allowing a rapid evaluation of whether the putative answer is correct or incorrect through a computation related to visual 'pop-out'. This fact may account for our strong psychological feeling of right or wrong when we retrieve a nominal memory from a minimal clue. This information allows more difficult computations or memory retrievals to be done in a serial fashion by using the fast but limited capabilities of a computational module multiple times. The mathematics of the excitatory-inhibitory circuits for associative memory and for Sudoku, both of which are understood in terms of 'energy' or Lyapunov functions, is described in detail.

q-bio.NC