SearcharxivSearch

arXiv subjects

Simon Brandt

Publications and source records attributed to Simon Brandt.

3 recordsLinked to original sources

Dendritic structure enables powerful plasticity

Over the past decades, it has become increasingly clear that the complex morphology of cortical neurons is more than just a quirk of evolution, and that dendritic compartments serve as computational elements in their own right, rather than just providing connections between nerve cell bodies. While most computational studies discuss the enhanced representational capabilities of multi-compartment models as compared to point neurons, we focus here on the implications of neuronal morphology for synaptic plasticity. We argue that the ability of single neurons to simultaneously encode multiple pieces of information gives synapses local access to more than just the classical Hebbian pre- and postsynaptic terms, and with much greater specificity and reaction speed than permitted by other globally modulated factors. Based on a comparative review of recent dendritic learning models, we show how such neuronal compartmentalization can provide synapses with the means for calculating various forms of error signals, which in turn give rise to powerful real-time and fully local instantiations of deep learning through gradient descent. Implemented within cortical microcircuits capable of propagating and manipulating these errors, compartmentalized neurons thus ultimately enable the learning of far more complex tasks than are achievable by globally modulated Hebbian plasticity alone.

q-bio.NC

A Variational Latent Equilibrium for Learning in Neuronal Circuits

Brains remain unrivaled in their ability to recognize and generate complex spatiotemporal patterns. While AI is able to reproduce some of these capabilities, deep learning algorithms remain largely at odds with our current understanding of brain circuitry and dynamics. This is prominently the case for backpropagation through time (BPTT), the go-to algorithm for learning complex temporal dependencies. In this work we propose a general formalism to approximate BPTT in a controlled, biologically plausible manner. Our approach builds on, unifies and extends several previous approaches to local, time-continuous, phase-free spatiotemporal credit assignment based on principles of energy conservation and extremal action. Our starting point is a prospective energy function of neuronal states, from which we calculate real-time error dynamics for time-continuous neuronal networks. In the general case, this provides a simple and straightforward derivation of the adjoint method result for neuronal networks, the time-continuous equivalent to BPTT. With a few modifications, we can turn this into a fully local (in space and time) set of equations for neuron and synapse dynamics. Our theory provides a rigorous framework for spatiotemporal deep learning in the brain, while simultaneously suggesting a blueprint for physical circuits capable of carrying out these computations. These results reframe and extend the recently proposed Generalized Latent Equilibrium (GLE) model.

q-bio.NC

Prospective and retrospective coding in cortical neurons

Brains can process sensory information from different modalities at astonishing speed; this is surprising as the integration of inputs through the membrane of each individual neuron already causes a delayed response. Neuronal recordings {\em in vitro} reveal a possible explanation for this fast processing, in terms of individual neurons advancing their output firing rates with respect to the input, a concept which we refer to as prospective coding. The underlying mechanisms of prospective coding, however, are not completely understood. We propose a mechanistic explanation for individual neurons advancing their output on the level of single action potentials and instantaneous firing rates. We show that the spike generation mechanism can be the source for prospective (advanced) or retrospective (delayed) responses. A simplified Hodgkin-Huxley model identifies sodium inactivation as a source for prospective firing, controlling the timing of the neuron's output as a function of the voltage and its temporal derivative. We further show that slow adaptation processes, such as spike-frequency adaptation or deactivating dendritic currents, represent mechanisms generating prospective firing for inputs that undergo slow temporal modulations. In general, we show that adaptation processes at different time scales can cause advanced neuronal responses to time-varying inputs that are modulated on the corresponding time scales.

q-bio.NC