SearcharxivSearch

arXiv subjects

Valentin Schmutz

Publications and source records attributed to Valentin Schmutz.

10 recordsLinked to original sources

On large networks of integrate-and-fire neurons with short-term synaptic plasticity

This work studies the mean-field limit of large networks of interacting stochastic leaky integrate-and-fire (LIF) neurons subject to short-term synaptic depression (STD). The macroscopic dynamics of this system is governed by a two-dimensional, non-linear McKean-Vlasov equation that couples the evolution of the neurons' membrane potentials with a synaptic depression variable. We investigate the long-time behavior of this limit system. To this end, we introduce an auxiliary linearized Markov process by freezing the interaction non-linearity to a constant. By exploiting the regeneration of the membrane potential at spike times, we are able to explicitly compute the conditional expectation of the synaptic depression variable, conditionally on the potential value, under the invariant measure of this two-dimensional linear process. This is a crucial ingredient to study time-dependent local perturbations thereof. As a consequence we are able to identify an analytic criterion guaranteeing the local stability of any invariant probability measure of the fully non-linear system. This stability criterion is formulated in terms of the zeros of the Laplace transform of a specific linear response function. Finally, we provide numerical examples demonstrating that the two-dimensional framework induces a richer spectrum of long-time dynamics than purely one-dimensional models. For example, synaptic depression can lead to low-frequency oscillations around a unique, unstable invariant measure where the oscillations are much slower than the neurons' firing rates.

math.PR

Spikes can transmit neurons' subthreshold membrane potentials

Neurons primarily communicate through the emission of action potentials, or spikes. To generate a spike, a neuron's membrane potential must cross a defined threshold. Does this spiking mechanism inherently prevent neurons from transmitting their subthreshold membrane potential fluctuations to other neurons? We prove that, in theory, it does not. The subthreshold membrane potential fluctuations of a presynaptic population of spiking neurons can be perfectly transmitted to a downstream population of neurons. Mathematically, this surprising result is an example of concentration phenomenon in high dimensions.

q-bio.NC

Dense networks of integrate-and-fire neurons: Spatially-extended mean-field limit of the empirical measure

The dynamics of spatially-structured networks of $N$ interacting stochastic neurons can be described by deterministic population equations in the mean-field limit. While this is known, a general question has remained unanswered: does synaptic weight scaling suffice, by itself, to guarantee the convergence of network dynamics to a deterministic population equation, even when networks are not assumed to be homogeneous or spatially structured? In this work, we consider networks of stochastic integrate-and-fire neurons with arbitrary synaptic weights satisfying a $O(1/N)$ scaling condition. Borrowing results from the theory of dense graph limits, or graphons, we prove that, as $N\to\infty$, and up to the extraction of a subsequence, the empirical measure of the neurons' membrane potentials converges to the solution of a spatially-extended mean-field partial differential equation (PDE). Our proof requires analytical techniques that go beyond standard propagation of chaos methods. In particular, we introduce a weak metric that depends on the dense graph limit kernel and we show how the weak convergence of the initial data can be obtained by propagating the regularity of the limit kernel along the dual-backward equation associated with the spatially-extended mean-field PDE. Overall, this result invites us to reinterpret spatially-extended population equations as universal mean-field limits of networks of neurons with $O(1/N)$ synaptic weight scaling.

math.PR

Emergent rate-based dynamics in duplicate-free populations of spiking neurons

Can Spiking Neural Networks (SNNs) approximate the dynamics of Recurrent Neural Networks (RNNs)? Arguments in classical mean-field theory based on laws of large numbers provide a positive answer when each neuron in the network has many "duplicates", i.e. other neurons with almost perfectly correlated inputs. Using a disordered network model that guarantees the absence of duplicates, we show that duplicate-free SNNs can converge to RNNs, thanks to the concentration of measure phenomenon. This result reveals a general mechanism underlying the emergence of rate-based dynamics in large SNNs.

q-bio.NC

Mesoscopic modeling of hidden spiking neurons

Can we use spiking neural networks (SNN) as generative models of multi-neuronal recordings, while taking into account that most neurons are unobserved? Modeling the unobserved neurons with large pools of hidden spiking neurons leads to severely underconstrained problems that are hard to tackle with maximum likelihood estimation. In this work, we use coarse-graining and mean-field approximations to derive a bottom-up, neuronally-grounded latent variable model (neuLVM), where the activity of the unobserved neurons is reduced to a low-dimensional mesoscopic description. In contrast to previous latent variable models, neuLVM can be explicitly mapped to a recurrent, multi-population SNN, giving it a transparent biological interpretation. We show, on synthetic spike trains, that a few observed neurons are sufficient for neuLVM to perform efficient model inversion of large SNNs, in the sense that it can recover connectivity parameters, infer single-trial latent population activity, reproduce ongoing metastable dynamics, and generalize when subjected to perturbations mimicking photo-stimulation.

q-bio.NC

Mesoscopic description of hippocampal replay and metastability in spiking neural networks with short-term plasticity

Bottom-up models of functionally relevant patterns of neural activity provide an explicit link between neuronal dynamics and computation. A prime example of functional activity pattern is hippocampal replay, which is critical for memory consolidation. The switchings between replay events and a low-activity state in neural recordings suggests metastable neural circuit dynamics. As metastability has been attributed to noise and/or slow fatigue mechanisms, we propose a concise mesoscopic model which accounts for both. Crucially, our model is bottom-up: it is analytically derived from the dynamics of finite-size networks of Linear-Nonlinear Poisson neurons with short-term synaptic depression. As such, noise is explicitly linked to spike noise and network size, and fatigue is explicitly linked to synaptic dynamics. To derive the mesosocpic model, we first consider a homogeneous spiking neural network and follow the temporal coarse-graining approach of Gillespie ("chemical Langevin equation"), which can be naturally interpreted as a stochastic neural mass model. The Langevin equation is computationally inexpensive to simulate and enables a thorough study of metastable dynamics in classical setups (population spikes and Up-Down states dynamics) by means of phase-plane analysis. This stochastic neural mass model is the basic component of our mesoscopic model for replay. We show that our model faithfully captures the stochastic nature of individual replayed trajectories. Moreover, compared to the deterministic Romani-Tsodyks model of place cell dynamics, it exhibits a higher level of variability in terms of content, direction and timing of replay events, compatible with biological evidence and could be functionally desirable. This variability is the product of a new dynamical regime where metastability emerges from a complex interplay between finite-size fluctuations and local fatigue.

q-bio.NC

On a finite-size neuronal population equation

Population equations for infinitely large networks of spiking neurons have a long tradition in theoretical neuroscience. In this work, we analyze a recent generalization of these equations to populations of finite size, which takes the form of a nonlinear stochastic integral equation. We prove that, in the case of leaky integrate-and-fire (LIF) neurons with escape noise and for a slightly simplified version of the model, the equation is well-posed and stable in the sense of Br\'emaud-Massouli\'e. The proof combines methods from Markov processes taking values in the space of positive measures and nonlinear Hawkes processes. For applications, we also provide efficient simulation algorithms.

math.PR

Long time behavior of an age and leaky memory-structured neuronal population equation

We study the asymptotic stability of a two-dimensional mean-field equation, which takes the form of a nonlocal transport equation and generalizes the time-elapsed neuron network model by the inclusion of a leaky memory variable. This additional variable can represent a slow fatigue mechanism, like spike frequency adaptation or short-term synaptic depression. Even though two-dimensional models are known to have emergent behaviors, like population bursts, which are not observed in standard one-dimensional models, we show that in the weak connectivity regime, two-dimensional models behave like one-dimensional models, i.e. they relax to a unique stationary state. The proof is based on an application of Harris' ergodic theorem and a perturbation argument, adapted to the case of a multidimensional equation with delays.

math.AP

Mean-field limit of Age and Leaky Memory dependent Hawkes processes

We propose a mean-field model of interacting point processes where each process has a memory of the time elapsed since its last event (age) and its recent past (leaky memory), generalizing Age-dependent Hawkes processes. The model is motivated by interacting nonlinear Hawkes processes with Markovian self-interaction and networks of spiking neurons with adaptation and short-term synaptic plasticity. By proving propagation of chaos and using a path integral representation for the law of the limit process, we show that, in the mean-field limit, the empirical measure of the system follows a multidimensional nonlocal transport equation.

math.PR

Mesoscopic population equations for spiking neural networks with synaptic short-term plasticity

Coarse-graining microscopic models of biological neural networks to obtain mesoscopic models of neural activities is an essential step towards multi-scale models of the brain. Here, we extend a recent theory for mesoscopic population dynamics with static synapses to the case of dynamic synapses exhibiting short-term plasticity (STP). Under the assumption that spike arrivals at synapses have Poisson statistics, we derive analytically stochastic mean-field dynamics for the effective synaptic coupling between finite-size populations undergoing Tsodyks-Markram STP. The novel mean-field equations account for both finite number of synapses and correlations between the neurotransmitter release probability and the fraction of available synaptic resources. Comparisons with Monte Carlo simulations of the microscopic model show that in both feedforward and recurrent networks the mesoscopic mean-field model accurately reproduces stochastic realizations of the total synaptic input into a postsynaptic neuron and accounts for stochastic switches between Up and Down states as well as for population spikes. The extended mesoscopic population theory of spiking neural networks with STP may be useful for a systematic reduction of detailed biophysical models of cortical microcircuits to efficient and mathematically tractable mean-field models.

q-bio.NC