SearcharxivSearch

arXiv subjects

Ralf Wessel

Publications and source records attributed to Ralf Wessel.

8 recordsLinked to original sources

Pre-Synaptic Pool Modification (PSPM): A Supervised Learning Procedure for Spiking Neural Networks

Learning synaptic weights of spiking neural network (SNN) models that can reproduce target spike trains from provided neural firing data is a central problem in computational neuroscience and spike-based computing. The discovery of the optimal weight values can be posed as a supervised learning task wherein the weights of the model network are chosen to maximize the similarity between the target spike trains and the model outputs. It is still largely unknown whether optimizing spike train similarity of highly recurrent SNNs produces weight matrices similar to those of the ground truth model. To this end, we propose flexible heuristic supervised learning rules, termed Pre-Synaptic Pool Modification (PSPM), that rely on stochastic weight updates in order to produce spikes within a short window of the desired times and eliminate spikes outside of this window. PSPM improves spike train similarity for all-to-all SNNs and makes no assumption about the post-synaptic potential of the neurons or the structure of the network since no gradients are required. We test whether optimizing for spike train similarity entails the discovery of accurate weights and explore the relative contributions of local and homeostatic weight updates. Although PSPM improves similarity between spike trains, the learned weights often differ from the weights of the ground truth model, implying that connectome inference from spike data may require additional constraints on connectivity statistics. We also find that spike train similarity is sensitive to local updates, but other measures of network activity such as avalanche distributions, can be learned through synaptic homeostasis.

cs.NE

New hallmarks of criticality in recurrent neural networks

A rigorous understanding of brain dynamics and function requires a conceptual bridge between multiple levels of organization, including neural spiking and network-level population activity. Mounting evidence suggests that neural networks of cerebral cortex operate at criticality. How operating near this network state impacts the variability of neuronal spiking is largely unknown. Here we show in a computational model that two prevalent features of cortical single-neuron activity, irregular spiking and the decline of response variability at stimulus onset, are both emergent properties of a recurrent network operating near criticality. Importantly, our work reveals that the relation between the irregularity of spiking and the number of input connections to a neuron, i.e., the in-degree, is maximized at criticality. Our findings establish criticality as a unifying principle for the variability of single-neuron spiking and the collective behavior of recurrent circuits in cerebral cortex.

q-bio.NC

Noise-dependent stability of the synchronized state in a coupled system of active rotators

We consider a Kuramoto model for the dynamics of an excitable system consisting of two coupled active rotators. Depending on both the coupling strength and the noise, the two rotators can be in a synchronized or desynchronized state. The synchronized state of the system is most stable for intermediate noise intensity in the sense that the coupling strength required to desynchronize the system is maximal at this noise level. We evaluate the phase boundary between synchronized and desynchronized states through numerical and analytical calculations.

nlin.PS

Distributed delays stabilize neural feedback systems

We consider the effect of distributed delays in neural feedback systems. The avian optic tectum is reciprocally connected with the nucleus isthmi. Extracellular stimulation combined with intracellular recordings reveal a range of signal delays from 4 to 9 ms between isthmotectal elements. This observation together with prior mathematical analysis concerning the influence of a delay distribution on system dynamics raises the question whether a broad delay distribution can impact the dynamics of neural feedback loops. For a system of reciprocally connected model neurons, we found that distributed delays enhance system stability in the following sense. With increased distribution of delays, the system converges faster to a fixed point and converges slower toward a limit cycle. Further, the introduction of distributed delays leads to an increased range of the average delay value for which the system's equilibrium point is stable. The enhancement of stability with increasing delay distribution is caused by the introduction of smaller delays rather than the distribution per se.

physics.bio-ph

Winner-take-all selection in a neural system with delayed feedback

We consider the effects of temporal delay in a neural feedback system with excitation and inhibition. The topology of our model system reflects the anatomy of the avian isthmic circuitry, a feedback structure found in all classes of vertebrates. We show that the system is capable of performing a `winner-take-all' selection rule for certain combinations of excitatory and inhibitory feedback. In particular, we show that when the time delays are sufficiently large a system with local inhibition and global excitation can function as a `winner-take-all' network and exhibit oscillatory dynamics. We demonstrate how the origin of the oscillations can be attributed to the finite delays through a linear stability analysis.

physics.bio-ph

Synchronization in a neuronal feedback loop through asymmetric temporal delays

We consider the effect of asymmetric temporal delays in a system of two coupled Hopfield neurons. For couplings of opposite signs, a limit cycle emerges via a supercritical Hopf bifurcation when the sum of the delays reaches a critical value. We show that the angular frequency of the limit cycle is independent of an asymmetry in the delays. However, the delay asymmetry determines the phase difference between the periodic activities of the two components. Specifically, when the connection with negative coupling has a delay much larger than the delay for the positive coupling, the system approaches in-phase synchrony between the two components. Employing variational perturbation theory (VPT), we achieve an approximate analytical evaluation of the phase shift, in good agreement with numerical results.

physics.bio-ph

Variational calculation of the limit cycle and its frequency in a two-neuron model with delay

We consider a model system of two coupled Hopfield neurons, which is described by delay differential equations taking into account the finite signal propagation and processing times. When the delay exceeds a critical value, a limit cycle emerges via a supercritical Hopf bifurcation. First, we calculate its frequency and trajectory perturbatively by applying the Poincaré-Lindstedt method. Then, the perturbation series are resummed by means of the Shohat expansion in good agreement with numerical values. However, with increasing delay, the accuracy of the results from the Shohat expansion worsens. We thus apply variational perturbation theory (VPT) to the perturbation expansions to obtain more accurate results, which moreover hold even in the limit of large delays.

physics.bio-ph

Synchronization from Disordered Driving Forces in Arrays of Coupled Oscillators

The effects of disorder in external forces on the dynamical behavior of coupled nonlinear oscillator networks are studied. When driven synchronously, i.e., all driving forces have the same phase, the networks display chaotic dynamics. We show that random phases in the driving forces result in regular, periodic network behavior. Intermediate phase disorder can produce network synchrony. Specifically, there is an optimal amount of phase disorder, which can induce the highest level of synchrony. These results demonstrate that the spatiotemporal structure of external influences can control chaos and lead to synchronization in nonlinear systems.

nlin.CD