SearcharxivSearch

arXiv subjects

Gaëtan Vignoud

Publications and source records attributed to Gaëtan Vignoud.

3 recordsLinked to original sources

A Palm Space Approach to Non-Linear Hawkes Processes

A Hawkes process on $\R$ is a point process whose intensity function at time $t$ is a functional of its past activity before time $t$. It is defined by its activation function $Φ$ and its memory function $h$. In this paper, the Hawkes property is expressed as an operator on the sub-space of non-negative sequences associated to distances between its points. By using the classical correspondence between a stationary point process and its Palm measure, we establish a characterization of the corresponding Palm measure as an invariant distribution of a Markovian kernel. We prove that if $Φ$ is continuous and its growth rate is at most linear with a rate below some constant, then there exists a stationary Hawkes point process. The classical Lipschitz condition of the literature for an unbounded function $Φ$ is relaxed. Our proofs rely on a combination of coupling methods, monotonicity properties of linear Hawkes processes and classical results on Palm distributions. An investigation of the Hawkes process starting from the null measure, the empty state, on $\R_-$ plays also an important role. The linear case of Hawkes and Oakes is revisited at this occasion. If the memory function $h$ is an exponential function, under a weak condition it is shown that there exists a unique stationary Hawkes point process. In this case, its Palm measure is expressed in terms of the invariant distribution of a one-dimensional Harris ergodic Markov chain. When the activation function is a polynomial $Φ$ with degree ${>}1$, there does not exist a stationary Hawkes process and if the Hawkes process starts from the empty state, a scaling result for the accumulation of its points is obtained.

math.PR

On the Spontaneous Dynamics of Synaptic Weights in Stochastic Models with Pair-Based STDP

We investigate spike-timing dependent plasticity (STPD) in the case of a synapse connecting two neural cells. We develop a theoretical analysis of several STDP rules using Markovian theory. In this context there are two different timescales, fast neural activity and slower synaptic weight updates. Exploiting this timescale separation, we derive the long-time limits of a single synaptic weight subject to STDP. We show that the pairing model of presynaptic and postsynaptic spikes controls the synaptic weight dynamics for small external input, on an excitatory synapse. This result implies in particular that mean-field analysis of plasticity may miss some important properties of STDP. Anti-Hebbian STDP seems to favor the emergence of a stable synaptic weight, but only for high external input. In the case of inhibitory synapse the pairing schemes matter less, and we observe convergence of the synaptic weight to a non-null value only for Hebbian STDP. We extensively study different asymptotic regimes for STDP rules, raising interesting questions for future works on adaptative neural networks and, more generally, on adaptive systems.

q-bio.NC

A Variational Inequality Perspective on Generative Adversarial Networks

Generative adversarial networks (GANs) form a generative modeling approach known for producing appealing samples, but they are notably difficult to train. One common way to tackle this issue has been to propose new formulations of the GAN objective. Yet, surprisingly few studies have looked at optimization methods designed for this adversarial training. In this work, we cast GAN optimization problems in the general variational inequality framework. Tapping into the mathematical programming literature, we counter some common misconceptions about the difficulties of saddle point optimization and propose to extend techniques designed for variational inequalities to the training of GANs. We apply averaging, extrapolation and a computationally cheaper variant that we call extrapolation from the past to the stochastic gradient method (SGD) and Adam.

cs.LG