arXiv subjects

Bertrand Cloez

Publications and source records attributed to Bertrand Cloez.

29 records · Page 2Linked to original sources

arXiv2017

Stochastic approximation of quasi-stationary distributions on compact spaces and applications

In the continuity of a recent paper ([6]), dealing with finite Markov chains, this paper proposes and analyzes a recursive algorithm for the approximation of the quasi-stationary distribution of a general Markov chain living on a compact metric space killed in finite time. The idea is to run the process until extinction and then to bring it back to life at a position randomly chosen according to the (possibly weighted) empirical occupation measure of its past positions. General conditions are given ensuring the convergence of this measure to the quasi-stationary distribution of the chain. We then apply this method to the numerical approximation of the quasi-stationary distribution of a diffusion process killed on the boundary of a compact set and to the estimation of the spectral gap of irreducible Markov processes. Finally, the sharpness of the assumptions is illustrated through the study of the algorithm in a non-irreducible setting.

math.PR↗

arXiv2017

Probabilistic and Piecewise Deterministic models in Biology

We present recent results on Piecewise Deterministic Markov Processes (PDMPs), involved in biological modeling. PDMPs, first introduced in the probabilistic literature by Davis (1984), are a very general class of Markov processes and are being increasingly popular in biological applications. They also give new interesting challenges from the theoretical point of view. We give here different examples on the long time behavior of switching Markov models applied to population dynamics, on uniform sampling in general branching models applied to structured population dynamic, on time scale separation in integrate-and-fire models used in neuroscience, and, finally, on moment calculus in stochastic models of gene expression.

math.PR↗

arXiv2017

Fluctuations of the Empirical Measure of Freezing Markov Chains

In this work, we consider a finite-state inhomogeneous-time Markov chain whose probabilities of transition from one state to another tend to decrease over time. This can be seen as a cooling of the dynamics of an underlying Markov chain. We are interested in the long time behavior of the empirical measure of this freezing Markov chain. Some recent papers provide almost sure convergence and convergence in distribution in the case of the freezing speed $n^{-θ}$, with different limits depending on $θ<1,θ=1$ or $θ>1$. Using stochastic approximation techniques, we generalize these results for any freezing speed, and we obtain a better characterization of the limit distribution as well as rates of convergence as well as functional convergence.

math.PR↗

arXiv2017

Ergodicity of inhomogeneous Markov chains through asymptotic pseudotrajectories

In this work, we consider an inhomogeneous (discrete time) Markov chain and are interested in its long time behavior. We provide sufficient conditions to ensure that some of its asymptotic properties can be related to the ones of a homogeneous (continuous time) Markov process. Renowned examples such as a bandit algorithms, weighted random walks or decreasing step Euler schemes are included in our framework. Our results are related to functional limit theorems, but the approach differs from the standard "Tightness/Identification" argument; our method is unified and based on the notion of pseudotrajectories on the space of probability measures.

math.PR↗

arXiv2017

Gaussian approximations for chemostat models in finite and infinite dimensions

In a chemostat, bacteria live in a growth container of constant volume in which liquid is injected continuously. Recently, Campillo and Fritsch introduced a mass-structured individual-based model to represent this dynamics and proved its convergence to a more classic partial differential equation. In this work, we are interested in the convergence of the fluctuation process. We consider this process in some Sobolev spaces and use central limit theorems on Hilbert space to prove its convergence in law to an infinite-dimensional Gaussian process.As a consequence, we obtain a two-dimensional Gaussian approximation of the Crump-Young model for which the long time behavior is relatively misunderstood. For this approximation, we derive the invariant distribution and the convergence to it. We also present numerical simulations illustrating our results.

math.PR↗

arXiv2016

Fleming-Viot processes : two explicit examples

The purpose of this paper is to extend the investigation of the Fleming-Viot process in discrete space started in a previous work to two specific examples. The first one corresponds to a random walk on the complete graph. Due to its geometry, we establish several explicit and optimal formulas for the Fleming-Viot process (invariant distribution, correlations, spectral gap). The second example corresponds to a Markov chain in a two state space. In this case, the study of the Fleming-Viot particle system is reduced to the study of birth and death process with quadratic rates.

math.PR↗

arXiv2015

A stochastic approximation approach to quasi-stationary distributions on finite spaces

This work is concerned with the analysis of a stochastic approximation algorithm for the simulation of quasi-stationary distributions on finite state spaces. This is a generalization of a method introduced by Aldous, Flannery and Palacios. It is shown that the asymptotic behavior of the empirical occupation measure of this process is precisely related to the asymptotic behavior of some deterministic dynamical system induced by a vector field on the unit simplex. This approach provides new proof of convergence as well as precise rates for this type of algorithm. We then compare this algorithm with particle system algorithms.

math.PR↗

arXiv2015

Exponential ergodicity for Markov processes with random switching

We study a Markov process with two components: the first component evolves according to one of finitely many underlying Markovian dynamics, with a choice of dynamics that changes at the jump times of the second component. The second component is discrete and its jump rates may depend on the position of the whole process. Under regularity assumptions on the jump rates and Wasserstein contraction conditions for the underlying dynamics, we provide a concrete criterion for the convergence to equilibrium in terms of Wasserstein distance. The proof is based on a coupling argument and a weak form of the Harris theorem. In particular, we obtain exponential ergodicity in situations which do not verify any hypoellipticity assumption, but are not uniformly contracting either. We also obtain a bound in total variation distance under a suitable regularising assumption. Some examples are given to illustrate our result, including a class of piecewise deterministic Markov processes.

math.PR↗

arXiv2014

Quantitative results for the Fleming-Viot Particle system and quasi-stationary distributions in discrete space

We show, for a class of discrete Fleming-Viot (or Moran) type particle systems, that the convergence to the equilibrium is exponential for a suitable Wassertein coupling distance. The approach provides an explicit quantitative estimate on the rate of convergence. As a consequence, we show that the conditioned process converges exponentially fast to a unique quasi-stationary distribution. Moreover, by estimating the two-particle correlations, we prove that the Fleming-Viot process converges, uniformly in time, to the conditioned process with an explicit rate of convergence. We illustrate our results on the examples of the complete graph and of N particles jumping on two points.

math.PR↗

arXiv2012

Limit theorems for some branching measure-valued processes

We consider a particle system in continuous time, discrete population, with spatial motion and nonlocal branching. The offspring's weights and their number may depend on the mother's weight. Our setting captures, for instance, the processes indexed by a Galton-Watson tree. Using a size-biased auxiliary process for the empirical measure, we determine this asymptotic behaviour. We also obtain a large population approximation as weak solution of a growth-fragmentation equation. Several examples illustrate our results.

math.PR↗

arXiv2012

Wasserstein decay of one dimensional jump-diffusions

This work is devoted to the Lipschitz contraction and the long time behavior of certain Markov processes. These processes diffuse and jump. They can represent some natural phenomena like size of cell or data transmission over the Internet. Using a Feynman-Kac semigroup, we prove a bound in Wasserstein metric. This bound is explicit and optimal in the sense of Wasserstein curvature. This notion of curvature is relatively close to the notion of (coarse) Ricci curvature or spectral gap. Several consequences and examples are developed, including an $L^2$ spectral for general Markov processes, explicit formulas for the integrals of compound Poisson processes with respect to a Brownian motion, quantitative bounds for Kolmogorov-Langevin processes and some total variation bounds for piecewise deterministic Markov processes.

math.PR↗