SearcharxivSearch

arXiv subjects

Mathias Rousset

Publications and source records attributed to Mathias Rousset.

At least 19 recordsLinked to original sources

The particle approximation of quasi-stationary distributions: concentration bounds in the uniform case

We study mean-field particle approximations of normalized Feynman-Kac semi-groups, usually called Fleming-Viot or Feynman-Kac particle systems. Assuming various large time stability properties of the semi-group uniformly in the initial condition, we provide explicit time-uniform $L^p$ and exponential bounds (a new result) with the expected rate in terms of sample size. This work is based on a stochastic backward error analysis (similar to the classical concept of numerical analysis) of the measure-valued Markov particle estimator, an approach that simplifies methods previously used for time-uniform $L^p$ estimates.

math.PR

Adaptive reduced tempering For Bayesian inverse problems and rare event simulation

This work proposes an adaptive sequential Monte Carlo sampling algorithm to solve Bayesian inverse problems in scenarios where likelihood evaluations are costly but can be approximated using a surrogate model built from previous evaluations of the true likelihood. A rough estimate of the surrogate error is required. The method relies on an adaptive SMC framework that simultaneously adjusts both the likelihood approximations and a standard tempering scheme of the target posterior distribution. This algorithm is well-suited for cases where the posterior is concentrated in a rare and unknown region of the prior. It is also suitable for solving low-temperature and rare event simulation problems. The main contribution is to propose an entropy criterion that relates the accuracy of the current surrogate to a maximum inverse temperature for the likelihood approximation. The latter is instrumental to sample a so-called snapshot, on which is performed an exact likelihood evaluation, used to update the surrogate and its error quantification. Some consistency results are presented in an idealized framework for the proposed algorithm. Our numerical experiments use in particular a reduced basis approach to construct approximate parametric solutions to a partially observed solution of an elliptic partial differential equation. They demonstrate the convergence of the algorithm and show a significant cost reduction (close to a factor of $10$) for comparable accuracy.

stat.CO

Adaptive Reduced Multilevel Splitting

This paper considers the classical problem of sampling with Monte Carlo methods a target rare event distribution defined by a score function that is very expensive to compute. We assume we can build using evaluations of the true score, an approximate surrogate score certified with error bounds. This work proposes a fully adaptive algorithm to sequentially sample surrogate rare event distributions with increasing target levels. An essential contribution consists in sampling at each iteration the surrogate rare event at a critical level corresponding to a specific cost. This cost is related to importance sampling for a target for a given budget. The critical level is calculated solely from the reduced score and its error bound From a practical point of view, sampling the proposal sequence is performed by extending the framework of the popular adaptive multilevel splitting algorithm to the use of score approximations. Numerical experiments evaluate the proposed importance sampling algorithm in terms of computational complexity versus squared error. In particular, we investigate the performance of the algorithm when simulating rare events related to the solution of a parametric PDE, which is approximated by a reduced basis.

stat.CO

A general martingale approach to large noise homogenization

We consider Markov processes with generator of the form $\gamma \mathcal{L}_{1} + \mathcal{L}_{0}$, in which $\mathcal{L}_{1}$ generates a so-called dominant process that converges at large times towards a random point in a fixed subset called the effective state space. Using the usual characterization through martingales problems, we give general conditions under which homogenization holds true: the original process converges, when $\gamma$ is large and for the Meyer-Zheng pseudo-path topology and for finite-dimensional time marginals, towards an identified effective Markov process on the effective space. Few simple model examples for diffusions are studied.

math.PR

Fluctuations of Rare Event Simulation with Monte Carlo Splitting in the Small Noise Asymptotics

Diffusion processes with small noise conditioned to reach a target set are considered. The AMS algorithm is a Monte Carlo method that is used to sample such rare events by iteratively simulating clones of the process and selecting trajectories that have reached the highest value of a so-called importance function. In this paper, the large sample size relative variance of the AMS small probability estimator is considered. The main result is a large deviations logarithmic equivalent of the latter in the small noise asymptotics, which is rigorously derived. It is given as a maximisation problem explicit in terms of the quasi-potential cost function associated with the underlying small noise large deviations. Necessary and sufficient geometric conditions ensuring the vanishing of the obtained quantity ('weak' asymptotic efficiency) are provided. Interpretations and practical consequences are discussed.

math.NA

Entropy minimizing distributions are worst-case optimal importance proposals

Importance sampling of target probability distributions belonging to a given convex class is considered. Motivated by previous results, the cost of importance sampling is quantified using the relative entropy of the target with respect to proposal distributions. Using a reference measure as a reference for cost, we prove under some general conditions that the worst-case optimal proposal is precisely given by the distribution minimizing entropy with respect to the reference within the considered convex class of distributions. The latter conditions are in particular satisfied when the convex class is defined using a push-forward map defining atomless conditional measures. Applications in which the optimal proposal is Gibbsian and can be practically sampled using Monte Carlo methods are discussed.

math.NA

Chilled Sampling for Uncertainty Quantification: A Motivation From A Meteorological Inverse Problem

Atmospheric motion vectors (AMVs) extracted from satellite imagery are the only wind observations with good global coverage. They are important features for feeding numerical weather prediction (NWP) models. Several Bayesian models have been proposed to estimate AMVs. Although critical for correct assimilation into NWP models, very few methods provide a thorough characterization of the estimation errors. The difficulty of estimating errors stems from the specificity of the posterior distribution, which is both very high dimensional, and highly ill-conditioned due to a singular likelihood. Motivated by this difficult inverse problem, this work studies the evaluation of the (expected) estimation errors using gradient-based Markov Chain Monte Carlo (MCMC) algorithms. The main contribution is to propose a general strategy, called here chilling, which amounts to sampling a local approximation of the posterior distribution in the neighborhood of a point estimate. From a theoretical point of view, we show that under regularity assumptions, the family of chilled posterior distributions converges in distribution as temperature decreases to an optimal Gaussian approximation at a point estimate given by the Maximum A Posteriori, also known as the Laplace approximation. Chilled sampling therefore provides access to this approximation generally out of reach in such high-dimensional nonlinear contexts. From an empirical perspective, we evaluate the proposed approach based on some quantitative Bayesian criteria. Our numerical simulations are performed on synthetic and real meteorological data. They reveal that not only the proposed chilling exhibits a significant gain in terms of accuracy of the point estimates and of their associated expected errors, but also a substantial acceleration in the convergence speed of the MCMC algorithms.

stat.ME

Exact targeting of Gibbs distributions using velocity-jump processes

This work introduces and studies a new family of velocity jump Markov processes directly amenable to exact simulation with the following two properties: i) trajectories converge in law when a time-step parameter vanishes towards a given Langevin or Hamil-tonian dynamics; ii) the stationary distribution of the process is always exactly given by the product of a Gaussian (for velocities) by any target log-density whose gradient is pointwise computabe together with some additional explicit appropriate upper bound. The process does not exhibit any velocity reflections (jump sizes can be controlled) and is suitable for the 'factorization method'. We provide a rigorous mathematical proof of: i) the small time-step convergence towards Hamiltonian/Langevin dynamics, as well as ii) the exponentially fast convergence towards the target distribution when suitable noise on velocity is present. Numerical implementation is detailed and illustrated.

math.NA

On Synchronized Fleming-Viot Particle Systems

This article presents a variant of Fleming-Viot particle systems, which are a standard way to approximate the law of a Markov process with killing as well as related quantities. Classical Fleming-Viot particle systems proceed by simulating $N$ trajectories, or particles, according to the dynamics of the underlying process, until one of them is killed. At this killing time, the particle is instantaneously branched on one of the $(N-1)$ other ones, and so on until a fixed and finite final time $T$. In our variant, we propose to wait until $K$ particles are killed and then rebranch them independently on the $(N-K)$ alive ones. Specifically, we focus our attention on the large population limit and the regime where $K/N$ has a given limit when $N$ goes to infinity. In this context, we establish consistency and asymptotic normality results. The variant we propose is motivated by applications in rare event estimation problems.

math.PR

Hybrid Monte Carlo methods for sampling probability measures on submanifolds

Probability measures supported on submanifolds can be sampled by adding an extra momentum variable to the state of the system, and discretizing the associated Hamiltonian dynamics with some stochastic perturbation in the extra variable. In order to avoid biases in the invariant probability measures sampled by discretizations of these stochastically perturbed Hamiltonian dynamics, a Metropolis rejection procedure can be considered. The so-obtained scheme belongs to the class of generalized Hybrid Monte Carlo (GHMC) algorithms. We show here how to generalize to GHMC a procedure suggested by Goodman, Holmes-Cerfon and Zappa for Metropolis random walks on submanifolds, where a reverse projection check is performed to enforce the reversibility of the algorithm for large timesteps and hence avoid biases in the invariant measure. We also provide a full mathematical analysis of such procedures, as well as numerical experiments demonstrating the importance of the reverse projection check on simple toy examples.

math.NA

More on the long time stability of Feynman-Kac semigroups

Feynman-Kac semigroups appear in various areas of mathematics: non-linear filtering, large deviations theory, spectral analysis of Schrodinger operators among others. Their long time behavior provides important information, for example in terms of ground state energy of Schrodinger operators, or scaled cumulant generating function in large deviations theory. In this paper, we propose a simple and natural extension of the stability of Markov chains for these non-linear evolutions. As other classical ergodicity results, it relies on two assumptions: a Lyapunov condition that induces some compactness, and a minorization condition ensuring some mixing. Illustrative examples are provided, where the stability of the non-linear semigroup arises either from the underlying dynamics or from the Feynman-Kac weight function. We also use our technique to provide uniform in the time step convergence estimates for discretizations of stochastic differential equations

math.PR

On the Asymptotic Normality of Adaptive Multilevel Splitting

Adaptive Multilevel Splitting (AMS for short) is a generic Monte Carlo method for Markov processes that simulates rare events and estimates associated probabilities. Despite its practical efficiency, there are almost no theoretical results on the convergence of this algorithm. The purpose of this paper is to prove both consistency and asymptotic normality results in a general setting. This is done by associating to the original Markov process a level-indexed process, also called a stochastic wave, and by showing that AMS can then be seen as a Fleming-Viot type particle system. This being done, we can finally apply general results on Fleming-Viot particle systems that we have recently obtained.

math.PR

A Weak Overdamped Limit Theorem for Langevin Processes

In this paper, we prove convergence in distribution of Langevin processes in the overdamped asymptotics. The proof relies on the classical perturbed test function (or corrector) method, which is used both to show tightness in path space, and to identify the extracted limit with a martingale problem. The result holds assuming the continuity of the gradient of the potential energy, and a mild control of the initial kinetic energy.

math.PR

A Central Limit Theorem for Fleming-Viot Particle Systems with Hard Killing

Fleming-Viot type particle systems represent a classical way to approximate the distribution of a Markov process with killing, given that it is still alive at a final deterministic time. In this context, each particle evolves independently according to the law of the underlying Markov process until its killing, and then branches instantaneously on another randomly chosen particle. While the consistency of this algorithm in the large population limit has been recently studied in several articles, our purpose here is to prove Central Limit Theorems under very general assumptions. For this, we only suppose that the particle system does not explode in finite time, and that the jump and killing times have atomless distributions. In particular, this includes the case of elliptic diffusions with hard killing.

math.PR

A Central Limit Theorem for Fleming-Viot Particle Systems with Soft Killing

The distribution of a Markov process with killing, conditioned to be still alive at a given time, can be approximated by a Fleming-Viot type particle system. In such a system, each particle is simulated independently according to the law of the underlying Markov process, and branches onto another particle at each killing time. The consistency of this method in the large population limit was the subject of several recent articles. In the present paper, we go one step forward and prove a central limit theorem for the law of the Fleming-Viot particle system at a given time under two conditions: a "soft killing" assumption and a boundedness condition involving the "carr\'e du champ" operator of the underlying Markov process.

math.PR

A $N$-uniform quantitative Tanaka's theorem for the conservative Kac's $N$-particle system with Maxwell molecules

This paper considers the space homogenous Boltzmann equation with Maxwell molecules and arbitrary angular distribution. Following Kac's program, emphasis is laid on the the associated conservative Kac's stochastic $N$-particle system, a Markov process with binary collisions conserving energy and total momentum. An explicit Markov coupling (a probabilistic, Markovian coupling of two copies of the process) is constructed, using simultaneous collisions, and parallel coupling of each binary random collision on the sphere of collisional directions. The euclidean distance between the two coupled systems is almost surely decreasing with respect to time, and the associated quadratic coupling creation (the time variation of the averaged squared coupling distance) is computed explicitly. Then, a family (indexed by $\delta > 0$) of $N$-uniform ''weak'' coupling / coupling creation inequalities are proven, that leads to a $N$-uniform power law trend to equilibrium of order ${\sim}_{ t \to + \infty} t^{-\delta} $, with constants depending on moments of the velocity distributions strictly greater than $2(1 + \delta)$. The case of order $4$ moment is treated explicitly, achieving Kac's program without any chaos propagation analysis. Finally, two counter-examples are suggested indicating that the method: (i) requires the dependance on $>2$-moments, and (ii) cannot provide contractivity in quadratic Wasserstein distance in any case.

math.PR

Analysis of Adaptive Multilevel Splitting algorithms in an idealized case

The Adaptive Multilevel Splitting algorithm is a very powerful and versatile method to estimate rare events probabilities. It is an iterative procedure on an interacting particle system, where at each step, the $k$ less well-adapted particles among $n$ are killed while $k$ new better adapted particles are resampled according to a conditional law. We analyze the algorithm in the idealized setting of an exact resampling and prove that the estimator of the rare event probability is unbiased whatever $k$. We also obtain a precise asymptotic expansion for the variance of the estimator and the cost of the algorithm in the large $n$ limit, for a fixed $k$.

math.PR

Analysis and simulation of rare events for SPDE

In this work, we consider the numerical estimation of the probability for a stochastic process to hit a set B before reaching another set A. This event is assumed to be rare. We consider reactive trajectories of the stochastic Allen-Cahn partial differential evolution equation (with double well potential) in dimension 1. Reactive trajectories are defined as the probability distribution of the trajectories of a stochastic process, conditioned by the event of hitting B before A. We investigate the use of the so-called Adaptive Multilevel Splitting algorithm in order to estimate the rare event and simulate reactive trajectories. This algorithm uses a \emph{reaction coordinate} (a real valued function of state space defining level sets), and is based on (i) the selection, among several replicas of the system having hit A before B, of those with maximal reaction coordinate; (ii) iteration of the latter step. We choose for the reaction coordinate the average magnetization, and for B the minimum of the well opposite to the initial condition. We discuss the context, prove that the algorithm has a sense in the usual functional setting, and numerically test the method (estimation of rare event, and transition state sampling).

math.AP