SearcharxivSearch

arXiv subjects

Fabien Panloup

Publications and source records attributed to Fabien Panloup.

At least 19 recordsLinked to original sources

Convergence rate of the occupation measure of classes of ergodic processes toward their invariant distribution in mean Wasserstein distance

N. Fournier and A. Guillin obtained in their 2015 PTRF paper some bounds of the L^p-mean rate of convergence in Wasserstein distance of empirical distributions for a class of stationary mixing processes. In this paper, we propose to extend their strategy of proof and provide general criterions which allow to keep similar rates for a larger class of processes. These results (which do not require regularization techniques) lead to various applications to occupation measures of ergodic processes which may be not stationary or not Markovian under an assumption of {\em conditional} convergence to equilibrium in Total Variation or Wasserstein distance. We then provide explicit conditions which lead to these rates for Brownian diffusions and additive SDEs driven by fractional Brownian Motions {or by Gaussian processes with stationary increments}.

math.PR

Kolmogorov-Smirnov distance and discrepancies versus Wasserstein distances

We establish inequalities that compare the p-Wasserstein distance to distances which are built as suprema of box measures. More precisely, when the measures are supported on $[0,1]^d$, we obtain sharp upper-bounds of the $p$-Wasserstein distance by (powers of) the (uniform) discrepancy. As an application, we retrieve the Pro\''inov Theorem. When the two distributions are supported {by the whole} $R^d$, {their} $p$-Wasserstein distance is upper bounded by the product of a (power of) their Kolmogorov-Smirnov (KS) distance with the sum of their $p$-moments. Reverse inequalities are established when one of the two distributions has a density, depending on its ${\cal L}^s$-integrability with respect to the Lebesgue measure for some $s>1$.

math.PR

Fast convergence rates for estimating the stationary density in SDEs driven by a fractional Brownian motion with semi-contractive drift

We study the estimation of the invariant density of additive fractional stochastic differential equations with Hurst parameter $H \in (0,1)$. We first focus on continuous observations and develop a kernel-based estimator achieving faster convergence rates than previously available. This result stems from a martingale decomposition combined with new bounds on the (conditional) convergence in total variation to equilibrium of fractional SDEs. For $H<1/2$, we further refine the rates based on recent bounds on the marginal density. We then extend the methodology to discrete observations, showing that the same convergence rates can be attained. Moreover, we establish concentration inequalities for the estimator and introduce a data-driven bandwidth selection procedure that adapts to unknown smoothness. Numerical experiments for the fractional Ornstein-Uhlenbeck process illustrate the estimator's practical performance. Finally, our results weaken the usual convexity assumptions on the drift component, allowing us to consider settings where strong convexity only holds outside a compact set.

math.ST

Asymptotically unbiased approximation of the QSD of diffusion processes with a decreasing time step Euler scheme

We build and study a recursive algorithm based on the occupation measure of an Euler scheme with decreasing step for the numerical approximation of the quasistationary distribution (QSD) of an elliptic diffusion in a bounded domain. We prove the almost sure convergence of the procedure for a family of redistributions and show that we can also recover the approximation of the rate of survival and the convergence in distribution of the algorithm. This last point follows from some new bounds on the weak error related to diffusion dynamics with renewal.

math.PR

Quasi-Stationary Distributions of Interacting Dynamical Systems and their approximation

In \cite{BCP}, the authors built and studied an algorithm based on the (self)-interaction of a dynamics with its occupation measure to approximate Quasi-Stationary Distributions (QSD) of general Markov chains conditioned to stay in a compact set. In this paper, we propose to tackle the case of McKean-Vlasov-type dynamics, \emph{i.e.} of dynamics interacting with their marginal distribution (conditioned to not be killed). In this non-linear setting, we are able to exhibit some conditions which guarantee that weak limits of these sequences of random measures are QSDs of the given dynamics. We also prove tightness results in the non-compact case. These general conditions are then applied to Euler schemes of McKean-Vlasov SDEs and in the compact case, the behavior of these QSDs when the step $h$ goes to $0$ is investigated. Our results also allow to consider some examples in the non-compact case and some new tightness criterions are also provided in this setting. Finally, we illustrate our theoretical results with several simulations.

math.PR

Multilevel-Langevin pathwise average for Gibbs approximation

We propose and study a new multilevel method for the numerical approximation of a Gibbs distribution $π$ on $\mathbb{R}^d$, based on (overdamped) Langevin diffusions. This method inspired by \cite{mainPPlangevin} and \cite{giles_szpruch_invariant} relies on a multilevel occupation measure, $i.e.$ on an appropriate combination of $R$ occupation measures of (constant-step) Euler schemes with respective steps $γ_r = γ_0 2^{-r}$, $r=0,\ldots,R$. We first state a quantitative result under general assumptions which guarantees an \textit{$\varepsilon$-approximation} (in a $L^2$-sense) with a cost of the order $\varepsilon^{-2}$ or $\varepsilon^{-2}|\log \varepsilon|^3$ under less contractive assumptions. We then apply it to overdamped Langevin diffusions with strongly convex potential $U:\mathbb{R}^d\rightarrow\mathbb{R}$ and obtain an \textit{$\varepsilon$-complexity} of the order ${\cal O}(d\varepsilon^{-2}\log^3(d\varepsilon^{-2}))$ or ${\cal O}(d\varepsilon^{-2})$ under additional assumptions on $U$. More precisely, up to universal constants, an appropriate choice of the parameters leads to a cost controlled by ${(\barλ_U\vee 1)^2}{\underlineλ_U^{-3}} d\varepsilon^{-2}$ (where $\barλ_U$ and $\underlineλ_U$ respectively denote the supremum and the infimum of the largest and lowest eigenvalue of $D^2U$). We finally complete these theoretical results with some numerical illustrations including comparisons to other algorithms in Bayesian learning and opening to non strongly convex setting.

math.NA

On the (Non-)Stationary Density of Fractional-Driven Stochastic Differential Equations

We investigate the stationary measure $π$ of SDEs driven by additive fractional noise with any Hurst parameter and establish that $π$ admits a smooth Lebesgue density obeying both Gaussian-type lower and upper bounds. The proofs are based on a novel representation of the stationary density in terms of a Wiener-Liouville bridge, which proves to be of independent interest: We show that it also allows to obtain Gaussian bounds on the non-stationary density, which extend previously known results in the additive setting. In addition, we study a parameter-dependent version of the SDE and prove smoothness of the stationary density, jointly in the parameter and the spatial coordinate. With this we revisit the fractional averaging principle of Li and Sieber [Ann. Appl. Probab. 32(5) (2022)] and remove an ad-hoc assumption on the limiting coefficients. Avoiding any use of Malliavin calculus in our arguments, we can prove our results under minimal regularity requirements.

math.PR

Total variation distance between two diffusions in small time with unbounded drift: application to the Euler-Maruyama scheme

We give bounds for the total variation distance between the solutions to two stochastic differential equations starting at the same point and with close coefficients, which applies in particular to the distance between an exact solution and its Euler-Maruyama scheme in small time. We show that for small $t$, the total variation distance is of order $t^{r/(2r+1)}$ if the noise coefficient $σ$ of the SDE is elliptic and $\mathcal{C}^{2r}_b$, $r\in \mathbb{N}$ and if the drift is $C^1$ with bounded derivatives, using multi-step Richardson-Romberg extrapolation. We do not require the drift to be bounded. Then we prove with a counterexample that we cannot achieve a bound better than $t^{1/2}$ in general.

math.PR

Unadjusted Langevin algorithm with multiplicative noise: Total variation and Wasserstein bounds

In this paper, we focus on non-asymptotic bounds related to the Euler scheme of an ergodic diffusion with a possibly multiplicative diffusion term (non-constant diffusion coefficient). More precisely, the objective of this paper is to control the distance of the standard Euler scheme with decreasing step ({usually called Unadjusted Langevin Algorithm in the Monte Carlo literature}) to the invariant distribution of such an ergodic diffusion. In an appropriate Lyapunov setting and under {uniform} ellipticity assumptions on the diffusion coefficient, we establish (or improve) such bounds for Total Variation and $L^1$-Wasserstein distances in both multiplicative and additive and frameworks. These bounds rely on weak error expansions using {Stochastic Analysis} adapted to decreasing step setting.

math.PR

On the cost of Bayesian posterior mean strategy for log-concave models

In this paper, we investigate the problem of computing Bayesian estimators using Langevin Monte-Carlo type approximation. The novelty of this paper is to consider together the statistical and numerical counterparts (in a general log-concave setting). More precisely, we address the following question: given $n$ observations in $\mathbb{R}^q$ distributed under an unknown probability $\mathbb{P}_{θ^\star}$ with $θ^\star \in \mathbb{R}^d$ , what is the optimal numerical strategy and its cost for the approximation of $θ^\star$ with the Bayesian posterior mean? To answer this question, we establish some quantitative statistical bounds related to the underlying Poincaré constant of the model and establish new results about the numerical approximation of Gibbs measures by Cesaro averages of Euler schemes of (over-damped) Langevin diffusions. These last results include in particular some quantitative controls in the weakly convex case based on new bounds on the solution of the related Poisson equation of the diffusion.

math.PR

VARCLUST: clustering variables using dimensionality reduction

VARCLUST algorithm is proposed for clustering variables under the assumption that variables in a given cluster are linear combinations of a small number of hidden latent variables, corrupted by the random noise. The entire clustering task is viewed as the problem of selection of the statistical model, which is defined by the number of clusters, the partition of variables into these clusters and the 'cluster dimensions', i.e. the vector of dimensions of linear subspaces spanning each of the clusters. The optimal model is selected using the approximate Bayesian criterion based on the Laplace approximations and using a non-informative uniform prior on the number of clusters. To solve the problem of the search over a huge space of possible models we propose an extension of the ClustOfVar algorithm which was dedicated to subspaces of dimension only 1, and which is similar in structure to the $K$-centroid algorithm. We provide a complete methodology with theoretical guarantees, extensive numerical experimentations, complete data analyses and implementation. Our algorithm assigns variables to appropriate clusterse based on the consistent Bayesian Information Criterion (BIC), and estimates the dimensionality of each cluster by the PEnalized SEmi-integrated Likelihood Criterion (PESEL), whose consistency we prove. Additionally, we prove that each iteration of our algorithm leads to an increase of the Laplace approximation to the model posterior probability and provide the criterion for the estimation of the number of clusters. Numerical comparisons with other algorithms show that VARCLUST may outperform some popular machine learning tools for sparse subspace clustering. We also report the results of real data analysis including TCGA breast cancer data and meteorological data. The proposed method is implemented in the publicly available R package varclust.

stat.CO

Sub-exponential convergence to equilibrium for Gaussian driven Stochastic Differential Equations with semi-contractive drift

The convergence to the stationary regime is studied for Stochastic Differential Equations driven by an additive Gaussian noise and evolving in a semi-contractive environment, i.e. when the drift is only contractive out of a compact set but does not have repulsive regions. In this setting, we develop a synchronous coupling strategy to obtain sub-exponential bounds on the rate of convergence to equilibrium in Wasserstein distance. Then by a coalescent coupling close to terminal time, we derive a similar bound in total variation distance.

math.PR

A general drift estimation procedure for stochastic differential equations with additive fractional noise

In this paper we consider the drift estimation problem for a general differential equation driven by an additive multidimensional fractional Brownian motion, under ergodic assumptions on the drift coefficient. Our estimation procedure is based on the identification of the invariant measure, and we provide consistency results as well as some information about the convergence rate. We also give some examples of coefficients for which the identifiability assumption for the invariant measure is satisfied.

math.ST

Probabilistic reconstruction of genealogies for polyploid plant species

A probabilistic reconstruction of genealogies in a polyploid population (from 2x to 4x) is investigated, by considering genetic data analyzed as the probability of allele presence in a given genotype. Based on the likelihood of all possible crossbreeding patterns, our model enables us to infer and to quantify the whole potential genealogies in the population. We explain in particular how to deal with the uncertain allelic multiplicity that may occur with polyploids. Then we build an \textit{ad hoc} penalized likelihood to compare genealogies and to decide whether a particular individual brings sufficient information to be included in the taken genealogy. This decision criterion enables us in a next part to suggest a greedy algorithm in order to explore missing links and to rebuild some connections in the genealogies, retrospectively. As a by-product, we also give a way to infer the individuals that may have been favored by breeders over the years. In the last part we highlight the results given by our model and our algorithm, firstly on a simulated population and then on a real population of rose bushes. Most of the methodology relies on the maximum likelihood principle and on graph theory.

q-bio.PE

Stochastic approximation of quasi-stationary distributions on compact spaces and applications

In the continuity of a recent paper ([6]), dealing with finite Markov chains, this paper proposes and analyzes a recursive algorithm for the approximation of the quasi-stationary distribution of a general Markov chain living on a compact metric space killed in finite time. The idea is to run the process until extinction and then to bring it back to life at a position randomly chosen according to the (possibly weighted) empirical occupation measure of its past positions. General conditions are given ensuring the convergence of this measure to the quasi-stationary distribution of the chain. We then apply this method to the numerical approximation of the quasi-stationary distribution of a diffusion process killed on the boundary of a compact set and to the estimation of the spectral gap of irreducible Markov processes. Finally, the sharpness of the assumptions is illustrated through the study of the algorithm in a non-irreducible setting.

math.PR

Optimal non-asymptotic bound of the Ruppert-Polyak averaging without strong convexity

This paper is devoted to the non-asymptotic control of the mean-squared error for the Ruppert-Polyak stochastic averaged gradient descent introduced in the seminal contributions of [Rup88] and [PJ92]. In our main results, we establish non-asymptotic tight bounds (optimal with respect to the Cramer-Rao lower bound) in a very general framework that includes the uniformly strongly convex case as well as the one where the function f to be minimized satisfies a weaker Kurdyka-Lojiasewicz-type condition [Loj63, Kur98]. In particular, it makes it possible to recover some pathological examples such as on-line learning for logistic regression (see [Bac14]) and recursive quan- tile estimation (an even non-convex situation).

math.ST

Stochastic Heavy Ball

This paper deals with a natural stochastic optimization procedure derived from the so-called Heavy-ball method differential equation, which was introduced by Polyak in the 1960s with his seminal contribution [Pol64]. The Heavy-ball method is a second-order dynamics that was investigated to minimize convex functions f . The family of second-order methods recently received a large amount of attention, until the famous contribution of Nesterov [Nes83], leading to the explosion of large-scale optimization problems. This work provides an in-depth description of the stochastic heavy-ball method, which is an adaptation of the deterministic one when only unbiased evalutions of the gradient are available and used throughout the iterations of the algorithm. We first describe some almost sure convergence results in the case of general non-convex coercive functions f . We then examine the situation of convex and strongly convex potentials and derive some non-asymptotic results about the stochastic heavy-ball method. We end our study with limit theorems on several rescaled algorithms.

math.ST