Searcharxiv⌕ Search

arXiv subjects

Miha Brešar

Publications and source records attributed to Miha Brešar.

7 recordsLinked to original sources

Superdiffusive limits for stochastic kinetics driven by self-similar drifts

We prove anomalous-diffusion scaling for a one-dimensional stochastic kinetic dynamics, in which the stochastic drift is driven by an exogenous self-similar noise, and also includes endogenous volatility which is permitted to have arbitrary dependence with the exogenous noise. We identify the superdiffusive scaling exponent for the model, and prove strong and weak convergence results on the corresponding scale. Our framework admits self-similar noise that is either a Bessel process, or, more generally, a self-similar continuous-state branching process with immigration, as well as more general processes satisfying certain asymptotic conditions.

math.PR↗

Diffeomorphic Markov Chain Monte Carlo: fast mixing for heavy-tailed distributions

We introduce a new class of uniformly ergodic MCMC algorithms, termed Diffeomorphic Contraction Sampler (DCS), and provide fast non-asymptotic mixing guarantees for DCS targeting distributions on $\R^d$ with arbitrarily heavy polynomial tails. DCS provides a solution to a well-known problem for MCMC samplers, which typically struggle with the combination of unbounded high-dimensional state space and vanishing gradients. The DCS pulls back a target on $\R^d$ onto a Euclidean ball $B(R)\subset\R^d$ and then samples from the transformed density on the convex set $B(R)$ via algorithms such as the Ball Walk, Hit-and-Run and others. A radial diffeomorphic contraction is chosen so that the pull-back density on $B(R)$ is bounded, implying uniform ergodicity for \textit{all} targets with a finite polynomial moment. Non-asymptotic bounds for DCS require stronger assumptions such as log-concavity of the pull-back density. In practice, this is achieved approximately by a preconditioned automorphism of the ball $B(R)$, tuned via Variational Inference. Numerical simulation tests demonstrate that the DCS outperforms significantly the No-U-Turns sampler on multi-dimensional heavy-tailed targets arising as real-world posteriors in PosteriorDB benchmark. DCS also numerically outperforms in high-dimensional examples recently developed spherical projection samplers for heavy-tailed target distributions.

stat.CO↗

Central Limit Theorem for ergodic averages of Markov chains \& the comparison of sampling algorithms for heavy-tailed distributions

Establishing central limit theorems (CLTs) for ergodic averages of Markov chains is a fundamental problem in probability and its applications. Since the seminal work~\cite{MR834478}, a vast literature has emerged on the sufficient conditions for such CLTs. To counterbalance this, the present paper provides verifiable necessary conditions for CLTs of ergodic averages of Markov chains on general state spaces. Our theory is based on drift conditions, which also yield lower bounds on the rates of convergence to stationarity in various metrics. The validity of the ergodic CLT is of particular importance for sampling algorithms, where it underpins the error analysis of estimators in Bayesian statistics and machine learning. Although heavy-tailed sampling is of central importance in applications, the characterisation of the CLT and the convergence rates are theoretically poorly understood for almost all practically-used Markov chain Monte Carlo (MCMC) algorithms. In this setting our results provide sharp conditions on the validity of the ergodic CLT and establish convergence rates for large families of MCMC sampling algorithms for heavy-tailed targets. Our study includes a rather complete analyses for random walk Metropolis samplers (with finite- and infinite-variance proposals), Metropolis-adjusted and unadjusted Langevin algorithms and the stereographic projection sampler (as well as the independence sampler). By providing these sharp results via our practical drift conditions, our theory offers significant insights into the problems of algorithm selection and comparison for sampling heavy-tailed distributions (see short YouTube presentations~\cite{YouTube_talk} describing our \href{https://youtu.be/m2y7U4cEqy4}{\underline{theory}} and \href{https://youtu.be/w8I_oOweuko}{\underline{applications}}).

math.PR↗

Stability of storage processes with general release rates

This paper quantifies the ergodicity and the rate of decay of the tail of the stationary distribution for a broad class of storage models, encompassing constant, linear, and power-type release rates with both finite and infinite activity input process. Our results are expressed in terms of the asymptotics of the release rate, the tail-decay rate of the Lévy measure of the input process and its (possibly infinite) first moment. Our framework unifies and significantly extends classical results on the stability of storage models. Under certain regularity assumptions, we also provide upper bounds on the stability in the Wasserstein distance.

math.PR↗

Non-asymptotic bounds for forward processes in denoising diffusions: Ornstein-Uhlenbeck is hard to beat

Denoising diffusion probabilistic models (DDPMs) represent a recent advance in generative modelling that has delivered state-of-the-art results across many domains of applications. Despite their success, a rigorous theoretical understanding of the error within DDPMs, particularly the non-asymptotic bounds required for the comparison of their efficiency, remain scarce. Making minimal assumptions on the initial data distribution, allowing for example the manifold hypothesis, this paper presents explicit non-asymptotic bounds on the forward diffusion error in total variation (TV), expressed as a function of the terminal time $T$. We parametrise multi-modal data distributions in terms of the distance $R$ to their furthest modes and consider forward diffusions with additive and multiplicative noise. Our analysis rigorously proves that, under mild assumptions, the canonical choice of the Ornstein-Uhlenbeck (OU) process cannot be significantly improved in terms of reducing the terminal time $T$ as a function of $R$ and error tolerance $\varepsilon>0$. Motivated by data distributions arising in generative modelling, we also establish a cut-off like phenomenon (as $R\to\infty$) for the convergence to its invariant measure in TV of an OU process, initialized at a multi-modal distribution with maximal mode distance $R$.

math.ST↗

Subexponential lower bounds for $f$-ergodic Markov processes

We provide a criterion for establishing lower bounds on the rate of convergence in $f$-variation of a continuous-time ergodic Markov process to its invariant measure. The criterion consists of novel super- and submartingale conditions for certain functionals of the Markov process. It provides a general approach for proving lower bounds on the tails of the invariant measure and the rate of convergence in $f$-variation of a Markov process, analogous to the widely used Lyapunov drift conditions for upper bounds. Our key technical innovation produces lower bounds on the tails of the heights and durations of the excursions from bounded sets of a continuous-time Markov process using path-wise arguments. We apply our theory to elliptic diffusions and Lévy-driven stochastic differential equations with known polynomial/stretched exponential upper bounds on their rates of convergence. Our lower bounds match asymptotically the known upper bounds for these classes of models, thus establishing their rate of convergence to stationarity. The generality of the approach suggests that, analogous to the Lyapunov drift conditions for upper bounds, our methods can be expected to find applications in many other settings.

math.PR↗

Brownian motion with asymptotically normal reflection in unbounded domains: from transience to stability

We quantify the asymptotic behaviour of multidimensional drifltess diffusions in domains unbounded in a single direction, with asymptotically normal reflections from the boundary. We identify the critical growth/contraction rates of the domain that separate stability, null recurrence and transience. In the stable case we prove existence and uniqueness of the invariant distribution and establish the polynomial rate of decay of its tail. We also establish matching polynomial upper and lower bounds on the rate of convergence to stationarity in total variation. All exponents are explicit in the model parameters that determine the asymptotics of the growth rate of the domain, the interior covariance, and the reflection vector field. Proofs are probabilistic, and use upper and lower tail bounds for additive functionals up to return times to compact sets, for which we develop novel sub/supermartingale criteria, applicable to general continuous semimartingales. Narrowing domains fall outside of the standard literature, in part because boundary local time can accumulate arbitrarily rapidly. Establishing Feller continuity (essential for characterizing stability) thus requires an extension of the usual approach. Our recurrence/transience classification extends previous work on strictly normal reflections, and expands the range of phenomena observed across all dimensions. For all recurrent cases, we provide quantitative information through upper and lower bounds on tails of return times to compact sets (see https://www.youtube.com/watch?v=oDDDWdbPx74 for a short YouTube video describing the results).

math.PR↗