SearcharxivSearch

arXiv subjects

Laurent Mertz

Publications and source records attributed to Laurent Mertz.

At least 19 recordsLinked to original sources

Improving Diffusion Generative Models via Truncated Karhunen--Loève Expansion

Pretrained diffusion models exhibit a well-known training-sampling mismatch, often attributed to exposure bias and related distribution-shift effects. We provide a quantitative interpretation of this phenomenon through the notion of an effective noise level: empirically, a pretrained denoiser behaves as if trained at a noise level slightly below the nominal schedule. Motivated by this observation, we introduce a training-free sampling strategy based on truncating the Karhunen--Loève (KL) expansion of the Brownian motion driving the forward stochastic differential equation. Truncation yields a finite-dimensional forward process with a reduced noise level that can be adjusted independently of the time discretization. We prove uniform convergence of the truncated process to the original diffusion. To explain the resulting behaviour, we analyse a toy model in which the denoiser is exact but operates at a reduced effective noise level. The analysis predicts a non-monotone response to the sampling noise with a unique interior optimum, located by a one-dimensional sweep over the truncation order. We implement the approach through corresponding truncated reverse-time and probability-flow equations, without modifying the network architecture. Across CIFAR-10, CelebA, ImageNet, and latent-space Stable Diffusion, the truncation order consistently reveals a sweet spot, improving pretrained models in nearly all tested configurations. Training from scratch at a matched truncation order makes that order the network's own sweet spot, accelerates convergence by about $2.8\times$, and lowers the generation error on CIFAR-10 (Fréchet Inception Distance 7.14 to 5.47 at matched epochs; best checkpoint 6.74 to 5.23). A Lévy--Ciesielski comparison confirms that finite expansion is broadly beneficial.

cs.CV

Controllability and Exponential Mixing in Singular Interacting Particle Systems

This article concerns interacting particle systems with singular kernels, driven either by degenerate deterministic controls or by degenerate decomposable noise. In the deterministic setting, we establish global exact controllability and a topologically robust property called solid controllability. Moreover, we prove a result that guarantees global approximate controllability with prescribed trajectories. For stochastic dynamics, we obtain ergodicity and exponential mixing by utilizing coupling and recurrence mechanisms based on controllability. Our approach exploits the singularity and applies to a broad class of models, including Biot-Savart, Coulomb, Riesz, and Yukawa interactions, as well as heterogeneous multi-species systems.

math.OC

A control variate method for threshold crossing probabilities of plastic deformation driven by transient coloured noise

We propose a hybrid method combining partial differential equation (PDE) and Monte Carlo (MC) techniques to obtain efficient estimates of statistics for plastic deformation related to kinematic hardening models driven by transient coloured noise. Our approach employs a control variate strategy inspired by [CPAM, 75 (3), 455-492, 2022] and relies on a class of PDEs with non-standard boundary conditions, which we derive here. The solutions of those PDEs represent the statistics of models driven by transient white noise and are significantly easier to solve than the coloured noise version. Our approach uses a coupling between the white-noise-driven process and the coloured-noise-driven process, yielding a variance-reduced estimator through control variate techniques. We apply our method to threshold-crossing probabilities, which are used as failure criteria known as ultimate and serviceability limit states under non-stationary excitation. Our contribution provides solid grounds for such calculations and is significantly more computationally efficient in terms of variance reduction compared to standard MC simulations.

cond-mat.stat-mech

A control variate method based on polynomial approximation of Brownian path

We present a novel control variate technique for enhancing the efficiency of Monte Carlo (MC) estimation of expectations involving solutions to stochastic differential equations (SDEs). Our method integrates a primary fine-time-step discretization of the SDE with a control variate derived from a secondary coarse-time-step discretization driven by a piecewise parabolic approximation of Brownian motion. This approximation is conditioned on the same fine-scale Brownian increments, enabling strong coupling between the estimators. The expectation of the control variate is computed via an independent MC simulation using the coarse approximation. We characterize the minimized quadratic error decay as a function of the computational budget and the weak and strong orders of the primary and secondary discretization schemes. We demonstrate the method's effectiveness through numerical experiments on representative SDEs.

math.PR

Constrained non-linear estimation and links with stochastic filtering

This article studies the problem of estimating the state variable of non-smooth subdifferential dynamics constrained in a bounded convex domain given some real-time observation. On the one hand, we show that the value function of the estimation problem is a viscosity solution of a Hamilton Jacobi Bellman equation whose sub and super solutions have different Neumann type boundary conditions. This intricacy arises from the non-reversibility in time of the non-smooth dynamics, and hinders the derivation of a comparison principle and the uniqueness of the solution in general. Nonetheless, we identify conditions on the drift (including zero drift) coefficient in the non-smooth dynamics that make such a derivation possible. On the other hand, we show in a general situation that the value function appears in the small noise limit of the corresponding stochastic filtering problem by establishing a large deviation result. We also give quantitative approximation results when replacing the non-smooth dynamics with a smooth penalised one.

math.OC

Sensitivity analysis of colored noise-driven interacting particle systems

We propose an efficient sensitivity analysis method for a wide class of colored noise-driven interacting particle systems (IPS). Our method is based on unperturbed simulations and significantly extends the Malliavin weight sampling method proposed by Szamel (EPL, 117 (2017) 50010) for evaluating sensitivities such as linear response functions of IPS driven by simple Ornstein-Uhlenbeck processes. We show that the sensitivity index depends not only on two effective parameters that characterize the variance and correlation time of the noise, but also on the noise spectrum. In the case of a single particle in a harmonic potential, we obtain exact analytical formulas for two types of linear response functions. By applying our method to a system of many particles interacting via a repulsive screened Coulomb potential, we compute the mobility and effective temperature of the system. Our results show that the system dynamics depend, in a nontrivial way, on the noise spectrum.

math.PR

Exponential mixing of constrained random dynamical systems via controllability conditions

We provide deterministic controllability conditions that imply exponential mixing properties for randomly forced constrained dynamical systems with possibly unbounded state space. As an application, new ergodicity results are obtained for non-smooth models in elasto-plasticity driven by various types of noise, including white noise. It is thereby illustrated how tools from control theory can be utilized to tackle regularity issues that commonly arise in the qualitative study of constrained systems.

math.OC

Computing the diffusivity of a particle subject to dry friction with colored noise

This paper considers the motion of an object subjected to dry friction and an external random force. The objective is to characterize the role of the correlation time of the external random force. We develop efficient stochastic simulation methods for computing the diffusivity (the linear growth rate of the variance of the displacement) and other related quantities of interest when the external random force is white or colored. These methods are based on original representation formulas for the quantities of interest which make it possible to build unbiased and consistent estimators. The numerical results obtained with these original methods are in perfect agreement with known closed-form formulas valid in the white noise regime. In the colored noise regime the numerical results show that the predictions obtained from the white-noise approximation are reasonable for quantities such as the histograms of the stationary velocity but can be wrong for the diffusivity unless the correlation time is extremely small.

cond-mat.stat-mech

A piecewise deterministic Markov process approach modeling a dry friction problem with noise

Understanding and predicting the dynamical properties of systems involving dry friction is a major concern in physics and engineering. It abounds in many mechanical processes, from the sound produced by a violin to the screeching of chalk on a blackboard to human infant crawling dynamics and friction-based locomotion of a multitude of living organisms (snakes, bacteria, scallops..) to the displacement of mechanical structures (building, bridges, nuclear plants, massive industrial infrastructures) under earthquakes and beyond. Surprisingly, even for low-dimensional systems, the modeling of dry friction in the presence of random forcing has not been elucidated. In this paper, we propose a piecewise deterministic Markov process approach modeling a system with dry friction including different coefficients for the static and dynamic forces. In this mathematical framework, we derive the corresponding Kolmogorov equations and related tools to compute statistical quantities of interest related to the distributions of the static (sticked) and dynamic phases. We show ergodicity and provide a representation formula of the stationary measure using independent identically distributed portions of the trajectory (excursions). We also obtain deterministic characterizations of the Laplace transforms of the probability density functions of the durations of the static and dynamic phases.

math.PR

Mortensen Observer for a class of variational inequalities -Lost equivalence with stochastic filtering approaches

We address the problem of deterministic sequential estimation for a nonsmooth dynamics in R governed by a variational inequality, as illustrated by the Skorokhod problem with a reflective boundary condition at 0. For smooth dynamics, Mortensen introduced an energy for the likelihood that the state variable produces-up to perturbations disturbances-a given observation in a finite time interval, while reaching a given target state at the final time. The Mortensen observer is the minimiser of this energy. For dynamics given by a variational inequality and therefore not reversible in time, we study the definition of a Mortensen estimator. On the one hand, we address this problem by relaxing the boundary constraint of the synthetic variable and then proposing an approximated variant of the Mortensen estimator that uses the resulting nonlinear smooth dynamics. On the other hand, inspired by the smooth dynamics approach, we study the vanishing viscosity limit of the Hamilton-Jacobi equation satisfied by the Hopf-Cole transform of the solution of the robust Zakai equation. We prove a stability result that allows us to interpret the limiting solution as the value function associated with a control problem rather than an estimation problem. In contrast to the case of smooth dynamics, here the zero-noise limit of the robust form of the Zakai equation cannot be understood from the Bellman equation of the value function arising in Mortensen's deterministic estimation. This may unveil a violation of equivalence for non-reversible dynamics between the Mortensen approach and the low noise stochastic approach for nonsmooth dynamics.

math.AP

Probing quantum effects with classical stochastic analogs

We propose a method to construct a classical analog of an open quantum system, namely a single quantum particle confined in a potential well and immersed in a thermal bath. The classical analog is made out of a collection of identical wells where classical particles of mass $m$ are trapped. The distribution $n(x,t)$ of the classical positions is used to reconstruct the quantum Bohm potential $V_{\rm Bohm} = -\frac{\hbar^2}{2 m} \frac{Δ\sqrt{n}}{\sqrt{n}}$, which in turn acts on the shape of the potential wells. As a result, the classical particles experience an effective "quantum" force. This protocol is tested with numerical simulations using single- and double-well potentials, evidencing typical quantum effects such as long-lasting correlations and quantum tunneling. For harmonic confinement, the analogy is implemented experimentally using micron-sized dielectric beads optically trapped by a laser beam.

quant-ph

A control variate method driven by diffusion approximation

In this paper we examine a control variate estimator for a quantity that can be expressed as the expectation of a functional of a random process, that is itself the solution of a differential equation driven by fast mean-reverting ergodic forces. The control variate is the expectation of the same functional for the limit diffusion process that approximates the original process when the mean-reversion time goes to zero. To get an efficient control variate estimator, we propose a coupling method to build the original process and the limit diffusion process. We show that the correlation between the two processes indeed goes to one when the mean reversion time goes to zero and we quantify the convergence rate, which makes it possible to characterize the variance reduction of the proposed control variate method. The efficiency of the method is illustrated on a few examples.

math.PR

Optimal protocols and universal time-energy bound in Brownian thermodynamics

We propose an optimization strategy to control the dynamics of a stochastic system transferred from one thermal equilibrium to another and apply it experimentally to a Brownian particle in an optical trap under compression. Based on a variational principle that treats the transfer duration and the expended work on an equal footing, our strategy leads to a family of protocols that are either optimally cheap for a given duration or optimally fast for a given energetic cost. This approach unveils a universal relation $Δt\,ΔW \ge (Δt\,ΔW)_{\rm opt}$ between the transfer duration and the expended work. We verify experimentally that the lower bound is reached only with the optimized protocols.

cond-mat.stat-mech

A Feynman-kac Formula Approach for Computing Expectations and Threshold Crossing Probabilities of Non-smooth Stochastic Dynamical Systems

We present a computational alternative to probabilistic simulations for non-smooth stochastic dynamical systems that are prevalent in engineering mechanics. As examples, we target (1) stochastic elasto-plastic problems, which involve transitions between elastic and plastic states, and (2) obstacle problems with noise, which involve discrete impulses due to collisions with an obstacle. We formally introduce a class of partial differential equations related to the Feynman-Kac formula, where the underlying stochastic processes satisfy variational inequalities modelling elasto-plastic and obstacle oscillators. We then focus on solving them numerically. The main challenge in solving these equations is the non-standard boundary conditions which describe the behavior of the underlying process on the boundary. We illustrate how to use our approach to compute expectations and other statistical quantities, such as the asymptotic growth rate of variance in asymptotic formulae for threshold crossing probabilities.

math.PR

Penalization of non-smooth dynamical systems with noise : ergodicity and asymptotic formulae for threshold crossings probabilities

The purpose of this paper is to prove ergodicity and provide asymptotic formulae for probabilities of threshold crossing related to smooth approximations of three fundamental nonlinear mechanical models: (a) an elasto-plastic oscillator, (b) an oscillator with dry friction, (c) an oscillator constrained by an obstacle (one sided or two sided) and subject to impacts, all three in presence of white or colored noise. Relying on a groundbreaking result on density estimates for degenerate diffusions by Delarue and Menozzi (2010), we identify Lyapunov functions that satisfy appropriate conditions leading to ergodicity (invariant measure and Poisson equation) and a functional central limit theorem. These conditions appear in the very fundamental works of Down, Meyn and Tweedie (1995) and Glynn and Meyn (1996). From an applied mathematics perspective, an important consequence is the access to asymptotic formulae for quantities of interest in engineering and science.

math.PR

Asymptotic Analysis of Stochastic Variational Inequalities Modeling an Elasto-Plastic Problem with Vanishing Jumps

In a previous work by the first author with J. Turi (AMO, 08), a stochastic variational inequality has been introduced to model an elasto-plastic oscillator with noise. A major advantage of the stochastic variational inequality is to overcome the need to describe the trajectory by phases (elastic or plastic). This is useful, since the sequence of phases cannot be characterized easily. In particular, there are numerous small elastic phases which may appear as an artefact of the Wiener process. However, it remains important to have informations on these phases. In order to reconcile these contradictory issues, we introduce an approximation of stochastic variational inequalities by imposing artificial small jumps between phases allowing a clear separation of the phases. In this work, we prove that the approximate solution converges on any finite time interval, when the size of jumps tends to 0.

math.NA

An analytic approach to the ergodic theory of stochastic variational inequalities

In an earlier work made by the first author with J. Turi (Degenerate Dirichlet Problems Related to the Invariant Measure of Elasto-Plastic Oscillators, AMO, 2008), the solution of a stochastic variational inequality modeling an elasto-perfectly-plastic oscillator has been studied. The existence and uniqueness of an invariant measure have been proven. Nonlocal problems have been introduced in this context. In this work, we present a new characterization of the invariant measure. The key finding is the connection between nonlocal PDEs and local PDEs which can be interpreted with short cycles of the Markov process solution of the stochastic variational inequality.

math.AP