SearcharxivSearch

arXiv subjects

Simon Bienewald

Publications and source records attributed to Simon Bienewald.

2 recordsLinked to original sources

Statistical Convergence of Spherical First Hitting Diffusion Models

Denoising diffusion models have evolved into a state-of-the-art method for tasks in various fields, such as denoising and generation of images, text generation, or generation of synthetic data for training of other machine learning models. First hitting diffusion models (FHDM) are a particular class of denoising diffusion models with \textit{random} adaptive generation time tailored to generate data on a known manifold. Building on the conditioning framework of Doob's $h$-transform these models leverage the given information on the target data manifold to demonstrate strong performance across tasks while offering distinct features such as time-homogeneous dynamics of the generating process and a reduced average simulation time. Even though the theoretical investigation of standard forward-backward diffusion models has attracted much attention in the recent past, the statistical convergence properties of FHDMs are not yet understood. In this work, we show that, up to logarithmic factors, FHDMs achieve the minimax optimal convergence rate in total variation for spherically supported Sobolev smooth data distributions. In particular, this is the first statistical optimality result for denoising diffusion modelling with random generation time.

math.ST

The Hungry Daemon: An energy-harvesting active particle must obey the Second Law of Thermodynamics

Thought experiments like Maxwell's Demon or the Feynman-Smoluchowski Ratchet can help in pursuing the microscopic origin of the Second Law of Thermodynamics. Here we present a more sophisticated physical system than a ratchet, consisting of a Hamiltonian active particle which can harvest energy from an environment which may be in thermal equilibrium at a single temperature. We show that while a phenomenological description would seem to allow the system to operate as a Perpetual Motion Machine of the Second Kind, a full mechanical analysis confirms that this is impossible, and that perpetual energy harvesting can only occur if the environment has an energetic population inversion similar to a lasing medium.

cond-mat.stat-mech