SearcharxivSearch

arXiv subjects

Junsu Seo

Publications and source records attributed to Junsu Seo.

2 recordsLinked to original sources

Modeling Score Approximation Errors in Diffusion Models via Forward SPDEs

This study investigates the dynamics of Score-based Generative Models (SGMs) by treating the score estimation error as a stochastic source driving the Fokker-Planck equation. Departing from particle-centric SDE analyses, we employ an SPDE framework to model the evolution of the probability density field under stochastic drift perturbations. Under a simplified setting, we utilize this framework to interpret the robustness of generative models through the lens of geometric stability and displacement convexity. Furthermore, we introduce a candidate evaluation metric derived from the quadratic variation of the SPDE solution projected onto a radial test function. Preliminary observations suggest that this metric remains effective using only the initial 10% of the sampling trajectory, indicating a potential for computational efficiency.

cs.LG

Connecting SPDE to SGMs

This paper investigates a Stochastic Partial Differential Equation (SPDE) derived from the Fokker-Planck equation associated with Score-based Generative Models. We modify the standard Fokker-Planck equation to better represent practical SGMs and introduce noise to mitigate potential discretization issues. The primary goal is to prove the existence and uniqueness of solutions for this SPDE. This aspect requires careful consideration due to the time-dependent operator and unbounded domain. To overcome these hurdles, we employ a variational approach and introduce a novel space inspired by Ornstein-Uhlenbeck operators. By demonstrating that this space and its subspace satisfy the necessary assumptions, they establish the existence of a solution for the given SPDE.

math.AP