SearcharxivSearch

arXiv subjects

Giovanni Conforti

Publications and source records attributed to Giovanni Conforti.

At least 19 recordsLinked to original sources

Trajectory inference via Acceleration Matching

Trajectory inference is a fundamental problem in many scientific domains: given a collection of unpaired snapshots of observations at discrete time points, the goal is to generate smooth trajectories that best resemble and interpolate the data. Existing algorithms exhibit computational challenges: they either rely on preprocessing subroutines to enforce smoothness or on simulation-based training objectives, both of which can be expensive. In order to overcome these limitations, we propose a new algorithm called Acceleration Matching (\texttt{AM}). Our approach consists of lifting the original interpolation problem to phase space and then regressing onto an explicit conditional acceleration field that induces random, smooth trajectories that agree with the prescribed marginals. Importantly, our resulting training algorithm only requires positional data, avoids trajectory simulation during training, and is devoid of expensive preprocessing. We provide ample numerical evidence suggesting that \texttt{AM} is competitive with or superior to existing algorithms on several benchmark problems from the existing literature.

cs.LG

Diffusion Flow Matching: Dimension-Improved KL Bounds and Wasserstein Guarantees

Diffusion Flow Matching (DFM) has recently emerged as a versatile framework for generative modeling, yet its theoretical convergence properties remain only partially understood. In this work, we provide refined and novel convergence guarantees for Brownian motion based DFMs, focusing on the discretization error. Our analysis is conducted under the Kullback-Leibler (KL) divergence and the 2-Wasserstein distance. Under finite-moment conditions and a mild score integrability assumption, we derive KL convergence bounds with improved dimensional dependence compared to prior work, achieving, up to our knowledge, state-of-the-art scaling under minimal conditions. We further extend the analysis to the 2-Wasserstein distance: under an additional first-order score integrability assumption and a weak log-concavity condition, we obtain convergence guarantees with dimensional dependence consistent with the KL case.

stat.ML

Discrete Flow Matching: Convergence Guarantees Under Minimal Assumptions

Flow Matching has recently emerged as a popular class of generative models for simulating a target distribution $\mu_1$ from samples drawn from a source distribution $\mu_0$. This framework relies on a fixed coupling between $\mu_0$ and $\mu_1$, and on a deterministic or stochastic bridge to define an interpolating process between the two distributions. The time marginals of this process can then be approximately sampled by estimating the transition rates, or more generally the generator, of its Markovian projection. This framework has recently been extended to the case of discrete source and target distributions, under the name Discrete Flow Matching (DFM). However, theoretical guarantees for such models remain scarce. In this paper, we study two DFM models on $\mathbb{Z}_m^d = \{0,\ldots,m-1\}^d$, sampled through time discretization, and derive non-asymptotic associated bounds for both of them. In contrast to previous work, we establish non-asymptotic bounds in Kullback--Leibler divergence for the early-stopped version of the target distribution. We also derive explicit convergence guarantees in total variation distance with respect to the true target distribution. Importantly, these bounds rely only on an approximation error assumption, relaxing standard score assumptions used in earlier works, while also yielding improved dependence on the vocabulary size $m$ and the dimension $d$.

cs.LG

Iterative Tilting for Diffusion Fine-Tuning

We introduce iterative tilting, a gradient-free method for fine-tuning diffusion models toward reward-tilted distributions. The method decomposes a large reward tilt $\exp(\lambda r)$ into $N$ sequential smaller tilts, each admitting a tractable score update via first-order Taylor expansion. This requires only forward evaluations of the reward function and avoids backpropagating through sampling chains. We validate on a two-dimensional Gaussian mixture with linear reward, where the exact tilted distribution is available in closed form.

stat.ML

Non-Asymptotic Convergence of Discrete Diffusion Models: Masked and Random Walk dynamics

Diffusion models for continuous state spaces based on Gaussian noising processes are now relatively well understood from both practical and theoretical perspectives. In contrast, results for diffusion models on discrete state spaces remain far less explored and pose significant challenges, particularly due to their combinatorial structure and their more recent introduction in generative modelling. In this work, we establish new and sharp convergence guarantees for three popular discrete diffusion models (DDMs). Two of these models are designed for finite state spaces and are based respectively on the random walk and the masking process. The third DDM we consider is defined on the countably infinite space $\mathbb{N}^d$ and uses a drifted random walk as its forward process. For each of these models, the backward process can be characterized by a discrete score function that can, in principle, be estimated. However, even with perfect access to these scores, simulating the exact backward process is infeasible, and one must rely on time discretization. In this work, we study Euler-type approximations and establish convergence bounds in both Kullback-Leibler divergence and total variation distance for the resulting models, under minimal assumptions on the data distribution. To the best of our knowledge, this study provides the optimal non-asymptotic convergence guarantees for these noising processes that do not rely on boundedness assumptions on the estimated score. In particular, the computational complexity of each method scales only linearly in the dimension, up to logarithmic factors.

cs.LG

Exponential Convergence Guarantees for Iterative Markovian Fitting

The Schrödinger Bridge (SB) problem has become a fundamental tool in computational optimal transport and generative modeling. To address this problem, ideal methods such as Iterative Proportional Fitting and Iterative Markovian Fitting (IMF) have been proposed-alongside practical approximations like Diffusion Schrödinger Bridge and its Matching (DSBM) variant. While previous work have established asymptotic convergence guarantees for IMF, a quantitative, non-asymptotic understanding remains unknown. In this paper, we provide the first non-asymptotic exponential convergence guarantees for IMF under mild structural assumptions on the reference measure and marginal distributions, assuming a sufficiently large time horizon. Our results encompass two key regimes: one where the marginals are log-concave, and another where they are weakly log-concave. The analysis relies on new contraction results for the Markovian projection operator and paves the way to theoretical guarantees for DSBM.

stat.ML

Bit-Level Discrete Diffusion with Markov Probabilistic Models: An Improved Framework with Sharp Convergence Bounds under Minimal Assumptions

This paper introduces Discrete Markov Probabilistic Models (DMPMs), a novel discrete diffusion algorithm for discrete data generation. The algorithm operates in discrete bit space, where the noising process is a continuous-time Markov chain that flips labels uniformly at random. The time-reversal process, like the forward noise process, is a jump process with its intensity governed by a discrete analogue of the classical score function. Crucially, this intensity is proven to be the conditional expectation of a function of the forward process, underlining theoretical alignment with score-based generative models. We establish convergence bounds for the algorithm under minimal assumptions, ensuring robustness and efficiency, which we demonstrate through experiments on low-dimensional Bernoulli-distributed datasets and high-dimensional binary MNIST data. The results highlight competitive performance in generating discrete structures compared to the state-of-the-art. This work bridges theoretical foundations and practical applications, advancing the development of effective and theoretically grounded discrete generative modeling.

stat.ML

A semiconcavity approach to stability of entropic plans and exponential convergence of Sinkhorn's algorithm

We study stability of optimizers and convergence of Sinkhorn's algorithm for the entropic optimal transport problem. In the special case of the quadratic cost, our stability bounds imply that if one of the two entropic potentials is semiconcave, then the relative entropy between optimal plans is controlled by the squared Wasserstein distance between their marginals. When employed in the analysis of Sinkhorn's algorithm, this result gives a natural sufficient condition for its exponential convergence, which does not require the ground cost to be bounded. By controlling from above the Hessians of Sinkhorn potentials in examples of interest, we obtain new exponential convergence results. For instance, for the first time we obtain exponential convergence for log-concave marginals and quadratic costs for all values of the regularization parameter, based on semiconcavity propagation results. Moreover, the convergence rate has a linear dependence on the regularization: this behavior is sharp and had only been previously obtained for compact distributions arXiv:2407.01202. These optimal rates are also established in situations where one of the two marginals does not have subgaussian tails. Other interesting new applications include subspace elastic costs, weakly log-concave marginals, marginals with light tails (where, under reinforced assumptions, we manage to improve the rates obtained in arXiv:2311.04041), the case of Lipschitz costs with bounded Hessian, and compact Riemannian manifolds.

math.PR

Propagation of weak log-concavity along generalised heat flows via Hamilton-Jacobi equations

A well-known consequence of the Pr{é}kopa-Leindler inequality is the preservation of logconcavity by the heat semigroup. Unfortunately, this property does not hold for more general semigroups. In this paper, we exhibit a slightly weaker notion of log-concavity that can be propagated along generalised heat semigroups. As a consequence, we obtain logsemiconcavity properties for the ground state of Schr{ö}dinger operators for non-convex potentials, as well as propagation of functional inequalities along generalised heat flows. We then investigate the preservation of weak log-concavity by conditioning and marginalisation, following the seminal works of Brascamp and Lieb. To our knowledge, our results are the first of this type in non log-concave settings. We eventually study generation of log-concavity by parabolic regularisation and prove novel two-sided log-Hessian estimates for the fundamental solution of parabolic equations with unbounded coefficients, which can be made uniform in time. These properties are obtained as a consequence of new propagation of weak convexity results for quadratic Hamilton-Jacobi-Bellman (HJB) equations. The proofs rely on a stochastic control interpretation combined with a second order analysis of reflection coupling along HJB characteristics.

math.AP

A coupling approach to Lipschitz transport maps

In this note, we propose a probabilistic approach to bound the (dimension-free) Lipschitz constant of the Langevin flow map on $\mathbb{R}^d$ introduced by Kim and Milman (2012). As example of application, we construct Lipschitz maps from a uniformly $\log$-concave probability measure to $\log$-Lipschitz perturbations as in Fathi, Mikulincer, Shenfeld (2024). Our proof is based on coupling techniques applied to the stochastic representation of the family of vector fields inducing the transport map. This method is robust enough to relax the uniform convexity to a weak asymptotic convexity condition and to remove the bound on the third derivative of the potential of the source measure.

math.PR

Regularity and stability for the Gibbs conditioning principle on path space via McKean-Vlasov control

We consider a system of diffusion processes interacting through their empirical distribution. Assuming that the empirical average of a given observable can be observed at any time, we derive regularity and quantitative stability results for the optimal solutions in the associated version of the Gibbs conditioning principle. The proofs rely on the analysis of a McKean-Vlasov control problem with distributional constraints. Some new estimates are derived for Hamilton-Jacobi-Bellman equations and the Hessian of the log-density of diffusion processes, which are of independent interest.

math.OC

Gibbs principle with infinitely many constraints: optimality conditions and stability

We extend the Gibbs conditioning principle to an abstract setting combining infinitely many linear equality constraints and non-linear inequality constraints, which need not be convex. A conditional large large deviation principle (LDP) is proved in a Wassersteintype topology, and optimality conditions are written in this abstract setting. This setting encompasses versions of the Schr{ö}dinger bridge problem with marginal non-linear inequality constraints at every time. In the case of convex constraints, stability results for perturbations both in the constraints and the reference measure are proved. We then specify our results when the reference measure is the path-law of a continuous diffusion process, whose law is constrained at each time. We obtain a complete description of the constrained process through an atypical mean-field PDE system involving a Lagrange multiplier.

math.FA

The exponential turnpike phenomenon for mean field game systems: weakly monotone drifts and small interactions

This article aims at quantifying the long time behavior of solutions of mean field PDE systems arising in the theory of Mean Field Games and McKean-Vlasov control. Our main contribution is to show well-posedness of the ergodic problem and the exponential turnpike property of dynamic optimizers, which implies exponential convergence to equilibrium for both optimal states and controls to their ergodic counterparts. In contrast with previous works that require some version of the Lasry-Lions monotonicity condition, our main assumption is a weak form of asymptotic monotonicity on the drift of the controlled dynamics and some basic regularity and smallness conditions on the interaction terms. Our proof strategy is probabilistic and based on the construction of contractive couplings between controlled processes and forward-backward stochastic differential equations. The flexibility of the coupling approach allows us to cover several interesting situations. For example, we do not need to restrict ourselves to compact domains and can work on the whole space $\mathbb{R}^d$, we can cover the case of non-constant diffusion coefficients and we can sometimes show turnpike estimates for the hessians of solutions to the backward equation.

math.PR

KL Convergence Guarantees for Score diffusion models under minimal data assumptions

Diffusion models are a new class of generative models that revolve around the estimation of the score function associated with a stochastic differential equation. Subsequent to its acquisition, the approximated score function is then harnessed to simulate the corresponding time-reversal process, ultimately enabling the generation of approximate data samples. Despite their evident practical significance these models carry, a notable challenge persists in the form of a lack of comprehensive quantitative results, especially in scenarios involving non-regular scores and estimators. In almost all reported bounds in Kullback Leibler (KL) divergence, it is assumed that either the score function or its approximation is Lipschitz uniformly in time. However, this condition is very restrictive in practice or appears to be difficult to establish. To circumvent this issue, previous works mainly focused on establishing convergence bounds in KL for an early stopped version of the diffusion model and a smoothed version of the data distribution, or assuming that the data distribution is supported on a compact manifold. These explorations have led to interesting bounds in either Wasserstein or Fortet-Mourier metrics. However, the question remains about the relevance of such early-stopping procedure or compactness conditions. In particular, if there exist a natural and mild condition ensuring explicit and sharp convergence bounds in KL. In this article, we tackle the aforementioned limitations by focusing on score diffusion models with fixed step size stemming from the Ornstein-Uhlenbeck semigroup and its kinetic counterpart. Our study provides a rigorous analysis, yielding simple, improved and sharp convergence bounds in KL applicable to any data distribution with finite Fisher information with respect to the standard Gaussian distribution.

math.ST

Theoretical guarantees in KL for Diffusion Flow Matching

Flow Matching (FM) (also referred to as stochastic interpolants or rectified flows) stands out as a class of generative models that aims to bridge in finite time the target distribution $ν^\star$ with an auxiliary distribution $μ$, leveraging a fixed coupling $π$ and a bridge which can either be deterministic or stochastic. These two ingredients define a path measure which can then be approximated by learning the drift of its Markovian projection. The main contribution of this paper is to provide relatively mild assumptions on $ν^\star$, $μ$ and $π$ to obtain non-asymptotics guarantees for Diffusion Flow Matching (DFM) models using as bridge the conditional distribution associated with the Brownian motion. More precisely, we establish bounds on the Kullback-Leibler divergence between the target distribution and the one generated by such DFM models under moment conditions on the score of $ν^\star$, $μ$ and $π$, and a standard $L^2$-drift-approximation error assumption.

stat.ML

Convergence of Sinkhorn's Algorithm for Entropic Martingale Optimal Transport Problem

In this paper, we study the Entropic Martingale Optimal Transport (EMOT) problem on \mathbb{R}. The investigation of the EMOT problem arises in the calibration problem of the Stochastic Volatility Models, where martingale constraints reflect no-arbitrage pricing conditions under the risk-neutral measure, as originally proposed by Henry-Labordere. We first establish the dual formulation of the EMOT problem and prove that Sinkhorn's algorithm achieves an exponential convergence rate under mild conditions. Notably, our analysis does not presuppose the existence of optimal potentials and rigorously confirms the absence of a primal-dual gap. These results provide a theoretical foundation for solving EMOT via Sinkhorn's method and constructing the optimal distribution from dual coefficients.

math.PR

Weak semiconvexity estimates for Schrödinger potentials and logarithmic Sobolev inequality for Schrödinger bridges

We investigate the quadratic Schrödinger bridge problem, a.k.a. Entropic Optimal Transport problem, and obtain weak semiconvexity and semiconcavity bounds on Schrödinger potentials under mild assumptions on the marginals that are substantially weaker than log-concavity. We deduce from these estimates that Schrödinger bridges satisfy a logarithmic Sobolev inequality on the product space. Our proof strategy is based on a second order analysis of coupling by reflection on the characteristics of the Hamilton-Jacobi-Bellman equation that reveals the existence of new classes of invariant functions for the corresponding flow.

math.PR

Hamilton--Jacobi equations for Wasserstein controlled gradient flows: existence of viscosity solutions

This work is the third part of a program initiated in arXiv:2111.13258, arXiv:2302.06571 aiming at the development of an intrinsic geometric well-posedness theory for Hamilton-Jacobi equations related to controlled gradient flow problems in metric spaces. In this paper, we finish our analysis in the context of Wasserstein gradient flows with underlying energy functional satisfying McCann's condition. More prescisely, we establish that the value function for a linearly controlled gradient flow problem whose running cost is quadratic in the control variable and just continuous in the state variable yields a viscosity solution to the Hamilton-Jacobi equation in terms of two operators introduced in our former works, acting as rigorous upper and lower bounds for the formal Hamiltonian at hand. The definition of these operators is directly inspired by the Evolutional Variational Inequality formulation of gradient flows (EVI): one of the main innovations of this work is to introduce a controlled version of EVI, which turns out to be crucial in establishing regularity properties, energy and metric bounds along optimzing sequences in the controlled gradient flow problem that defines the candidate solution.

math.AP