Searcharxiv⌕ Search

arXiv subjects

Marcel Nutz

Publications and source records attributed to Marcel Nutz.

At least 37 records · Page 2Linked to original sources

On the Martingale Schrödinger Bridge between Two Distributions

We study a martingale Schrödinger bridge problem: given two probability distributions, find their martingale coupling with minimal relative entropy. Our main result provides Schrödinger potentials for this coupling. Namely, under certain conditions, the log-density of the optimal coupling is given by a triplet of real functions representing the marginal and martingale constraints. The potentials are also described as the solution of a dual problem.

math.PR↗

Stability of Mean-Field Variational Inference

Mean-field variational inference (MFVI) is a widely used method for approximating high-dimensional probability distributions by product measures. This paper studies the stability properties of the mean-field approximation when the target distribution varies within the class of strongly log-concave measures. We establish dimension-free Lipschitz continuity of the MFVI optimizer with respect to the target distribution, measured in the 2-Wasserstein distance, with Lipschitz constant inversely proportional to the log-concavity parameter. Under additional regularity conditions, we further show that the MFVI optimizer depends differentiably on the target potential and characterize the derivative by a partial differential equation. Methodologically, we follow a novel approach to MFVI via linearized optimal transport: the non-convex MFVI problem is lifted to a convex optimization over transport maps with a fixed base measure, enabling the use of calculus of variations and functional analysis. We discuss several applications of our results to robust Bayesian inference and empirical Bayes, including a quantitative Bernstein--von Mises theorem for MFVI, as well as to distributed stochastic control.

math.PR↗

Sparse Regularized Optimal Transport without Curse of Dimensionality

Entropic optimal transport -- the optimal transport problem regularized by KL diver\-gence -- is highly successful in statistical applications. Thanks to the smoothness of the entropic coupling, its sample complexity avoids the curse of dimensionality suffered by unregularized optimal transport. The flip side of smoothness is overspreading: the entropic coupling always has full support, whereas the unregularized coupling that it approximates is usually sparse, even given by a map. Regularizing optimal transport by less-smooth $f$-divergences such as Tsallis divergence (i.e., $L^p$-regularization) is known to allow for sparse approximations, but is often thought to suffer from the curse of dimensionality as the couplings have limited differentiability and the dual is not strongly concave. We refute this conventional wisdom and show, for a broad family of divergences, that the key empirical quantities converge at the parametric rate, independently of the dimension. More precisely, we provide central limit theorems for the optimal cost, the optimal coupling, and the dual potentials induced by i.i.d.\ samples from the marginals. These results are obtained by a powerful yet elementary approach that is of broader interest for Z-estimation in function classes that are not Donsker.

math.ST↗

Quantitative Convergence of Quadratically Regularized Linear Programs

Linear programs with quadratic regularization are attracting renewed interest due to their applications in optimal transport: unlike entropic regularization, the squared-norm penalty gives rise to sparse approximations of optimal transport couplings. It is well known that the solution of a quadratically regularized linear program over any polytope converges stationarily to the minimal-norm solution of the linear program when the regularization parameter tends to zero. However, that result is merely qualitative. Our main result quantifies the convergence by specifying the exact threshold for the regularization parameter, after which the regularized solution also solves the linear program. Moreover, we bound the suboptimality of the regularized solution before the threshold. These results are complemented by a convergence rate for the regime of large regularization. We apply our general results to the setting of optimal transport, where we shed light on how the threshold and suboptimality depend on the number of data points.

math.OC↗

Monotonicity in Quadratically Regularized Linear Programs

In optimal transport, quadratic regularization is a sparse alternative to entropic regularization: the solution measure tends to have small support. Computational experience suggests that the support decreases monotonically to the unregularized counterpart as the regularization parameter is relaxed. We find it useful to investigate this monotonicity more abstractly for linear programs over polytopes, regularized with the squared norm. Here, monotonicity can be stated as an invariance property of the curve mapping the regularization parameter to the solution: once the curve enters a face of the polytope, does it remain in that face forever? We show that this invariance is equivalent to a geometric property of the polytope, namely that each face contains the minimum norm point of its affine hull. Returning to the optimal transport problem and its associated Birkhoff polytope, we verify this property for low dimensions, but show that it fails for marginals with five or more point masses. As a consequence, the conjectured monotonicity of the support fails in general, even if experiments suggest that monotonicity holds for many cost matrices. Separately, we apply our geometric point of view to a problem of Erdős, namely to characterize the doubly stochastic matrices whose maximal trace equals their squared norm.

math.OC↗

On the Convergence Rate of Sinkhorn's Algorithm

We study Sinkhorn's algorithm for solving the entropically regularized optimal transport problem. Its iterate $π_{t}$ is shown to satisfy $H(π_{t}|π_{*})+H(π_{*}|π_{t})=O(t^{-1})$ where $H$ denotes relative entropy and $π_{*}$ the optimal coupling. This holds for a large class of cost functions and marginals, including quadratic cost with subgaussian marginals. We also obtain the rate $O(t^{-1})$ for the dual suboptimality and $O(t^{-2})$ for the marginal entropies. More precisely, we derive non-asymptotic bounds, and in contrast to previous results on linear convergence that are limited to bounded costs, our estimates do not deteriorate exponentially with the regularization parameter. We also obtain a stability result for $π_{*}$ as a function of the marginals, quantified in relative entropy.

math.OC↗

Quadratically Regularized Optimal Transport: Existence and Multiplicity of Potentials

The optimal transport problem with quadratic regularization is useful when sparse couplings are desired. The density of the optimal coupling is described by two functions called potentials; equivalently, potentials can be defined as a solution of the dual problem. We prove the existence of potentials for a general square-integrable cost. Potentials are not necessarily unique, a phenomenon directly related to sparsity of the optimal support. For discrete problems, we describe the family of all potentials based on the connected components of the support, for a graph-theoretic notion of connectedness. On the other hand, we show that continuous problems have unique potentials under standard regularity assumptions, regardless of sparsity. Using potentials, we prove that the optimal support is indeed sparse for small regularization parameter in a continuous setting with quadratic cost, which seems to be the first theoretical guarantee for sparsity in this context.

math.OC↗

Martingale Transports and Monge Maps

It is well known that martingale transport plans between marginals $μ\neqν$ are never given by Monge maps -- with the understanding that the map is over the first marginal $μ$, or forward in time. Here, we change the perspective, with surprising results. We show that any distributions $μ,ν$ in convex order with $ν$ atomless admit a martingale coupling given by a Monge map over the second marginal $ν$. Namely, we construct a particular coupling called the barcode transport. Much more generally, we prove that such ``backward Monge'' martingale transports are dense in the set of all martingale couplings, paralleling the classical denseness result for Monge transports in the Kantorovich formulation of optimal transport. Various properties and applications are presented, including a refined version of Strassen's theorem and a mimicking theorem where the marginals of a given martingale are reproduced by a ``backward deterministic'' martingale, a remarkable type of process whose current state encodes its whole history.

math.PR↗

On the Guyon-Lekeufack Volatility Model

Guyon and Lekeufack recently proposed a path-dependent volatility model and documented its excellent performance in fitting market data and capturing stylized facts. The instantaneous volatility is modeled as a linear combination of two processes, one is an integral of weighted past price returns and the other is the square-root of an integral of weighted past squared volatility. Each of the weightings is built using two exponential kernels reflecting long and short memory. Mathematically, the model is a coupled system of four stochastic differential equations. Our main result is the wellposedness of this system: the model has a unique strong (non-explosive) solution for all parameter values. We also study the positivity of the resulting volatility process and the martingale property of the associated exponential price process.

q-fin.PR↗

Estimating the Rate-Distortion Function by Wasserstein Gradient Descent

In the theory of lossy compression, the rate-distortion (R-D) function $R(D)$ describes how much a data source can be compressed (in bit-rate) at any given level of fidelity (distortion). Obtaining $R(D)$ for a given data source establishes the fundamental performance limit for all compression algorithms. We propose a new method to estimate $R(D)$ from the perspective of optimal transport. Unlike the classic Blahut--Arimoto algorithm which fixes the support of the reproduction distribution in advance, our Wasserstein gradient descent algorithm learns the support of the optimal reproduction distribution by moving particles. We prove its local convergence and analyze the sample complexity of our R-D estimator based on a connection to entropic optimal transport. Experimentally, we obtain comparable or tighter bounds than state-of-the-art neural network methods on low-rate sources while requiring considerably less tuning and computation effort. We also highlight a connection to maximum-likelihood deconvolution and introduce a new class of sources that can be used as test cases with known solutions to the R-D problem.

cs.IT↗

Convergence Rates for Regularized Optimal Transport via Quantization

We study the convergence of divergence-regularized optimal transport as the regularization parameter vanishes. Sharp rates for general divergences including relative entropy or $L^{p}$ regularization, general transport costs and multi-marginal problems are obtained. A novel methodology using quantization and martingale couplings is suitable for non-compact marginals and achieves, in particular, the sharp leading-order term of entropically regularized 2-Wasserstein distance for all marginals with finite $(2+δ)$-moment.

math.OC↗

Stability of Entropic Optimal Transport and Schrödinger Bridges

We establish the stability of solutions to the entropically regularized optimal transport problem with respect to the marginals and the cost function. The result is based on the geometric notion of cyclical invariance and inspired by the use of $c$-cyclical monotonicity in classical optimal transport. As a consequence of stability, we obtain the wellposedness of the solution in this geometric sense, even when all transports have infinite cost. More generally, our results apply to a class of static Schrödinger bridge problems including entropic optimal transport.

math.OC↗

Quantitative Stability of Regularized Optimal Transport and Convergence of Sinkhorn's Algorithm

We study the stability of entropically regularized optimal transport with respect to the marginals. Lipschitz continuity of the value and Hölder continuity of the optimal coupling in $p$-Wasserstein distance are obtained under general conditions including quadratic costs and unbounded marginals. The results for the value extend to regularization by an arbitrary divergence. As an application, we show convergence of Sinkhorn's algorithm in Wasserstein sense, including for quadratic cost. Two techniques are presented: The first compares an optimal coupling with its so-called shadow, a coupling induced on other marginals by an explicit construction. The second transforms one set of marginals by a change of coordinates and thus reduces the comparison of differing marginals to the comparison of differing cost functions under the same marginals.

math.OC↗

Martingale Schrödinger Bridges and Optimal Semistatic Portfolios

In a two-period financial market where a stock is traded dynamically and European options at maturity are traded statically, we study the so-called martingale Schrödinger bridge Q*; that is, the minimal-entropy martingale measure among all models calibrated to option prices. This minimization is shown to be in duality with an exponential utility maximization over semistatic portfolios. Under a technical condition on the physical measure P, we show that an optimal portfolio exists and provides an explicit solution for Q*. This result overcomes the remarkable issue of non-closedness of semistatic strategies discovered by Acciaio, Larsson and Schachermayer. Specifically, we exhibit a dense subset of calibrated martingale measures with particular properties to show that the portfolio in question has a well-defined and integrable option position.

q-fin.MF↗

Limits of Semistatic Trading Strategies

We show that pointwise limits of semistatic trading strategies in discrete time are again semistatic strategies. The analysis is carried out in full generality for a two-period model, and under a probabilistic condition for multi-period, multi-stock models. Our result contrasts with a counterexample of Acciaio, Larsson and Schachermayer, and shows that their observation is due to a failure of integrability rather than instability of the semistatic form. Mathematically, our results relate to the decomposability of functions as studied in the context of Schrödinger bridges.

q-fin.MF↗

Climate Change Adaptation under Heterogeneous Beliefs

We study strategic interactions between firms with heterogeneous beliefs about future climate impacts. To that end, we propose a Cournot-type equilibrium model where firms choose mitigation efforts and production quantities such as to maximize the expected profits under their subjective beliefs. It is shown that optimal mitigation efforts are increased by the presence of uncertainty and act as substitutes; i.e., one firm's lack of mitigation incentivizes others to act more decidedly, and vice versa.

math.OC↗

Stability of Schrödinger Potentials and Convergence of Sinkhorn's Algorithm

We study the stability of entropically regularized optimal transport with respect to the marginals. Given marginals converging weakly, we establish a strong convergence for the Schrödinger potentials describing the density of the optimal couplings. When the marginals converge in total variation, the optimal couplings also converge in total variation. This is applied to show that Sinkhorn's algorithm converges in total variation when costs are quadratic and marginals are subgaussian, or more generally for all continuous costs satisfying an integrability condition.

math.PR↗

Entropic Optimal Transport: Geometry and Large Deviations

We study the convergence of entropically regularized optimal transport to optimal transport. The main result is concerned with the convergence of the associated optimizers and takes the form of a large deviations principle quantifying the local exponential convergence rate as the regularization parameter vanishes. The exact rate function is determined in a general setting and linked to the Kantorovich potential of optimal transport. Our arguments are based on the geometry of the optimizers and inspired by the use of $c$-cyclical monotonicity in classical transport theory. The results can also be phrased in terms of Schrödinger bridges.

math.OC↗