Searcharxiv⌕ Search

arXiv subjects

Dario Trevisan

Publications and source records attributed to Dario Trevisan.

At least 37 records · Page 2Linked to original sources

Wide Deep Neural Networks with Gaussian Weights are Very Close to Gaussian Processes

We establish novel rates for the Gaussian approximation of random deep neural networks with Gaussian parameters (weights and biases) and Lipschitz activation functions, in the wide limit. Our bounds apply for the joint output of a network evaluated any finite input set, provided a certain non-degeneracy condition of the infinite-width covariances holds. We demonstrate that the distance between the network output and the corresponding Gaussian approximation scales inversely with the width of the network, exhibiting faster convergence than the naive heuristic suggested by the central limit theorem. We also apply our bounds to obtain theoretical approximations for the exact Bayesian posterior distribution of the network, when the likelihood is a bounded Lipschitz function of the network output evaluated on a (finite) training set. This includes popular cases such as the Gaussian likelihood, i.e. exponential of minus the mean squared error.

math.ST↗

Quantitative Gaussian Approximation of Randomly Initialized Deep Neural Networks

Given any deep fully connected neural network, initialized with random Gaussian parameters, we bound from above the quadratic Wasserstein distance between its output distribution and a suitable Gaussian process. Our explicit inequalities indicate how the hidden and output layers sizes affect the Gaussian behaviour of the network and quantitatively recover the distributional convergence results in the wide limit, i.e., if all the hidden layers sizes become large.

cs.LG↗

Boundedness of Riesz transforms on $\RCD(K, \infty)$ spaces

For $1<p<\infty$, we prove the $L^p$-boundedness of the Riesz transform operators on metric measure spaces with Riemannian Ricci curvature bounded from below, without any restriction on their dimension. This large class of spaces include e.g. that of Hilbert spaces endowed with a log-concave probability measure. As a consequence, we extend the range of the validity of the Lusin-type approximation of Sobolev by Lipschitz functions, previously obtained by L. Ambrosio, E. Bruè and the third author in the quadratic case, i.e. $p=2$. The proofs are analytic and rely on computations on an explicit Bellman function.

math.MG↗

Quantum Optimal Transport: Quantum Channels and Qubits

These notes are based on the lectures given by the second author at the School on Optimal Transport on Quantum Structures at Erdös Center in September 2022. The focus of the exposition is on two recently introduced approaches on quantum optimal transport: one based on quantum channels as generalized transport plans, the other based on the notion of Hamming-Wasserstein distance of order 1 on multiple-qubit systems. The material is presented in an elementary manner with a focus on the finite-dimensional setting.

math-ph↗

Optimal transport methods for combinatorial optimization over two random point sets

We investigate the minimum cost of a wide class of combinatorial optimization problems over random bipartite geometric graphs in $\mathbb{R}^d$ where the edge cost between two points is given by a $p$-th power of their Euclidean distance. This includes e.g.\ the travelling salesperson problem and the bounded degree minimum spanning tree. We establish in particular almost sure convergence, as $n$ grows, of a suitable renormalization of the random minimum cost, if the points are uniformly distributed and $d \ge 3$, $1\le p<d$. Previous results were limited to the range $p<d/2$. Our proofs are based on subadditivity methods and build upon new bounds for random instances of the Euclidean bipartite matching problem, obtained through its optimal transport relaxation and functional analytic techniques.

math.PR↗

The Wasserstein distance of order 1 for quantum spin systems on infinite lattices

We propose a generalization of the Wasserstein distance of order 1 to quantum spin systems on the lattice $\mathbb{Z}^d$, which we call specific quantum $W_1$ distance. The proposal is based on the $W_1$ distance for qudits of [De Palma et al., IEEE Trans. Inf. Theory 67, 6627 (2021)] and recovers Ornstein's $\bar{d}$-distance for the quantum states whose marginal states on any finite number of spins are diagonal in the canonical basis. We also propose a generalization of the Lipschitz constant to quantum interactions on $\mathbb{Z}^d$ and prove that such quantum Lipschitz constant and the specific quantum $W_1$ distance are mutually dual. We prove a new continuity bound for the von Neumann entropy for a finite set of quantum spins in terms of the quantum $W_1$ distance, and we apply it to prove a continuity bound for the specific von Neumann entropy in terms of the specific quantum $W_1$ distance for quantum spin systems on $\mathbb{Z}^d$. Finally, we prove that local quantum commuting interactions above a critical temperature satisfy a transportation-cost inequality, which implies the uniqueness of their Gibbs states.

math-ph↗

On the concave one-dimensional random assignment problem and Young integration theory

We investigate the one-dimensional random assignment problem in the concave case, i.e., the assignment cost is a concave power function, with exponent $0<p<1$, of the distance between $n$ source and $n$ target points, that are i.i.d. random variables with a common law on an interval. We prove that the limit of a suitable renormalization of the costs exists if the exponent $p$ is different than $1/2$. Our proof in the case $1/2<p<1$ makes use of a novel version of the Kantorovich optimal transport problem based on Young integration theory, where the difference between two measures is replaced by the weak derivative of a function with finite $q$-variation, which may be of independent interest. We also prove a similar result for the random bipartite Traveling Salesperson Problem.

math.PR↗

Infinite multidimensional scaling for metric measure spaces

For a given metric measure space $(X,d,μ)$ we consider finite samples of points, calculate the matrix of distances between them and then reconstruct the points in some finite-dimensional space using the multidimensional scaling (MDS) algorithm with this distance matrix as an input. We show that this procedure gives a natural limit as the number of points in the samples grows to infinity and the density of points approaches the measure $μ$. This limit can be viewed as "infinite MDS" embedding of the original space, now not anymore into a finite-dimensional space but rather into an infinitedimensional Hilbert space. We further show that this embedding is stable with respect to the natural convergence of metric measure spaces. However, contrary to what is usually believed in applications, we show that in many cases it does not preserve distances, nor is even bi-Lipschitz, but may provide snowflake (Assouad-type) embeddings of the original space to a Hilbert space (this is, for instance, the case of a sphere and a flat torus equipped with their geodesic distances).

math.MG↗

Wasserstein Asymptotics for the Empirical Measure of Fractional Brownian Motion on a Flat Torus

We establish asymptotic upper and lower bounds for the Wasserstein distance of any order $p\ge 1$ between the empirical measure of a fractional Brownian motion on a flat torus and the uniform Lebesgue measure. Our inequalities reveal an interesting interaction between the Hurst index $H$ and the dimension $d$ of the state space, with a "phase-transition" in the rates when $d=2+1/H$, akin to the Ajtai-Komlós-Tusnády theorem for the optimal matching of i.i.d. points in two-dimensions. Our proof couples PDE's and probabilistic techniques, and also yields a similar result for discrete-time approximations of the process, as well as a lower bound for the same problem on $\mathbb{R}^d$.

math.PR↗

The Quantum Wasserstein Distance of Order 1

We propose a generalization of the Wasserstein distance of order 1 to the quantum states of $n$ qudits. The proposal recovers the Hamming distance for the vectors of the canonical basis, and more generally the classical Wasserstein distance for quantum states diagonal in the canonical basis. The proposed distance is invariant with respect to permutations of the qudits and unitary operations acting on one qudit and is additive with respect to the tensor product. Our main result is a continuity bound for the von Neumann entropy with respect to the proposed distance, which significantly strengthens the best continuity bound with respect to the trace distance. We also propose a generalization of the Lipschitz constant to quantum observables. The notion of quantum Lipschitz constant allows us to compute the proposed distance with a semidefinite program. We prove a quantum version of Marton's transportation inequality and a quantum Gaussian concentration inequality for the spectrum of quantum Lipschitz observables. Moreover, we derive bounds on the contraction coefficients of shallow quantum circuits and of the tensor product of one-qudit quantum channels with respect to the proposed distance. We discuss other possible applications in quantum machine learning, quantum Shannon theory, and quantum many-body systems.

quant-ph↗

On exterior differential systems involving differentials of Hölder functions

We study the validity of an extension of Frobenius theorem on integral manifolds for some classes of Pfaff-type systems of partial differential equations involving multidimensional "rough" signals, i.e. "differentials" of given Hölder continuous functions interpreted in a suitable way, similarly to Young Differential Equations in Rough Paths theory. This can be seen as a tool to study solvability of exterior differential systems involving rough differential forms, i.e. the forms involving weak (distributional) derivatives of highly irregular (e.g. Hölder continuous) functions; the solutions (integral manifolds) being also some very weakly regular geometric structures.

math.AP↗

On the quadratic random matching problem in two-dimensional domains

We investigate the average minimum cost of a bipartite matching, with respect to the squared Euclidean distance, between two samples of n i.i.d. random points on a bounded Lipschitz domain in the Euclidean plane, whose common law is absolutely continuous with strictly positive H{ö}lder continuous density. We confirm in particular the validity of a conjecture by D. Benedetto and E. Caglioti stating that the asymptotic cost as n grows is given by the logarithm of n multiplied by an explicit constant times the volume of the domain. Our proof relies on a reduction to the optimal transport problem between the associated empirical measures and a Whitney-type decomposition of the domain, together with suitable upper and lower bounds for local and global contributions, both ultimately based on PDE tools. We further show how to extend our results to more general settings, including Riemannian manifolds, and also give an application to the asymptotic cost of the random quadratic bipartite travelling salesperson problem.

math.AP↗

On Minimum Spanning Trees for Random Euclidean Bipartite Graphs

We consider the minimum spanning tree problem on a weighted complete bipartite graph $K_{n_R, n_B}$ whose $n=n_R+n_B$ vertices are random, i.i.d. uniformly distributed points in the unit cube in $d$ dimensions and edge weights are the $p$-th power of their Euclidean distance, with $p>0$. In the large $n$ limit with $n_R/n \to α_R$ and $0<α_R<1$, we show that the maximum vertex degree of the tree grows logarithmically, in contrast with the classical, non-bipartite, case, where a uniform bound holds depending on $d$ only. Despite this difference, for $p<d$, we are able to prove that the total edge costs normalized by the rate $n^{1-p/d}$ converge to a limiting constant that can be represented as a series of integrals, thus extending a classical result of Avram and Bertsimas to the bipartite case and confirming a conjecture of Riva, Caracciolo and Malatesta.

math.PR↗

Quantum optimal transport with quantum channels

We propose a new generalization to quantum states of the Wasserstein distance, which is a fundamental distance between probability distributions given by the minimization of a transport cost. Our proposal is the first where the transport plans between quantum states are in natural correspondence with quantum channels, such that the transport can be interpreted as a physical operation on the system. Our main result is the proof of a modified triangle inequality for our transport distance. We also prove that the distance between a quantum state and itself is intimately connected with the Wigner-Yanase metric on the manifold of quantum states. We then specialize to quantum Gaussian systems, which provide the mathematical model for the electromagnetic radiation in the quantum regime. We prove that the noiseless quantum Gaussian attenuators and amplifiers are the optimal transport plans between thermal quantum Gaussian states, and that our distance recovers the classical Wasserstein distance in the semiclassical limit.

math-ph↗

Convergence of asymptotic costs for random Euclidean matching problems

We investigate the average minimum cost of a bipartite matching between two samples of n independent random points uniformly distributed on a unit cube in d $\ge$ 3 dimensions, where the matching cost between two points is given by any power p $\ge$ 1 of their Euclidean distance. As n grows, we prove convergence, after a suitable renormalization, towards a finite and positive constant. We also consider the analogous problem of optimal transport between n points and the uniform measure. The proofs combine sub-additivity inequalities with a PDE ansatz similar to the one proposed in the context of the matching problem in two dimensions and later extended to obtain upper bounds in higher dimensions.

math.AP↗

Lie brackets of nonsmooth vector fields and commutation of their flows

It is well-known that the flows generated by two smooth vector fields commute, if the Lie bracket of these vector fields vanishes. This assertion is known to extend to Lipschitz continuous vector fields, up to interpreting the vanishing of their Lie bracket in the sense of almost everywhere equality. We show that this cannot be extended to general a.e. differentiable vector fields admitting a.e. unique flows. We show however that the extension holds when one field is Lipschitz continuous and the other one is merely Sobolev regular (but admitting a regular Lagrangian flow).

math.FA↗

Towards geometric integration of rough differential forms

We provide a draft of a theory of geometric integration of rough differential forms which are generalizations of classical (smooth) differential forms to similar objects with very low regularity, for instance, involving Hölder continuous functions that may be nowhere differentiable. Borrowing ideas from the theory of rough paths, we show that such a geometric integration can be constructed substituting appropriately differentials with more general asymptotic expansions. This can be seen as the basis of geometric integration similar to that used in geometric measure theory, but without any underlying differentiable structure, thus allowing Lipschitz functions and rectifiable sets to be substituted by far less regular objects (e.g. Hölder functions and their images which may be purely unrectifiable). Our construction includes both the one-dimensional Young integral and multidimensional integrals introduced recently by R. Züst. To simplify the exposition, we limit ourselves to integration of forms of dimensions not exceeding two.

math.DG↗

Integration of nonsmooth $\boldsymbol{2}$-forms: from Young to Itô and Stratonovich

We show that geometric integrals of the type $\int_Ωf\, d g^1\wedge \, d g^2$ can be defined over a two-dimensional domain $Ω$ when the functions $f$, $g^1$, $g^2\colon \mathbb{R}^2\to \mathbb{R}$ are just Hölder continuous with sufficiently large Hölder exponents and the boundary of $Ω$ has sufficiently small dimension, by summing over a refining sequence of partitions the discrete Stratonovich or Itô type terms. This leads to a two-dimensional extension of the classical Young integral that coincides with the integral introduced recently by R.~Züst. We further show that the Stratonovich-type summation allows to weaken the requirements on Hölder exponents of the map $g=(g^1,g^2)$ when $f(x)=F(x,g(x))$ with $F$ sufficiently regular. The technique relies upon an extension of the sewing lemma from Rough paths theory to alternating functions of two-dimensional oriented simplices, also proven in the paper.

math.FA↗