SearcharxivSearch

arXiv subjects

Vaios Laschos

Publications and source records attributed to Vaios Laschos.

14 recordsLinked to original sources

In-context learning to predict critical transitions in dynamical systems

Critical transitions - abrupt, often irreversible changes in system dynamics - arise across human and natural systems, often with catastrophic consequences. Real-world observations of such shifts remain scarce, preventing the development of reliable early warning systems. Conventional statistical and spectral indicators, such as increasing variance, tend to fail under realistic conditions of limited data and correlated noise, whereas existing deep learning classifiers do not extrapolate beyond their training data distribution. In this work, we introduce TipPFN, an in-context learning (ICL) framework that uses a prior-data fitted network to infer a system's proximity to a critical transition. Trained on our novel synthetic data generator, which is based on canonical bifurcation scenarios coupled to diverse, randomized stochastic dynamics, TipPFN flexibly capitalizes on contexts of various sizes, complexity and dimensionalities. We demonstrate robust, state-of-the-art early detection of critical transitions in previously unseen tipping regimes, sim-to-real examples, and real-world observations in both ICL and zero-shot settings.

cs.LG

Talagrand-type transport inequalities for path spaces over Carnot groups

We consider Talagrand-type transportation inequalities for the law of Brownian motion on Carnot groups. An important example is the lift of standard Brownian motion to the Brownian rough path. We present a direct proof on enhanced path space, which also yields equality when restricting to adapted couplings in the transport problem. Moreover, we prove a Talagrand inequality for the heat kernel measure on Carnot groups and deduce the inequality for the law of Brownian motion on Carnot groups via a bottom-up argument. Our study of this enhanced Wiener measure contributes to a longstanding programme to extend key properties of Wiener measure to the non-commutative setting of the enhanced Wiener measure, which is of central importance in Lyons' rough path theory. With a non-commutative sub-Riemannian state space, we observe phenomena that differ from the Euclidean case. In particular, while a top-down projection argument recovers Talagrand's inequality on Euclidean space from the corresponding inequality on the path space, such a projection argument breaks down in the Carnot group setting. We further study a Riemannian approximation of the Heisenberg group, in which case the failure of the top-down projection can be partially overcome. Finally, we show that the cost function used in the Talagrand inequality is a natural choice, in that it arises as a limit of discretised costs in the sense of $Γ$-convergence.

math.PR

Universal Neural Optimal Transport

Optimal Transport (OT) problems are a cornerstone of many applications, but solving them is computationally expensive. To address this problem, we propose UNOT (Universal Neural Optimal Transport), a novel framework capable of accurately predicting (entropic) OT distances and plans between discrete measures for a given cost function. UNOT builds on Fourier Neural Operators, a universal class of neural networks that map between function spaces and that are discretization-invariant, which enables our network to process measures of variable resolutions. The network is trained adversarially using a second, generating network and a self-supervised bootstrapping loss. We ground UNOT in an extensive theoretical framework. Through experiments on Euclidean and non-Euclidean domains, we show that our network not only accurately predicts OT distances and plans across a wide range of datasets, but also captures the geometry of the Wasserstein space correctly. Furthermore, we show that our network can be used as a state-of-the-art initialization for the Sinkhorn algorithm with speedups of up to $7.4\times$, significantly outperforming existing approaches.

cs.LG

Evolutionary Variational Inequalities on the Hellinger-Kantorovich and Spherical Hellinger-Kantorovich spaces

We study the minimizing movement scheme for families of geodesically semi-convex functionals defined on either the Hellinger-Kantorovich or the Spherical Hellinger-Kantorovich space. By exploiting some of the finer geometric properties of those spaces, we prove that the sequence of curves, which are produced by geodesically interpolating the points generated by the minimizing movement scheme, converges to curves that satisfy the Evolutionary Variational Inequality (EVI), when the time step goes to 0.

math.AP

Risk-Sensitive Partially Observable Markov Decision Processes as Fully Observable Multivariate Utility Optimization problems

We provide a new algorithm for solving Risk Sensitive Partially Observable Markov Decisions Processes, when the risk is modeled by a utility function, and both the state space and the space of observations is finite. This algorithm is based on an observation that the change of measure and the subsequent introduction of the information space that is used for exponential utility functions, can be actually extended for sums of exponentials if one introduces an extra vector parameter that tracks the "expected accumulated cost" that corresponds to each exponential. Since every increasing function can be approximated by sums of exponentials in finite intervals, the method can be essentially applied for any utility function, with its complexity depending on the number of exponentials.

math.OC

Training Generative Networks with general Optimal Transport distances

We propose a new algorithm that uses an auxiliary neural network to express the potential of the optimal transport map between two data distributions. In the sequel, we use the aforementioned map to train generative networks. Unlike WGANs, where the Euclidean distance is ${\it implicitly}$ used, this new method allows to ${\it explicitly}$ use ${\it any}$ transportation cost function that can be chosen to match the problem at hand. For example, it allows to use the squared distance as a transportation cost function, giving rise to the Wasserstein-2 metric for probability distributions, which results in fast and stable gradient descends. It also allows to use image centered distances, like the structure similarity index, with notable differences in the results.

cs.LG

Large deviations for configurations generated by Gibbs distributions with energy functionals consisting of singular interaction and weakly confining potentials

We establish large deviation principles (LDPs) for empirical measures associated with a sequence of Gibbs distributions on $n$-particle configurations, each of which is defined in terms of an inverse temperature $% β_n$ and an energy functional consisting of a (possibly singular) interaction potential and a (possibly weakly) confining potential. Under fairly general assumptions on the potentials, we use a common framework to establish LDPs both with speeds $β_n/n \rightarrow \infty$, in which case the rate function is expressed in terms of a functional involving the potentials, and with speed $β_n =n$, when the rate function contains an additional entropic term. Such LDPs are motivated by questions arising in random matrix theory, sampling, simulated annealing and asymptotic convex geometry. Our approach, which uses the weak convergence method developed by Dupuis and Ellis, establishes LDPs with respect to stronger Wasserstein-type topologies. Our results address several interesting examples not covered by previous works, including the case of a weakly confining potential, which allows for rate functions with minimizers that do not have compact support, thus resolving several open questions raised in a work of Chafa\"ı et al.

math.PR

A Fenchel-Moreau-Rockafellar type theorem on the Kantorovich-Wasserstein space with Applications in Partially Observable Markov Decision Processes

By using the fact that the space of all probability measures with finite support can be somehow completed in two different fashions, one generating the Arens-Eells space and another generating the Kantorovich-Wasserstein (Wasserstein-1) space, and by exploiting the duality relationship between the Arens-Eells space with the space of Lipschitz functions, we provide a dual representation of Fenchel-Moreau-Rockafellar type for proper convex functionals on Wasserstein-1. We retrieve dual transportation inequalities as a Corollary and we provide examples where the theorem can be used to easily prove dual expressions like the celebrated Donsker-Varadhan variational formula. Finally our result allows to write convex functions as the supremum over all linear functions that are generated by roots of its conjugate dual, something that we apply to the field of Partially observable Markov decision processes (POMDPs) to approximate the value function of a given POMDP by iterating level sets. This extends the method used in Smallwood 1973 for finite state spaces to the case were the state space is a Polish metric space.

math.PR

Exit Time Risk-Sensitive Control for Systems of Cooperative Agents

We study sequences, parametrized by the number of agents, of many agent exit time stochastic control problems with risk-sensitive cost structure. We identify a fully characterizing assumption, under which each of such control problem corresponds to a risk-neutral stochastic control problem with additive cost, and sequentially to a risk-neutral stochastic control problem on the simplex, where the specific information about the state of each agent can be discarded. We also prove that, under some additional assumptions, the sequence of value functions converges to the value function of a deterministic control problem, which can be used for the design of nearly optimal controls for the original problem, when the number of agents is sufficiently large.

math.OC

Geometric properties of cones with applications on the Hellinger-Kantorovich space, and a new distance on the space of probability measures

We study general geometric properties of cone spaces, and we apply them on the Hellinger--Kantorovich space $(\mathcal{M}(X),\mathsf{H\hspace{-0.25em} K}_{α,β}).$ We exploit a two-parameter scaling property of the Hellinger-Kantorovich metric $ \mathsf{H\hspace{-0.25em} K}_{α,β},$ and we prove the existence of a distance $\mathsf{S\hspace{-0.18em} H\hspace{-0.25em} K}_{α,β}$ on the space of Probability measures that turns the Hellinger--Kantorovich space $(\mathcal{M}(X),\mathsf{H\hspace{-0.25em} K}_{α,β})$ into a cone space over the space of probabilities measures $(\mathcal{P}(X),\mathsf{S\hspace{-0.18em} H\hspace{-0.25em} K}_{α,β}).$ We provide a two parameter rescaling of geodesics in $(\mathcal{M}(X),\mathsf{H\hspace{-0.25em} K}_{α,β}),$ and for $(\mathcal{P}(X),\mathsf{S\hspace{-0.18em} H\hspace{-0.25em} K}_{α,β})$ we obtain a full characterization of the geodesics. We finally prove finer geometric properties, including local-angle condition and partial $K$-semiconcavity of the squared distances, that will be used in a future paper to prove existence of gradient flows on both spaces.

math.MG

Gradient flow structure for McKean-Vlasov equations on discrete spaces

In this work, we show that a family of non-linear mean-field equations on discrete spaces can be viewed as a gradient flow of a natural free energy functional with respect to a certain metric structure we make explicit. We also prove that this gradient flow structure arises as the limit of the gradient flow structures of a natural sequence of N-particle dynamics, as N goes to infinity.

math.PR

On a conjecture regarding the upper graph box dimension of bounded subsets of the real line

Let X \subset R be a bounded set; we introduce a formula that calculates the upper graph box dimension of X (i.e.the supremum of the upper box dimension of the graph over all uniformly continuous functions defined on X). We demonstrate the strength of the formula by calculating the upper graph box dimension for some sets and by giving an "one line" proof, alternative to the one given in [1], of the fact that if X has finitely many isolated points then its upper graph box dimension is equal to the upper box dimension plus one. Furthermore we construct a collection of sets X with infinitely many isolated points, having upper box dimension a taking values from zero to one while their graph box dimension takes any value in [max{2a,1},a + 1], answering this way, negatively to a conjecture posed in [1].

math.CA

Relations between $\mathcal{L}^p$- and Pointwise Convergence of Families of Functions Indexed by the Unit Interval

We construct a variety of mappings of the unit interval into $\mathcal{L}^p([0,1])$ to generalize classical examples of $\mathcal{L}^p$-convergence of sequences of functions with simultaneous pointwise divergence. By establishing relations between the regularity of the functions in the image of the mappings and the topology of $[0,1]$, we obtain examples which are $\mathcal{L}^p$-continuous but exhibit discontinuity in a pointwise sense to different degrees. We conclude by proving an Egorov-type theorem, namely that if almost every function in the image is continuous, then we can remove a set of arbitrarily small measure from the index set $[0,1]$ and establish pointwise limits for all functions in the remaining image.

math.CA

Wasserstein gradient flows from large deviations of thermodynamic limits

We study the Fokker-Planck equation as the hydrodynamic limit of a stochastic particle system on one hand and as a Wasserstein gradient flow on the other. We write the rate functional, that characterizes the large deviations from the hydrodynamic limit, in a way that the free energy appears explicitly. Next we use this formulation via the contraction principle to prove that the discreet time rate functional is asymptotically equivalent in the Gamma-convergence sense to the functional derived from the Wasserstein gradient discretization scheme.

math.AP