arXiv subjects

Yifeng Chu

Publications and source records attributed to Yifeng Chu.

5 recordsLinked to original sources

arXiv2026

Upper and Lower Bounds on Expected Soft Maxima of Gaussian Processes

We obtain upper and lower bounds for "smoothed" versions of the expected supremum of centered Gaussian processes with finite or countable index sets. These so-called soft maxima are computed in terms of expected values of random Gibbs averages at inverse temperature $\beta > 0$ and reduce to expected suprema in the zero-temperature limit $\beta \to \infty$. Our analysis builds on ideas from statistical physics and information theory, and relies crucially on the tensorization technique introduced recently by Liu (2025). The bounds retain the same multiscale structure as in the expressions for the expected supremum derived using the method of generic chaining, with a truncation term governed by the inverse temperature $\beta$. In the zero-temperature limit, we recover the majorizing measure theorem. As an illustrative example, we apply our results to the analysis of the quenched free energy in the Sherrington-Kirkpatrick model and obtain a Parisi formula in the finite system size setting.

math.PR↗

arXiv2025

Talagrand Meets Talagrand: Upper and Lower Bounds on Expected Soft Maxima of Gaussian Processes with Finite Index Sets

Analysis of extremal behavior of stochastic processes is a key ingredient in a wide variety of applications, including probability, statistical physics, theoretical computer science, and learning theory. In this paper, we consider centered Gaussian processes on finite index sets and investigate expected values of their smoothed, or ``soft,'' maxima. We obtain upper and lower bounds for these expected values using a combination of ideas from statistical physics (the Gibbs variational principle for the equilibrium free energy and replica-symmetric representations of Gibbs averages) and from probability theory (Sudakov minoration). These bounds are parametrized by an inverse temperature $\beta > 0$ and reduce to the usual Gaussian maximal inequalities in the zero-temperature limit $\beta \to \infty$. We provide an illustration of our methods in the context of the Random Energy Model, one of the simplest models of physical systems with random disorder.

math.PR↗

arXiv2023

A unified framework for information-theoretic generalization bounds

This paper presents a general methodology for deriving information-theoretic generalization bounds for learning algorithms. The main technical tool is a probabilistic decorrelation lemma based on a change of measure and a relaxation of Young's inequality in $L_{ψ_p}$ Orlicz spaces. Using the decorrelation lemma in combination with other techniques, such as symmetrization, couplings, and chaining in the space of probability measures, we obtain new upper bounds on the generalization error, both in expectation and in high probability, and recover as special cases many of the existing generalization bounds, including the ones based on mutual information, conditional mutual information, stochastic chaining, and PAC-Bayes inequalities. In addition, the Fernique-Talagrand upper bound on the expected supremum of a subgaussian process emerges as a special case.

cs.LG↗

arXiv2023

Majorizing Measures, Codes, and Information

The majorizing measure theorem of Fernique and Talagrand is a fundamental result in the theory of random processes. It relates the boundedness of random processes indexed by elements of a metric space to complexity measures arising from certain multiscale combinatorial structures, such as packing and covering trees. This paper builds on the ideas first outlined in a little-noticed preprint of Andreas Maurer to present an information-theoretic perspective on the majorizing measure theorem, according to which the boundedness of random processes is phrased in terms of the existence of efficient variable-length codes for the elements of the indexing metric space.

cs.IT↗

arXiv2023

A Chain Rule for the Expected Suprema of Bernoulli Processes

We obtain an upper bound on the expected supremum of a Bernoulli process indexed by the image of an index set under a uniformly Lipschitz function class in terms of properties of the index set and the function class, extending an earlier result of Maurer for Gaussian processes. The proof makes essential use of recent results of Bednorz and Latala on the boundedness of Bernoulli processes.

math.PR↗