arXiv subjects

Garrett G. Wen

Publications and source records attributed to Garrett G. Wen.

5 recordsLinked to original sources

arXiv2026

The sharp SAT/UNSAT phase transition in random ellipsoid fitting

Let $x_1,\ldots,x_n$ be independent standard Gaussian vectors in $\mathbb{R}^d$. An \emph{ellipsoid fit} is a matrix $S \succeq 0$ such that $x_i^\top S x_i =d$ for every $i$, so that all the points lie on the boundary of the centered ellipsoid $\{ x : x^\top S x = d\}$. Saunderson, Parrilo and Willsky conjectured that, as $n,d \to \infty$, this semidefinite feasibility problem undergoes a sharp transition at $n \sim d^2/4$. We prove this conjecture. If $\lim \sup n/d^2 = α^* <1/4$, then, with probability tending to one, an ellipsoid fit exists; moreover, one can choose $S$ with all eigenvalues in a fixed interval $[λ_- , λ_+] \subset (0,\infty)$ depending only on $α^*$. Conversely, if $\lim \inf n/d^2 > 1/4$, then, with probability tending to one, no ellipsoid fit exists, without any spectral restriction. Our proof builds on the Gaussian-equivalence framework developed by Bandeira and Maillard (2025) and closes the two gaps left open in their work: establishing exact fitting and removing the operator-norm constraint. On the satisfiable side, the new ingredients are a head-tail decomposition of the dual vector, exact correction of the sparse head constraints, and a Gaussian comparison principle for the low-influence tail. On the unsatisfiable side, we split a candidate into a low-rank spectral head and a Schatten-3 diffuse bulk, Gaussianize the bulk conditionally on the head, and apply a projected Gordon escape argument. The threshold is governed by the statistical dimension $d(d+1)/4$ of the positive semidefinite cone.

math.PR↗

arXiv2026

Dynamical mean-field limit and replica-symmetric free energy for the orthogonally-invariant SK model

We study a class of diffusion processes on $\mathbb{R}^n$ interacting through a symmetric matrix $X\in\mathbb{R}^{n\times n}$. When eigenvectors of $X$ are Haar-uniform on the orthogonal group, we derive a dynamical mean-field limit for the empirical law of sample paths, extending the classical Sompolinsky--Zippelius characterization for $X\sim\mathrm{GOE}$. The limit takes the form of a generalized Langevin equation with correlated Gaussian noise and memory, whose correlation and response kernels relate to those of the original dynamics through convolution equations involving the free cumulants of the eigenvalue distribution of $X$. For the overdamped Langevin diffusion associated with $μ(\boldsymbolθ)\propto \exp\!\big(\frac12\boldsymbolθ^{\top}X\boldsymbolθ\big)\prod_{i=1}^nν(\mathrm{d}θ_i)$, we analyze the mean-field limit under a rapid-mixing assumption. The correlation and response kernels admit time-translation-invariant approximants satisfying a fluctuation-dissipation relation. The generalized Langevin equation admits a Markovian approximation coupled to an auxiliary multivariate OU process and converges to a replica-symmetric prediction for the empirical coordinate law under $μ$. This auxiliary correlation structure is characterized through the infinitesimal generator of a Markov semigroup for the lifted path-history process. Consequently, the free energy converges to a replica-symmetric limit under an explicit high-temperature condition, which for an Ising model is $\|X\|_{\mathrm{op}}<1/2$. By recent dynamical universality results, the same free-energy characterization holds for deterministic models without random disorder when $X$ satisfies a set of deterministic delocalization conditions.

math.PR↗

arXiv2026

Recommending Best Paper Awards for ML/AI Conferences via the Isotonic Mechanism

Machine learning and artificial intelligence conferences such as NeurIPS and ICML now regularly receive tens of thousands of submissions, posing significant challenges to maintaining the quality and consistency of the peer review process. This challenge is particularly acute for best paper awards, which are an important part of the peer review process, yet whose selection has increasingly become a subject of debate in recent years. In this paper, we introduce an author-assisted mechanism to facilitate the selection of best paper awards. Our method employs the Isotonic Mechanism for eliciting authors' assessments of their own submissions in the form of a ranking, which is subsequently utilized to adjust the raw review scores for optimal estimation of the submissions' ground-truth quality. We demonstrate that authors are incentivized to report truthfully when their utility is a convex additive function of the adjusted scores, and we validate this convexity assumption for best paper awards using publicly accessible review data of ICLR from 2019 to 2023 and NeurIPS from 2021 to 2023. Crucially, in the special case where an author has a single quota -- that is, may nominate only one paper -- we prove that truthfulness holds even when the utility function is merely nondecreasing and additive. This finding represents a substantial relaxation of the assumptions required in prior work. For practical implementation, we extend our mechanism to accommodate the common scenario of overlapping authorship. Finally, simulation results demonstrate that our mechanism significantly improves the quality of papers selected for awards.

cs.LG↗

arXiv2025

When does Gaussian equivalence fail and how to fix it: Non-universal behavior of random features with quadratic scaling

A major effort in modern high-dimensional statistics has been devoted to the analysis of linear predictors trained on nonlinear feature embeddings via empirical risk minimization (ERM). Gaussian equivalence theory (GET) has emerged as a powerful universality principle in this context: it states that the behavior of high-dimensional, complex features can be captured by Gaussian surrogates, which are more amenable to analysis. Despite its remarkable successes, numerical experiments show that this equivalence can fail even for simple embeddings -- such as polynomial maps -- under general scaling regimes. We investigate this breakdown in the setting of random feature (RF) models in the quadratic scaling regime, where both the number of features and the sample size grow quadratically with the data dimension. We show that when the target function depends on a low-dimensional projection of the data, such as generalized linear models, GET yields incorrect predictions. To capture the correct asymptotics, we introduce a Conditional Gaussian Equivalent (CGE) model, which can be viewed as appending a low-dimensional non-Gaussian component to an otherwise high-dimensional Gaussian model. This hybrid model retains the tractability of the Gaussian framework and accurately describes RF models in the quadratic scaling regime. We derive sharp asymptotics for the training and test errors in this setting, which continue to agree with numerical simulations even when GET fails. Our analysis combines general results on CLT for Wiener chaos expansions and a careful two-phase Lindeberg swapping argument. Beyond RF models and quadratic scaling, our work hints at a rich landscape of universality phenomena in high-dimensional ERM.

math.ST↗

arXiv2025

Optimal Detection for Language Watermarks with Pseudorandom Collision

Text watermarking plays a crucial role in ensuring the traceability and accountability of large language model (LLM) outputs and mitigating misuse. While promising, most existing methods assume perfect pseudorandomness. In practice, repetition in generated text induces collisions that create structured dependence, compromising Type I error control and invalidating standard analyses. We introduce a statistical framework that captures this structure through a hierarchical two-layer partition. At its core is the concept of minimal units -- the smallest groups treatable as independent across units while permitting dependence within. Using minimal units, we define a non-asymptotic efficiency measure and cast watermark detection as a minimax hypothesis testing problem. Applied to Gumbel-max and inverse-transform watermarks, our framework produces closed-form optimal rules. It explains why discarding repeated statistics often improves performance and shows that within-unit dependence must be addressed unless degenerate. Both theory and experiments confirm improved detection power with rigorous Type I error control. These results provide the first principled foundation for watermark detection under imperfect pseudorandomness, offering both theoretical insight and practical guidance for reliable tracing of model outputs.

math.ST↗