Searcharxiv⌕ Search

arXiv subjects

Tâm LeMinh

Publications and source records attributed to Tâm LeMinh.

3 recordsLinked to original sources

Uniform inference for $U$-statistics of exchangeable arrays under degeneracy

Many $U$-statistics of row-column exchangeable arrays become degenerate at natural null hypotheses: their convergence rates change and their limiting laws may or may not remain Gaussian. We establish conditions under which inference based on the classical unbiased variance estimator is uniformly valid across these changes, without knowledge of the degeneracy order. It is known that $U$-statistics can be decomposed into orthogonal projections indexed by bipartite graphs. Under uniform fourth-moment assumptions, we establish that the standardized statistic is asymptotically Gaussian and the classical unbiased variance estimator is ratio-consistent, as long as a certain measure of concentration for projections indexed by disconnected graphs tends to zero. Under compactness of the normalized projections, both properties hold if and only if the proportion of variance contributed by disconnected graphs tends to zero. The necessity of this condition follows from a general limit theorem for these $U$-statistics, in which each graph contributes to a Wiener chaos of order equal to its number of connected components. We note that the row-column jackknife variance estimator, although nonnegative, does not generally give a studentized statistic with a standard normal limit in degenerate regimes. We illustrate our theory with an application to estimation and testing based on a distance from product form, exhibiting Gaussian and non-Gaussian limits at various rates depending on the model. We also propose a conservative inference procedure that does not require a Gaussian limit, valid under additional moment and projection conditions.

math.ST↗

A variational framework for modal estimation

Multivariate mode estimation arises in many statistical problems such as inverse problems, multimodal sampling, and density-based clustering, but becomes challenging in moderate to high dimensions, especially when the underlying density is not directly evaluable. We introduce GERVE (Gibbs-measure Entropy-Regularized Variational Estimation), a sample-based method for estimating multivariate modes by approximating Gibbs distributions directly from samples, without estimating or evaluating the density. GERVE uses Gaussian-mixture variational annealing and natural-gradient optimization, producing a mixture concentrated in high-density regions whose component responsibilities also provide a clustering of the observations. We prove theoretical guarantees in two regimes: as the Gibbs temperature goes to zero, the optimal variational mixture concentrates around the global modes of the population density; at fixed positive temperature, we prove existence, consistency, and asymptotic normality of empirical maximizers and propose a bootstrap procedure for uncertainty quantification. Simulations and a real-data experiment show that GERVE accurately recovers modes and produces meaningful clusters.

stat.ME↗

Natural Variational Annealing for Multimodal Optimization

We introduce a new multimodal optimization approach called Natural Variational Annealing (NVA) that combines the strengths of three foundational concepts to simultaneously search for multiple global and local modes of black-box nonconvex objectives. First, it implements a simultaneous search by using variational posteriors, such as, mixtures of Gaussians. Second, it applies annealing to gradually trade off exploration for exploitation. Finally, it learns the variational search distribution using natural-gradient learning where updates resemble well-known and easy-to-implement algorithms. The three concepts come together in NVA giving rise to new algorithms and also allowing us to incorporate "fitness shaping", a core concept from evolutionary algorithms. We assess the quality of search on simulations and compare them to methods using gradient descent and evolution strategies. We also provide an application to a real-world inverse problem in planetary science.

stat.ML↗