Searcharxiv⌕ Search

arXiv subjects

Zoltán Szabó

Publications and source records attributed to Zoltán Szabó.

At least 19 recordsLinked to original sources

Unbounded Characteristic and Universal Kernels

Kernel methods are among the most powerful tools in machine learning and statistics, with a large number of successful applications. Their immense success stems from the flexible function class associated to each kernel---its reproducing kernel Hilbert space (RKHS)---which facilitates statistical analysis, as well as from their computational tractability and applicability to many domains. Multiple notions (such as characteristic, $L_p$-universal, and integrally strictly positive definite) capture the expressivity of kernels and their RKHSs and play a key role in understanding the statistical properties of kernel methods; these concepts and their relations are well-understood for bounded kernels. Even though unbounded kernels have received significant attention over the past decade (for instance, in the construction of kernel-based discrepancy and dependence measures such as the maximum mean discrepancy, the Hilbert-Schmidt independence criterion, and the kernel Stein discrepancy), surprisingly little is known about the relations of these notions in the unbounded case. In the present paper we tackle this severe bottleneck, establishing their relations under mild assumptions.

math.ST↗

The real quotient of the Cartwright-Steger surface

Borisov and Yeung showed that the Cartwright-Steger surface $X$ is defined over ${\mathbb {Q}}$, hence complex conjugation gives an antiholomorphic involution on $X$. We show that the orbit space $Y$ is a closed oriented smooth four-manifold homeomorphic to ${\mathbb {CP}}^2\# (S^1 \times S^3)$, presenting $X$ as a double branched cover $X\to Y$, with branch locus diffeomorphic to the connected sum of three copies of the real projective plane.

math.GT↗

Small Lefschetz fibrations on the BMY line

We give explicit positive factorizations for a genus-19 Lefschetz fibration over the torus and a family of genus-4 Lefschetz fibrations over a genus-2 surface. All these examples have only three nodes, and their total spaces are symplectic 4-manifolds of general type on the Bogomolov-Miyaoka-Yau line. In the course of deriving the monodromy relation in genus 19, we obtain several interesting identities, including a factorization of a Dehn twist into a product of three order-3 mapping classes. We show that the total space of this fibration is topologically s-cobordant to the Cartwright-Steger surface, and we determine its real quotient up to homeomorphism. The genus-4 family consists of variations of the Bauer-Catanese fibrations and contains 65 isomorphism classes of Lefschetz fibrations on 45 diffeomorphism types of compact complex ball quotients. We describe their topology and that of the real quotients of the three original surfaces. The handle monodromies in our main factorizations are pseudo-Anosov, and we show more generally that for holomorphic genus-4 Lefschetz fibrations on the BMY line, this holds for every choice of handle generators.

math.GT↗

The monodromy of Xiao's genus-two fibrations in degrees 3, 4 and 5

We determine the vanishing cycles of Xiao's genus-two fibrations $X_d\to P^1$, $d=3,4,5$, whose fibers admit degree-$d$ maps to a fixed elliptic curve $E$. We tile the base $P^1$ by triangles and realize the surface $X_d$ as a degree-$d$ branched cover of $P^1\times E$. The covering description gives an explicit algorithm for the vanishing cycles. A vanishing path is recorded by the sides it crosses in the tiling; each crossing changes a labelled picture of the fiber by a local hexagon move, and the vanishing cycle is read from the terminal picture. We obtain the $7$, $13$, and $31$ vanishing cycles as explicit curves in a marked reference fiber. For $d=4,5$, these give new positive factorizations of the identity in the genus-two mapping class group, of types $(6,7)$ and $(12,19)$.

math.AG↗

Irreducible exotic ${\mathbb {CP}}^2\# 7{\overline {\mathbb {C}} {\mathbb {P}} } ^2$'s with free involutions

We construct infinitely many pairwise non-diffeomorphic irreducible smooth four-manifolds homeomorphic to ${\mathbb {CP}}^2\# 7{\overline {\mathbb {C}} {\mathbb {P}} } ^2$, each admitting a free, orientation-preserving involution. Their quotients give infinitely many irreducible definite four-manifolds with fundamental group ${\mathbb {Z}}/2 {\mathbb {Z}}$ and $b_2=3$, filling the corresponding gap in the geography of such examples. The construction of infinitely many distinct examples relies on a novel equivariant torus surgery.

math.GT↗

A polynomial formula for the Albanese map of the Cartwright-Steger surface

The Albanese fibration of the Cartwright--Steger surface is a genus-$19$ Lefschetz fibration over a torus. We give an explicit formula for it: in the projective model of Borisov and Yeung, the map is represented by three homogeneous polynomials of degree $13$ with integer coefficients, and its target is the elliptic curve $Y^2Z=X^3-3888Z^3$. A recognition theorem shows that it suffices to verify one polynomial identity on the surface. A coefficient bound allows us to establish the identity over $Q$ from computations modulo primes. We also determine exact coordinates for the three nodes and their images on the elliptic curve.

math.AG↗

Minimax Lower Bounds of Kernel Discrepancy Estimation: MMD, HSIC, KSD

Over the past 20 years, kernel discrepancies have been leveraged as a highly powerful tool for quantifying the disagreement of distributions, with numerous successful applications in two-sample, goodness-of-fit, and independence testing, among others. Their fastest estimators are known to converge at a parametric rate---$n^{-1/2}$---under mild conditions. While this rate is known to be minimax optimal on $\mathbb R^d$ under strict assumptions with bounded kernels, little is known about its optimality beyond the finite-dimensional Euclidean setting with unbounded kernels. In this work, we prove that the minimax lower bound of estimation of the most popular kernel discrepancies (maximum mean discrepancy, Hilbert-Schmidt independence criterion and kernel Stein discrepancy; MMD, HSIC, KSD) is $n^{-1/2}$ on general topological spaces, and under mild assumptions on the kernel; the same rates are shown (as corollaries) to hold for the estimation of the mean embedding and the centered cross-covariance operator. Our results settle the question of optimal estimation of these kernel discrepancies.

stat.ML↗

Nyström Kernel Stein Discrepancy Tests

Kernel Stein discrepancy (KSD) is among the most popular goodness-of-fit (GoF) measures on general domains with a large number of successful deployments. One of the main applications of KSD is in constructing powerful GoF tests. However, tests relying on the classical U-/V-statistic-based KSD estimators have two major drawbacks. (i) Their runtime scales quadratically in the number of samples. (ii) Their asymptotic null distribution is computationally intractable in most cases, typically handled by bootstrapping. While it is known that the Nyström method permits accelerating KSD estimation with no loss of statistical accuracy under mild conditions, to the best of our knowledge, the fundamental question of its impact on bootstrap-based GoF testing is open; resolving this question is the focus of the current paper. In particular, we prove that the key properties of the quadratic-time bootstrapped KSD-based GoF test (asymptotic level and local consistency) are preserved by its Nyström acceleration. We numerically demonstrate the efficiency of the accelerated KSD estimator and bootstrap in the context of GoF testing of spherical and functional data. Our numerical results show that the Nyström-accelerated method performs statistically on-par with the quadratic-time approach, while requiring substantially smaller runtime.

stat.ML↗

The Minimax Lower Bound of Kernel Stein Discrepancy Estimation

Kernel Stein discrepancies (KSDs) have emerged as a powerful tool for quantifying goodness-of-fit over the last decade, featuring numerous successful applications. To the best of our knowledge, all existing KSD estimators with known rate achieve $\sqrt n$-convergence. In this work, we present two complementary results (with different proof strategies), establishing that the minimax lower bound of KSD estimation is $n^{-1/2}$ and settling the optimality of these estimators. Our first result focuses on KSD estimation on $\mathbb R^d$ with the Langevin-Stein operator; our explicit constant for the Gaussian kernel indicates that the difficulty of KSD estimation may increase exponentially with the dimensionality $d$. Our second result settles the minimax lower bound for KSD estimation on general domains.

stat.ML↗

Kernel Integrated $R^2$: A Measure of Dependence

We introduce kernel integrated $R^2$, a new measure of statistical dependence that combines the local normalization principle of the recently introduced integrated $R^2$ with the flexibility of reproducing kernel Hilbert spaces (RKHSs). The proposed measure extends integrated $R^2$ from scalar responses to responses taking values on general spaces equipped with a characteristic kernel, allowing to measure dependence of multivariate, functional, and structured data, while remaining sensitive to tail behaviour and oscillatory dependence structures. We establish that (i) this new measure takes values in $[0,1]$, (ii) equals zero if and only if independence holds, and (iii) equals one if and only if the response is almost surely a measurable function of the covariates. Two estimators are proposed: a graph-based method using $K$-nearest neighbours and an RKHS-based method built on conditional mean embeddings. We prove consistency and derive convergence rates for the graph-based estimator, showing its adaptation to intrinsic dimensionality. Numerical experiments on simulated data and a real data experiment in the context of dependency testing for media annotations demonstrate competitive power against state-of-the-art dependence measures, particularly in settings involving non-linear and structured relationships.

stat.ML↗

Adaptive Kernel Methods

Kernel methods approximate nonlinear maps in a data-driven manner by projecting the target map onto a finite-dimensional Hilbert space called the solution space. Traditionally, this space is a subspace of a fixed ambient reproducing kernel Hilbert space (RKHS), determined solely by the chosen kernel and the dataset, whose elements identify the basis elements. Consequently, the projection operator underlying the kernel method depends on the loss function, the dataset, and the choice of ambient RKHS. In this study, we consider kernel methods whose solution spaces also depend on learnable parameters that are independent of the dataset. The resulting methods can be viewed as variable projection operators that depend on the loss function, the dataset, and the new learnable parameters instead of a fixed RKHS. This work has two main contributions. First, we propose an efficient approximation of kernels associated with infinite-dimensional RKHSs, commonly used to reduce the solution-space dimension for large datasets. Second, we construct fixed-dimensional, parameter-dependent solution spaces that enable highly efficient kernel models suitable for large-scale problems without the need to approximate kernels of infinite-dimensional RKHSs. Our novel family of adaptive kernel methods generalizes earlier approaches, including Random Fourier Features, and we demonstrate their effectiveness through several numerical experiments.

math.NA↗

Generalized rational Prony and Bernoulli methods

The generalized operator-based Prony method is an important tool for describing signals which can be written as finite linear combinations of eigenfunctions of certain linear operators. On the other hand, Bernoulli's algorithm and its generalizations can be used to recover the parameters of rational functions belonging to finite-dimensional subspaces of $H_2$ Hardy-Hilbert spaces. In this work, we discuss several results related to these methods. We discuss a rational variant of the generalized operator-based Prony method and show that in fact, any Prony problem can be treated this way. This realization establishes the connection between Prony and Bernoulli methods and allows us to address some well-known numerical pitfalls. Several numerical experiments are provided to showcase the usefulness of the introduced methods. These include problems related to the identification of time-delayed linear systems and parameter recovery problems in reproducing kernel Hilbert spaces.

math.NA↗

Nyström $M$-Hilbert-Schmidt Independence Criterion

Kernel techniques are among the most popular and powerful approaches of data science. Among the key features that make kernels ubiquitous are (i) the number of domains they have been designed for, (ii) the Hilbert structure of the function class associated to kernels facilitating their statistical analysis, and (iii) their ability to represent probability distributions without loss of information. These properties give rise to the immense success of Hilbert-Schmidt independence criterion (HSIC) which is able to capture joint independence of random variables under mild conditions, and permits closed-form estimators with quadratic computational complexity (w.r.t. the sample size). In order to alleviate the quadratic computational bottleneck in large-scale applications, multiple HSIC approximations have been proposed, however these estimators are restricted to $M=2$ random variables, do not extend naturally to the $M\ge 2$ case, and lack theoretical guarantees. In this work, we propose an alternative Nyström-based HSIC estimator which handles the $M\ge 2$ case, prove its consistency, and demonstrate its applicability in multiple contexts, including synthetic examples, dependency testing of media annotations, and causal discovery.

stat.ML↗

Kernelized Cumulants: Beyond Kernel Mean Embeddings

In $\mathbb R^d$, it is well-known that cumulants provide an alternative to moments that can achieve the same goals with numerous benefits such as lower variance estimators. In this paper we extend cumulants to reproducing kernel Hilbert spaces (RKHS) using tools from tensor algebras and show that they are computationally tractable by a kernel trick. These kernelized cumulants provide a new set of all-purpose statistics; the classical maximum mean discrepancy and Hilbert-Schmidt independence criterion arise as the degree one objects in our general construction. We argue both theoretically and empirically (on synthetic, environmental, and traffic data analysis) that going beyond degree one has several advantages and can be achieved with the same computational complexity and minimal overhead in our experiments.

stat.ML↗

Definite four-manifolds with exotic smooth structures

In this paper we study smooth structures on closed oriented 4-manifolds with fundamental group Z_2 and definite intersection form. We construct infinitely many irreducible, smooth, oriented, closed, definite four-manifolds with fundamental group Z_2 and second Betti number 1 and 2. As an application, we prove that when the second Betti number of a definite four-manifold with fundamental group Z_2 is positive and it admits a smooth structure, then it admits infinitely many smooth structures.

math.GT↗

Discussion of `Multiscale Fisher's Independence Test for Multivariate Dependence'

We discuss how MultiFIT, the Multiscale Fisher's Independence Test for Multivariate Dependence proposed by Gorsky and Ma (2022), compares to existing linear-time kernel tests based on the Hilbert-Schmidt independence criterion (HSIC). We highlight the fact that the levels of the kernel tests at any finite sample size can be controlled exactly, as it is the case with the level of MultiFIT. In our experiments, we observe some of the performance limitations of MultiFIT in terms of test power.

stat.ME↗