SearcharxivSearch

arXiv subjects

John Jasper

Publications and source records attributed to John Jasper.

At least 19 recordsLinked to original sources

Towards a mathematical theory of superposition

We develop a mathematical theory of superposition in neural networks using tools from frame theory and compressed sensing. In our model, a sparse binary vector \(x\) of active features is encoded through an overcomplete dictionary \(W\), and feature recovery is performed by applying \(\operatorname{ReLU}(W^\top W x+b)\) with an appropriate bias vector \(b\). We prove several recovery theorems for this model. In the random-support setting, we establish high-probability support recovery for nearly tight, low-coherence dictionaries, with guarantees when the expected sparsity is up to order \(d/\log n\). In the worst-case support setting, we give a sharp and computable criterion for which sparsity levels permit support recovery. We apply this criterion to Gaussian random matrices and equiangular tight frames. For real equiangular tight frames with \(n>d+1\), we determine the exact recovery threshold in terms of the coherence. The proof of this result for real equiangular tight frames relies on a novel characterization---which should be of independent interest to frame theorists---of the distribution of signs in the Gram matrix.

stat.ML

HRT counterexamples with exponential tails

We build on the recent breakthrough of Faulhuber, Petersen, van Velthoven, and Voigtlaender that disproved the HRT conjecture with a Schwartz function and a $12$-point configuration. We give a human-readable treatment of their mechanism and find HRT counterexample functions with exponential (or faster) decay. By a result of Bownik and Speegle, this is the fastest possible decay for an HRT counterexample, up to a logarithmic factor in the exponent.

math.FA

The Singer-Zauner gap for equiangular tight frames

We show that there does not exist a complex $d\times n$ equiangular tight frame with \[ d^2-d+1<n<d^2. \] The proof, which originated from an internal model at OpenAI, mimics the relationship between real equiangular tight frames and strongly regular graphs.

math.FA

Asymptotically optimal approximate Hadamard matrices

An approximate Hadamard matrix is a well-conditioned square matrix with all entries in $\{\pm1\}$. We measure the quality of a matrix by its condition number, i.e., the ratio of its largest and smallest singular values. We prove that for any fixed positive $\alpha<17/92$, every sufficiently large dimension admits an approximate Hadamard matrix with condition number at most $1+n^{-\alpha}$. In particular, the smallest possible condition number tends to $1$ as $n\to\infty$. Conversely, there exists an absolute constant $c>0$ such that for every sufficiently large $n\not\equiv0\pmod4$, every $n\times n$ matrix with entries in $\{\pm1\}$ has condition number at least $1+c(\log n)/n$. Along the way, we resolve a problem of Jaming and Matolcsi concerning flat orthogonal matrices, and we conclude by describing several explicit infinite families of approximate Hadamard matrices.

math.CO

More on the optimal arrangement of $2d$ lines in $\mathbb{C}^d$

We introduce a new infinite family of $d\times 2d$ equiangular tight frames. Many matrices in this family consist of two $d\times d$ circulant blocks. We conjecture that such equiangular tight frames exist for every $d$. We show that our conjecture holds for $d\leq 165$ by a computer-assisted application of a Newton-Kantorovich theorem. In addition, we supply numerical constructions that corroborate our conjecture for $d\leq 1500$.

math.MG

Optimal codes in the Stiefel manifold

We consider the coding problem in the Stiefel manifold with chordal distance. After considering various low-dimensional instances of this problem, we use Rankin's bounds on spherical codes to prove upper bounds on the minimum distance of a Stiefel code, and then we construct several examples of codes that achieve equality in these bounds.

math.MG

Totally symmetric Grassmannian codes

We introduce a general technique to construct tight fusion frames with prescribed symmetries. Applying this technique with a prescription for "all the symmetries", we construct a new family of equi-isoclinic tight fusion frames (EITFFs), which consequently form optimal Grassmannian codes. By virtue of their construction, our EITFFs have the remarkable property of total symmetry: any permutation of subspaces can be achieved by an appropriate unitary.

math.CO

Diagonals of self-adjoint operators II: Non-compact operators

Given a self-adjoint operator $T$ on a separable infinite-dimensional Hilbert space we study the problem of characterizing the set $\mathcal D(T)$ of all possible diagonals of $T$. For operators $T$ with at least two points in their essential spectrum $σ_{ess}(T)$, we give a complete characterization of $\mathcal D(T)$ for the class of self-adjoint operators sharing the same spectral measure as $T$ with a possible exception of multiplicities of eigenvalues at the extreme points of $σ_{ess}(T)$. We also give a more precise description of $\mathcal D(T)$ for a fixed self-adjoint operator $T$, albeit modulo the kernel problem for special classes of operators. These classes consist of operators $T$ for which an extreme point of the essential spectrum $σ_{ess}(T)$ is also an extreme point of the spectrum $σ(T)$. Our results generalize a characterization of diagonals of orthogonal projections by Kadison, Blaschke-type results of Müller and Tomilov, and Loreaux and Weiss, and a characterization of diagonals of operators with finite spectrum by the authors.

math.FA

Diagonals of self-adjoint operators I: compact operators

Given a self-adjoint operator $T$ on a separable infinite-dimensional Hilbert space we study the problem of characterizing the set $\mathcal D(T)$ of all possible diagonals of $T$. For compact operators $T$, we give a complete characterization of diagonals modulo the kernel of $T$. That is, we characterize $\mathcal D(T)$ for the class of operators sharing the same nonzero eigenvalues (with multiplicities) as $T$. Moreover, we determine $\mathcal D(T)$ for a fixed compact operator $T$, modulo the kernel problem for positive compact operators with finite-dimensional kernel. Our results generalize a characterization of diagonals of trace class positive operators by Arveson and Kadison and diagonals of compact positive operators by Kaftal, Loreaux, and Weiss. The proof uses the technique of diagonal-to-diagonal results, which was pioneered in the earlier joint work of the authors with Siudeja.

math.FA

Equi-isoclinic subspaces, covers of the complete graph, and complex conference matrices

In 1992, Godsil and Hensel published a ground-breaking study of distance-regular antipodal covers of the complete graph that, among other things, introduced an important connection with equi-isoclinic subspaces. This connection seems to have been overlooked, as many of its immediate consequences have never been detailed in the literature. To correct this situation, we first describe how Godsil and Hensel's machine uses representation theory to construct equi-isoclinic tight fusion frames. Applying this machine to Mathon's construction produces $q+1$ planes in $\mathbb{R}^{q+1}$ for any even prime power $q>2$. Despite being an application of the 30-year-old Godsil-Hensel result, infinitely many of these parameters have never been enunciated in the literature. Following ideas from Et-Taoui, we then investigate a fruitful interplay with complex symmetric conference matrices.

math.CO

Harmonic Grassmannian codes

An equi-isoclinic tight fusion frame (EITFF) is a type of Grassmannian code, being a sequence of subspaces of a finite-dimensional Hilbert space of a given dimension with the property that the smallest spectral distance between any pair of them is as large as possible. EITFFs arise in compressed sensing, yielding dictionaries with minimal block coherence. Their existence remains poorly characterized. Most known EITFFs have parameters that match those of one that arose from an equiangular tight frame (ETF) in a rudimentary, direct-sum-based way. In this paper, we construct new infinite families of non-"tensor-sized" EITFFs in a way that generalizes the one previously known infinite family of them as well as the celebrated equivalence between harmonic ETFs and difference sets for finite abelian groups. In particular, we construct EITFFs consisting of $Q$ planes in $\mathbb{C}^Q$ for each prime power $Q\geq 4$, of $Q-1$ planes in $\mathbb{C}^Q$ for each odd prime power $Q$, and of $11$ three-dimensional subspaces in $\mathbb{R}^{11}$. The key idea is that every harmonic EITFF -- one that is the orbit of a single subspace under the action of a unitary representation of a finite abelian group -- arises from a smaller tight fusion frame with a nicely behaved "Fourier transform." Our particular constructions of harmonic EITFFs exploit the properties of Gauss sums over finite fields.

cs.IT

Frames over finite fields: Equiangular lines in orthogonal geometry

We investigate equiangular lines in finite orthogonal geometries, focusing specifically on equiangular tight frames (ETFs). In parallel with the known correspondence between real ETFs and strongly regular graphs (SRGs) that satisfy certain parameter constraints, we prove that ETFs in finite orthogonal geometries are closely aligned with a modular generalization of SRGs. The constraints in our finite field setting are weaker, and all but~18 known SRG parameters on $v \leq 1300$ vertices satisfy at least one of them. Applying our results to triangular graphs, we deduce that Gerzon's bound is attained in finite orthogonal geometries of infinitely many dimensions. We also demonstrate connections with real ETFs, and derive necessary conditions for ETFs in finite orthogonal geometries. As an application, we show that Gerzon's bound cannot be attained in a finite orthogonal geometry of dimension~5.

math.CO

Frames over finite fields: Basic theory and equiangular lines in unitary geometry

We introduce the study of frames and equiangular lines in classical geometries over finite fields. After developing the basic theory, we give several examples and demonstrate finite field analogs of equiangular tight frames (ETFs) produced by modular difference sets, and by translation and modulation operators. Using the latter, we prove that Gerzon's bound is attained in each unitary geometry of dimension $d = 2^{2l+1}$ over the field $\mathbb{F}_{3^2}$. We also investigate interactions between complex ETFs and those in finite unitary geometries, and we show that every complex ETF implies the existence of ETFs with the same size over infinitely many finite fields.

math.MG

Grassmannian codes from paired difference sets

An equiangular tight frame (ETF) is a sequence of vectors in a Hilbert space that achieves equality in the Welch bound and so has minimal coherence. More generally, an equichordal tight fusion frame (ECTFF) is a sequence of equi-dimensional subspaces of a Hilbert space that achieves equality in Conway, Hardin and Sloane's simplex bound. Every ECTFF is a type of optimal Grassmannian code, that is, an optimal packing of equi-dimensional subspaces of a Hilbert space. We construct ECTFFs by exploiting new relationships between known ETFs. Harmonic ETFs equate to difference sets for finite abelian groups. We say that a difference set for such a group is "paired" with a difference set for its Pontryagin dual when the corresponding subsequence of its harmonic ETF happens to be an ETF for its span. We show that every such pair yields an ECTFF. We moreover construct an infinite family of paired difference sets using quadratic forms over the field of two elements. Together this yields two infinite families of real ECTFFs.

math.FA

Game of Sloanes: Best known packings in complex projective space

It is often of interest to identify a given number of points in projective space such that the minimum distance between any two points is as large as possible. Such configurations yield representations of data that are optimally robust to noise and erasures. The minimum distance of an optimal configuration not only depends on the number of points and the dimension of the projective space, but also on whether the space is real or complex. For decades, Neil Sloane's online Table of Grassmannian Packings has been the go-to resource for putatively or provably optimal packings of points in real projective spaces. Using a variety of numerical algorithms, we have created a similar table for complex projective spaces. This paper surveys the relevant literature, explains some of the methods used to generate the table, presents some new putatively optimal packings, and invites the reader to competitively contribute improvements to this table.

math.MG

Optimal line packings from nonabelian groups

We use group schemes to construct optimal packings of lines through the origin. In this setting, optimal line packings are naturally characterized using representation theory, which in turn leads to a necessary integrality condition for the existence of equiangular central group frames. We conclude with an infinite family of optimal line packings using the group schemes associated with certain Suzuki 2-groups, specifically, extensions of Heisenberg groups. Notably, this is the first known infinite family of equiangular tight frames generated by representations of nonabelian groups.

math.FA

Equiangular tight frames from group divisible designs

An equiangular tight frame (ETF) is a type of optimal packing of lines in a real or complex Hilbert space. In the complex case, the existence of an ETF of a given size remains an open problem in many cases. In this paper, we observe that many of the known constructions of ETFs are of one of two types. We further provide a new method for combining a given ETF of one of these two types with an appropriate group divisible design (GDD) in order to produce a larger ETF of the same type. By applying this method to known families of ETFs and GDDs, we obtain several new infinite families of ETFs. The real instances of these ETFs correspond to several new infinite families of strongly regular graphs. Our approach was inspired by a seminal paper of Davis and Jedwab which both unified and generalized McFarland and Spence difference sets. We provide combinatorial analogs of their algebraic results, unifying Steiner ETFs with hyperoval ETFs and Tremain ETFs.

math.FA