SearcharxivSearch

arXiv subjects

Josiah Park

Publications and source records attributed to Josiah Park.

13 recordsLinked to original sources

Polynomial potential minimization on the unit circle

In the following, we study the minimization of polynomial potentials $ f(t) $ on the unit circle, where the potentials take the form \[ f(t) = \sum_{i=1}^n b_i x^{2i}, \quad b_i \in \mathbb{R}. \] This form arises in the context of truncations of expansions of $ p $-frame potentials. One approach to minimize these potentials involves rewriting the integral as a sum of integrals obtained by expanding the potential $ f(t) = \sum_{i=1}^n c_i T_i(t) $ in terms of Chebyshev polynomials. By replacing the inner product $ \langle x, y \rangle $ with $ \cos(θ_{x, y}) $, we can reformulate the original problem as: \[ \min_{μ\in P(T)} \int_T \int_T f(\langle x, y \rangle) dμ(x) dμ(y) \] as an equivalent form: \[ \min_{ν\in P([-π, π])} \sum_{i=1}^n c_i \int_{-π}^π\int_{-π}^π\cos(n(x - y)) dν(x) dν(y) \].

math.GM

Optimal Measures for Multivariate Geometric Potentials

We study measures and point configurations optimizing energies based on multivariate potentials. The emphasis is put on potentials defined by geometric characteristics of sets of points, which serve as multi-input generalizations of the well-known Riesz potentials for pairwise interaction. One of such potentials is volume squared of the simplex with vertices at the $k \ge 3$ given points: we show that the arising energy is maximized by balanced isotropic measures, in contrast to the classical two-input energy. These results are used to obtain interesting geometric optimality properties of the regular simplex. As the main machinery, we adapt the semidefinite programming method to this context and establish relevant versions of the $k$-point bounds.

math.CA

Optimizers of three-point energies and nearly orthogonal sets

This paper is devoted to spherical measures and point configurations optimizing three-point energies. Our main goal is to extend the classic optimization problems based on pairs of distances between points to the context of three-point potentials. In particular, we study three-point analogues of the sphere packing problem and the optimization problem for $p$-frame energies based on three points. It turns out that both problems are inherently connected to the problem of nearly orthogonal sets by Erdős. As the outcome, we provide a new solution of the Erdős problem from the three-point packing perspective. We also show that the orthogonal basis uniquely minimizes the $p$-frame three-point energy when $0<p<1$ in all dimensions. The arguments make use of multivariate polynomials employed in semidefinite programming and based on the classical Gegenbauer polynomials. For $p=1$, we completely solve the analogous problem on the circle. As for higher dimensions, we show that the Hausdorff dimension of minimizers is not greater than $d-2$ for measures on $\mathbb{S}^{d-1}$. As the main ingredient of our proof, we show that the only isotropic measure without obtuse angles is the uniform distribution over an orthonormal basis.

math.CA

Grassmannian packings: Trust-region stochastic tuning for matrix incoherence

We provide a new numerical procedure for constructing low coherence matrices, Trust-Region Stochastic Tuning for Matrix Incoherence (TRSTMI) and detail the results of experiments with a CPU/GPU parallelized implementation of this method. These trials suggest the superiority of this approach over other existing methods when the size of the matrix is large. We also present new conjectures on optimal complex matrices motivated and guided by the experimental results.

cs.IT

Qualitative neural network approximation over R and C: Elementary proofs for analytic and polynomial activation

In this article, we prove approximation theorems in classes of deep and shallow neural networks with analytic activation functions by elementary arguments. We prove for both real and complex networks with non-polynomial activation that the closure of the class of neural networks coincides with the closure of the space of polynomials. The closure can further be characterized by the Stone-Weierstrass theorem (in the real case) and Mergelyan's theorem (in the complex case). In the real case, we further prove approximation results for networks with higher-dimensional harmonic activation and orthogonally projected linear maps. We further show that fully connected and residual networks of large depth with polynomial activation functions can approximate any polynomial under certain width requirements. All proofs are entirely elementary.

cs.LG

Optimal measures for p-frame energies on spheres

We provide new answers about the placement of mass on spheres so as to minimize energies of pairwise interactions. We find optimal measures for the $p$-frame energies, i.e. energies with the kernel given by the absolute value of the inner product raised to a positive power $p$. Application of linear programming methods in the setting of projective spaces allows for describing the minimizing measures in full in several cases: we show optimality of tight designs and of the $600$-cell for several ranges of $p$ in different dimensions. Our methods apply to a much broader class of potential functions, those which are absolutely monotonic up to a particular order as functions of the cosine of the geodesic distance. In addition, a preliminary numerical study is presented which suggests optimality of several other highly symmetric configurations and weighted designs in low dimensions. In one case we improve the best known lower bounds on a minimal sized weighted design in $\mathbb{CP}^4$. All these results point to the discreteness of minimizing measures for the $p$-frame energy with $p$ not an even integer.

math.MG

Neural Network Approximation of Refinable Functions

In the desire to quantify the success of neural networks in deep learning and other applications, there is a great interest in understanding which functions are efficiently approximated by the outputs of neural networks. By now, there exists a variety of results which show that a wide range of functions can be approximated with sometimes surprising accuracy by these outputs. For example, it is known that the set of functions that can be approximated with exponential accuracy (in terms of the number of parameters used) includes, on one hand, very smooth functions such as polynomials and analytic functions (see e.g. \cite{E,S,Y}) and, on the other hand, very rough functions such as the Weierstrass function (see e.g. \cite{EPGB,DDFHP}), which is nowhere differentiable. In this paper, we add to the latter class of rough functions by showing that it also includes refinable functions. Namely, we show that refinable functions are approximated by the outputs of deep ReLU networks with a fixed width and increasing depth with accuracy exponential in terms of their number of parameters. Our results apply to functions used in the standard construction of wavelets as well as to functions constructed via subdivision algorithms in Computer Aided Geometric Design.

cs.LG

Repeated minimizers of $p$-frame energies

For a collection of $N$ unit vectors $\mathbf{X}=\{x_i\}_{i=1}^N$, define the $p$-frame energy of $\mathbf{X}$ as the quantity $\sum_{i\neq j} |\langle x_i,x_j \rangle|^p$. In this paper, we connect the problem of minimizing this value to another optimization problem, so giving new lower bounds for such energies. In particular, for $p<2$, we prove that this energy is at least $2(N-d) p^{-\frac p 2} (2-p)^{\frac {p-2} 2}$ which is sharp for $d\leq N\leq 2d$ and $p=1$. We prove that for $1\leq m<d$, a repeated orthonormal basis construction of $N=d+m$ vectors minimizes the energy over an interval, $p\in[1,p_m]$, and demonstrate an analogous result for all $N$ in the case $d=2$. Finally, in connection, we give conjectures on these and other energies.

math.MG

Potential theory with multivariate kernels

In the present paper we develop the theory of minimization for energies with multivariate kernels, i.e. energies, in which pairwise interactions are replaced by interactions between triples or, more generally, $n$-tuples of particles. Such objects, which arise naturally in various fields, present subtle differences and complications when compared to the classical two-input case. We introduce appropriate analogues of conditionally positive definite kernels, establish a series of relevant results in potential theory, explore rotationally invariant energies on the sphere, and present a variety of interesting examples, in particular, some optimization problems in probabilistic geometry which are related to multivariate versions of the Riesz energies.

math.CA

Balian-Low Theorems in Several Variables

Recently, Nitzan and Olsen showed that Balian-Low theorems (BLTs) hold for discrete Gabor systems defined on $\mathbb{Z}_d$. Here we extend these results to a multivariable setting. Additionally, we show a variety of applications of the Quantitative BLT, proving in particular nonsymmetric BLTs in both the discrete and continuous setting for functions with more than one argument. Finally, in direct analogy of the continuous setting, we show the Quantitative Finite BLT implies the Finite BLT.

math.CA

Energy on spheres and discreteness of minimizing measures

In the present paper we study the minimization of energy integrals on the sphere with a focus on an interesting clustering phenomenon: for certain types of potentials, optimal measures are discrete or are supported on small sets. In particular, we prove that the support of any minimizer of the $p$-frame energy has empty interior whenever $p$ is not an even integer. A similar effect is also demonstrated for energies with analytic potentials which are not positive definite. In addition, we establish the existence of discrete minimizers for a large class of energies, which includes energies with polynomial potentials.

math.CA

Lattices from tight frames and vertex transitive graphs

We show that real tight frames that generate lattices must be rational, and use this observation to describe a construction of lattices from vertex transitive graphs. In the case of irreducible group frames, we show that the corresponding lattice is always strongly eutactic. This is the case for the more restrictive class of distance transitive graphs. We show that such lattices exist in arbitrarily large dimensions and demonstrate examples arising from some notable families of graphs. In particular, some well-known root lattices and those related to them can be recovered this way. We discuss various properties of this construction and also mention some potential applications of lattices generated by incoherent systems of vectors.

math.CO

Frame Potentials and Orthogonal Vectors

An extension is given of a recent result of Glazyrin, showing that an orthonormal basis $\{e_{i}\}_{i=1}^{d}$ joined with the vectors $\{e_{j}\}_{j=1}^{m}$, where $1\leq m < d$ minimizes the $p$-frame potential for $p\in[1,2\log{\frac{2m+1}{2m}}/\log{\frac{m+1}{m}}]$ over all collections of $N=d+m$ vectors $\{x_1,\dots,x_N \}$ in $\mathbb{S}^{d-1}$.

math.MG