Searcharxiv⌕ Search

arXiv subjects

Balazs Szegedy

Publications and source records attributed to Balazs Szegedy.

At least 19 recordsLinked to original sources

Holographic functions and neural networks

A fuzzy Boolean function is a map $f:\cube^n\to [0,1]$, where $n\in\mathbb N$. We introduce and compare three ways of saying that such a function has bounded complexity. The first is a sampling property: the value $f(x)$ can be recovered, up to small error and with high probability, from the values of a bounded number of randomly chosen coordinates of $x$. We call this the holographic property. The second is a structural property: $f$ is uniformly close to a bounded-degree polynomial in boundedly many bounded linear coordinate forms. The third is computational: $f$ is uniformly close to the output of a neural network with a bounded number of non-input neurons, bounded Lipschitz activation functions and bounded incoming weights. We prove that these three properties are equivalent up to quantitative changes of the parameters. The implication from holography to polynomial structure uses a variant of a weak version of hypergraph regularity.

math.CO↗

Star observations in bounded-degree graphs

Similarity metrics are central in the theory of large networks and graph limits. For bounded-degree graphs, the Benjamini--Schramm metric records the distribution of rooted neighbourhoods, while the stronger colored-neighbourhood metric gives rise to local-global convergence. In this paper we show that this intricate topology is already determined by much smaller observations. For technical convenience and greater generality, we work with graphings, which are measurable generalizations of finite graphs and include all finite graphs as special cases. We prove that, for graphings of uniformly bounded degree, convergence of all colored degree distributions, or equivalently of all colored star statistics, is equivalent to local-global convergence. We also introduce an even more economical sampling procedure, the colored cherry metric, in which one observes only the root and two randomly chosen neighbours, and prove that it induces the same topology. Thus the full local-global structure can be reconstructed, at the level of topology, from families of very small colored observations. Our star-observation theorem was previously announced in the work of Backhausz and the author as an important ingredient in the proof that the so-called action convergence unifies dense graph limit theory with local-global convergence, thereby providing a general graph limit theory for sparse, dense, and intermediate-density graphs.

math.CO↗

A higher-order generalization of group theory

The goal of this paper is to show that fundamental concepts in higher-order Fourier analysis can be nauturally extended to the non-commutative setting. We generalize Gowers norms to arbitrary compact non-commutative groups. On the structural side, we show that nilspace theory (the algebraic part of higher-order Fourier analysis) can be naturally extended to include all non-commutative groups. To this end, we introduce generalized nilspaces called "groupspaces" and demonstrate that they possess properties very similar to nilspaces. We study $k$-th order generalizations of groups that are special groupspaces called {\it k-step} groupspaces. One step groupspaces are groups. We show that $k$-step groupspaces admit the structure of an iterated principal bundle with structure groups $G_1,G_2,\dots,G_k$. A similar, but somewhat more technical statement holds for general groupspaces, with possibly infinitely many structure groups. Structure groups of groupspaces are in some sense analogous to higher homotopy groups. In particular we use a version of the Eckmann-Hilton argument from homotopy theory to show that $G_i$ is abelian for $i\geq 2$. Groupspaces also show some similarities with $n$-groups from higher category theory (also used in physics) but the exact relationship between these concepts is a subject of future research.

math.GR↗

Action convergence of operators and graphs

We present a new approach to graph limit theory which unifies and generalizes the two most well developed directions, namely dense graph limits (even the more general $L^p$ limits) and Benjamini--Schramm limits (even in the stronger local-global setting). We illustrate by examples that this new framework provides a rich limit theory with natural limit objects for graphs of intermediate density. Moreover, it provides a limit theory for bounded operators (called $P$-operators) of the form $L^\infty(Ω)\to L^1(Ω)$ for probability spaces $Ω$. We introduce a metric to compare $P$-operators (for example finite matrices) even if they act on different spaces. We prove a compactness result which implies that in appropriate norms, limits of uniformly bounded $P$-operators can again be represented by $P$-operators. We show that limits of operators representing graphs are self-adjoint, positivity-preserving $P$-operators called graphops. Graphons, $L^p$ graphons and graphings (known from graph limit theory) are special examples for graphops. We describe a new point of view on random matrix theory using our operator limit framework.

math.CO↗

On Sidorenko's conjecture for determinants and Gaussian Markov random fields

We study a class of determinant inequalities that are closely related to Sidorenko's famous conjecture (Also conjectured by Erd\H os and Simonovits in a different form). Our results can also be interpreted as entropy inequalities for Gaussian Markov random fields (GMRF). We call a GMRF on a finite graph $G$ homogeneous if the marginal distributions on the edges are all identical. We show that if $G$ satisfies Sidorenko's conjecture then the differential entropy of any homogeneous GMRF on $G$ is at least $|E(G)|$ times the edge entropy plus $|V(G)|-2|E(G)|$ times the point entropy. We also prove this inequality in a large class of graphs for which Sidorenko's conjecture is not verified including the so-called Möbius ladder: $K_{5,5}\setminus C_{10}$. The connection between Sidorenko's conjecture and GMRF's is established via a large deviation principle on high dimensional spheres combined with graph limit theory.

math.PR↗

On the almost eigenvectors of random regular graphs

Let $d\geq 3$ be fixed and $G$ be a large random $d$-regular graph on $n$ vertices. We show that if $n$ is large enough then the entry distribution of every almost eigenvector $v$ of $G$ (with entry sum 0 and normalized to have length $\sqrt{n}$) is close to some Gaussian distribution $N(0,σ)$ in the weak topology where $0\leqσ\leq 1$. Our theorem holds even in the stronger sense when many entries are looked at simultaneously in small random neighborhoods of the graph. Furthermore, we also get the Gaussianity of the joint distribution of several almost eigenvectors if the corresponding eigenvalues are close. Our proof uses graph limits and information theory. Our results have consequences for factor of i.i.d.\ processes on the infinite regular tree.

math.PR↗

Sparse graph limits, entropy maximization and transitive graphs

In this paper we describe a triple correspondence between graph limits, information theory and group theory. We put forward a new graph limit concept called log-convergence that is closely connected to dense graph limits but its main applications are in the study of sparse graph sequences. We present an information theoretic limit concept for $k$-tuples of random variables that is based on the entropy maximization problem for joint distributions of random variables where a system of marginal distributions is prescribed. We give a fruitful correspondence between the two limit concepts that has a group theoretic nature. Our applications are in graph theory and information theory. We shows that if $H$ is a bipartite graph, $P_1$ is the edge and $t$ is the homomorphism density function then the supremum of $\log t(H,G)/\log t(P_1,G)$ in the set of all graphs $G$ is the same as in the set of graphs that are both edge and vertex transitive. This result gives a group theoretic approach to Sidorenko's famous conjecture. We obtain information theoretic inequalities regarding the entropy maximization problem. We investigate the limits of sparse random graphs and discuss quasi-randomness in our framework.

math.CO↗

Limits of functions on groups

Our goal is to develop a limit approach for a class of problems in additive combinatorics that is analogous to the limit theory of dense graph sequences. We introduce metric, convergence and limit objects for functions on groups and for measurable functions on compact abelian groups. As an application we find exact minimizers for densities of linear configurations of complexity $1$.

math.CO↗

An information theoretic approach to Sidorenko's conjecture

We investigate the famous conjecture by Erd\H os-Simonovits and Sidorenko using information theory. Our method gives a unified treatment for all known cases of the conjecture and it implies various new results as well. Our topological type conditions allow us to extend Sidorenko's conjecture to large families of $k$-uniform hypergraphs. This is somewhat unexpected since the conjecture fails for $k$ uniform hypergraphs in general.

math.CO↗

Borel Liftings of Graph Limits

The cut pseudo-metric on the space of graph limits induces an equivalence relation. The quotient space obtained by collapsing each equivalence class to a point is a metric space with appealing analytic properties. We show that the equivalence relation admits a Borel lifting: There exists a Borel-measurable mapping which maps each equivalence class to one of its elements.

math.PR↗

Finitely forcible graphons

We investigate families of graphs and graphons (graph limits) that are defined by a finite number of prescribed subgraph densities. Our main focus is the case when the family contains only one element, i.e., a unique structure is forced by finitely many subgraph densities. Generalizing results of Turan, Erdos-Simonovits and Chung-Graham-Wilson, we construct numerous finitely forcible graphons. Most of these fall into two categories: one type has an algebraic structure and the other type has an iterated (fractal-like) structure. We also give some necessary conditions for forcibility, which imply that finitely forcible graphons are "rare", and exhibit simple and explicit non-forcible graphons.

math.CO↗

Ramanujan graphings and correlation decay in local algorithms

Let $G$ be a large-girth $d$-regular graph and $μ$ be a random process on the vertices of $G$ produced by a randomized local algorithm. We prove the upper bound $(k+1-2k/d)\Bigl(\frac{1}{\sqrt{d-1}}\Bigr)^k$ for the (absolute value of the) correlation of values on pairs of vertices of distance $k$ and show that this bound is optimal. The same results hold automatically for factor of i.i.d processes on the $d$-regular tree. In that case we give an explicit description for the (closure) of all possible correlation sequences. Our proof is based on the fact that the Bernoulli graphing of the infinite $d$-regular tree has spectral radius $2\sqrt{d-1}$. Graphings with this spectral gap are infinite analogues of finite Ramanujan graphs and they are interesting on their own right.

math.PR↗

Nilspaces, nilmanifolds and their morphisms

Recent developments in ergodic theory, additive combinatorics, higher order Fourier analysis and number theory give a central role to a class of algebraic structures called nilmanifolds. In the present paper we continue a program started by Host and Kra. We introduce nilspaces as structures satisfying a variant of the Host-Kra axiom system for parallelepiped structures. We give a detailed structural analysis of abstract and compact topological nilspaces. Among various results it will be proved that compact nilspaces are inverse limits of finite dimensional ones. Then we show that finite dimensional compact connected nilspaces are nilmanifolds. The theory of compact nilspaces is a generalization of the theory of compact abelian groups. This paper is the main algebraic tool in the second authors approach to Gowers's uniformity norms and higher order Fourier analysis.

math.DS↗

On higher order Fourier analysis

We develop a theory of higher order structures in compact abelian groups. In the frame of this theory we prove general inverse theorems and regularity lemmas for Gowers's uniformity norms. We put forward an algebraic interpretation of the notion "higher order Fourier analysis" in terms of continuous morphisms between structures called compact $k$-step nilspaces. As a byproduct of our results we obtain a new type of limit theory for functions on abelian groups in the spirit of the so-called graph limit theory. Our proofs are based on an exact (non-approximative) version of higher order Fourier analysis which appears on ultra product groups.

math.CO↗

On the logarithimic calculus and Sidorenko's conjecture

We study a type of calculus for proving inequalities between subgraph densities which is based on Jensen's inequality for the logarithmic function. As a demonstration of the method we verify the conjecture of Erdös-Simonovits and Sidorenko for new families of graphs. In particular we give a short analytic proof for a result by Conlon, Fox and Sudakov. Using this, we prove the forcing conjecture for bipartite graphs in which one vertex is complete to the other side.

math.CO↗

Structure of finite nilspaces and inverse theorems for the Gowers norms in bounded exponent groups

A result of the author shows that the behavior of Gowers norms on bounded exponent abelian groups is connected to finite nilspaces. Motivated by this, we investigate the structure of finite nilspaces. As an application we prove inverse theorems for the Gowers norms on bounded exponent abelian groups. It says roughly speaking that if a function on A has non negligible U(k+1)-norm then it correlates with a phase polynomial of degree k when lifted to some abelian group extension of A. This result is closely related to a conjecture by Tao and Ziegler. In prticular we obtain a new proof for the Tao-Ziegler inverse theorem.

math.CO↗

Gowers norms, regularization and limits of functions on abelian groups

For every natural number k we prove a decomposition theorem for bounded measurable functions on compact abelian groups into a structured part, a quasi random part and a small error term. In this theorem quasi randomness is measured with the Gowers norm U(k+1) and the structured part is a bounded complexity ``nilspace-polynomial'' of degree k. This statement implies a general inverse theorem for the U(k+1) norm. (We discuss some consequences in special families of groups such as bounded exponent groups, zero characteristic groups and the circle group.) Along these lines we introduce a convergence notion and corresponding limit objects for functions on abelian groups. This subject is closely related to the recently developed graph and hypergraph limit theory. An important goal of this paper is to put forward a new algebraic aspect of the notion ``higher order Fourier analysis''. According to this, k-th order Fourier analysis is regarded as the study of continuous morphisms between structures called compact k-step nilspaces. All our proofs are based on an underlying theory of topological nilspace factors of ultra product groups.

math.CO↗

Limits of kernel operators and the spectral regularity lemma

We study the spectral aspects of the graph limit theory. We give a description of graphon convergence in terms of converegnce of eigenvalues and eigenspaces. Along these lines we prove a spectral version of the strong regularity lemma. Using spectral methods we investigate group actions on graphons. As an application we show that the set of isometry invariant graphons on the sphere is closed in terms of graph convergence however the analogous statement does not hold for the circle. This fact is rooted in the representation theory of the orthogonal group.

math.CO↗