SearcharxivSearch

arXiv subjects

Aran Raoufi

Publications and source records attributed to Aran Raoufi.

13 recordsLinked to original sources

What Does a Discrete Diffusion Model Learn?

What does a discrete diffusion model learn: a denoiser, a score ratio, or a bridge plug-in predictor? At the level of jump rates, these are one object in different coordinates, and reading a neural network in the wrong coordinate changes the process being trained and sampled. Starting with a rigorous derivation of the continuous-time Markov chain (CTMC) ELBO for any noising process, boundary terms included, we prove the \emph{Oracle Distance} theorem: the negative ELBO is exactly equal to the data entropy plus the path KL from the oracle reverse process to the learned one, not merely a bound. Its unique optimizer is therefore the conditional expectation of the true reverse jump rate given the current noisy state, and its irreducible cost is the rate at which the forward process $Z_t$ destroys information about the clean data $Z_0$, $-\tfrac{d}{dt}I(Z_0; Z_t)$, so every noising process shares the same best achievable negative ELBO: the data entropy. For sequences with token-factorizing noise, the oracle projection yields three exact coordinates for the optimizer: denoiser, cavity (bridge plug-in), and score, with closed-form conversions among them. This framework identifies which law each loss in the literature actually optimizes, recovering MDM, UDM, SEDD, and GIDD as special cases; explains why denoiser and cavity coincide for masked diffusion but not for uniform diffusion; proves that a denoiser parameterization makes the uniform ELBO diverge at initialization while the bridge plug-in stays finite; and calibrates ELBO implementations exactly at initialization. Every identity is verified numerically, without approximation, on an exactly solvable model.

cs.LG

Logarithmic variance for the height function of square-ice

In this article, we prove that the height function associated with the square-ice model (i.e.~the six-vertex model with $a=b=c=1$ on the square lattice), or, equivalently, of the uniform random homomorphisms from $\mathbb Z^2$ to $\mathbb Z$, has logarithmic variance. This establishes a strong form of roughness of this height function.

math.PR

Mass scaling of the near-critical 2D Ising model using random currents

We examine the Ising model at its critical temperature with an external magnetic field $h a^{\frac{15}{8}}$ on $a\mathbb{Z}^2$ for $a,h >0$. A new proof of exponential decay of the truncated two-point correlation functions is presented. It is proven that the mass (inverse correlation length) is of the order of $h^\frac{8}{15}$ in the limit $h \to 0$. This was previously proven with CLE-methods in $\lbrack 1 \rbrack$. Our new proof uses instead the random current representation of the Ising model and its backbone exploration. The method further relies on recent couplings to the random cluster model $\lbrack 2 \rbrack$ as well as a near-critical RSW-result for the random cluster model $\lbrack 3 \rbrack$.

math-ph

Existence of phase transition for percolation using the Gaussian Free Field

In this paper, we prove that Bernoulli percolation on bounded degree graphs with isoperimetric dimension $d>4$ undergoes a non-trivial phase transition (in the sense that $p_c<1$). As a corollary, we obtain that the critical point of Bernoulli percolation on infinite quasi-transitive graphs (in particular, Cayley graphs) with super-linear growth is strictly smaller than 1, thus answering a conjecture of Benjamini and Schramm. The proof relies on a new technique consisting in expressing certain functionals of the Gaussian Free Field (GFF) in terms of connectivity probabilities for percolation model in a random environment. Then, we integrate out the randomness in the edge-parameters using a multi-scale decomposition of the GFF. We believe that a similar strategy could lead to proofs of the existence of a phase transition for various other models.

math.PR

Sharp phase transition for the random-cluster and Potts models via decision trees

We prove an inequality on decision trees on monotonic measures which generalizes the OSSS inequality on product spaces. As an application, we use this inequality to prove a number of new results on lattice spin models and their random-cluster representations. More precisely, we prove that 1. For the Potts model on transitive graphs, correlations decay exponentially fast for $β<β_c$. 2. For the random-cluster model with cluster weight $q\geq1$ on transitive graphs, correlations decay exponentially fast in the subcritical regime and the cluster-density satisfies the mean-field lower bound in the supercritical regime. 3. For the random-cluster models with cluster weight $q\geq1$ on planar quasi-transitive graphs $\mathbb{G}$, $$\frac{p_c(\mathbb{G})p_c(\mathbb{G}^*)}{(1-p_c(\mathbb{G}))(1-p_c(\mathbb{G}^*))}~=~q.$$ As a special case, we obtain the value of the critical point for the square, triangular and hexagonal lattices (this provides a short proof of the result of Beffara and Duminil-Copin [Probability Theory and Related Fields, 153(3-4):511--542, 2012]). These results have many applications for the understanding of the subcritical (respectively disordered) phase of all these models. The techniques developed in this paper have potential to be extended to a wide class of models including the Ashkin-Teller model, continuum percolation models such as Voronoi percolation and Boolean percolation, super-level sets of massive Gaussian Free Field, and random-cluster and Potts model with infinite range interactions.

math.PR

Subcritical phase of $d$-dimensional Poisson-Boolean percolation and its vacant set

We prove that the Poisson-Boolean percolation on $\mathbb{R}^d$ undergoes a sharp phase transition in any dimension under the assumption that the radius distribution has a $5d-3$ finite moment (in particular we do not assume that the distribution is bounded). More precisely, we prove that: -In the whole subcritical regime, the expected size of the cluster of the origin is finite, and furthermore we obtain bounds for the origin to be connected to distance $n$: when the radius distribution has a finite exponential moment, the probability decays exponentially fast in $n$, and when the radius distribution has heavy tails, the probability is equivalent to the probability that the origin is covered by a ball going to distance $n$. - In the supercritical regime, it is proved that the probability of the origin being connected to infinity satisfies a mean-field lower bound. The same proof carries on to conclude that the vacant set of Poisson-Boolean percolation on $\mathbb{R}^d$ undergoes a sharp phase transition. This paper belongs to a series of papers using the theory of randomized algorithms to prove sharpness of phase transitions.

math.PR

Exponential decay of truncated correlations for the Ising model in any dimension for all but the critical temperature

The truncated two-point function of the ferromagnetic Ising model on $\mathbb Z^d$ ($d\ge3$) in its pure phases is proven to decay exponentially fast throughout the ordered regime ($\beta>\beta_c$ and $h=0$). Together with the previously known results, this implies that the exponential clustering property holds throughout the model's phase diagram except for the critical point: $(\beta,h) = (\beta_c,0)$.

math.PR

Translation-Invariant Gibbs States of Ising model: General Setting

We prove that at any inverse temperature $β$ and on any transitive amenable graph, the automorphism-invariant Gibbs states of the ferromagnetic Ising model are convex combinations of the plus and minus states. This is obtained for a general class of interactions, that is automorphism-invariant and irreducible coupling constants. The proof uses the random current representation of the Ising model. The result is novel when the graph is not $\mathbb{Z}^d$, or when the graph is $\mathbb{Z}^d$ but endowed with infinite-range interactions, or even $\mathbb{Z}^2$ with finite-range interactions. Among the corollaries of this result, we can list continuity of the magnetization at any non-critical temperature, the differentiability of the free energy, and the uniqueness of FK-Ising infinite-volume measures.

math.PR

Exponential decay of connection probabilities for subcritical Voronoi percolation in $\mathbb{R}^d$

We prove that for Voronoi percolation on $\mathbb{R}^d$, there exists $p_c\in[0,1]$ such that - for $p 0$ such that $\mathbb{P}_p[0\text{ connected to distance }n]\leq \exp(-c_p n)$, - there exists $c>0$ such that for $p>p_c$, $\mathbb{P}_p[0\text{ connected to }\infty]\geq c(p-p_c)$. For dimension 2, this result offers a new way of showing that $p_c(2)=1/2$. This paper belongs to a series of papers using the theory of algorithms to prove sharpness of the phase transition.

math.PR

Indicable groups and $p_c<1$

A conjecture of Benjamini & Schramm from 1996 states that any finitely generated group that is not a finite extension of Z has a non-trivial percolation phase. Our main results prove this conjecture for certain groups, and in particular prove that any group with a non-trivial homomorphism into the additive group of real numbers satisfies the conjecture. We use this to reduce the conjecture to the case of hereditary just-infinite groups. The novelty here is mainly in the methods used, combining the methods of EIT and evolving sets, and using the algebraic properties of the group to apply these methods.

math.PR

A note on continuity of magnetization at criticality for the ferromagnetic Ising model on amenable quasi-transitive graphs with exponential growth

The purpose of this modest note is to point out that the proof of the recent result of Huchcroft concerning continuity of phase transition in Bernoulli percolation is applicable to the setting of the Ising model with free boundary condition. This observation, together with a recent result of Aizenman, Duminil-Copin, and Sidoravicius implies that the Ising model on amenable quasi-transitive graph with exponential growth undergoes a second order phase transition.

math.PR

A new computation of the critical point for the planar random-cluster model with $q\ge1$

We present a new computation of the critical value of the random-cluster model with cluster weight $q\ge 1$ on $\mathbb{Z}^2$. This provides an alternative approach to the result of Beffara and Duminil-Copin. We believe that this approach has several advantages. First, most of the proof can easily be extended to other planar graphs with sufficient symmetries. Furthermore, it invokes RSW-type arguments which are not based on self-duality. And finally, it contains a new way of applying sharp threshold results which avoid the use of symmetric events and periodic boundary conditions.

math.PR

The phase transitions of the random-cluster and Potts models on slabs with $q \geq 1$ are sharp

We prove sharpness of the phase transition for the random-cluster model with $q \geq 1$ on graphs of the form $\mathcal{S} := \mathcal{G} \times S$, where $\mathcal{G}$ is a planar lattice with mild symmetry assumptions, and $S$ a finite graph. That is, for any such graph and any $q \geq 1$, there exists some parameter $p_c = p_c(\mathcal{S}, q)$, below which the model exhibits exponential decay and above which there exists a.s. an infinite cluster. The result is also valid for the random-cluster model on planar graphs with long range, compactly supported interaction. It extends to the Potts model via the Edwards-Sokal coupling.

math.PR