SearcharxivSearch

arXiv subjects

Tamra Nebabu

Publications and source records attributed to Tamra Nebabu.

4 recordsLinked to original sources

A Two-Point Hologram for Everything

Known holographic dictionaries, especially AdS/CFT, rely on symmetry matching between the bulk and the boundary. We take a step toward a holographic dictionary with no symmetry requirement and without assuming the geometry being asymptotically AdS. Starting from any interacting Majorana generalized free field on a $(0+1)$d boundary and its two-point function data, we derive a concise analytic formula for the dual $(1+1)$d bulk geometry, borrowing techniques from unitary matrix integral and inverse scattering. Using this formula, we compute the near-horizon curvature, give conditions for positive versus negative curvature, and identify simple boundary models with de Sitter or anti-de Sitter near-horizon duals. We also study the large-$q$ SYK model, finding an unusual temperature dependence of the near-horizon curvature, related to the discrepancy between physical temperature and the ``fake disk'' temperature. We also construct, directly from boundary operators, approximate algebras generated by null translations and boost that become exact at the bifurcate horizon.

hep-th

Bulk Reconstruction from Generalized Free Fields

We propose a generalized protocol for constructing a dual free bulk theory from any boundary model of generalized free fields (GFFs). To construct the bulk operators, we employ a linear ansatz similar to the Hamilton-Kabat-Liftschytz and Lowe (HKLL) construction. However, unlike the HKLL construction, our protocol relies only on boundary data with no presupposed form for the bulk equations of motion, so our reconstructed bulk is fully emergent. For a (1+1)d bulk, imposing the bulk operator algebra as well as a causal structure is sufficient to determine the bulk operators and dynamics uniquely up to an unimportant local basis choice. We study the bulk construction for several two-sided SYK models with and without coupling between the two sides, and find good agreement with known results in the low-temperature conformal limit. In particular, we find bulk features consistent with the presence of a black hole horizon for the TFD state, and characterize the infalling fermion modes. We are also able to extract bulk quantities such as the curvature and bulk state correlators in terms of boundary quantities. In the presence of coupling between the two SYK models, we are able to observe evidence of the shockwave geometry and the traversable wormhole geometry using the two-sided mutual information between the reconstructed bulk operators. Our results show evidence that features of the geometric bulk can survive away from the low temperature conformal limit. Furthermore, the generality of the protocol allows it to be applied to other boundary theories with no canonical holographic bulk.

hep-th

Geometric Dynamics of Signal Propagation Predict Trainability of Transformers

We investigate forward signal propagation and gradient back propagation in deep, randomly initialized transformers, yielding simple necessary and sufficient conditions on initialization hyperparameters that ensure trainability of deep transformers. Our approach treats the evolution of the representations of $n$ tokens as they propagate through the transformer layers in terms of a discrete time dynamical system of $n$ interacting particles. We derive simple update equations for the evolving geometry of this particle system, starting from a permutation symmetric simplex. Our update equations show that without MLP layers, this system will collapse to a line, consistent with prior work on rank collapse in transformers. However, unlike prior work, our evolution equations can quantitatively track particle geometry in the additional presence of nonlinear MLP layers, and it reveals an order-chaos phase transition as a function of initialization hyperparameters, like the strength of attentional and MLP residual connections and weight variances. In the ordered phase the particles are attractive and collapse to a line, while in the chaotic phase the particles are repulsive and converge to a regular $n$-simplex. We analytically derive two Lyapunov exponents: an angle exponent that governs departures from the edge of chaos in this particle system, and a gradient exponent that governs the rate of exponential growth or decay of backpropagated gradients. We show through experiments that, remarkably, the final test loss at the end of training is well predicted just by these two exponents at the beginning of training, and that the simultaneous vanishing of these two exponents yields a simple necessary and sufficient condition to achieve minimal test loss.

cond-mat.dis-nn

Entanglement Features of Random Neural Network Quantum States

Restricted Boltzmann machines (RBMs) are a class of neural networks that have been successfully employed as a variational ansatz for quantum many-body wave functions. Here, we develop an analytic method to study quantum many-body spin states encoded by random RBMs with independent and identically distributed complex Gaussian weights. By mapping the computation of ensemble-averaged quantities to statistical mechanics models, we are able to investigate the parameter space of the RBM ensemble in the thermodynamic limit. We discover qualitatively distinct wave functions by varying RBM parameters, which correspond to distinct phases in the equivalent statistical mechanics model. Notably, there is a regime in which the typical RBM states have near-maximal entanglement entropy in the thermodynamic limit, similar to that of Haar-random states. However, these states generically exhibit nonergodic behavior in the Ising basis, and do not form quantum state designs, making them distinguishable from Haar-random states.

quant-ph