SearcharxivSearch

arXiv subjects

Roi Holtzman

Publications and source records attributed to Roi Holtzman.

8 recordsLinked to original sources

Path convergence in diffusion models

We discuss diffusion-model paths interpolating between a target distribution known only through p patterns and a reference distribution that can be sampled. These interpolating paths can be constructed symmetrically or else in forward direction (often referred to as a "noising") from the target patterns to the reference distribution or in backward direction (as a "denoising") from the reference distribution to the patterns. For backward paths with identical diffusion noise, we consider the path convergence in number of patterns p towards the path for infinitely many patterns. In a one-dimensional test case, we show that this convergence is on a scale 1/sqrt(p), but with infinite mean square deviation. We demonstrate that the path convergence allows for extrapolation towards the p=infinity path which samples the target distribution. We provide a proof-of-concept extrapolation algorithm and propose the convergence and extrapolation of paths as a possible strategy for density estimation and generalization. We illustrate all our algorithms through pseudo-codes and provide Python implementations.

cond-mat.stat-mech

Hyperparameter Transfer for Dense Associative Memories

Dense Associative Memory (DenseAM) is a promising family of AI architectures that is represented by a neural network performing temporal dynamics on an energy landscape. While hyperparameter transfer methods are well-studied for feed-forward networks, these methods have not been developed for settings in which weights are shared across layers and within the layer, which is common in DenseAMs. Additionally, DenseAMs utilize rapidly peaking activation functions that are rarely used in feed-forward architectures. The confluence of these aspects makes DenseAM a challenging framework for using existing methods for hyperparameter transfer. Our work initiates the development of hyperparameter transfer methods for this class of models. We derive explicit prescriptions for how the hyperparameters tuned on small models can be transferred to models trained at scale. We demonstrate excellent agreement between these theoretical findings and empirical results.

cs.LG

Shortcuts to adiabaticity across a separatrix

Shortcuts to adiabaticity are strategies for conserving adiabatic invariants under non-adiabatic (i.e. fast-driving) conditions. Here, we show how to extend classical, Hamiltonian shortcuts to adiabaticity to allow the crossing of a phase-space separatrix -- a situation in which a corresponding adiabatic protocol does not exist. Specifically, we show how to construct a time-dependent Hamiltonian that evolves one energy shell to another energy shell across a separatrix. Leveraging this method, we design an erasure procedure whose energy cost and fidelity do not depend on the protocol's duration.

cond-mat.stat-mech

A new technique to measure gravitational mass of ultra-cold matter and its implications for antimatter studies

Measuring the effect of gravity on antimatter is a longstanding problem in physics that has significant implications for our understanding of the fundamental nature of the universe. Here, we present a technique to measure the gravitational mass of atoms, motivated by a recent measurement of antimatter atoms in CERN [1]. We demonstrate the results on ultra-cold atoms by measuring the surviving fraction of atoms gradually released from a quadrupole magnetic trap, which is tilted due to gravitational potential. We compare our measurements with a Monte Carlo simulation to extract the value of the gravitational constant. The difference between the literature value for g, the local acceleration due to gravity, and the measured value is $(-1.9 \pm 12^{stat} \pm 5^{syst}) \times 10^{- 4} g$. We demonstrate the importance of various design parameters in the experiment setup, and estimate their contribution to the achievable accuracy in future experiments. Our method demonstrates simplicity, precision, and reliability, paving the way for future precision studies of the gravitational force on antimatter. It also enables a precise calibration of atom traps based on the known gravitational attraction of normal matter to Earth.

physics.atom-ph

Acceleration from a clustering environment

We study the effects of correlations in a random environment on a random walker. The dependence of its asymptotic speed on the correlations is a nonperturbative effect as it is not captured by a homogeneous version of the same environment. For a slowly cooling environment, the buildup of correlations modifies the walker's speed and, by so, realizes acceleration. We remark on the possible relevance in the discussion of cosmic acceleration as traditionally started from the Friedmann equations, which, from a statistical mechanical point of view, would amount to a mean-field approximation. Our environment is much simpler though, with transition rates sampled from the one-dimensional Ising model and allowing exact results and detailed velocity characteristics.

cond-mat.stat-mech

Making sense of complex systems through resolution, relevance, and mapping entropy

Complex systems are characterised by a tight, nontrivial interplay of their constituents, which gives rise to a multi-scale spectrum of emergent properties. In this scenario, it is practically and conceptually difficult to identify those degrees of freedom that mostly determine the behaviour of the system and separate them from less prominent players. Here, we tackle this problem making use of three measures of statistical information: resolution, relevance, and mapping entropy. We address the links existing among them, taking the moves from the established relation between resolution and relevance and further developing novel connections between resolution and mapping entropy; by these means we can identify, in a quantitative manner, the number and selection of degrees of freedom of the system that preserve the largest information content about the generative process that underlies an empirical dataset. The method, which is implemented in a freely available software, is fully general, as it is shown through the application to three very diverse systems, namely a toy model of independent binary spins, a coarse-grained representation of the financial stock market, and a fully atomistic simulation of a protein.

cond-mat.stat-mech

Landau Theory for the Mpemba Effect Through Phase Transitions

The Mpemba effect describes the situation in which a hot system cools faster than an identical copy that is initiated at a colder temperature. In many of the experimental observations of the effect, e.g. in water and clathrate hydrates, it is defined by the phase transition timing. However, none of the theoretical investigations so far considered the timing of the phase transition, and most of the abstract models used to explore the Mpemba effect do not have a phase transition. We use the phenomenological Landau theory for phase transitions to identify the second order phase transition time, and demonstrate with a concrete example that a Mpemba effect can exist in such models.

cond-mat.stat-mech

Hamiltonian Memory: An Erasable Classical Bit

Computations implemented on a physical system are fundamentally limited by the laws of physics. A prominent example for a physical law that bounds computations is the Landauer principle. According to this principle, erasing a bit of information requires a concentration of probability in phase space, which by Liouville's theorem is impossible in pure Hamiltonian dynamics. It therefore requires dissipative dynamics with heat dissipation of at least $k_BT\log 2$ per erasure of one bit. Using a concrete example, we show that when the dynamic is confined to a single energy shell it is possible to concentrate the probability on this shell using Hamiltonian dynamic, and therefore to implement an erasable bit with no thermodynamic cost.

cond-mat.stat-mech