Searcharxiv⌕ Search

arXiv · physics/0512167

Perfect Tempering

Abstract

Multimodal structures in the sampling density (e.g. two competing phases) can be a serious problem for traditional Markov Chain Monte Carlo (MCMC), because correct sampling of the different structures can only be guaranteed for infinite sampling time. Samples may not decouple from the initial configuration for a long time and autocorrelation times may be hard to determine. We analyze a suitable modification (C. J. Geyer and E. A. Thompson, J. Amer. Statist. Assoc., 90, 909, 1995) of the simulated tempering idea (E. Marinari and G. Parisi, Europhys. Lett. 19, 451, 1992), which has orders of magnitude smaller autocorrelation times for multimodal sampling densities and which samples all peaks of multimodal structures according to their weight. The method generates exact, i.e. uncorrelated, samples and thus gives access to reliable error estimates. Exact tempering is applicable to arbitrary (continuous or discreet) sampling densities and moreover presents a possibility to calculate integrals over the density (e.g. the partition function for the Boltzmann distribution), which are not accessible by usual MCMC.

Explore related subjects

Keep this discovery

Explore connections, maps & timelines

BibTeXRIS

M. Daghofer, M. Konegger, H. G. Evertz, W. von der Linden. 2006-05-22. Perfect Tempering. https://doi.org/10.1063/1.1835233

Cite the original work for its findings. Save a collection to share your selection of sources.

KEEP EXPLORING

Related papers

How much data does a memory kernel need? Measurement requirements for fractional models of battery and corrosion degradation

How much data does a memory kernel need before a fit is meaningful? For a distributed-order model, the answer is about 3.1 decades of observation, more than standard battery-degradation tests provide. Battery capacity fade and corrosion-film growth depend on their history, so they are often modelled using general fractional calculus (GFC), where memory is described by an arbitrary Sonine kernel rather than a single power law. We tested this using two mechanistic models without fractional operators and de Levie's porous-electrode model, whose high-frequency order is exactly 0.5; our estimator recovered 0.500. A single aging curve can recover an effective order, alpha, to within 5% noise using a weak formulation, while separating the tempered parameters (alpha, lambda) requires several Arrhenius conditions, with errors improving from (0.25, 0.43) with one condition to (0.04, 0.07) with four. A distributed-order memory needs 3.1 decades of data to be resolved to 90%; below that, a two-order memory can collapse into one intermediate order that fits the data better than the true spectrum. For saturating passivation, however, a general kernel improves the fit substantially, raising R2 from 0.862 to 0.998. Across 20 cells from two public datasets, observation windows span only 1.23 to 2.24 decades, making the 3.1-decade result a practical design rule: it defines what must be measured before fitting a memory kernel, not only what cannot be fitted.

physics.data-an↗

A Probability Model for Pentagonal Prism Dice Rolls

In the realm of probability theory and game design, the study of dice probabilities plays a crucial role. The featured dice are usually fair, so their probabilities can be predicted without rolling the dice. Pentagonal prismatic dice are not fair. Hence, the probabilities are more complicated. Our mathematical model is naturally derived from both the geometric properties of the dice and empirical evidence. Dice of varying sizes but with constant volume were designed. Using a 3D printer with 100 percent infill, the dice were printed and prepared. A machine that simulates dropping dice through a dice tower onto a hard surface was used to obtain about 41,000 results. From these data, a statistical model was constructed that gives probabilities of dice with varying height-to-radius ratios. The formula for the model is based on the centroid solid angle, but with two adjustment parameters due to varying energy and other requirements to transition between different resting aspects. Within the range of height-to-radius ratios tested, the data are within reasonable statistical error of the model.

physics.data-an↗

Accelerating fits in high-energy physics and beyond

Data analysis in particle physics often involves optimizing a loss function that quantifies how well a theoretical model describes the observed data, in order to estimate the parameters of the model. This is referred to as fitting. As datasets grow larger and more expensive analysis methods are used, the time required to perform this parameter estimation can be a limiting factor. This work explores techniques for accelerating the fitting process, and measures their performance on a set of models representative of a variety of physics fits. We compare the speed and precision of variants of well-known optimization algorithms, namely Newton's method, BFGS, and the Migrad algorithm (commonly used in particle physics fits). We observe significant speedups when using some algorithms: most notably, some variants of BFGS are about ten times faster than Migrad, while achieving the same precision. For quasi-Newtonian algorithms like BFGS and Migrad, we find that the initial value of the Hessian matrix has a large impact on the runtime. We additionally discuss methods for accelerating the evaluation of the loss function and its derivatives, using algebraic simplifications, automatic differentiation, and modern hardware features. We explore techniques for achieving good precision with 32-bit operations, which can achieve significantly higher throughput on the GPU. Lastly we explore efficient parallelization strategies for the CPU and GPU. All of the techniques and algorithms in this paper are implemented in our new FastFit library, which was used for all of our benchmarks.

physics.data-an↗