Searcharxiv⌕ Search

arXiv subjects

Miguel Biron-Lattes

Publications and source records attributed to Miguel Biron-Lattes.

8 recordsLinked to original sources

GPU-accelerated Bayesian inference for block-cave geometry recovery via muon tomography

We describe a Bayesian framework for the inverse problem of geometry recovery of block caving via muon tomography. We work with a low dimensional surface-based representation of the geometry of the block cave, which dramatically reduces the computational requirements of the model while allowing realistic geometries. Adopting a Bayesian approach, we define a prior distribution on the space of geometries that favors realistic cave shapes. Pairing this prior with a likelihood based on the muon tomography forward model, we obtain a posterior distribution over cave geometries using Bayes rule. We obtain approximate samples from this posterior distribution using Markov chain Monte Carlo algorithms running on GPUs, resulting in fast and accurate sampling. We test the fidelity of our methodology by applying it to a simulated block caving scenario for which the ground truth is known. Results show that our method produces sensible geometries that are simultaneously compatible with the data.

stat.AP↗

AutoStep: Locally adaptive involutive MCMC

Many common Markov chain Monte Carlo (MCMC) kernels can be formulated using a deterministic involutive proposal with a step size parameter. Selecting an appropriate step size is often a challenging task in practice; and for complex multiscale targets, there may not be one choice of step size that works well globally. In this work, we address this problem with a novel class of involutive MCMC methods -- AutoStep MCMC -- that selects an appropriate step size at each iteration adapted to the local geometry of the target distribution. We prove that under mild conditions AutoStep MCMC is $π$-invariant, irreducible, and aperiodic, and obtain bounds on expected energy jump distance and cost per iteration. Empirical results examine the robustness and efficacy of our proposed step size selection procedure, and show that AutoStep MCMC is competitive with state-of-the-art methods in terms of effective sample size per unit cost on a range of challenging target distributions.

stat.CO↗

Is Gibbs sampling faster than Hamiltonian Monte Carlo on GLMs?

The Hamiltonian Monte Carlo (HMC) algorithm is often lauded for its ability to effectively sample from high-dimensional distributions. In this paper we challenge the presumed domination of HMC for the Bayesian analysis of GLMs. By utilizing the structure of the compute graph rather than the graphical model, we show a reduction of the time per sweep of a full-scan Gibbs sampler from $O(d^2)$ to $O(d)$, where $d$ is the number of GLM parameters. A simple change to the implementation of the Gibbs sampler allows us to perform Bayesian inference on high-dimensional GLMs that are practically infeasible with traditional Gibbs sampler implementations. We empirically demonstrate a substantial increase in effective sample size per time when comparing our Gibbs algorithms to state-of-the-art HMC algorithms. While Gibbs is superior in terms of dimension scaling, neither Gibbs nor HMC dominate the other: we provide numerical and theoretical evidence that HMC retains an edge in certain circumstances thanks to its advantageous condition number scaling. Interestingly, for GLMs of fixed data size, we observe that increasing dimensionality can stabilize or even decrease condition number, shedding light on the empirical advantage of our efficient Gibbs sampler.

stat.CO↗

On the Orbit of the Binary Brown Dwarf Companion GL229 Ba and Bb

The companion GL229B was recently resolved by Xuan et al. (2024) as a tight binary of two brown dwarfs (Ba and Bb) through VLTI-GRAVITY interferometry and VLT-CRIRES+ RV measurements. Here, we present Bayesian models of the interferometric and RV data in additional detail, along with an updated outer orbit of the brown dwarf pair about the primary. To create a model of the inner orbit with robust uncertainties, we apply kernel phases to the GRAVITY data to address baseline redundancy in the raw closure phases. Using parallel tempering, we constrain the binary's orbit using only VLTI-GRAVITY data, despite each epoch having low visibility-plane coverage and/or SNR. We demonstrate very agreement the VLTI-GRAVITY and CRIRES+ datasets and find that the inner binary has a period of 12.1346$\pm$0.0011 days, eccentricity of 0.2317$\pm$0.0025, and total mass of 71.0$\pm$0.4 Mjup, with Ba and Bb having masses of 37.7$\pm$1.1Mjup and 33.4$\pm$1.0Mjup respectively. With new Keck/NIRC2 astrometry, we update the outer orbit GL229B around the primary. We find a semi-major axis of 42.9+3.0-2.4AU, eccentricity of 0.736$\pm$0.014, and a total mass for B of 71.7$\pm$0.6Mjup, consistent with that derived from the inner orbit. We find a mutual inclination of 31$\pm$2.5deg, below the threshold for Kozai-Lidov oscillations. The agreement on the mass of Ba+Bb between the inner and outer orbits is an important test of our ability to model RV, astrometry, and Hipparcos-Gaia proper motion anomaly. Our methodological advances in handling interferometric data with low SNR and sparse UV-coverage will benefit future observations of rapidly-orbiting companions with VLTI-GRAVITY.

astro-ph.SR↗

autoMALA: Locally adaptive Metropolis-adjusted Langevin algorithm

Selecting the step size for the Metropolis-adjusted Langevin algorithm (MALA) is necessary in order to obtain satisfactory performance. However, finding an adequate step size for an arbitrary target distribution can be a difficult task and even the best step size can perform poorly in specific regions of the space when the target distribution is sufficiently complex. To resolve this issue we introduce autoMALA, a new Markov chain Monte Carlo algorithm based on MALA that automatically sets its step size at each iteration based on the local geometry of the target distribution. We prove that autoMALA has the correct invariant distribution, despite continual automatic adjustments of the step size. Our experiments demonstrate that autoMALA is competitive with related state-of-the-art MCMC methods, in terms of the number of log density evaluations per effective sample, and it outperforms state-of-the-art samplers on targets with varying geometries. Furthermore, we find that autoMALA tends to find step sizes comparable to optimally-tuned MALA when a fixed step size suffices for the whole domain.

stat.CO↗

Automatic Regenerative Simulation via Non-Reversible Simulated Tempering

Simulated Tempering (ST) is an MCMC algorithm for complex target distributions that operates on a path between the target and a more amenable reference distribution. Crucially, if the reference enables i.i.d. sampling, ST is regenerative and can be parallelized across independent tours. However, the difficulty of tuning ST has hindered its widespread adoption. In this work, we develop a simple nonreversible ST (NRST) algorithm, a general theoretical analysis of ST, and an automated tuning procedure for ST. A core contribution that arises from the analysis is a novel performance metric -- Tour Effectiveness (TE) -- that controls the asymptotic variance of estimates from ST for bounded test functions. We use the TE to show that NRST dominates its reversible counterpart. We then develop an automated tuning procedure for NRST algorithms that targets the TE while minimizing computational cost. This procedure enables straightforward integration of NRST into existing probabilistic programming languages. We provide extensive experimental evidence that our tuning scheme improves the performance and robustness of NRST algorithms on a diverse set of probabilistic models.

stat.CO↗

Pigeons.jl: Distributed Sampling From Intractable Distributions

We introduce a software package, Pigeons.jl, that provides a way to leverage distributed computation to obtain samples from complicated probability distributions, such as multimodal posteriors arising in Bayesian inference and high-dimensional distributions in statistical mechanics. Pigeons.jl provides simple APIs to perform such computations single-threaded, multi-threaded, and/or distributed over thousands of MPI-communicating machines. In addition, Pigeons.jl guarantees a property that we call strong parallelism invariance: the output for a given seed is identical irrespective of the number of threads and processes, which is crucial for scientific reproducibility and software validation. We describe the key features of Pigeons.jl and the approach taken to implement a distributed and randomized algorithm that satisfies strong parallelism invariance.

stat.CO↗

Pseudo-marginal Inference for CTMCs on Infinite Spaces via Monotonic Likelihood Approximations

Bayesian inference for Continuous-Time Markov Chains (CTMCs) on countably infinite spaces is notoriously difficult because evaluating the likelihood exactly is intractable. One way to address this challenge is to first build a non-negative and unbiased estimate of the likelihood -- involving the matrix exponential of finite truncations of the true rate matrix -- and then to use the estimates in a pseudo-marginal inference method. In this work, we show that we can dramatically increase the efficiency of this approach by avoiding the computation of exact matrix exponentials. In particular, we develop a general methodology for constructing an unbiased, non-negative estimate of the likelihood using doubly-monotone matrix exponential approximations. We further develop a novel approximation in this family -- the skeletoid -- as well as theory regarding its approximation error and how that relates to the variance of the estimates used in pseudo-marginal inference. Experimental results show that our approach yields more efficient posterior inference for a wide variety of CTMCs.

stat.CO↗