arXiv subjects

Pablo Lemos

Publications and source records attributed to Pablo Lemos.

At least 55 records · Page 3Linked to original sources

arXiv2022

Marginal Bayesian Statistics Using Masked Autoregressive Flows and Kernel Density Estimators with Examples in Cosmology

Cosmological experiments often employ Bayesian workflows to derive constraints on cosmological and astrophysical parameters from their data. It has been shown that these constraints can be combined across different probes such as Planck and the Dark Energy Survey and that this can be a valuable exercise to improve our understanding of the universe and quantify tension between multiple experiments. However, these experiments are typically plagued by differing systematics, instrumental effects and contaminating signals, which we collectively refer to as `nuisance' components, that have to be modelled alongside target signals of interest. This leads to high dimensional parameter spaces, especially when combining data sets, with > 20 dimensions of which only around 5 correspond to key physical quantities. We present a means by which to combine constraints from different data sets in a computationally efficient manner by generating rapid, reusable and reliable marginal probability density estimators, giving us access to nuisance-free likelihoods. This is possible through the unique combination of nested sampling, which gives us access to Bayesian evidences, and the marginal Bayesian statistics code MARGARINE. Our method is lossless in the signal parameters, resulting in the same posterior distributions as would be found from a full nested sampling run over all nuisance parameters, and typically quicker than evaluating full likelihoods. We demonstrate our approach by applying it to the combination of posteriors from the Dark Energy Survey and Planck.

astro-ph.CO↗

arXiv2022

${\rm S{\scriptsize IM}BIG}$: A Forward Modeling Approach To Analyzing Galaxy Clustering

We present the first-ever cosmological constraints from a simulation-based inference (SBI) analysis of galaxy clustering from the new ${\rm S{\scriptsize IM}BIG}$ forward modeling framework. ${\rm S{\scriptsize IM}BIG}$ leverages the predictive power of high-fidelity simulations and provides an inference framework that can extract cosmological information on small non-linear scales, inaccessible with standard analyses. In this work, we apply ${\rm S{\scriptsize IM}BIG}$ to the BOSS CMASS galaxy sample and analyze the power spectrum, $P_\ell(k)$, to $k_{\rm max}=0.5\,h/{\rm Mpc}$. We construct 20,000 simulated galaxy samples using our forward model, which is based on high-resolution ${\rm Q{\scriptsize UIJOTE}}$ $N$-body simulations and includes detailed survey realism for a more complete treatment of observational systematics. We then conduct SBI by training normalizing flows using the simulated samples and infer the posterior distribution of $Λ$CDM cosmological parameters: $Ω_m, Ω_b, h, n_s, σ_8$. We derive significant constraints on $Ω_m$ and $σ_8$, which are consistent with previous works. Our constraints on $σ_8$ are $27\%$ more precise than standard analyses. This improvement is equivalent to the statistical gain expected from analyzing a galaxy sample that is $\sim60\%$ larger than CMASS with standard methods. It results from additional cosmological information on non-linear scales beyond the limit of current analytic models, $k > 0.25\,h/{\rm Mpc}$. While we focus on $P_\ell$ in this work for validation and comparison to the literature, ${\rm S{\scriptsize IM}BIG}$ provides a framework for analyzing galaxy clustering using any summary statistic. We expect further improvements on cosmological constraints from subsequent ${\rm S{\scriptsize IM}BIG}$ analyses of summary statistics beyond $P_\ell$.

astro-ph.CO↗

arXiv2022

${\rm S{\scriptsize IM}BIG}$: Mock Challenge for a Forward Modeling Approach to Galaxy Clustering

Simulation-Based Inference of Galaxies (${\rm S{\scriptsize IM}BIG}$) is a forward modeling framework for analyzing galaxy clustering using simulation-based inference. In this work, we present the ${\rm S{\scriptsize IM}BIG}$ forward model, which is designed to match the observed SDSS-III BOSS CMASS galaxy sample. The forward model is based on high-resolution ${\rm Q{\scriptsize UIJOTE}}$ $N$-body simulations and a flexible halo occupation model. It includes full survey realism and models observational systematics such as angular masking and fiber collisions. We present the "mock challenge" for validating the accuracy of posteriors inferred from ${\rm S{\scriptsize IM}BIG}$ using a suite of 1,500 test simulations constructed using forward models with a different $N$-body simulation, halo finder, and halo occupation prescription. As a demonstration of ${\rm S{\scriptsize IM}BIG}$, we analyze the power spectrum multipoles out to $k_{\rm max} = 0.5\,h/{\rm Mpc}$ and infer the posterior of $Λ$CDM cosmological and halo occupation parameters. Based on the mock challenge, we find that our constraints on $Ω_m$ and $σ_8$ are unbiased, but conservative. Hence, the mock challenge demonstrates that ${\rm S{\scriptsize IM}BIG}$ provides a robust framework for inferring cosmological parameters from galaxy clustering on non-linear scales and a complete framework for handling observational systematics. In subsequent work, we will use ${\rm S{\scriptsize IM}BIG}$ to analyze summary statistics beyond the power spectrum including the bispectrum, marked power spectrum, skew spectrum, wavelet statistics, and field-level statistics.

astro-ph.CO↗

arXiv2022

Constraints on dark matter to dark radiation conversion in the late universe with DES-Y1 and external data

We study a phenomenological class of models where dark matter converts to dark radiation in the low redshift epoch. This class of models, dubbed DMDR, characterizes the evolution of comoving dark matter density with two extra parameters, and may be able to help alleviate the observed discrepancies between early- and late-time probes of the universe. We investigate how the conversion affects key cosmological observables such as the CMB temperature and matter power spectra. Combining 3x2pt data from Year 1 of the Dark Energy Survey, {\it Planck}-2018 CMB temperature and polarization data, supernovae (SN) Type Ia data from Pantheon, and baryon acoustic oscillation (BAO) data from BOSS DR12, MGS and 6dFGS, we place new constraints on the amount of dark matter that has converted to dark radiation and the rate of this conversion. The fraction of the dark matter that has converted since the beginning of the universe in units of the current amount of dark matter, $ζ$, is constrained at 68\% confidence level to be $<0.32$ for DES-Y1 3x2pt data, $<0.030$ for CMB+SN+BAO data, and $<0.037$ for the combined dataset. The probability that the DES and CMB+SN+BAO datasets are concordant increases from 4\% for the $Λ$CDM model to 8\% (less tension) for DMDR. The tension in $S_8 = σ_8 \sqrt{Ω_{\rm m}/0.3}$ between DES-Y1 3x2pt and CMB+SN+BAO is slightly reduced from $2.3σ$ to $1.9σ$. We find no reduction in the Hubble tension when the combined data is compared to distance-ladder measurements in the DMDR model. The maximum-posterior goodness-of-fit statistics of DMDR and $Λ$CDM model are comparable, indicating no preference for the DMDR cosmology over $Λ$CDM.

astro-ph.CO↗

arXiv2022

Weak lensing magnification of Type Ia Supernovae from the Pantheon sample

Using data from the Pantheon SN Ia compilation and the Sloan Digital Sky Survey (SDSS), we propose an estimator for weak lensing convergence incorporating positional and photometric data of foreground galaxies. The correlation between this and the Hubble diagram residuals of the supernovae has $3.6σ$ significance, and is consistent with weak lensing magnification due to dark matter halos centered on galaxies. We additionally constrain the properties of the galactic haloes, such as the mass-to-light ratio $Γ$ and radial profile of the halo matter density $ρ(r)$. We derive a new relationship for the additional r.m.s. scatter in magnitudes caused by lensing, finding $σ_{\rm lens} = (0.06 \pm 0.017) (d_{\rm C}(z)/ d_{\rm C}(z=1))^{3/2}$ where $d_{\rm C}(z)$ is the comoving distance to redshift $z$. Hence the scatter in apparent magnitudes due lensing will be of the same size as the intrinsic scatter of SN Ia by $z \sim 1.2$. We propose a modification of the distance modulus estimator for SN Ia to incorporate lensing, which can be easily calculated from observational data. We anticipate this will improve the accuracy of cosmological parameter estimation for high-redshift SN Ia data.

astro-ph.CO↗

arXiv2022

Cosmological Information in the Marked Power Spectrum of the Galaxy Field

Marked power spectra are two-point statistics of a marked field obtained by weighting each location with a function that depends on the local density around that point. We consider marked power spectra of the galaxy field in redshift space that up-weight low density regions, and perform a Fisher matrix analysis to assess the information content of this type of statistics using the Molino mock catalogs built upon the Quijote simulations. We identify four different ways to up-weight the galaxy field, and compare the Fisher information contained in their marked power spectra to the one of the standard galaxy power spectrum, when considering monopole and quadrupole of each statistic. Our results show that each of the four marked power spectra can tighten the standard power spectrum constraints on the cosmological parameters $Ω_{\rm m}$, $Ω_{\rm b}$, $h$, $n_s$, $M_ν$ by $15-25\%$ and on $σ_8$ by a factor of 2. The same analysis performed by combining the standard and four marked power spectra shows a substantial improvement compared to the power spectrum constraints that is equal to a factor of 6 for $σ_8$ and $2.5-3$ for the other parameters. Our constraints may be conservative, since the galaxy number density in the Molino catalogs is much lower than the ones in future galaxy surveys, which will allow them to probe lower density regions of the large-scale structure.

astro-ph.CO↗

arXiv2022

Split personalities in Bayesian Neural Networks: the case for full marginalisation

The true posterior distribution of a Bayesian neural network is massively multimodal. Whilst most of these modes are functionally equivalent, we demonstrate that there remains a level of real multimodality that manifests in even the simplest neural network setups. It is only by fully marginalising over all posterior modes, using appropriate Bayesian sampling tools, that we can capture the split personalities of the network. The ability of a network trained in this manner to reason between multiple candidate solutions dramatically improves the generalisability of the model, a feature we contend is not consistently captured by alternative approaches to the training of Bayesian neural networks. We provide a concise minimal example of this, which can provide lessons and a future path forward for correctly utilising the explainability and interpretability of Bayesian neural networks.

stat.ML↗

arXiv2022

Wavelet Moments for Cosmological Parameter Estimation

Extracting non-Gaussian information from the non-linear regime of structure formation is key to fully exploiting the rich data from upcoming cosmological surveys probing the large-scale structure of the universe. However, due to theoretical and computational complexities, this remains one of the main challenges in analyzing observational data. We present a set of summary statistics for cosmological matter fields based on 3D wavelets to tackle this challenge. These statistics are computed as the spatial average of the complex modulus of the 3D wavelet transform raised to a power $q$ and are therefore known as invariant wavelet moments. The 3D wavelets are constructed to be radially band-limited and separable on a spherical polar grid and come in three types: isotropic, oriented, and harmonic. In the Fisher forecast framework, we evaluate the performance of these summary statistics on matter fields from the Quijote suite, where they are shown to reach state-of-the-art parameter constraints on the base $Λ$CDM parameters, as well as the sum of neutrino masses. We show that we can improve constraints by a factor 5 to 10 in all parameters with respect to the power spectrum baseline.

astro-ph.CO↗

arXiv2022

Rediscovering orbital mechanics with machine learning

We present an approach for using machine learning to automatically discover the governing equations and hidden properties of real physical systems from observations. We train a "graph neural network" to simulate the dynamics of our solar system's Sun, planets, and large moons from 30 years of trajectory data. We then use symbolic regression to discover an analytical expression for the force law implicitly learned by the neural network, which our results showed is equivalent to Newton's law of gravitation. The key assumptions that were required were translational and rotational equivariance, and Newton's second and third laws of motion. Our approach correctly discovered the form of the symbolic force law. Furthermore, our approach did not require any assumptions about the masses of planets and moons or physical constants. They, too, were accurately inferred through our methods. Though, of course, the classical law of gravitation has been known since Isaac Newton, our result serves as a validation that our method can discover unknown laws and hidden properties from observed data. More broadly this work represents a key step toward realizing the potential of machine learning for accelerating scientific discovery.

astro-ph.EP↗

arXiv2022

Cosmology with one galaxy?

Galaxies can be characterized by many internal properties such as stellar mass, gas metallicity, and star-formation rate. We quantify the amount of cosmological and astrophysical information that the internal properties of individual galaxies and their host dark matter halos contain. We train neural networks using hundreds of thousands of galaxies from 2,000 state-of-the-art hydrodynamic simulations with different cosmologies and astrophysical models of the CAMELS project to perform likelihood-free inference on the value of the cosmological and astrophysical parameters. We find that knowing the internal properties of a single galaxy allow our models to infer the value of $Ω_{\rm m}$, at fixed $Ω_{\rm b}$, with a $\sim10\%$ precision, while no constraint can be placed on $σ_8$. Our results hold for any type of galaxy, central or satellite, massive or dwarf, at all considered redshifts, $z\leq3$, and they incorporate uncertainties in astrophysics as modeled in CAMELS. However, our models are not robust to changes in subgrid physics due to the large intrinsic differences the two considered models imprint on galaxy properties. We find that the stellar mass, stellar metallicity, and maximum circular velocity are among the most important galaxy properties to determine the value of $Ω_{\rm m}$. We believe that our results can be explained taking into account that changes in the value of $Ω_{\rm m}$, or potentially $Ω_{\rm b}/Ω_{\rm m}$, affect the dark matter content of galaxies. That effect leaves a distinct signature in galaxy properties to the one induced by galactic processes. Our results suggest that the low-dimensional manifold hosting galaxy properties provides a tight direct link between cosmology and astrophysics.

astro-ph.CO↗

arXiv2021

A buyer's guide to the Hubble Constant

Since the expansion of the universe was first established by Edwin Hubble and Georges Lemaitre about a century ago, the Hubble constant H0 which measures its rate has been of great interest to astronomers. Besides being interesting in its own right, few properties of the universe can be deduced without it. In the last decade a significant gap has emerged between different methods of measuring it, some anchored in the nearby universe, others at cosmological distances. The SH0ES team has found $H_0 = 73.2 \pm 1.3$ km sec$^{-1}$ Mpc$^{-1}$ locally, whereas the value found for the early universe by the Planck Collaboration is $H_0 = 67.4 \pm 0.5$ km sec$^{-1}$ Mpc$^{-1}$ from measurements of the cosmic microwave background. Is this gap a sign that the well-established $Λ$CDM cosmological model is somehow incomplete? Or are there unknown systematics? And more practically, how should humble astronomers pick between competing claims if they need to assume a value for a certain purpose? In this article, we review results and what changes to the cosmological model could be needed to accommodate them all. For astronomers in a hurry, we provide a buyer's guide to the results, and make recommendations.

astro-ph.CO↗

arXiv2021

Quantifying the global parameter tensions between ACT, SPT and Planck

The overall cosmological parameter tension between the Atacama Cosmology Telescope 2020 (ACT) and Planck 2018 data within the concordance cosmological model is quantified using the suspiciousness statistic to be 2.6$σ$. Between ACT and the South Pole Telescope (SPT) we find a tension of 2.4$σ$, and 2.8$σ$ between ACT and Planck+SPT combined. While it is unclear whether the tension is caused by statistical fluctuations, systematic effects or new physics, caution should be exercised in combining these cosmic microwave background datasets in the context of the $Λ$CDM standard model of the universe.

astro-ph.CO↗

arXiv2020

The sum of the masses of the Milky Way and M31: a likelihood-free inference approach

We use Density Estimation Likelihood-Free Inference, $Λ$ Cold Dark Matter simulations of $\sim 2M$ galaxy pairs, and data from Gaia and the Hubble Space Telescope to infer the sum of the masses of the Milky Way and Andromeda (M31) galaxies, the two main components of the Local Group. This method overcomes most of the approximations of the traditional timing argument, makes the writing of a theoretical likelihood unnecessary, and allows the non-linear modelling of observational errors that take into account correlations in the data and non-Gaussian distributions. We obtain an $M_{200}$ mass estimate $M_{\rm MW+M31} = 4.6^{+2.3}_{-1.8} \times 10^{12} M_{\odot}$ ($68 \%$ C.L.), in agreement with previous estimates both for the sum of the two masses and for the individual masses. This result is not only one of the most reliable estimates of the sum of the two masses to date, but is also an illustration of likelihood-free inference in a problem with only one parameter and only three data points.

astro-ph.GA↗

arXiv2020

The Impact of Peculiar Velocities on the Estimation of the Hubble Constant from Gravitational Wave Standard Sirens

In this work we investigate the systematic uncertainties that arise from the calculation of the peculiar velocity when estimating the Hubble constant ($H_0$) from gravitational wave standard sirens. We study the GW170817 event and the estimation of the peculiar velocity of its host galaxy, NGC 4993, when using Gaussian smoothing over nearby galaxies. NGC 4993 being a relatively nearby galaxy, at $\sim 40 \ {\rm Mpc}$ away, is subject to a significant effect of peculiar velocities. We demonstrate a direct dependence of the estimated peculiar velocity value on the choice of smoothing scale. We show that when not accounting for this systematic, a bias of $\sim 200 \ {\rm km \ s ^{-1}}$ in the peculiar velocity incurs a bias of $\sim 4 \ {\rm km \ s ^{-1} \ Mpc^{-1}}$ on the Hubble constant. We formulate a Bayesian model that accounts for the dependence of the peculiar velocity on the smoothing scale and by marginalising over this parameter we remove the need for a choice of smoothing scale. The proposed model yields $H_0 = 68.6 ^{+14.0}_{-8.5}~{\rm km\ s^{-1}\ Mpc^{-1}}$. We demonstrate that under this model a more robust unbiased estimate of the Hubble constant from nearby GW sources is obtained.

astro-ph.CO↗

arXiv2020

Baryon Acoustic Oscillations and the Hubble Constant: Past, Present and Future

We investigate constraints on the Hubble constant ($H_0$) using Baryon Acoustic Oscillations (BAO) and baryon density measurements from Big Bang Nucleosynthesis (BBN). We start by investigating the tension between galaxy BAO measurements and those using the Lyman-$α$ forest, within a Bayesian framework. Using the latest results from eBOSS DR14 we find that the probability of this tension being statistical is $\simeq6.3\%$ assuming flat $Λ$CDM. We measure $H_0 = 67.6\pm1.1$ km s$^{-1}$ Mpc$^{-1}$, with a weak dependence on the BBN prior used, in agreement with results from Planck Cosmic Microwave Background (CMB) results and in strong tension with distance ladder results. Finally, we forecast the future of BAO $+$ BBN measurements of $H_0$, using the Dark Energy Spectroscopic Instrument (DESI). We find that the choice of BBN prior will have a significant impact when considering future BAO measurements from DESI.

astro-ph.CO↗

arXiv2019

Quantifying dimensionality: Bayesian cosmological model complexities

We demonstrate a measure for the effective number of parameters constrained by a posterior distribution in the context of cosmology. In the same way that the mean of the Shannon information (i.e. the Kullback-Leibler divergence) provides a measure of the strength of constraint between prior and posterior, we show that the variance of the Shannon information gives a measure of dimensionality of constraint. We examine this quantity in a cosmological context, applying it to likelihoods derived from Cosmic Microwave Background, large scale structure and supernovae data. We show that this measure of Bayesian model dimensionality compares favourably both analytically and numerically in a cosmological context with the existing measure of model complexity used in the literature.

astro-ph.CO↗

arXiv2019

Quantifying tensions in cosmological parameters: Interpreting the DES evidence ratio

We provide a new interpretation for the Bayes factor combination used in the Dark Energy Survey (DES) first year analysis to quantify the tension between the DES and Planck datasets. The ratio quantifies a Bayesian confidence in our ability to combine the datasets. This interpretation is prior-dependent, with wider prior widths boosting the confidence. We therefore propose that if there are any reasonable priors which reduce the confidence to below unity, then we cannot assert that the datasets are compatible. Computing the evidence ratios for the DES first year analysis and Planck, given that narrower priors drop the confidence to below unity, we conclude that DES and Planck are, in a Bayesian sense, incompatible under LCDM. Additionally we compute ratios which confirm the consensus that measurements of the acoustic scale by the Baryon Oscillation Spectroscopic Survey (SDSS) are compatible with Planck, whilst direct measurements of the acceleration rate of the Universe by the SHOES collaboration are not. We propose a modification to the Bayes ratio which removes the prior dependency using Kullback-Leibler divergences, and using this statistical test find Planck in strong tension with SHOES, in moderate tension with DES, and in no tension with SDSS. We propose this statistic as the optimal way to compare datasets, ahead of the next DES data releases, as well as future surveys. Finally, as an element of these calculations, we introduce in a cosmological setting the Bayesian model dimensionality, which is a parameterisation-independent measure of the number of parameters that a given dataset constrains.

astro-ph.CO↗

arXiv2019

Quantifying Suspiciousness Within Correlated Data Sets

We propose a principled Bayesian method for quantifying tension between correlated datasets with wide uninformative parameter priors. This is achieved by extending the Suspiciousness statistic, which is insensitive to priors. Our method uses global summary statistics, and as such it can be used as a diagnostic for internal consistency. We show how our approach can be combined with methods that use parameter space and data space to identify the existing internal discrepancies. As an example, we use it to test the internal consistency of the KiDS-450 data in 4 photometric redshift bins, and to recover controlled internal discrepancies in simulated KiDS data. We propose this as a diagnostic of internal consistency for present and future cosmological surveys, and as a tension metric for data sets that have non-negligible correlation, such as LSST and Euclid.

astro-ph.CO↗