arXiv subjects

Benjamin Wandelt

Publications and source records attributed to Benjamin Wandelt.

At least 37 records · Page 2Linked to original sources

arXiv2022

Simulation-Based Inference of Strong Gravitational Lensing Parameters

In the coming years, a new generation of sky surveys, in particular, Euclid Space Telescope (2022), and the Rubin Observatory's Legacy Survey of Space and Time (LSST, 2023) will discover more than 200,000 new strong gravitational lenses, which represents an increase of more than two orders of magnitude compared to currently known sample sizes. Accurate and fast analysis of such large volumes of data under a statistical framework is therefore crucial for all sciences enabled by strong lensing. Here, we report on the application of simulation-based inference methods, in particular, density estimation techniques, to the predictions of the set of parameters of strong lensing systems from neural networks. This allows us to explicitly impose desired priors on lensing parameters, while guaranteeing convergence to the optimal posterior in the limit of perfect performance.

astro-ph.CO↗

arXiv2022

The CAMELS project: public data release

The Cosmology and Astrophysics with MachinE Learning Simulations (CAMELS) project was developed to combine cosmology with astrophysics through thousands of cosmological hydrodynamic simulations and machine learning. CAMELS contains 4,233 cosmological simulations, 2,049 N-body and 2,184 state-of-the-art hydrodynamic simulations that sample a vast volume in parameter space. In this paper we present the CAMELS public data release, describing the characteristics of the CAMELS simulations and a variety of data products generated from them, including halo, subhalo, galaxy, and void catalogues, power spectra, bispectra, Lyman-$α$ spectra, probability distribution functions, halo radial profiles, and X-rays photon lists. We also release over one thousand catalogues that contain billions of galaxies from CAMELS-SAM: a large collection of N-body simulations that have been combined with the Santa Cruz Semi-Analytic Model. We release all the data, comprising more than 350 terabytes and containing 143,922 snapshots, millions of halos, galaxies and summary statistics. We provide further technical details on how to access, download, read, and process the data at \url{https://camels.readthedocs.io}.

astro-ph.CO↗

arXiv2021

The CAMELS Multifield Dataset: Learning the Universe's Fundamental Parameters with Artificial Intelligence

We present the Cosmology and Astrophysics with MachinE Learning Simulations (CAMELS) Multifield Dataset, CMD, a collection of hundreds of thousands of 2D maps and 3D grids containing many different properties of cosmic gas, dark matter, and stars from 2,000 distinct simulated universes at several cosmic times. The 2D maps and 3D grids represent cosmic regions that span $\sim$100 million light years and have been generated from thousands of state-of-the-art hydrodynamic and gravity-only N-body simulations from the CAMELS project. Designed to train machine learning models, CMD is the largest dataset of its kind containing more than 70 Terabytes of data. In this paper we describe CMD in detail and outline a few of its applications. We focus our attention on one such task, parameter inference, formulating the problems we face as a challenge to the community. We release all data and provide further technical details at https://camels-multifield-dataset.readthedocs.io.

cs.LG↗

arXiv2021

Robust marginalization of baryonic effects for cosmological inference at the field level

We train neural networks to perform likelihood-free inference from $(25\,h^{-1}{\rm Mpc})^2$ 2D maps containing the total mass surface density from thousands of hydrodynamic simulations of the CAMELS project. We show that the networks can extract information beyond one-point functions and power spectra from all resolved scales ($\gtrsim 100\,h^{-1}{\rm kpc}$) while performing a robust marginalization over baryonic physics at the field level: the model can infer the value of $Ω_{\rm m} (\pm 4\%)$ and $σ_8 (\pm 2.5\%)$ from simulations completely different to the ones used to train it.

astro-ph.CO↗

arXiv2021

Multifield Cosmology with Artificial Intelligence

Astrophysical processes such as feedback from supernovae and active galactic nuclei modify the properties and spatial distribution of dark matter, gas, and galaxies in a poorly understood way. This uncertainty is one of the main theoretical obstacles to extract information from cosmological surveys. We use 2,000 state-of-the-art hydrodynamic simulations from the CAMELS project spanning a wide variety of cosmological and astrophysical models and generate hundreds of thousands of 2-dimensional maps for 13 different fields: from dark matter to gas and stellar properties. We use these maps to train convolutional neural networks to extract the maximum amount of cosmological information while marginalizing over astrophysical effects at the field level. Although our maps only cover a small area of $(25~h^{-1}{\rm Mpc})^2$, and the different fields are contaminated by astrophysical effects in very different ways, our networks can infer the values of $Ω_{\rm m}$ and $σ_8$ with a few percent level precision for most of the fields. We find that the marginalization performed by the network retains a wealth of cosmological information compared to a model trained on maps from gravity-only N-body simulations that are not contaminated by astrophysical effects. Finally, we train our networks on multifields -- 2D maps that contain several fields as different colors or channels -- and find that not only they can infer the value of all parameters with higher accuracy than networks trained on individual fields, but they can constrain the value of $Ω_{\rm m}$ with higher accuracy than the maps from the N-body simulations.

astro-ph.CO↗

arXiv2021

The Quijote simulations

The Quijote simulations are a set of 44,100 full N-body simulations spanning more than 7,000 cosmological models in the $\{Ω_{\rm m}, Ω_{\rm b}, h, n_s, σ_8, M_ν, w \}$ hyperplane. At a single redshift the simulations contain more than 8.5 trillions of particles over a combined volume of 44,100 $(h^{-1}{\rm Gpc})^3$; each simulation follow the evolution of $256^3$, $512^3$ or $1024^3$ particles in a box of $1~h^{-1}{\rm Gpc}$ length. Billions of dark matter halos and cosmic voids have been identified in the simulations, whose runs required more than 35 million core hours. The Quijote simulations have been designed for two main purposes: 1) to quantify the information content on cosmological observables, and 2) to provide enough data to train machine learning algorithms. In this paper we describe the simulations and show a few of their applications. We also release the Petabyte of data generated, comprising hundreds of thousands of simulation snapshots at multiple redshifts, halo and void catalogs, together with millions of summary statistics such as power spectra, bispectra, correlation functions, marked power spectra, and estimated probability density functions.

astro-ph.CO↗

arXiv2021

CARPool: fast, accurate computation of large-scale structure statistics by pairing costly and cheap cosmological simulations

To exploit the power of next-generation large-scale structure surveys, ensembles of numerical simulations are necessary to give accurate theoretical predictions of the statistics of observables. High-fidelity simulations come at a towering computational cost. Therefore, approximate but fast simulations, surrogates, are widely used to gain speed at the price of introducing model error. We propose a general method that exploits the correlation between simulations and surrogates to compute fast, reduced-variance statistics of large-scale structure observables without model error at the cost of only a few simulations. We call this approach Convergence Acceleration by Regression and Pooling (CARPool). In numerical experiments with intentionally minimal tuning, we apply CARPool to a handful of GADGET-III $N$-body simulations paired with surrogates computed using COmoving Lagrangian Acceleration (COLA). We find $\sim 100$-fold variance reduction even in the non-linear regime, up to $k_\mathrm{max} \approx 1.2$ $h {\rm Mpc^{-1}}$ for the matter power spectrum. CARPool realises similar improvements for the matter bispectrum. In the nearly linear regime CARPool attains far larger sample variance reductions. By comparing to the 15,000 simulations from the Quijote suite, we verify that the CARPool estimates are unbiased, as guaranteed by construction, even though the surrogate misses the simulation truth by up to $60\%$ at high $k$. Furthermore, even with a fully configuration-space statistic like the non-linear matter density probability density function, CARPool achieves unbiased variance reduction factors of up to $\sim 10$, without any further tuning. Conversely, CARPool can be used to remove model error from ensembles of fast surrogates by combining them with a few high-accuracy simulations.

astro-ph.CO↗

arXiv2021

The Role of Machine Learning in the Next Decade of Cosmology

In recent years, machine learning (ML) methods have remarkably improved how cosmologists can interpret data. The next decade will bring new opportunities for data-driven cosmological discovery, but will also present new challenges for adopting ML methodologies and understanding the results. ML could transform our field, but this transformation will require the astronomy community to both foster and promote interdisciplinary research endeavors.

astro-ph.IM↗

arXiv2020

CMB-HD: Astro2020 RFI Response

CMB-HD is a proposed ultra-deep (0.5 uk-arcmin), high-resolution (15 arcseconds) millimeter-wave survey over half the sky that would answer many outstanding questions in both fundamental physics of the Universe and astrophysics. This survey would be delivered in 7.5 years of observing 20,000 square degrees, using two new 30-meter-class off-axis cross-Dragone telescopes to be located at Cerro Toco in the Atacama Desert. Each telescope would field 800,000 detectors (200,000 pixels), for a total of 1.6 million detectors.

astro-ph.CO↗

arXiv2019

The local and distant Universe: stellar ages and $H_0$

The ages of the oldest stellar objects in our galaxy provide an independent test of the current cosmological model as they give a lower limit to the age of the Universe. Recent accurate parallaxes by the Gaia space mission, accurate measurements of the metallicity of stars, via individual elemental abundances, and advances in the modelling of stellar evolution, provide new, higher-precision age estimates of the oldest stellar populations in the galaxy: globular clusters and very-low-metallicity stars. The constraints on the age of the Universe, $t_U$, so obtained are determined from the local Universe and at late time. It is well known that local and early-Universe determinations of another cosmological parameter closely related to the age of the Universe, the Hubble constant $H_0$, show a $\gtrsim 3 σ$ tension. In the standard cosmological model, $Λ$CDM, $t_U$ and $H_0$ are related by the matter density parameter $Ω_{m,0}$. We propose to combine local $t_U$ constraints with late-time $Ω_{m,0}$ estimates in a $Λ$CDM framework, to obtain a low-redshift $H_0$ determination that does not rely on early Universe physics. A proof-of-principle of this approach with current data gives $H_0=71\pm2.8$ ($H_0= 69.3 \pm 2.7$) km s$^{-1}$ Mpc$^{-1}$ from globular clusters (very-low-metallicity stars) with excellent prospects for improved constraints in the near future.

astro-ph.CO↗

arXiv2019

Nuisance hardened data compression for fast likelihood-free inference

In this paper we show how nuisance parameter marginalized posteriors can be inferred directly from simulations in a likelihood-free setting, without having to jointly infer the higher-dimensional interesting and nuisance parameter posterior first and marginalize a posteriori. The result is that for an inference task with a given number of interesting parameters, the number of simulations required to perform likelihood-free inference can be kept (roughly) the same irrespective of the number of additional nuisances to be marginalized over. To achieve this we introduce two extensions to the standard likelihood-free inference set-up. Firstly we show how nuisance parameters can be re-cast as latent variables and hence automatically marginalized over in the likelihood-free framework. Secondly, we derive an asymptotically optimal compression from $N$ data down to $n$ summaries -- one per interesting parameter -- such that the Fisher information is (asymptotically) preserved, but the summaries are insensitive (to leading order) to the nuisance parameters. This means that the nuisance marginalized inference task involves learning $n$ interesting parameters from $n$ "nuisance hardened" data summaries, regardless of the presence or number of additional nuisance parameters to be marginalized over. We validate our approach on two examples from cosmology: supernovae and weak lensing data analyses with nuisance parameterized systematics. For the supernova problem, high-fidelity posterior inference of $Ω_m$ and $w_0$ (marginalized over systematics) can be obtained from just a few hundred data simulations. For the weak lensing problem, six cosmological parameters can be inferred from $\mathcal{O}(10^3)$ simulations, irrespective of whether ten additional nuisance parameters are included in the problem or not.

astro-ph.CO↗

arXiv2019

Fast likelihood-free cosmology with neural density estimators and active learning

Likelihood-free inference provides a framework for performing rigorous Bayesian inference using only forward simulations, properly accounting for all physical and observational effects that can be successfully included in the simulations. The key challenge for likelihood-free applications in cosmology, where simulation is typically expensive, is developing methods that can achieve high-fidelity posterior inference with as few simulations as possible. Density-estimation likelihood-free inference (DELFI) methods turn inference into a density estimation task on a set of simulated data-parameter pairs, and give orders of magnitude improvements over traditional Approximate Bayesian Computation approaches to likelihood-free inference. In this paper we use neural density estimators (NDEs) to learn the likelihood function from a set of simulated datasets, with active learning to adaptively acquire simulations in the most relevant regions of parameter space on-the-fly. We demonstrate the approach on a number of cosmological case studies, showing that for typical problems high-fidelity posterior inference can be achieved with just $\mathcal{O}(10^3)$ simulations or fewer. In addition to enabling efficient simulation-based inference, for simple problems where the form of the likelihood is known, DELFI offers a fast alternative to MCMC sampling, giving orders of magnitude speed-up in some cases. Finally, we introduce \textsc{pydelfi} -- a flexible public implementation of DELFI with NDEs and active learning -- available at \url{https://github.com/justinalsing/pydelfi}.

astro-ph.CO↗

arXiv2018

Statistical properties of paired fixed fields

The initial conditions of cosmological simulations are commonly drawn from a Gaussian ensemble. The limited number of modes inside a simulation volume gives rise to statistical fluctuations known as \textit{sample variance}, limiting the accuracy of simulation predictions. Fixed fields offer an alternative initialization strategy; they have the same power spectrum as standard Gaussian fields but without intrinsic amplitude scatter at linear order. Paired fixed fields consists of two fixed fields with opposite phases that cancel phase correlations which otherwise induce second-order scatter in the non-linear power spectrum. We study the statistical properties of those fields for 19 different quantities at different redshifts through a large set of 600 N-body and 506 state-of-the-art magneto-hydrodynamic simulations covering a wide range of scales, mass and spatial resolutions. We find that paired fixed simulations do not introduce a bias on any of the examined quantities. We quantify the statistical improvement brought by these simulations, over standard ones, on different power spectra such as matter, halos, CDM, gas, stars, black-holes and magnetic fields, finding that they can reduce their variance by factors as large as $10^6$. We quantify the improvement achieved by fixing and by pairing, showing that sample variance in some quantities can be highly suppressed by pairing after fixing. Paired fixed simulations do not change the scatter in quantities such as the probability distribution function of matter density, or the halo, void or stellar mass functions. We argue that procedures aiming at reducing the sample variance of those quantities are unlikely to work. Our results show that paired fixed simulations do not affect either mean relations or scatter of galaxy properties, and suggest that the information embedded in 1-pt statistics is highly complementary to that in clustering.

astro-ph.CO↗

arXiv2018

Science Impacts of the SPHEREx All-Sky Optical to Near-Infrared Spectral Survey II: Report of a Community Workshop on the Scientific Synergies Between the SPHEREx Survey and Other Astronomy Observatories

SPHEREx is a proposed NASA MIDEX mission selected for Phase A study. SPHEREx would carry out the first all-sky spectral survey in the near infrared. At the end of its two-year mission, SPHEREx would obtain 0.75-to-5$μ$m spectra of every 6.2 arcsec pixel on the sky, with spectral resolution R>35 and a 5-$σ$ sensitivity AB$>$19 per spectral/spatial resolution element. More details concerning SPHEREx are available at http://spherex.caltech.edu. The SPHEREx team has proposed three specific science investigations to be carried out with this unique data set: cosmic inflation, interstellar and circumstellar ices, and the extra-galactic background light. Though these three themes are undoubtedly compelling, they are far from exhausting the scientific output of SPHEREx. Indeed, SPHEREx would create a unique all-sky spectral database including spectra of very large numbers of astronomical and solar system targets, including both extended and diffuse sources. These spectra would enable a wide variety of investigations, and the SPHEREx team is dedicated to making the data available to the community to enable these investigations, which we refer to as Legacy Science. To that end, we have sponsored two workshops for the general scientific community to identify the most interesting Legacy Science themes and to ensure that the SPHEREx data products are responsive to their needs. In February of 2016, some 50 scientists from all fields met in Pasadena to develop these themes and to understand their implications for the SPHEREx mission. The 2016 workshop highlighted many synergies between SPHEREx and other contemporaneous astronomical missions, facilities, and databases. Consequently, in January 2018 we convened a second workshop at the Center for Astrophysics in Cambridge to focus specifically on these synergies. This white paper reports on the results of the 2018 SPHEREx workshop.

astro-ph.IM↗

arXiv2018

Generalized massive optimal data compression

Data compression has become one of the cornerstones of modern astronomical data analysis, with the vast majority of analyses compressing large raw datasets down to a manageable number of informative summaries. In this paper we provide a general procedure for optimally compressing $N$ data down to $n$ summary statistics, where $n$ is equal to the number of parameters of interest. We show that compression to the score function -- the gradient of the log-likelihood with respect to the parameters -- yields $n$ compressed statistics that are optimal in the sense that they preserve the Fisher information content of the data. Our method generalizes earlier work on linear Karhunen-Loéve compression for Gaussian data whilst recovering both lossless linear compression and quadratic estimation as special cases when they are optimal. We give a unified treatment that also includes the general non-Gaussian case as long as mild regularity conditions are satisfied, producing optimal non-linear summary statistics when appropriate. As a worked example, we derive explicitly the $n$ optimal compressed statistics for Gaussian data in the general case where both the mean and covariance depend on the parameters.

astro-ph.CO↗

arXiv2018

Massive optimal data compression and density estimation for scalable, likelihood-free inference in cosmology

Many statistical models in cosmology can be simulated forwards but have intractable likelihood functions. Likelihood-free inference methods allow us to perform Bayesian inference from these models using only forward simulations, free from any likelihood assumptions or approximations. Likelihood-free inference generically involves simulating mock data and comparing to the observed data; this comparison in data-space suffers from the curse of dimensionality and requires compression of the data to a small number of summary statistics to be tractable. In this paper we use massive asymptotically-optimal data compression to reduce the dimensionality of the data-space to just one number per parameter, providing a natural and optimal framework for summary statistic choice for likelihood-free inference. Secondly, we present the first cosmological application of Density Estimation Likelihood-Free Inference (\textsc{delfi}), which learns a parameterized model for joint distribution of data and parameters, yielding both the parameter posterior and the model evidence. This approach is conceptually simple, requires less tuning than traditional Approximate Bayesian Computation approaches to likelihood-free inference and can give high-fidelity posteriors from orders of magnitude fewer forward simulations. As an additional bonus, it enables parameter inference and Bayesian model comparison simultaneously. We demonstrate Density Estimation Likelihood-Free Inference with massive data compression on an analysis of the joint light-curve analysis supernova data, as a simple validation case study. We show that high-fidelity posterior inference is possible for full-scale cosmological data analyses with as few as $\sim 10^4$ simulations, with substantial scope for further improvement, demonstrating the scalability of likelihood-free inference to large and complex cosmological datasets.

astro-ph.CO↗

arXiv2017

Measuring Polarized Emission in Clusters in the CMB S4 Era

The next generation of CMB experiments (CMB Stage-4) will produce a Sunyaev-Zel'dovich (SZ) cluster catalog containing $\sim10^{5}$ objects, two orders of magnitudes more than currently available. In this paper, we discuss the detectability of the polarized signal generated by scattering of the CMB quadrupole on the cluster electron gas using this catalog. We discuss the possibility of using this signal to measure the relationship between cluster optical depth and mass. We find that the area of observation of S4 maximizes the signal-to-noise (S/N) on the polarized signal but that this S/N is extremely small for an individual cluster, of order 0.5% for a typical cluster in our catalog, the main source of noise being the residual primordial E-mode signal. However, we find that the signal could be detected using the full cluster catalog and that the significance of the result will increase linearly with the size of the CMB S4 telescope mirror.

astro-ph.CO↗

arXiv2017

Pure E and B polarization maps via Wiener filtering

In order to draw scientific conclusions from observations of cosmic microwave background (CMB) polarization, it is necessary to separate the contributions of the E and B components of the data. For data with incomplete sky coverage, there are ambiguous modes, which can be sourced by either E or B signals. Techniques exist for producing "pure" E and B maps, which are guaranteed to be free of cross-contamination, although the standard method, which involves constructing an eigenbasis, has a high computational cost. We show that such pure maps can be thought of as resulting from the application of a Wiener filter to the data. This perspective leads to far more efficient methods of producing pure maps. Moreover, by expressing the idea of purification in the general framework of Wiener filtering (i.e., maximization of a posterior probability), it leads to a variety of generalizations of the notion of pure E and B maps, e.g., accounting for noise or other contaminants in the data as well as correlations with temperature anisotropy.

astro-ph.CO↗