Searcharxiv⌕ Search

arXiv subjects

ChangHoon Hahn

Publications and source records attributed to ChangHoon Hahn.

At least 55 records · Page 3Linked to original sources
arXiv2023

Sensitivity Analysis of Simulation-Based Inference for Galaxy Clustering

Simulation-based inference (SBI) is a promising approach to leverage high fidelity cosmological simulations and extract information from the non-Gaussian, non-linear scales that cannot be modeled analytically. However, scaling SBI to the next generation of cosmological surveys faces the computational challenge of requiring a large number of accurate simulations over a wide range of cosmologies, while simultaneously encompassing large cosmological volumes at high resolution. This challenge can potentially be mitigated by balancing the accuracy and computational cost for different components of the the forward model while ensuring robust inference. To guide our steps in this, we perform a sensitivity analysis of SBI for galaxy clustering on various components of the cosmological simulations: gravity model, halo-finder and the galaxy-halo distribution models (halo-occupation distribution, HOD). We infer the $σ_8$ and $Ω_m$ using galaxy power spectrum multipoles and the bispectrum monopole assuming a galaxy number density expected from the luminous red galaxies observed using the Dark Energy Spectroscopy Instrument (DESI). We find that SBI is insensitive to changing gravity model between $N$-body simulations and particle mesh (PM) simulations. However, changing the halo-finder from friends-of-friends (FoF) to Rockstar can lead to biased estimate of $σ_8$ based on the bispectrum. For galaxy models, training SBI on more complex HOD leads to consistent inference for less complex HOD models, but SBI trained on simpler HOD models fails when applied to analyze data from a more complex HOD model. Based on our results, we discuss the outlook on cosmological simulations with a focus on applying SBI approaches to future galaxy surveys.

astro-ph.CO↗
arXiv2023

Cosmology with multiple galaxies

Recent works have discovered a relatively tight correlation between $Ω_{\rm m}$ and properties of individual simulated galaxies. Because of this, it has been shown that constraints on $Ω_{\rm m}$ can be placed using the properties of individual galaxies while accounting for uncertainties on astrophysical processes such as feedback from supernova and active galactic nuclei. In this work, we quantify whether using the properties of multiple galaxies simultaneously can tighten those constraints. For this, we train neural networks to perform likelihood-free inference on the value of two cosmological parameters ($Ω_{\rm m}$ and $σ_8$) and four astrophysical parameters using the properties of several galaxies from thousands of hydrodynamic simulations of the CAMELS project. We find that using properties of more than one galaxy increases the precision of the $Ω_{\rm m}$ inference. Furthermore, using multiple galaxies enables the inference of other parameters that were poorly constrained with one single galaxy. We show that the same subset of galaxy properties are responsible for the constraints on $Ω_{\rm m}$ from one and multiple galaxies. Finally, we quantify the robustness of the model and find that without identifying the model range of validity, the model does not perform well when tested on galaxies from other galaxy formation models.

astro-ph.CO↗
arXiv2023

Learning neutrino effects in Cosmology with Convolutional Neural Networks

Measuring the sum of the three active neutrino masses, $M_ν$, is one of the most important challenges in modern cosmology. Massive neutrinos imprint characteristic signatures on several cosmological observables in particular on the large-scale structure of the Universe. In order to maximize the information that can be retrieved from galaxy surveys, accurate theoretical predictions in the non-linear regime are needed. Currently, one way to achieve those predictions is by running cosmological numerical simulations. Unfortunately, producing those simulations requires high computational resources -- several hundred to thousand core-hours for each neutrino mass case. In this work, we propose a new method, based on a deep learning network, to quickly generate simulations with massive neutrinos from standard $Λ$CDM simulations without neutrinos. We computed multiple relevant statistical measures of deep-learning generated simulations, and conclude that our approach is an accurate alternative to the traditional N-body techniques. In particular the power spectrum is within $\simeq 6\%$ down to non-linear scales $k=0.7$~\rm h/Mpc. Finally, our method allows us to generate massive neutrino simulations 10,000 times faster than the traditional methods.

astro-ph.CO↗
arXiv2023

Validation of semi-analytical, semi-empirical covariance matrices for two-point correlation function for Early DESI data

We present an extended validation of semi-analytical, semi-empirical covariance matrices for the two-point correlation function (2PCF) on simulated catalogs representative of Luminous Red Galaxies (LRG) data collected during the initial two months of operations of the Stage-IV ground-based Dark Energy Spectroscopic Instrument (DESI). We run the pipeline on multiple effective Zel'dovich (EZ) mock galaxy catalogs with the corresponding cuts applied and compare the results with the mock sample covariance to assess the accuracy and its fluctuations. We propose an extension of the previously developed formalism for catalogs processed with standard reconstruction algorithms. We consider methods for comparing covariance matrices in detail, highlighting their interpretation and statistical properties caused by sample variance, in particular, nontrivial expectation values of certain metrics even when the external covariance estimate is perfect. With improved mocks and validation techniques, we confirm a good agreement between our predictions and sample covariance. This allows one to generate covariance matrices for comparable datasets without the need to create numerous mock galaxy catalogs with matching clustering, only requiring 2PCF measurements from the data itself. The code used in this paper is publicly available at https://github.com/oliverphilcox/RascalC.

astro-ph.CO↗
arXiv2023

Outlier Detection in the DESI Bright Galaxy Survey

We present an unsupervised search for outliers in the Bright Galaxy Survey (BGS) dataset from the DESI Early Data Release. This analysis utilizes an autoencoder to compress galaxy spectra into a compact, redshift-invariant latent space, and a normalizing flow to identify low-probability objects. The most prominent outliers show distinctive spectral features such as irregular or double-peaked emission lines, or originate from galaxy mergers, blended sources, and rare quasar types, including one previously unknown Broad Absorption Line system. A significant portion of the BGS outliers are stars spectroscopically misclassified as galaxies. By building our own star model trained on spectra from the DESI Milky Way Survey, we have determined that the misclassification likely stems from the Principle Component Analysis of stars in the DESI pipeline. To aid follow-up studies, we make the full probability catalog of all BGS objects and our pre-trained models publicly available.

astro-ph.GA↗
arXiv2023

Neutrino mass constraint from an Implicit Likelihood Analysis of BOSS voids

Cosmic voids identified in the spatial distribution of galaxies provide complementary information to two-point statistics. In particular, constraints on the neutrino mass sum, $\sum m_ν$, promise to benefit from the inclusion of void statistics. We perform inference on the CMASS NGC sample of SDSS-III/BOSS with the aim of constraining $\sum m_ν$. We utilize the void size function, the void galaxy cross power spectrum, and the galaxy auto power spectrum. To extract constraints from these summary statistics we use a simulation-based approach, specifically implicit likelihood inference. We populate approximate gravity-only, particle neutrino cosmological simulations with an expressive halo occupation distribution model. With a conservative scale cut of kmax=0.15 h/Mpc and a Planck-inspired LCDM prior, we find upper bounds on $\sum m_ν$ of 0.43 and 0.35 eV from the galaxy auto power spectrum and the full data vector, respectively (95% credible interval). We observe hints that the void statistics may be most effective at constraining $\sum m_ν$ from below. We also substantiate the usual assumption that the void size function is Poisson distributed.

astro-ph.CO↗
arXiv2023

A Hierarchy of Normalizing Flows for Modelling the Galaxy-Halo Relationship

Using a large sample of galaxies taken from the Cosmology and Astrophysics with MachinE Learning Simulations (CAMELS) project, a suite of hydrodynamic simulations varying both cosmological and astrophysical parameters, we train a normalizing flow (NF) to map the probability of various galaxy and halo properties conditioned on astrophysical and cosmological parameters. By leveraging the learnt conditional relationships we can explore a wide range of interesting questions, whilst enabling simple marginalisation over nuisance parameters. We demonstrate how the model can be used as a generative model for arbitrary values of our conditional parameters; we generate halo masses and matched galaxy properties, and produce realisations of the halo mass function as well as a number of galaxy scaling relations and distribution functions. The model represents a unique and flexible approach to modelling the galaxy-halo relationship.

astro-ph.GA↗
arXiv2023

PROVABGS: The Probabilistic Stellar Mass Function of the BGS One-Percent Survey

We present the probabilistic stellar mass function (pSMF) of galaxies in the DESI Bright Galaxy Survey (BGS), observed during the One-Percent Survey. The One-Percent Survey was one of DESI's survey validation programs conducted from April to May 2021, before the start of the main survey. It used the same target selection and similar observing strategy as the main survey and successfully observed the spectra and redshifts of 143,017 galaxies in the $r < 19.5$ magnitude-limited BGS Bright sample and 95,499 galaxies in the fainter surface brightness and color selected BGS Faint sample over $z < 0.6$. We derive pSMFs from posteriors of stellar mass, $M_*$, inferred from DESI photometry and spectroscopy using the Hahn et al. (2022a; arXiv:2202.01809) PRObabilistic Value-Added BGS (PROVABGS) Bayesian SED modeling framework. We use a hierarchical population inference framework that statistically and rigorously propagates the $M_*$ uncertainties. Furthermore, we include correction weights that account for the selection effects and incompleteness of the BGS observations. We present the redshift evolution of the pSMF in BGS as well as the pSMFs of star-forming and quiescent galaxies classified using average specific star formation rates from PROVABGS. Overall, the pSMFs show good agreement with previous stellar mass function measurements in the literature. Our pSMFs showcase the potential and statistical power of BGS, which in its main survey will observe >100$\times$ more galaxies. Moreover, we present the statistical framework for subsequent population statistics measurements using BGS, which will characterize the global galaxy population and scaling relations at low redshifts with unprecedented precision.

astro-ph.GA↗
arXiv2023

Target Selection and Sample Characterization for the DESI LOW-Z Secondary Target Program

We introduce the DESI LOW-Z Secondary Target Survey, which combines the wide-area capabilities of the Dark Energy Spectroscopic Instrument (DESI) with an efficient, low-redshift target selection method. Our selection consists of a set of color and surface brightness cuts, combined with modern machine learning methods, to target low-redshift dwarf galaxies ($z$ < 0.03) between $19 < r < 21$ with high completeness. We employ a convolutional neural network (CNN) to select high-priority targets. The LOW-Z survey has already obtained over 22,000 redshifts of dwarf galaxies (M$_* < 10^9$ M$_\odot$), comparable to the number of dwarf galaxies discovered in SDSS-DR8 and GAMA. As a spare fiber survey, LOW-Z currently receives fiber allocation for just ~50% of its targets. However, we estimate that our selection is highly complete: for galaxies at $z < 0.03$ within our magnitude limits, we achieve better than 95% completeness with ~1% efficiency using catalog-level photometric cuts. We also demonstrate that our CNN selections $z<0.03$ galaxies from the photometric cuts subsample at least ten times more efficiently while maintaining high completeness. The full five-year DESI program will expand the LOW-Z sample, densely mapping the low-redshift Universe, providing an unprecedented sample of dwarf galaxies, and providing critical information about how to pursue effective and efficient low-redshift surveys.

astro-ph.GA↗
arXiv2023

Cosmology with one galaxy? -- The ASTRID model and robustness

Recent work has pointed out the potential existence of a tight relation between the cosmological parameter $Ω_{\rm m}$, at fixed $Ω_{\rm b}$, and the properties of individual galaxies in state-of-the-art cosmological hydrodynamic simulations. In this paper, we investigate whether such a relation also holds for galaxies from simulations run with a different code that made use of a distinct subgrid physics: Astrid. We find that also in this case, neural networks are able to infer the value of $Ω_{\rm m}$ with a $\sim10\%$ precision from the properties of individual galaxies while accounting for astrophysics uncertainties as modeled in CAMELS. This tight relationship is present at all considered redshifts, $z\leq3$, and the stellar mass, the stellar metallicity, and the maximum circular velocity are among the most important galaxy properties behind the relation. In order to use this method with real galaxies, one needs to quantify its robustness: the accuracy of the model when tested on galaxies generated by codes different from the one used for training. We quantify the robustness of the models by testing them on galaxies from four different codes: IllustrisTNG, SIMBA, Astrid, and Magneticum. We show that the models perform well on a large fraction of the galaxies, but fail dramatically on a small fraction of them. Removing these outliers significantly improves the accuracy of the models across simulation codes.

astro-ph.CO↗
arXiv2023

Neural Stellar Population Synthesis Emulator for the DESI PROVABGS

The Probabilistic Value-Added Bright Galaxy Survey (PROVABGS) catalog will provide the posterior distributions of physical properties of $>10$ million DESI Bright Galaxy Survey (BGS) galaxies. Each posterior distribution will be inferred from joint Bayesian modeling of observed photometry and spectroscopy using Markov Chain Monte Carlo sampling and the [arXiv:2202.01809] stellar population synthesis (SPS) model. To make this computationally feasible, PROVABGS will use a neural emulator for the SPS model to accelerate the posterior inference. In this work, we present how we construct the emulator using the [arXiv:1911.11778] approach and verify that it can be used to accurately infer galaxy properties. We confirm that the emulator is in excellent agreement with the original SPS model with $\ll 1\%$ error and is $100\times$ faster. In addition, we demonstrate that the posteriors of galaxy properties derived using the emulator are also in excellent agreement with those inferred using the original model. The neural emulator presented in this work is essential in bypassing the computational challenge posed in constructing the PROVABGS catalog. Furthermore, it demonstrates the advantages of emulation for scaling sophisticated analyses to millions of galaxies.

astro-ph.GA↗
arXiv2023

Robust Simulation-Based Inference in Cosmology with Bayesian Neural Networks

Simulation-based inference (SBI) is rapidly establishing itself as a standard machine learning technique for analyzing data in cosmological surveys. Despite continual improvements to the quality of density estimation by learned models, applications of such techniques to real data are entirely reliant on the generalization power of neural networks far outside the training distribution, which is mostly unconstrained. Due to the imperfections in scientist-created simulations, and the large computational expense of generating all possible parameter combinations, SBI methods in cosmology are vulnerable to such generalization issues. Here, we discuss the effects of both issues, and show how using a Bayesian neural network framework for training SBI can mitigate biases, and result in more reliable inference outside the training set. We introduce cosmoSWAG, the first application of Stochastic Weight Averaging to cosmology, and apply it to SBI trained for inference on the cosmic microwave background.

astro-ph.CO↗
arXiv2023

The Target-selection Pipeline for the Dark Energy Spectroscopic Instrument

In 2021 May, the Dark Energy Spectroscopic Instrument (DESI) began a 5 yr survey of approximately 50 million total extragalactic and Galactic targets. The primary DESI dark-time targets are emission line galaxies (ELGs), luminous red galaxies (LRGs) and quasars (QSOs). In bright time, DESI will focus on two surveys known as the Bright Galaxy Survey (BGS) and the Milky Way Survey (MWS). DESI also observes a selection of "secondary" targets for bespoke science goals. This paper gives an overview of the publicly available pipeline (desitarget) used to process targets for DESI observations. Highlights include details of the different DESI survey targeting phases, the targeting ID (TARGETID) used to define unique targets, the bitmasks used to indicate a particular type of target, the data model and structure of DESI targeting files, and examples of how to access and use the desitarget code base. This paper will also describe "supporting" DESI target classes, such as standard stars, sky locations, and random catalogs that mimic the angular selection function of DESI targets. The DESI target selection pipeline is complex and sizable; this paper attempts to summarize the most salient information required to understand and work with DESI targeting data.

astro-ph.IM↗
arXiv2022

Autoencoding Galaxy Spectra I: Architecture

We introduce the neural network architecture SPENDER as a core differentiable building block for analyzing, representing, and creating galaxy spectra. It combines a convolutional encoder, which pays attention to up to 256 spectral features and compresses them into a low-dimensional latent space, with a decoder that generates a restframe representation, whose spectral range and resolution exceeds that of the observing instrument. The decoder is followed by explicit redshift, resampling, and convolution transformations to match the observations. The architecture takes galaxy spectra at arbitrary redshifts and is robust to glitches like residuals of the skyline subtraction, so that spectra from a large survey can be ingested directly without additional preprocessing. We demonstrate the performance of SPENDER by training on the entire spectroscopic galaxy sample of SDSS-II; show its ability to create highly accurate reconstructions with substantially reduced noise; perform deconvolution and oversampling for a super-resolution model that resolves the [OII] doublet; introduce a novel method to interpret attention weights as proxies for important spectral features; and infer the main degrees of freedom represented in the latent space. We conclude with a discussion of future improvements and applications.

astro-ph.IM↗
arXiv2022

Differentiable Stochastic Halo Occupation Distribution

In this work, we demonstrate how differentiable stochastic sampling techniques developed in the context of deep Reinforcement Learning can be used to perform efficient parameter inference over stochastic, simulation-based, forward models. As a particular example, we focus on the problem of estimating parameters of Halo Occupancy Distribution (HOD) models which are used to connect galaxies with their dark matter halos. Using a combination of continuous relaxation and gradient parameterization techniques, we can obtain well-defined gradients with respect to HOD parameters through discrete galaxy catalogs realizations. Having access to these gradients allows us to leverage efficient sampling schemes, such as Hamiltonian Monte-Carlo, and greatly speed up parameter inference. We demonstrate our technique on a mock galaxy catalog generated from the Bolshoi simulation using the Zheng et al. 2007 HOD model and find near identical posteriors as standard Markov Chain Monte Carlo techniques with an increase of ~8x in convergence efficiency. Our differentiable HOD model also has broad applications in full forward model approaches to cosmic structure and cosmological analysis.

astro-ph.CO↗
arXiv2022

${\rm S{\scriptsize IM}BIG}$: A Forward Modeling Approach To Analyzing Galaxy Clustering

We present the first-ever cosmological constraints from a simulation-based inference (SBI) analysis of galaxy clustering from the new ${\rm S{\scriptsize IM}BIG}$ forward modeling framework. ${\rm S{\scriptsize IM}BIG}$ leverages the predictive power of high-fidelity simulations and provides an inference framework that can extract cosmological information on small non-linear scales, inaccessible with standard analyses. In this work, we apply ${\rm S{\scriptsize IM}BIG}$ to the BOSS CMASS galaxy sample and analyze the power spectrum, $P_\ell(k)$, to $k_{\rm max}=0.5\,h/{\rm Mpc}$. We construct 20,000 simulated galaxy samples using our forward model, which is based on high-resolution ${\rm Q{\scriptsize UIJOTE}}$ $N$-body simulations and includes detailed survey realism for a more complete treatment of observational systematics. We then conduct SBI by training normalizing flows using the simulated samples and infer the posterior distribution of $Λ$CDM cosmological parameters: $Ω_m, Ω_b, h, n_s, σ_8$. We derive significant constraints on $Ω_m$ and $σ_8$, which are consistent with previous works. Our constraints on $σ_8$ are $27\%$ more precise than standard analyses. This improvement is equivalent to the statistical gain expected from analyzing a galaxy sample that is $\sim60\%$ larger than CMASS with standard methods. It results from additional cosmological information on non-linear scales beyond the limit of current analytic models, $k > 0.25\,h/{\rm Mpc}$. While we focus on $P_\ell$ in this work for validation and comparison to the literature, ${\rm S{\scriptsize IM}BIG}$ provides a framework for analyzing galaxy clustering using any summary statistic. We expect further improvements on cosmological constraints from subsequent ${\rm S{\scriptsize IM}BIG}$ analyses of summary statistics beyond $P_\ell$.

astro-ph.CO↗
arXiv2022

${\rm S{\scriptsize IM}BIG}$: Mock Challenge for a Forward Modeling Approach to Galaxy Clustering

Simulation-Based Inference of Galaxies (${\rm S{\scriptsize IM}BIG}$) is a forward modeling framework for analyzing galaxy clustering using simulation-based inference. In this work, we present the ${\rm S{\scriptsize IM}BIG}$ forward model, which is designed to match the observed SDSS-III BOSS CMASS galaxy sample. The forward model is based on high-resolution ${\rm Q{\scriptsize UIJOTE}}$ $N$-body simulations and a flexible halo occupation model. It includes full survey realism and models observational systematics such as angular masking and fiber collisions. We present the "mock challenge" for validating the accuracy of posteriors inferred from ${\rm S{\scriptsize IM}BIG}$ using a suite of 1,500 test simulations constructed using forward models with a different $N$-body simulation, halo finder, and halo occupation prescription. As a demonstration of ${\rm S{\scriptsize IM}BIG}$, we analyze the power spectrum multipoles out to $k_{\rm max} = 0.5\,h/{\rm Mpc}$ and infer the posterior of $Λ$CDM cosmological and halo occupation parameters. Based on the mock challenge, we find that our constraints on $Ω_m$ and $σ_8$ are unbiased, but conservative. Hence, the mock challenge demonstrates that ${\rm S{\scriptsize IM}BIG}$ provides a robust framework for inferring cosmological parameters from galaxy clustering on non-linear scales and a complete framework for handling observational systematics. In subsequent work, we will use ${\rm S{\scriptsize IM}BIG}$ to analyze summary statistics beyond the power spectrum including the bispectrum, marked power spectrum, skew spectrum, wavelet statistics, and field-level statistics.

astro-ph.CO↗
arXiv2022

Cosmological Information in Skew Spectra of Biased Tracers in Redshift Space

Extracting the non-Gaussian information encoded in the higher-order clustering statistics of the large-scale structure is key to fully realizing the potential of upcoming galaxy surveys. We investigate the information content of the redshift-space {\it weighted skew spectra} of biased tracers as efficient estimators for 3-point clustering statistics. The skew spectra are constructed by correlating the observed galaxy field with an appropriately-weighted square of it. We perform numerical Fisher forecasts using two synthetic datasets; the halo catalogs from the Quijote N-body simulations and the galaxy catalogs from the Molino suite. The latter serves to understand the effect of marginalization over a more complex matter-tracer biasing relation. Compared to the power spectrum multipoles, we show that the skew spectra substantially improve the constraints on six parameters of the $νΛ$CDM model, $\{Ω_m, Ω_b, h, n_s, σ_8, M_ν\}$. Imposing a small-scale cutoff of $k_{\rm max}=0.25 \, {\rm Mpc}^{-1}h$, the improvements from skew spectra alone range from 23% to 62% for the Quijote halos and from 32% to 71% for the Molino galaxies. Compared to the previous analysis of the bispectrum monopole on the same data and using the same range of scales, the skew spectra of Quijote halos provide competitive constraints. Conversely, the skew spectra outperform the bispectrum monopole for all cosmological parameters for the Molino catalogs. This may result from additional anisotropic information, particularly enhanced in the Molino sample, that is captured by the skew spectra but not by the bispectrum monopole. Our stability analysis of the numerical derivatives shows comparable convergence rates for the power spectrum and the skew spectra, indicating potential underestimation of parameter uncertainties by at most 30%.

astro-ph.CO↗