arXiv subjects

Sultan Hassan

Publications and source records attributed to Sultan Hassan.

At least 37 records · Page 2Linked to original sources

arXiv2023

Emulating radiation transport on cosmological scale using a denoising Unet

Semi-numerical simulations are the leading candidates for evolving reionization on cosmological scales. These semi-numerical models are efficient in generating large-scale maps of the 21cm signal, but they are too slow to enable inference at the field level. We present different strategies to train a U-Net to accelerate these simulations. We derive the ionization field directly from the initial density field without using the ionizing sources' location, and hence emulating the radiative transfer process. We find that the U-Net achieves higher accuracy in reconstructing the ionization field if the input includes either white noise or a noisy version of the ionization map beside the density field during training. Our model reconstructs the power spectrum over all scales perfectly well. This work represents a step towards generating large-scale ionization maps with a minimal cost and hence enabling rapid parameter inference at the field level.

astro-ph.CO↗

arXiv2023

Invertible mapping between fields in CAMELS

We build a bijective mapping between different physical fields from hydrodynamic CAMELS simulations. We train a CycleGAN on three different setups: translating dark matter to neutral hydrogen (Mcdm-HI), mapping between dark matter and magnetic fields magnitude (Mcdm-B), and finally predicting magnetic fields magnitude from neutral hydrogen (HI-B). We assess the performance of the models using various summary statistics, such as the probability distribution function (PDF) of the pixel values and 2D power spectrum ($P(k)$). Results suggest that in all setups, the model is capable of predicting the target field from the source field and vice versa, and the predicted maps exhibit statistical properties which are consistent with those of the target maps. This is indicated by the fact that the mean and standard deviation of the PDF of maps from the test set is in good agreement with those of the generated maps. The mean and variance of $P(k)$ of the real maps agree well with those of generated ones. The consistency tests on the model suggest that the source field can be recovered reasonably well by a forward mapping (source to target) followed by a backward mapping (target to source). This is demonstrated by the agreement between the statistical properties of the source images and those of the recovered ones.

astro-ph.CO↗

arXiv2022

HIGlow: Conditional Normalizing Flows for High-Fidelity HI Map Modeling

Extracting the maximum amount of cosmological and astrophysical information from upcoming large-scale surveys remains a challenge. This includes evaluating the exact likelihood, parameter inference and generating new diverse synthetic examples of the incoming high-dimensional data sets. In this work, we propose the use of normalizing flows as a generative model of the neutral hydrogen (HI) maps from the CAMELS project. Normalizing flows have been very successful at parameter inference and generating new, realistic examples. Our model utilizes the spatial structure of the HI maps in order to faithfully follow the statistics of the data, allowing for high-fidelity sample generation and efficient parameter inference.

astro-ph.CO↗

arXiv2022

Hybrid analytic and machine-learned baryonic property insertion into galactic dark matter haloes

While cosmological dark matter-only simulations relying solely on gravitational effects are comparably fast to compute, baryonic properties in simulated galaxies require complex hydrodynamic simulations that are computationally costly to run. We explore the merging of an extended version of the equilibrium model, an analytic formalism describing the evolution of the stellar, gas, and metal content of galaxies, into a machine learning framework. In doing so, we are able to recover more properties than the analytic formalism alone can provide, creating a high-speed hydrodynamic simulation emulator that populates galactic dark matter haloes in N-body simulations with baryonic properties. While there exists a trade-off between the reached accuracy and the speed advantage this approach offers, our results outperform an approach using only machine learning for a subset of baryonic properties. We demonstrate that this novel hybrid system enables the fast completion of dark matter-only information by mimicking the properties of a full hydrodynamic suite to a reasonable degree, and discuss the advantages and disadvantages of hybrid versus machine learning-only frameworks. In doing so, we offer an acceleration of commonly deployed simulations in cosmology.

astro-ph.GA↗

arXiv2022

Emulating cosmological multifields with generative adversarial networks

We explore the possibility of using deep learning to generate multifield images from state-of-the-art hydrodynamic simulations of the CAMELS project. We use a generative adversarial network to generate images with three different channels that represent gas density (Mgas), neutral hydrogen density (HI), and magnetic field amplitudes (B). The quality of each map in each example generated by the model looks very promising. The GAN considered in this study is able to generate maps whose mean and standard deviation of the probability density distribution of the pixels are consistent with those of the maps from the training data. The mean and standard deviation of the auto power spectra of the generated maps of each field agree well with those computed from the maps of IllustrisTNG. Moreover, the cross-correlations between fields in all instances produced by the emulator are in good agreement with those of the dataset. This implies that all three maps in each output of the generator encode the same underlying cosmology and astrophysics.

astro-ph.CO↗

arXiv2022

Towards a non-Gaussian Generative Model of large-scale Reionization Maps

High-dimensional data sets are expected from the next generation of large-scale surveys. These data sets will carry a wealth of information about the early stages of galaxy formation and cosmic reionization. Extracting the maximum amount of information from the these data sets remains a key challenge. Current simulations of cosmic reionization are computationally too expensive to provide enough realizations to enable testing different statistical methods, such as parameter inference. We present a non-Gaussian generative model of reionization maps that is based solely on their summary statistics. We reconstruct large-scale ionization fields (bubble spatial distributions) directly from their power spectra (PS) and Wavelet Phase Harmonics (WPH) coefficients. Using WPH, we show that our model is efficient in generating diverse new examples of large-scale ionization maps from a single realization of a summary statistic. We compare our model with the target ionization maps using the bubble size statistics, and largely find a good agreement. As compared to PS, our results show that WPH provide optimal summary statistics that capture most of information out of a highly non-linear ionization fields.

astro-ph.CO↗

arXiv2022

Predictive uncertainty on improved astrophysics recovery from multifield cosmology

We investigate how the constraints on cosmological and astrophysical parameters ($Ω_{\rm m}$, $σ_{8}$, $A_{\rm SN1}$, $A_{\rm SN2}$) vary when exploiting information from multiple fields in cosmology. We make use of a convolutional neural network to retrieve the salient features from different combinations of field maps from IllustrisTNG in the CAMELS project. The fields considered are neutral hydrogen (HI), gas density (Mgas), magnetic fields (B) and gas metallicity (Z). We estimate the predictive uncertainty on the predictions of our model by using Monte Carlo dropout, a Bayesian approximation. Results show that overall, the performance of the model improves on all parameters as the number of channels of its input is increased. As compared to previous works, our model is able to predict the astrophysical parameters with up to $5\%$ higher in accuracy. In the best setup which includes all fields (four channel input, Mgas-HI-B-Z) the model achieves $R^{2} > 0.96$ on all parameters. Similarly, we find that the total uncertainty, which is dominated by the aleatoric uncertainty, decreases as more fields are used to train the model in general. The uncertainties obtained by dropout variational inference are overestimated on all parameters in our case, in that the predictive uncertainty is much larger than the actual squared error. After calibration, which consists of a simple $σ$ scaling method, the average deviation of the total uncertainty from the actual error goes down to $25\%$ at most (on $A_{\rm SN1}$).

astro-ph.CO↗

arXiv2022

HIFlow: Generating Diverse HI Maps and Inferring Cosmology while Marginalizing over Astrophysics using Normalizing Flows

A wealth of cosmological and astrophysical information is expected from many ongoing and upcoming large-scale surveys. It is crucial to prepare for these surveys now and develop tools that can efficiently extract most information. We present HIFlow: a fast generative model of the neutral hydrogen (HI) maps that is conditioned only on cosmology ($Ω_{m}$ and $σ_{8}$) and designed using a class of normalizing flow models, the Masked Autoregressive Flow (MAF). HIFlow is trained on the state-of-the-art simulations from the Cosmology and Astrophysics with MachinE Learning Simulations (CAMELS) project. HIFlow has the ability to generate realistic diverse maps without explicitly incorporating the expected 2D maps structure into the flow as an inductive bias. We find that HIFlow is able to reproduce the CAMELS average and standard deviation HI power spectrum (Pk) within a factor of $\lesssim$ 2, scoring a very high $R^{2} > 90\%$. By inverting the flow, HIFlow provides a tractable high-dimensional likelihood for efficient parameter inference. We show that the conditional HIFlow on cosmology is successfully able to marginalize over astrophysics at the field level, regardless of the stellar and AGN feedback strengths. This new tool represents a first step toward a more powerful parameter inference, maximizing the scientific return of future HI surveys, and opening a new avenue to minimize the loss of complex information due to data compression down to summary statistics.

astro-ph.CO↗

arXiv2022

Reionization with Simba: How much does astrophysics matter in modeling cosmic reionization?

Traditional large-scale models of reionization usually employ simple deterministic relations between halo mass and luminosity to predict how reionization proceeds. We here examine the impact on modelling reionization of using more detailed models for the ionizing sources as identified within the $100~{\rm Mpc/h}$ cosmological hydrodynamic simulation {\sc Simba}, coupled with post-processed radiative transfer. Comparing with simple (one-to-one) models, the main difference of using {\sc Simba} sources is the scatter in the relation between dark matter halos and star formation, and hence ionizing emissivity. We find that, at the power spectrum level, the ionization morphology remains mostly unchanged, regardless of the variability in the number of sources or escape fraction. In particular, the power spectrum shape remains unaffected and its amplitude changes slightly by less than 5-10\%, throughout reionization, depending on the scale and neutral fraction. Our results show that simplified models of ionizing sources remain viable to efficiently model the structure of reionization on cosmological scales, although the precise progress of reionization requires accounting for the scatter induced by astrophysical effects.

astro-ph.CO↗

arXiv2022

Wavelet Moments for Cosmological Parameter Estimation

Extracting non-Gaussian information from the non-linear regime of structure formation is key to fully exploiting the rich data from upcoming cosmological surveys probing the large-scale structure of the universe. However, due to theoretical and computational complexities, this remains one of the main challenges in analyzing observational data. We present a set of summary statistics for cosmological matter fields based on 3D wavelets to tackle this challenge. These statistics are computed as the spatial average of the complex modulus of the 3D wavelet transform raised to a power $q$ and are therefore known as invariant wavelet moments. The 3D wavelets are constructed to be radially band-limited and separable on a spherical polar grid and come in three types: isotropic, oriented, and harmonic. In the Fisher forecast framework, we evaluate the performance of these summary statistics on matter fields from the Quijote suite, where they are shown to reach state-of-the-art parameter constraints on the base $Λ$CDM parameters, as well as the sum of neutrino masses. We show that we can improve constraints by a factor 5 to 10 in all parameters with respect to the power spectrum baseline.

astro-ph.CO↗

arXiv2022

The CAMELS project: public data release

The Cosmology and Astrophysics with MachinE Learning Simulations (CAMELS) project was developed to combine cosmology with astrophysics through thousands of cosmological hydrodynamic simulations and machine learning. CAMELS contains 4,233 cosmological simulations, 2,049 N-body and 2,184 state-of-the-art hydrodynamic simulations that sample a vast volume in parameter space. In this paper we present the CAMELS public data release, describing the characteristics of the CAMELS simulations and a variety of data products generated from them, including halo, subhalo, galaxy, and void catalogues, power spectra, bispectra, Lyman-$α$ spectra, probability distribution functions, halo radial profiles, and X-rays photon lists. We also release over one thousand catalogues that contain billions of galaxies from CAMELS-SAM: a large collection of N-body simulations that have been combined with the Santa Cruz Semi-Analytic Model. We release all the data, comprising more than 350 terabytes and containing 143,922 snapshots, millions of halos, galaxies and summary statistics. We provide further technical details on how to access, download, read, and process the data at \url{https://camels.readthedocs.io}.

astro-ph.CO↗

arXiv2021

The CAMELS Multifield Dataset: Learning the Universe's Fundamental Parameters with Artificial Intelligence

We present the Cosmology and Astrophysics with MachinE Learning Simulations (CAMELS) Multifield Dataset, CMD, a collection of hundreds of thousands of 2D maps and 3D grids containing many different properties of cosmic gas, dark matter, and stars from 2,000 distinct simulated universes at several cosmic times. The 2D maps and 3D grids represent cosmic regions that span $\sim$100 million light years and have been generated from thousands of state-of-the-art hydrodynamic and gravity-only N-body simulations from the CAMELS project. Designed to train machine learning models, CMD is the largest dataset of its kind containing more than 70 Terabytes of data. In this paper we describe CMD in detail and outline a few of its applications. We focus our attention on one such task, parameter inference, formulating the problems we face as a challenge to the community. We release all data and provide further technical details at https://camels-multifield-dataset.readthedocs.io.

cs.LG↗

arXiv2021

Robust marginalization of baryonic effects for cosmological inference at the field level

We train neural networks to perform likelihood-free inference from $(25\,h^{-1}{\rm Mpc})^2$ 2D maps containing the total mass surface density from thousands of hydrodynamic simulations of the CAMELS project. We show that the networks can extract information beyond one-point functions and power spectra from all resolved scales ($\gtrsim 100\,h^{-1}{\rm kpc}$) while performing a robust marginalization over baryonic physics at the field level: the model can infer the value of $Ω_{\rm m} (\pm 4\%)$ and $σ_8 (\pm 2.5\%)$ from simulations completely different to the ones used to train it.

astro-ph.CO↗

arXiv2021

Multifield Cosmology with Artificial Intelligence

Astrophysical processes such as feedback from supernovae and active galactic nuclei modify the properties and spatial distribution of dark matter, gas, and galaxies in a poorly understood way. This uncertainty is one of the main theoretical obstacles to extract information from cosmological surveys. We use 2,000 state-of-the-art hydrodynamic simulations from the CAMELS project spanning a wide variety of cosmological and astrophysical models and generate hundreds of thousands of 2-dimensional maps for 13 different fields: from dark matter to gas and stellar properties. We use these maps to train convolutional neural networks to extract the maximum amount of cosmological information while marginalizing over astrophysical effects at the field level. Although our maps only cover a small area of $(25~h^{-1}{\rm Mpc})^2$, and the different fields are contaminated by astrophysical effects in very different ways, our networks can infer the values of $Ω_{\rm m}$ and $σ_8$ with a few percent level precision for most of the fields. We find that the marginalization performed by the network retains a wealth of cosmological information compared to a model trained on maps from gravity-only N-body simulations that are not contaminated by astrophysical effects. Finally, we train our networks on multifields -- 2D maps that contain several fields as different colors or channels -- and find that not only they can infer the value of all parameters with higher accuracy than networks trained on individual fields, but they can constrain the value of $Ω_{\rm m}$ with higher accuracy than the maps from the N-body simulations.

astro-ph.CO↗

arXiv2021

The CAMELS project: Cosmology and Astrophysics with MachinE Learning Simulations

We present the Cosmology and Astrophysics with MachinE Learning Simulations --CAMELS-- project. CAMELS is a suite of 4,233 cosmological simulations of $(25~h^{-1}{\rm Mpc})^3$ volume each: 2,184 state-of-the-art (magneto-)hydrodynamic simulations run with the AREPO and GIZMO codes, employing the same baryonic subgrid physics as the IllustrisTNG and SIMBA simulations, and 2,049 N-body simulations. The goal of the CAMELS project is to provide theory predictions for different observables as a function of cosmology and astrophysics, and it is the largest suite of cosmological (magneto-)hydrodynamic simulations designed to train machine learning algorithms. CAMELS contains thousands of different cosmological and astrophysical models by way of varying $Ω_m$, $σ_8$, and four parameters controlling stellar and AGN feedback, following the evolution of more than 100 billion particles and fluid elements over a combined volume of $(400~h^{-1}{\rm Mpc})^3$. We describe the simulations in detail and characterize the large range of conditions represented in terms of the matter power spectrum, cosmic star formation rate density, galaxy stellar mass function, halo baryon fractions, and several galaxy scaling relations. We show that the IllustrisTNG and SIMBA suites produce roughly similar distributions of galaxy properties over the full parameter space but significantly different halo baryon fractions and baryonic effects on the matter power spectrum. This emphasizes the need for marginalizing over baryonic effects to extract the maximum amount of information from cosmological surveys. We illustrate the unique potential of CAMELS using several machine learning applications, including non-linear interpolation, parameter estimation, symbolic regression, data generation with Generative Adversarial Networks (GANs), dimensionality reduction, and anomaly detection.

astro-ph.CO↗

arXiv2021

Can galaxy evolution mimic cosmic reionization?

Lyman-$α$ (Ly$α$) emitting galaxies are powerful tools to probe the late stages of cosmic reionization. The observed sudden drop in Ly$α$ fraction at $z>6$ is often interpreted as a sign of reionization, since the intergalactic medium (IGM) is more neutral and opaque to Ly$α$ photons. Crucially, this interpretation of the observations is only valid under the assumption that galaxies themselves experience a minimal evolution at these epochs. By modelling Ly$α$ radiative transfer effects in and around galaxies, we examine whether a change in the galactic properties can reproduce the observed drop in the Ly$α$ fraction. We find that an increase in the galactic neutral hydrogen content or a reduction in the outflow velocity toward higher redshift both lead to a lower Ly$α$ escape fraction, and can thus mimic an increasing neutral fraction of the IGM. We furthermore find that this change in galactic properties leads to systematically different Ly$α$ spectra which can be used to differentiate the two competing effects. Using the CANDELSz7 survey measurements which indicate slightly broader lines at $z\sim 6$, we find that the scenario of a mere increase in the galactic column density towards higher $z$ is highly unlikely. We also show that a decrease in outflow velocity is not ruled out by existing data but leads to more prominent blue peaks at $z>6$. Our results caution the use of Ly$α$ observations to estimate the IGM neutral fraction without accounting for the potential change in the galactic properties, e.g., by mapping out the evolution of Ly$α$ spectral characteristics.

astro-ph.CO↗

arXiv2020

Constraining the astrophysics and cosmology from 21cm tomography using deep learning with the SKA

Future Square Kilometre Array (SKA) surveys are expected to generate huge datasets of 21cm maps on cosmological scales from the Epoch of Reionization (EoR). We assess the viability of exploiting machine learning techniques, namely, convolutional neural networks (CNN), to simultaneously estimate the astrophysical and cosmological parameters from 21cm maps from semi-numerical simulations. We further convert the simulated 21cm maps into SKA-like mock maps using the detailed SKA antennae distribution, thermal noise and a recipe for foreground cleaning. We successfully design two CNN architectures (VGGNet-like and ResNet-like) that are both efficiently able to extract simultaneously three astrophysical parameters, namely the photon escape fraction (f$_{\rm esc}$), the ionizing emissivity power dependence on halo mass ($C_{\rm ion}$) and the ionizing emissivity redshift evolution index ($D_{\rm ion}$), and three cosmological parameters, namely the matter density parameter ($Ω_{m}$), the dimensionless Hubble constant ($h$), and the matter fluctuation amplitude ($σ_{8}$), from 21cm maps at several redshifts. With the presence of noise from SKA, our designed CNNs are still able to recover these astrophysical and cosmological parameters with great accuracy ($R^{2} > 92\%$), improving to $R^{2} > 99\%$ towards low redshift and low neutral fraction values. Our results show that future 21cm observations can play a key role to break degeneracy between models and tightly constrain the astrophysical and cosmological parameters, using only few frequency channels.

astro-ph.CO↗

arXiv2020

Constraining the reionization history using deep learning from 21cm tomography with the Square Kilometre Array

Upcoming 21cm surveys with the SKA1-LOW telescope will enable imaging of the neutral hydrogen distribution on cosmological scales in the early Universe. These surveys are expected to generate huge imaging datasets that will encode more information than the power spectrum. This provides an alternative unique way to constrain the reionization history, which might break the degeneracy in the power spectral analysis. Using Convolutional Neural Networks (CNN), we create a fast estimator of the neutral fraction from the 21cm maps that are produced by our large semi-numerical simulation. Our estimator is able to efficiently recover the neutral fraction ($x_{\rm HI}$) at several redshifts with a high accuracy of 99\% as quantified by the coefficient of determination $R^{2}$. Adding the instrumental effects from the SKA design slightly increases the loss function, but nevertheless we are still able to recover the neutral fraction with a similar high accuracy of 98\%, which is only 1 per cent less. While a weak dependence on redshift is observed, the accuracy increases rapidly with decreasing neutral fraction. This is due to the fact that the instrumental noise increases towards high redshift where the Universe is highly neutral. Our results show the promise of directly using 21cm-tomography to constrain the reionization history in a model independent way, complementing similar efforts, such as those of the optical depth measurements from the Cosmic Microwave Background (CMB) observations by {\it Planck}.

astro-ph.CO↗