Searcharxiv⌕ Search

arXiv subjects

Shivam Pandey

Publications and source records attributed to Shivam Pandey.

35 records · Page 2Linked to original sources

CHARM: Creating Halos with Auto-Regressive Multi-stage networks

To maximize the amount of information extracted from cosmological datasets, simulations that accurately represent these observations are necessary. However, traditional simulations that evolve particles under gravity by estimating particle-particle interactions (N-body simulations) are computationally expensive and prohibitive to scale to the large volumes and resolutions necessary for the upcoming datasets. Moreover, modeling the distribution of galaxies typically involves identifying virialized dark matter halos, which is also a time- and memory-consuming process for large N-body simulations, further exacerbating the computational cost. In this study, we introduce CHARM, a novel method for creating mock halo catalogs by matching the spatial, mass, and velocity statistics of halos directly from the large-scale distribution of the dark matter density field. We develop multi-stage neural spline flow-based networks to learn this mapping at redshift z=0.5 directly with computationally cheaper low-resolution particle mesh simulations instead of relying on the high-resolution N-body simulations. We show that the mock halo catalogs and painted galaxy catalogs have the same statistical properties as obtained from $N$-body simulations in both real space and redshift space. Finally, we use these mock catalogs for cosmological inference using redshift-space galaxy power spectrum, bispectrum, and wavelet-based statistics using simulation-based inference, performing the first inference with accelerated forward model simulations and finding unbiased cosmological constraints with well-calibrated posteriors. The code was developed as part of the Simons Collaboration on Learning the Universe and is publicly available at \url{https://github.com/shivampcosmo/CHARM}.

astro-ph.CO↗

LtU-ILI: An All-in-One Framework for Implicit Inference in Astrophysics and Cosmology

This paper presents the Learning the Universe Implicit Likelihood Inference (LtU-ILI) pipeline, a codebase for rapid, user-friendly, and cutting-edge machine learning (ML) inference in astrophysics and cosmology. The pipeline includes software for implementing various neural architectures, training schemata, priors, and density estimators in a manner easily adaptable to any research workflow. It includes comprehensive validation metrics to assess posterior estimate coverage, enhancing the reliability of inferred results. Additionally, the pipeline is easily parallelizable and is designed for efficient exploration of modeling hyperparameters. To demonstrate its capabilities, we present real applications across a range of astrophysics and cosmology problems, such as: estimating galaxy cluster masses from X-ray photometry; inferring cosmology from matter power spectra and halo point clouds; characterizing progenitors in gravitational wave signals; capturing physical dust parameters from galaxy colors and luminosities; and establishing properties of semi-analytic models of galaxy formation. We also include exhaustive benchmarking and comparisons of all implemented methods as well as discussions about the challenges and pitfalls of ML inference in astronomical sciences. All code and examples are made publicly available at https://github.com/maho3/ltu-ili.

astro-ph.IM↗

IITK at SemEval-2024 Task 1: Contrastive Learning and Autoencoders for Semantic Textual Relatedness in Multilingual Texts

This paper describes our system developed for the SemEval-2024 Task 1: Semantic Textual Relatedness. The challenge is focused on automatically detecting the degree of relatedness between pairs of sentences for 14 languages including both high and low-resource Asian and African languages. Our team participated in two subtasks consisting of Track A: supervised and Track B: unsupervised. This paper focuses on a BERT-based contrastive learning and similarity metric based approach primarily for the supervised track while exploring autoencoders for the unsupervised track. It also aims on the creation of a bigram relatedness corpus using negative sampling strategy, thereby producing refined word embeddings.

cs.CL↗

Zooming by in the CARPoolGP lane: new CAMELS-TNG simulations of zoomed-in massive halos

Galaxy formation models within cosmological hydrodynamical simulations contain numerous parameters with non-trivial influences over the resulting properties of simulated cosmic structures and galaxy populations. It is computationally challenging to sample these high dimensional parameter spaces with simulations, particularly for halos in the high-mass end of the mass function. In this work, we develop a novel sampling and reduced variance regression method, CARPoolGP, which leverages built-in correlations between samples in different locations of high dimensional parameter spaces to provide an efficient way to explore parameter space and generate low variance emulations of summary statistics. We use this method to extend the Cosmology and Astrophysics with MachinE Learning Simulations (CAMELS) to include a set of 768 zoom-in simulations of halos in the mass range of $10^{13} - 10^{14.5} M_\odot\,h^{-1}$ that span a 28-dimensional parameter space in the IllustrisTNG model. With these simulations and the CARPoolGP emulation method, we explore parameter trends in the Compton $Y-M$, black hole mass-halo mass, and metallicity-mass relations, as well as thermodynamic profiles and quenched fractions of satellite galaxies. We use these emulations to provide a physical picture of the complex interplay between supernova and active galactic nuclei feedback. We then use emulations of the $Y-M$ relation of massive halos to perform Fisher forecasts on astrophysical parameters for future Sunyaev-Zeldovich observations and find a significant improvement in forecasted constraints. We publicly release both the simulation suite and CARPoolGP software package.

astro-ph.GA↗

GODMAX: Modeling gas thermodynamics and matter distribution using JAX

We introduce GODMAX (Gas thermODynamics and Matter distribution using jAX), a novel code designed to calculate correlations between the cosmological matter distribution and various gas thermodynamic quantities. Utilizing the extensive ANTILLES suite of 200 hydrodynamical simulations with a diverse range of baryonic feedback strengths, we jointly fit the 3D profiles of total matter distribution, electron density, and electron pressure across various halo masses and redshifts. By accommodating significant variations in gas profiles expected due to baryonic feedback, solving exact hydrostatic equilibrium equation and offering flexible modeling of non-thermal pressure support, GODMAX has the capability to jointly fit all these profiles within the measurement uncertainties. This advancement enables, for the first time, robust joint analyses of multiple cosmic probes, including the kinetic and thermal Sunyaev-Zel'dovich effect, weak lensing, and X-ray observations. Furthermore, the model accurately captures correlations between the total matter power suppression due to baryonic feedback and local average thermodynamic quantities, such as the baryon fraction and integrated tSZ effect, in high-mass halos, aligning with observations from hydrodynamical simulations. Looking ahead, we forecast the expected constraints on cosmological and baryonic parameters from upcoming weak lensing catalogs from the LSST and tSZ maps from the Simons Observatory. This analysis underscores the importance of cross-correlations between weak lensing and tSZ in enhancing parameter constraints by resolving major systematic uncertainties due to baryonic physics. The GODMAX code leverages the JAX library, resulting in a fully differentiable halo model with native GPU compilation support.

astro-ph.CO↗

Deciphering baryonic feedback with galaxy clusters

Upcoming cosmic shear analyses will precisely measure the cosmic matter distribution at low redshifts. At these redshifts, the matter distribution is affected by galaxy formation physics, primarily baryonic feedback from star formation and active galactic nuclei. Employing measurements from the Magneticum and IllustrisTNG simulations and a dark matter + baryon (DMB) halo model, this paper demonstrates that Sunyaev-Zel'dovich (SZ) effect observations of galaxy clusters, whose masses have been calibrated using weak gravitational lensing, can constrain the baryonic impact on cosmic shear with statistical and systematic errors subdominant to the measurement errors of DES-Y3 and LSST-Y1. We further dissect the contributions from different scales and halos with different masses to cosmic shear, highlighting the dominant role of SZ clusters at scales critical for cosmic shear analyses. These findings suggest a promising avenue for future joint analyses of Cosmic Microwave Background (CMB) and lensing surveys.

astro-ph.CO↗

Inferring galaxy cluster masses from cosmic microwave background lensing with neural simulation based inference

Gravitational lensing by massive galaxy clusters distorts the observed cosmic microwave background (CMB) on arcminute scales, and these distortions carry information about cluster masses. Standard approaches to extracting cluster mass constraints from the CMB cluster lensing signal are either sub-optimal, ignore important physical or observational effects, are computationally intractable, or require additional work to turn the lensing measurements into constraints on cluster masses. We apply simulation based inference (SBI) using neural likelihood models to the problem. We show that in circumstances where the exact likelihood can be computed, the SBI constraints on cluster masses are in agreement with the exact likelihood, demonstrating that the SBI constraints are close to optimal. In scenarios where the exact likelihood cannot be feasibly computed, SBI still recovers unbiased estimates of individual cluster masses and combined constraints from multiple clusters. SBI will be a powerful tool for constraining the masses of galaxy clusters detected by future cosmic surveys. Code to run the analyses presented here will be made publicly available.

astro-ph.CO↗

The impact of halo concentration on the Sunyaev Zel'dovich effect signal from massive galaxy clusters

The Sunyaev Zel'dovich (SZ) effect is sensitive to the pressure of ionized gas inside galaxy clusters, which is in turn controlled largely by the gravitational potential of the cluster. Changing the concentration parameter describing the cluster mass distribution impacts the gravitational potential and thus the cluster SZ signal, with implications for cosmological and other analyses of SZ-selected clusters. We investigate the concentration-SZ relation in theory and simulations. We find that the impact of concentration on the inner SZ profile ($R \lesssim 0.75 R_{200c}$) can be captured with standard polytropic gas models. However, we find that such models do a poor job of reproducing the outer SZ profiles ($R \gtrsim 0.75 R_{200c}$) and the relation between the integrated SZ signal, $Y$, and concentration. This disagreement results from a sharp truncation of the gas pressure profile near the splashback radius, likely caused by virial shocks. We develop a simple description of the truncation that leads to a good match with the simulated SZ profiles out to several $R_{200c}$ for clusters of varying mass and concentration, and that also accurately predicts the concentration-$Y$ relationship. Finally, we determine how inference of the linear bias parameter and splashback radius for SZ-selected clusters can be biased by ignoring the concentration dependence of the SZ signal, finding that bias to the former is essentially negligible, while bias to the latter can be as much as 2\%.

astro-ph.CO↗

Predicting the impact of feedback on matter clustering with machine learning in CAMELS

Extracting information from the total matter power spectrum with the precision needed for upcoming cosmological surveys requires unraveling the complex effects of galaxy formation processes on the distribution of matter. We investigate the impact of baryonic physics on matter clustering at $z=0$ using a library of power spectra from the Cosmology and Astrophysics with MachinE Learning Simulations (CAMELS) project, containing thousands of $(25\,h^{-1}{\rm Mpc})^3$ volume realizations with varying cosmology, initial random field, stellar and AGN feedback strength and sub-grid model implementation methods. We show that baryonic physics affects matter clustering on scales $k \gtrsim 0.4\,h\,\mathrm{Mpc}^{-1}$ and the magnitude of this effect is dependent on the details of the galaxy formation implementation and variations of cosmological and astrophysical parameters. Increasing AGN feedback strength decreases halo baryon fractions and yields stronger suppression of power relative to N-body simulations, while stronger stellar feedback often results in weaker effects by suppressing black hole growth and therefore the impact of AGN feedback. We find a broad correlation between mean baryon fraction of massive halos ($M_{\rm 200c} > 10^{13.5}$\,\Msun) and suppression of matter clustering but with significant scatter compared to previous work owing to wider exploration of feedback parameters and cosmic variance effects. We show that a random forest regressor trained on the baryon content and abundance of halos across the full mass range $10^{10} \leq M_\mathrm{halo}/$\Msun$< 10^{15}$ can predict the effect of galaxy formation on the matter power spectrum on scales $k = 1.0$--20.0\,$h\,\mathrm{Mpc}^{-1}$.

astro-ph.GA↗

Cosmology with imaging galaxy surveys: the impact of evolving galaxy bias and magnification

The joint analysis of galaxy clustering and galaxy-shear cross-correlations (galaxy-galaxy lensing) in imaging surveys constitutes one of the main avenues to obtain cosmological information. Analyses from Stage III surveys have assumed constant galaxy bias and weak lensing magnification coefficients within redshift bins. We use simple models of bias and magnification evolution to show that plausible levels of evolution impact cosmological parameter inference significantly for Stage IV surveys and possibly for current datasets as well. The distance weighting factors in galaxy-galaxy lensing cause it to have a different effective mean redshift within a lens bin than galaxy clustering. If the evolution is not included carefully in the theory modeling, this produces an apparent de-correlation of clustering and lensing even on large scales and leads to biased cosmological constraints. The level of bias is sensitive to the redshift and the width of the lens redshift distributions: for magnitude-limited-like samples it is comparable to the statistical precision even for the full DES survey, and exceeds it for Rubin-LSST. We find that ignoring the evolution can lead to approximately $1σ$ biases in the cosmological constraints in future Rubin-LSST analyses. We describe how these effects can be mitigated from the modeling and data sides, in particular by using cross-correlations to constrain the evolution parameters. We also demonstrate that the combination of galaxy clustering and CMB lensing does not suffer from this problem, due to the different distance weighting.

astro-ph.CO↗

Sensitivity Analysis of Simulation-Based Inference for Galaxy Clustering

Simulation-based inference (SBI) is a promising approach to leverage high fidelity cosmological simulations and extract information from the non-Gaussian, non-linear scales that cannot be modeled analytically. However, scaling SBI to the next generation of cosmological surveys faces the computational challenge of requiring a large number of accurate simulations over a wide range of cosmologies, while simultaneously encompassing large cosmological volumes at high resolution. This challenge can potentially be mitigated by balancing the accuracy and computational cost for different components of the the forward model while ensuring robust inference. To guide our steps in this, we perform a sensitivity analysis of SBI for galaxy clustering on various components of the cosmological simulations: gravity model, halo-finder and the galaxy-halo distribution models (halo-occupation distribution, HOD). We infer the $σ_8$ and $Ω_m$ using galaxy power spectrum multipoles and the bispectrum monopole assuming a galaxy number density expected from the luminous red galaxies observed using the Dark Energy Spectroscopy Instrument (DESI). We find that SBI is insensitive to changing gravity model between $N$-body simulations and particle mesh (PM) simulations. However, changing the halo-finder from friends-of-friends (FoF) to Rockstar can lead to biased estimate of $σ_8$ based on the bispectrum. For galaxy models, training SBI on more complex HOD leads to consistent inference for less complex HOD models, but SBI trained on simpler HOD models fails when applied to analyze data from a more complex HOD model. Based on our results, we discuss the outlook on cosmological simulations with a focus on applying SBI approaches to future galaxy surveys.

astro-ph.CO↗

The SZ flux-mass ($Y$-$M$) relation at low halo masses: improvements with symbolic regression and strong constraints on baryonic feedback

Feedback from active galactic nuclei (AGN) and supernovae can affect measurements of integrated SZ flux of halos ($Y_\mathrm{SZ}$) from CMB surveys, and cause its relation with the halo mass ($Y_\mathrm{SZ}-M$) to deviate from the self-similar power-law prediction of the virial theorem. We perform a comprehensive study of such deviations using CAMELS, a suite of hydrodynamic simulations with extensive variations in feedback prescriptions. We use a combination of two machine learning tools (random forest and symbolic regression) to search for analogues of the $Y-M$ relation which are more robust to feedback processes for low masses ($M\lesssim 10^{14}\, h^{-1} \, M_\odot$); we find that simply replacing $Y\rightarrow Y(1+M_*/M_\mathrm{gas})$ in the relation makes it remarkably self-similar. This could serve as a robust multiwavelength mass proxy for low-mass clusters and galaxy groups. Our methodology can also be generally useful to improve the domain of validity of other astrophysical scaling relations. We also forecast that measurements of the $Y-M$ relation could provide percent-level constraints on certain combinations of feedback parameters and/or rule out a major part of the parameter space of supernova and AGN feedback models used in current state-of-the-art hydrodynamic simulations. Our results can be useful for using upcoming SZ surveys (e.g., SO, CMB-S4) and galaxy surveys (e.g., DESI and Rubin) to constrain the nature of baryonic feedback. Finally, we find that the an alternative relation, $Y-M_*$, provides complementary information on feedback than $Y-M$

astro-ph.CO↗

The CAMELS project: Expanding the galaxy formation model space with new ASTRID and 28-parameter TNG and SIMBA suites

We present CAMELS-ASTRID, the third suite of hydrodynamical simulations in the Cosmology and Astrophysics with MachinE Learning (CAMELS) project, along with new simulation sets that extend the model parameter space based on the previous frameworks of CAMELS-TNG and CAMELS-SIMBA, to provide broader training sets and testing grounds for machine-learning algorithms designed for cosmological studies. CAMELS-ASTRID employs the galaxy formation model following the ASTRID simulation and contains 2,124 hydrodynamic simulation runs that vary 3 cosmological parameters ($Ω_m$, $σ_8$, $Ω_b$) and 4 parameters controlling stellar and AGN feedback. Compared to the existing TNG and SIMBA simulation suites in CAMELS, the fiducial model of ASTRID features the mildest AGN feedback and predicts the least baryonic effect on the matter power spectrum. The training set of ASTRID covers a broader variation in the galaxy populations and the baryonic impact on the matter power spectrum compared to its TNG and SIMBA counterparts, which can make machine-learning models trained on the ASTRID suite exhibit better extrapolation performance when tested on other hydrodynamic simulation sets. We also introduce extension simulation sets in CAMELS that widely explore 28 parameters in the TNG and SIMBA models, demonstrating the enormity of the overall galaxy formation model parameter space and the complex non-linear interplay between cosmology and astrophysical processes. With the new simulation suites, we show that building robust machine-learning models favors training and testing on the largest possible diversity of galaxy formation models. We also demonstrate that it is possible to train accurate neural networks to infer cosmological parameters using the high-dimensional TNG-SB28 simulation set.

astro-ph.CO↗

Inferring the impact of feedback on the matter distribution using the Sunyaev Zel'dovich effect: Insights from CAMELS simulations and ACT+DES data

Feedback from active galactic nuclei and stellar processes changes the matter distribution on small scales, leading to significant systematic uncertainty in weak lensing constraints on cosmology. We investigate how the observable properties of group-scale halos can constrain feedback's impact on the matter distribution using Cosmology and Astrophysics with MachinE Learning Simulations (CAMELS). Extending the results of previous work to smaller halo masses and higher wavenumber, $k$, we find that the baryon fraction in halos contains significant information about the impact of feedback on the matter power spectrum. We explore how the thermal Sunyaev Zel'dovich (tSZ) signal from group-scale halos contains similar information. Using recent Dark Energy Survey (DES) weak lensing and Atacama Cosmology Telescope (ACT) tSZ cross-correlation measurements and models trained on CAMELS, we obtain $10\%$ constraints on feedback effects on the power spectrum at $k \sim 5\, h/{\rm Mpc}$. We show that with future surveys, it will be possible to constrain baryonic effects on the power spectrum to $\mathcal{O}(<1\%)$ at $k = 1\, h/{\rm Mpc}$ and $\mathcal{O}(3\%)$ at $k = 5\, h/{\rm Mpc}$ using the methods that we introduce here. Finally, we investigate the impact of feedback on the matter bispectrum, finding that tSZ observables are highly informative in this case.

astro-ph.CO↗

Perturbation theory models for LSST-era galaxy clustering: tests with sub-percent mock catalog measurements in Fourier and configuration space

We analyze the clustering of galaxies using the z=1.006 snapshot of the CosmoDC2 simulation, a high-fidelity synthetic galaxy catalog designed to validate analysis methods for the Large Synoptic Survey Telescope (LSST). We present sub-percent measurements of the galaxy auto-correlation and galaxy-dark matter cross correlations in Fourier space and configuration space for a magnitude-limited galaxy sample. At these levels of precision, the statistical errors of the measurement are comparable to the systematic effects present in the simulation and measurement procedure; nevertheless, using a hybrid-PT model, we are able to model non-linear galaxy bias with 0.5% precision up to scales of $k_{\rm max}= 0.5 \ h/{\rm Mpc}$ and $r_{\rm min}= 4 \ {\rm Mpc}/h$. While the linear bias parameter is measured with 0.01% precision, other bias parameters are determined with considerably weaker constraints and sometimes bimodal posterior distributions. We compare our fiducial model with lower dimensional models where the higher-order bias parameters are fixed at their co-evolution values and find that leaving these parameters free provides significant improvements in our ability to model small scale information. We also compare bias parameters for galaxy samples defined using different magnitude bands and find agreement between samples containing equal numbers of galaxies. Finally, we compare bias parameters between Fourier space and configuration space and find moderate tension between the two approaches. Although our model is often unable to fit the CosmoDC2 galaxy samples within the 0.1% precision of our measurements, our results suggest that the hybrid-PT model used in this analysis is capable of modeling non-linear galaxy bias within the percent level precision needed for upcoming galaxy surveys.

astro-ph.CO↗

The correlation of high-redshift galaxies with the thermal Sunyaev-Zel'dovich effect traces reionization

We explore a potential new probe of reionization: the cross-correlation of high-redshift galaxies with maps of the thermal Sunyaev-Zel'dovich (tSZ) effect. We consider two types of high redshift galaxies: Lyman break galaxies (LBGs) and Lyman-$α$ emitters (LAEs). LBGs and LAEs will be detected in large numbers at high redshift ($z \approx$ 4 to 7) by ongoing and future surveys. We consider a LBG sample like that expected from the The Rubin Observatory Legacy Survey of Space and Time (LSST), and a selection of LAEs modelled after the Subaru SILVERRUSH program, but covering a much larger sky fraction. The tSZ effect is sensitive to a line-of-sight integral of the ionized gas pressure, and can be measured across large patches of the sky using multi-frequency CMB surveys. We consider forecast tSZ maps from CMB Stage 4 and more futuristic observations. Using a suite of hydrodynamical simulations, we show that the high-redshift galaxies are correlated with the tSZ signal from reionization, with cross-power amplitude of order $10^{-15}$ at $\ell \sim 1000$. The cross-spectra between LBGs/LAEs with tSZ maps contain information about the reionization history of the Universe, such as the distribution of bubble sizes, and could in principle be used to directly measure the timing of reionization. The amplitude of the signal is small, however, and its detectability is hindered by low-redshift contributions to tSZ maps and by instrumental noise. If the the low-redshift contribution to the observed tSZ signal is suppressed by masking of massive halos, a combination of overlapping futuristic CMB and galaxy surveys could potentially probe this signal.

astro-ph.CO↗

A model independent comparison of supernova and strong lensing cosmography: implications for the Hubble constant tension

We use supernovae measurements, calibrated by the local determination of the Hubble constant $H_0$ by SH0ES, to interpolate the distance-redshift relation using Gaussian process regression. We then predict, independent of the cosmological model, the distances that are measured with strong lensing time delays. We find excellent agreement between these predictions and the measurements. The agreement holds when we consider only the redshift dependence of the distance-redshift relation, independent of the value of $H_0$. Our results disfavor the possibility that lens mass modeling contributes a 10\% bias or uncertainty in the strong lensing analysis, as suggested recently in the literature. In general our analysis strengthens the case that residual systematic errors in both measurements are below the level of the current discrepancy with the CMB determination of $H_0$, and supports the possibility of new physical phenomena on cosmological scales. With additional data our methodology can provide more stringent tests of unaccounted for systematics in the determinations of the distance-redshift relation in the late universe.

astro-ph.CO↗