SearcharxivSearch

arXiv subjects

Joe Zuntz

Publications and source records attributed to Joe Zuntz.

At least 19 recordsLinked to original sources

Balancing bias, baryons, and scale cuts in LSST 3x2pt analysis

Stage IV surveys such as LSST will probe deeply into the nonlinear regime, where systematic effects from galaxy bias and baryonic feedback become dominant and poorly constrained nuisance parameters can lead to degeneracies. In this work we present a $3\times2$pt analysis for LSST Y1 and Y10 data using the BACCO emulator for modelling both the hybrid-effective field theory (HEFT) for nonlinear galaxy bias and the baryonic feedback using the baryonification mechanism. We aim to find a balance between model complexity and scale cuts, with particular attention to parameter degeneracies and baryonic feedback effects on the galaxy--matter and galaxy--galaxy power spectra. First, we find that a linear bias model delivers percent-level, unbiased constraints on $\Omega_{\rm m}$ and $\sigma_8$ only up to $k_{\rm max}=0.1\,h/$Mpc, but pushing to smaller scales requires a perturbative approach. Second, we compare HEFT with a minimal bias variant with fixed higher-order terms, and find that the latter is unbiased in $\Lambda$CDM even at $k_{\rm max}=0.7\,h/$Mpc. We show that higher-order bias can mimic baryonic suppression, but baryons cannot reproduce the full range of higher-order bias behaviour. Third, we find that a detection of the total neutrino mass $M_\nu$ is possible for both Y1 and Y10 for $k\geq0.3\,h/$Mpc, at least when photo-$z$ uncertainties and related nuisance parameters are precisely known. However, the specific measured value is not robust across equally plausible mock scenarios: the inferred $M_\nu$ can be significantly biased by adopting the minimal bias model. The entire analysis is conducted with a new independent, open source pipeline (MGL) that we present for the first time in this work.

astro-ph.CO

cloelib: A Flexible Python Library for Computing Cosmological Observables in the Euclid Era

cloelib is a Python library developed to compute cosmological observables within the Cosmology Likelihood for Observables in Euclid (CLOE) ecosystem (cloe-org). As cosmology enters a precision era driven by galaxy survey missions such as Euclid, there is a growing need for flexible, efficient, and differentiable software capable of supporting next-generation inference pipelines. cloelib addresses these demands through a modular architecture that interfaces seamlessly with established Boltzmann solvers whilst incorporating JAX-based automatic differentiation to enable gradient-based methods. The library defines consistent protocols for background evolution, perturbations, and non-linear structure formation, and supports a wide range of observables, including photometric and spectroscopic large-scale structure probes, as well as cross-correlations with the Cosmic Microwave Background and galaxy clusters. In its finalised form, cloelib is intended to serve as the reference theory computation infrastructure for Euclid's first cosmological release, bridging traditional numerical cosmology with modern optimisation techniques and emerging machine learning approaches to inference.

astro-ph.CO

Propagating data-driven galaxy redshift distribution uncertainties in 3$\times$2-pt analyses

Uncertainties in the radial distribution of galaxies, $\boldsymbol{n}(\boldsymbol{z})$, are one of the major contributions to the error budget of early Stage-IV galaxy survey analyses of weak gravitational lensing, galaxy clustering and galaxy-galaxy lensing (3$\times$2-pt). Based on ensembles of simulated $\boldsymbol{n}(\boldsymbol{z})$ including stochastic and systematic variations, we study the impact of four different $\boldsymbol{n}(\boldsymbol{z})$ uncertainty models: shifts, shifts & stretches, Gaussian processes (GP) and principal component analysis (PCA). Due to the high dimensionality of the latter models, we make use of state-of-the-art gradient-based inference methods as well as approximate analytical marginalisation schemes. Our results show that Stage-IV 3$\times$2-pt analyses must go beyond simple shift & stretch models. In particular, we advocate for the adoption of PCA models even in early Stage-IV surveys. Our results show that considering a five-parameters PCA model only degrades the constraint on the $S_{\rm 8}$ parameter by $5$ per cent with respect to the case when only a shift and a stretch parameter are included, while incurring half the bias in its constituents parameters, $\Omega_{\rm m}$ and $\sigma_{\rm 8}$. We demonstrate that all models considered can be safely marginalised analytically, with speed-ups of up to a factor of 25 depending on the dimensionality of the model. This will allow Stage-IV analyses to safely include higher-dimensional $\boldsymbol{n}(\boldsymbol{z})$ uncertainty models in their analysis at negligible additional computational cost.

astro-ph.CO

Weak Lensing by Photometric Density Ridges

Ridges in galaxy density fields measured by photometric surveys are 2D projections of filaments in the cosmic web, and so should lens light from background galaxies. We report on a detection of this effect in Dark Energy Survey Year 3 data at high significance, though not independently of galaxy-galaxy lensing. We describe improvements to the existing subspace-constrained mean shift algorithm to locate these ridges efficiently at scale, and examine the dependence of the signal in simulations on cosmological and algorithmic parameters. We find that it depends primarily on $S_8=\sigma_8 \left( \Omega_m / 0.3 \right)^{1/2}$, and discuss improvements to our methodology that would be needed to allow precision parameter estimation.

astro-ph.CO

Extracting intrinsic alignments in the Dark Energy Survey's year 1 data, using the self-calibration method and LSST-DESC tools

We present the implementation of a Self-Calibration of Intrinsic Alignments of galaxies as an extension to the Vera C. Rubin Observatory's Legacy Survey of Space and Time (LSST) Dark Energy Science Collaboration (DESC)'s weak lensing 3x2pt pipeline (TXPipe). As a demonstration, we have run this pipeline on the Dark Energy Survey (DES) year one data set. We find indications of a non-zero intrinsic alignment signal in the higher redshift bins, while in the lower bins our results look more uncertain. We believe this is caused by known issues with the individual galaxies photo-z estimation. This effect is particularly harmful for the self-calibration method, since it has high requirements for reliable estimation of the photo-$z$s, and the need for individual galaxy point estimates and tomographic binning to match. We show how different methods of recreating the redshift probability distribution can affect the detection of intrinsic alignment.

astro-ph.CO

Confronting cosmic shear astrophysical uncertainties: DES Year 3 revisited

Cosmology from weak gravitational lensing has been limited by astrophysical uncertainties in baryonic feedback and intrinsic alignments. By calibrating these effects using external data, we recover non-linear information, achieving a 2% constraint on the clustering amplitude, $S_8$, resulting in a factor of two improvement on the $\Lambda$CDM constraints relative to the fiducial Dark Energy Survey Year 3 model. The posterior, $S_8=0.832^{+0.013}_{-0.017}$, shifts by $1.5\sigma$ to higher values, in closer agreement with the cosmic microwave background result for the standard six-parameter $\Lambda$CDM cosmology. Our approach uses a star-forming 'blue' galaxy sample with intrinsic alignment model parameters calibrated by direct spectroscopic measurements, together with a baryonic feedback model informed by observations of X-ray gas fractions and kinematic Sunyaev-Zel'dovich effect profiles that span a wide range in halo mass and redshift. Our results provide a blueprint for next-generation surveys: leveraging galaxy properties to control intrinsic alignments and external gas probes to calibrate feedback, unlocking a substantial improvement in the precision of weak lensing surveys.

astro-ph.CO

Improved photometric redshift estimations through self-organising map-based data augmentation

We introduce a framework for the enhanced estimation of photometric redshifts using Self-Organising Maps (SOMs). Our method projects galaxy Spectral Energy Distributions (SEDs) onto a two-dimensional map, identifying regions that are sparsely sampled by existing spectroscopic observations. These under-sampled areas are then augmented with simulated galaxies, yielding a more representative spectroscopic training dataset. To assess the efficacy of this SOM-based data augmentation in the context of the forthcoming Legacy Survey of Space and Time (LSST), we employ mock galaxy catalogues from the OpenUniverse2024 project and generate synthetic datasets that mimic the expected photometric selections of LSST after one (Y1) and ten (Y10) years of observation. We construct 501 degraded realisations by sampling galaxy colours, magnitudes, redshifts and spectroscopic success rates, in order to emulate the compilation of a wide array of realistic spectroscopic surveys. Augmenting the degraded mock datasets with simulated galaxies from the independent CosmoDC2 catalogues has markedly improved the performance of our photometric redshift estimates compared to models lacking this augmentation, particularly for high-redshift galaxies ($z_\mathrm{true} \gtrsim 1.5$). This improvement is manifested in notably reduced systematic biases and a decrease in catastrophic failures by up to approximately a factor of 2, along with a reduction in information loss in the conditional density estimations. These results underscore the effectiveness of SOM-based augmentation in refining photometric redshift estimation, thereby enabling more robust analyses in cosmology and astrophysics for the NSF-DOE Vera C. Rubin Observatory.

astro-ph.GA

Reanalysis of Stage-III cosmic shear surveys: A comprehensive study of shear diagnostic tests

In recent years, shear catalogs have been released by various Stage-III weak lensing surveys including the Kilo-Degree Survey, the Dark Energy Survey, and the Hyper Suprime-Cam Subaru Strategic Program. These shear catalogs have undergone rigorous validation tests to ensure that the residual shear systematic effects in the catalogs are subdominant relative to the statistical uncertainties, such that the resulting cosmological constraints are unbiased. While there exists a generic set of tests that are designed to probe certain systematic effects, the implementations differ slightly across the individual surveys, making it difficult to make direct comparisons. In this paper, we use the TXPipe package to conduct a series of predefined diagnostic tests across three public shear catalogs -- the 1,000 deg$^2$ KiDS-1000 shear catalog, the Year 3 DES-Y3 shear catalog, and the Year 3 HSC-Y3 shear catalog. We attempt to reproduce the published results when possible and perform key tests uniformly across the surveys. While all surveys pass most of the null tests in this study, we find two tests where some of the surveys fail. Namely, we find that when measuring the tangential ellipticity around bright and faint star samples, KiDS-1000 fails with a $\chi^2$/dof of 121.1/16 and 257.7/16 for bins 4 and 5 for faint, weighted stars. We also find that DES-Y3 and HSC-Y3 fail the $B$-mode test when estimated with the Hybrid-$E$/$B$ method, with a $\chi^2$/dof of 37.9/10 and 36.0/8 for the fourth and third autocorrelation bins. We assess the impacts on the $\Omega_{\rm m}$ - S$_{8}$ parameter space by comparing the posteriors of a simulated data vector with and without PSF contamination -- we find negligible effects in all cases. Finally, we propose strategies for performing these tests on future surveys such as the Vera C. Rubin Observatory's Legacy Survey of Space and Time.

astro-ph.CO

Baryon-free $S_8$ tension with Stage IV cosmic shear surveys

Accurately modelling matter power spectrum effects at small scales, such as baryonic feedback, is essential to avoid significant bias in the estimation of cosmological parameters with cosmic shear. However, Stage IV surveys like LSST will be so precise that significant information can still be extracted from large scales alone. In this work, we simulate LSST Y1-like mock data and perform a cosmic shear analysis, considering different models of baryonic feedback. To focus on large scales, we apply physically motivated scale cuts which account for the redshift dependence of the multipoles in the tomographic bin. Our main focus is to study the changes in the constraining power of $S_8$ and $\Omega_m$ parameters and assess possible effects on the tension with Planck measurements. We find that the $S_8$ tension is clearly detectable at $k_{\rm eff}^{\rm max}=0.20\,h\rm Mpc^{-1}$ in the analysis where we imposed a DES-sized tension, and at $k_{\rm eff}^{\rm max}=0.10\,h\rm Mpc^{-1}$ with a KiDS-sized tension, regardless of whether an incorrect model for baryons is assumed. However, to achieve these results, LSST will need high precision measurement of the redshift distributions, with photo-$z$ biases of the order of $10^{-3}$. Without this, the ability to constrain cosmological parameters independently of baryonic feedback - particularly regarding the $S_8$ tension - will be compromised.

astro-ph.CO

Comparing Mass Mapping Reconstruction Methods with Minkowski Functionals

Using higher-order statistics to capture cosmological information from weak lensing surveys often requires a transformation of observed shear to a measurement of the convergence signal. This inverse problem is complicated by noise and boundary effects, and various reconstruction methods have been developed to implement the process. Here we evaluate the retention of signal information of four such methods: Kaiser-Squires, Wiener filter, $\texttt{DarkMappy}$, and $\texttt{DeepMass}$. We use the higher order statistics $\textit{Minkowski functionals}$ to determine which method best reconstructs the original convergence with efficiency and precision. We find $\texttt{DeepMass}$ produces the tightest constraints on cosmological parameters, while Kaiser-Squires, Wiener filter, and $\texttt{DarkMappy}$ are similar at a smoothing scale of 3.5 arcmin. We also study the MF inaccuracy caused by inappropriate training sets in the $\texttt{DeepMass}$ method and find it to be large compared to the errors, underlining the importance of selecting appropriate training cosmologies.

astro-ph.CO

Transitioning from Stage-III to Stage-IV: Cosmology from galaxy$\times$CMB lensing and shear$\times$CMB lensing

We examine the cosmological constraining power from two cross-correlation probes between galaxy and CMB surveys: the cross-correlation of lens galaxy density with CMB lensing convergence $\langleδκ\rangle$, and source galaxy weak lensing shear with CMB lensing convergence $\langleγκ\rangle$. These two cross-correlation probes provide an independent cross-check of other large-scale structure constraints and are insensitive to galaxy-only or CMB-only systematic effects. In addition, when combined with other large-scale structure probes, the cross-correlations can break degeneracies in cosmological and nuisance parameters, improving both the precision and robustness of the analysis. In this work, we study how the constraining power of $\langleδκ\rangle+\langleγκ\rangle$ changes from Stage-III (ongoing) to Stage-IV (future) surveys. Given the flexibility in selecting the lens galaxy sample, we also explore systematically the impact on cosmological constraints when we vary the redshift range and magnitude limit of the lens galaxies using mock galaxy catalogs. We find that in our setup, the contribution to cosmological constraints from $\langleδκ\rangle$ and $\langleγκ\rangle$ are comparable in the Stage-III datasets; but in Stage-IV surveys, the noise in $\langleδκ\rangle$ becomes subdominant to cosmic variance, preventing $\langleδκ\rangle$ to further improve the constraints. This implies that to maximize the cosmological constraints from future $\langleδκ\rangle+\langleγκ\rangle$ analyses, we should focus more on the requirements on $\langleγκ\rangle$ instead of $\langleδκ\rangle$. Furthermore, the selection of the lens sample should be optimized in terms of our ability to characterize its redshift or galaxy bias instead of its number density.

astro-ph.CO

Improved Tomographic Binning of 3x2pt Lens Samples: Neural Network Classifiers and Optimal Bin Assignments

Large imaging surveys, such as the Legacy Survey of Space and Time, rely on photometric redshifts and tomographic binning for 3x2pt analyses that combine galaxy clustering and weak lensing. In this paper, we propose a method for optimizing the tomographic binning choice for the lens sample of galaxies. We divide the CosmoDC2 and Buzzard simulated galaxy catalogs into a training set and an application set, where the training set is nonrepresentative in a realistic way, and then estimate photometric redshifts for the application sets. The galaxies are sorted into redshift bins covering equal intervals of redshift or comoving distance, or with an equal number of galaxies in each bin, and we consider a generalized extension of these approaches. We find that bins of equal comoving distance produce the highest dark energy figure of merit of the initial binning choices, but that the choice of bin edges can be further optimized. We then train a neural network classifier to identify galaxies that are either highly likely to have accurate photometric redshift estimates or highly likely to be sorted into the correct redshift bin. The neural network classifier is used to remove poor redshift estimates from the sample, and the results are compared to the case when none of the sample is removed. We find that the neural network classifiers are able to improve the figure of merit by ~13% and are able to recover ~25% of the loss in the figure of merit that occurs when a nonrepresentative training sample is used.

astro-ph.CO

JAX-COSMO: An End-to-End Differentiable and GPU Accelerated Cosmology Library

We present jax-cosmo, a library for automatically differentiable cosmological theory calculations. It uses the JAX library, which has created a new coding ecosystem, especially in probabilistic programming. As well as batch acceleration, just-in-time compilation, and automatic optimization of code for different hardware modalities (CPU, GPU, TPU), JAX exposes an automatic differentiation (autodiff) mechanism. Thanks to autodiff, jax-cosmo gives access to the derivatives of cosmological likelihoods with respect to any of their parameters, and thus enables a range of powerful Bayesian inference algorithms, otherwise impractical in cosmology, such as Hamiltonian Monte Carlo and Variational Inference. In its initial release, jax-cosmo implements background evolution, linear and non-linear power spectra (using halofit or the Eisenstein and Hu transfer function), as well as angular power spectra with the Limber approximation for galaxy and weak lensing probes, all differentiable with respect to the cosmological parameters and their other inputs. We illustrate how autodiff can be a game-changer for common tasks involving Fisher matrix computations, or full posterior inference with gradient-based techniques. In particular, we show how Fisher matrices are now fast, exact, no longer require any fine tuning, and are themselves differentiable. Finally, using a Dark Energy Survey Year 1 3x2pt analysis as a benchmark, we demonstrate how jax-cosmo can be combined with Probabilistic Programming Languages to perform posterior inference with state-of-the-art algorithms including a No U-Turn Sampler, Automatic Differentiation Variational Inference,and Neural Transport HMC. We further demonstrate that Normalizing Flows using Neural Transport are a promising methodology for model validation in the early stages of analysis.

astro-ph.CO

Hyper Suprime-Cam Year 3 Results: Cosmology from Cosmic Shear Power Spectra

We measure weak lensing cosmic shear power spectra from the three-year galaxy shear catalog of the Hyper Suprime-Cam (HSC) Subaru Strategic Program imaging survey. The shear catalog covers $416 \ \mathrm{deg}^2$ of the northern sky, with a mean $i$-band seeing of 0.59 arcsec and an effective galaxy number density of 15 $\mathrm{arcmin}^{-2}$ within our adopted redshift range. With an $i$-band magnitude limit of 24.5 mag, and four tomographic redshift bins spanning $0.3 \leq z_{\mathrm{ph}} \leq 1.5$ based on photometric redshifts, we obtain a high-significance measurement of the cosmic shear power spectra, with a signal-to-noise ratio of approximately 26.4 in the multipole range $300<\ell<1800$. The accuracy of our power spectrum measurement is tested against realistic mock shear catalogs, and we use these catalogs to get a reliable measurement of the covariance of the power spectrum measurements. We use a robust blinding procedure to avoid confirmation bias, and model various uncertainties and sources of bias in our analysis, including point spread function systematics, redshift distribution uncertainties, the intrinsic alignment of galaxies and the modeling of the matter power spectrum. For a flat $Λ$CDM model, we find $S_8 \equiv σ_8 (Ω_m/0.3)^{0.5} =0.776^{+0.032}_{-0.033}$, which is in excellent agreement with the constraints from the other HSC Year 3 cosmology analyses, as well as those from a number of other cosmic shear experiments. This result implies a $\sim$$2σ$-level tension with the Planck 2018 cosmology. We study the effect that various systematic errors and modeling choices could have on this value, and find that they can shift the best-fit value of $S_8$ by no more than $\sim$$0.5σ$, indicating that our result is robust to such systematics.

astro-ph.CO

The Third Gravitational Lensing Accuracy Testing (GREAT3) Challenge Handbook

The GRavitational lEnsing Accuracy Testing 3 (GREAT3) challenge is the third in a series of image analysis challenges, with a goal of testing and facilitating the development of methods for analyzing astronomical images that will be used to measure weak gravitational lensing. This measurement requires extremely precise estimation of very small galaxy shape distortions, in the presence of far larger intrinsic galaxy shapes and distortions due to the blurring kernel caused by the atmosphere, telescope optics, and instrumental effects. The GREAT3 challenge is posed to the astronomy, machine learning, and statistics communities, and includes tests of three specific effects that are of immediate relevance to upcoming weak lensing surveys, two of which have never been tested in a community challenge before. These effects include realistically complex galaxy models based on high-resolution imaging from space; spatially varying, physically-motivated blurring kernel; and combination of multiple different exposures. To facilitate entry by people new to the field, and for use as a diagnostic tool, the simulation software for the challenge is publicly available, though the exact parameters used for the challenge are blinded. Sample scripts to analyze the challenge data using existing methods will also be provided. See http://great3challenge.info and http://great3.projects.phys.ucl.ac.uk/leaderboard/ for more information.

astro-ph.CO

GREAT3 results I: systematic errors in shear estimation and the impact of real galaxy morphology

We present first results from the third GRavitational lEnsing Accuracy Testing (GREAT3) challenge, the third in a sequence of challenges for testing methods of inferring weak gravitational lensing shear distortions from simulated galaxy images. GREAT3 was divided into experiments to test three specific questions, and included simulated space- and ground-based data with constant or cosmologically-varying shear fields. The simplest (control) experiment included parametric galaxies with a realistic distribution of signal-to-noise, size, and ellipticity, and a complex point spread function (PSF). The other experiments tested the additional impact of realistic galaxy morphology, multiple exposure imaging, and the uncertainty about a spatially-varying PSF; the last two questions will be explored in Paper II. The 24 participating teams competed to estimate lensing shears to within systematic error tolerances for upcoming Stage-IV dark energy surveys, making 1525 submissions overall. GREAT3 saw considerable variety and innovation in the types of methods applied. Several teams now meet or exceed the targets in many of the tests conducted (to within the statistical errors). We conclude that the presence of realistic galaxy morphology in simulations changes shear calibration biases by $\sim 1$ per cent for a wide range of methods. Other effects such as truncation biases due to finite galaxy postage stamps, and the impact of galaxy type as measured by the Sérsic index, are quantified for the first time. Our results generalize previous studies regarding sensitivities to galaxy size and signal-to-noise, and to PSF properties such as seeing and defocus. Almost all methods' results support the simple model in which additive shear biases depend linearly on PSF ellipticity.

astro-ph.CO

Ridges in the Dark Energy Survey for cosmic trough identification

Cosmic voids and their corresponding redshift-projected mass densities, known as troughs, play an important role in our attempt to model the large-scale structure of the Universe. Understanding these structures enables us to compare the standard model with alternative cosmologies, constrain the dark energy equation of state, and distinguish between different gravitational theories. In this paper, we extend the subspace-constrained mean shift algorithm, a recently introduced method to estimate density ridges, and apply it to 2D weak lensing mass density maps from the Dark Energy Survey Y1 data release to identify curvilinear filamentary structures. We compare the obtained ridges with previous approaches to extract trough structure in the same data, and apply curvelets as an alternative wavelet-based method to constrain densities. We then invoke the Wasserstein distance between noisy and noiseless simulations to validate the denoising capabilities of our method. Our results demonstrate the viability of ridge estimation as a precursor for denoising weak lensing observables to recover the large-scale structure, paving the way for a more versatile and effective search for troughs.

astro-ph.CO

The Pantheon+ Analysis: Cosmological Constraints

We present constraints on cosmological parameters from the Pantheon+ analysis of 1701 light curves of 1550 distinct Type Ia supernovae (SNe Ia) ranging in redshift from $z=0.001$ to 2.26. This work features an increased sample size, increased redshift span, and improved treatment of systematic uncertainties in comparison to the original Pantheon analysis and results in a factor of two improvement in cosmological constraining power. For a Flat$Λ$CDM model, we find $Ω_M=0.334\pm0.018$ from SNe Ia alone. For a Flat$w_0$CDM model, we measure $w_0=-0.90\pm0.14$ from SNe Ia alone, H$_0=73.5\pm1.1$ km s$^{-1}$ Mpc$^{-1}$ when including the Cepheid host distances and covariance (SH0ES), and $w_0=-0.978^{+0.024}_{-0.031}$ when combining the SN likelihood with constraints from the cosmic microwave background (CMB) and baryon acoustic oscillations (BAO); both $w_0$ values are consistent with a cosmological constant. We also present the most precise measurements to date on the evolution of dark energy in a Flat$w_0w_a$CDM universe, and measure $w_a=-0.1^{+0.9}_{-2.0}$ from Pantheon+ alone, H$_0=73.3\pm1.1$ km s$^{-1}$ Mpc$^{-1}$ when including SH0ES, and $w_a=-0.65^{+0.28}_{-0.32}$ when combining Pantheon+ with CMB and BAO data. Finally, we find that systematic uncertainties in the use of SNe Ia along the distance ladder comprise less than one third of the total uncertainty in the measurement of H$_0$ and cannot explain the present "Hubble tension" between local measurements and early-Universe predictions from the cosmological model.

astro-ph.CO