Searcharxiv⌕ Search

arXiv subjects

Hendrik Hildebrandt

Publications and source records attributed to Hendrik Hildebrandt.

At least 37 records · Page 2Linked to original sources

KiDS-Legacy: Cosmological constraints from cosmic shear with the complete Kilo-Degree Survey

We present cosmic shear constraints from the completed Kilo-Degree Survey (KiDS), where the cosmological parameter $S_8\equivσ_8\sqrt{Ω_{\rm m}/0.3} = 0.815^{+0.016}_{-0.021}$, is found to be in agreement ($0.73σ$) with results from the Planck Legacy cosmic microwave background experiment. The final KiDS footprint spans $1347$ square degrees of deep nine-band imaging across the optical and near-infrared, along with an extra $23$ square degrees of KiDS-like calibration observations of deep spectroscopic surveys. Improvements in our redshift distribution estimation methodology, combined with our enhanced calibration data and multi-band image simulations, allow us to extend our lensed sample out to a photometric redshift of $z_{\rm B}\leq2.0$. Compared to previous KiDS analyses, the increased survey area and redshift depth results in a $\sim32\%$ improvement in constraining power in terms of $Σ_8\equivσ_8\left(Ω_{\rm m}/0.3\right)^α= 0.821^{+0.014}_{-0.016}$, where $α= 0.58$ has been optimised to match the revised degeneracy direction of $σ_8$ and $Ω_{\rm m}$. We adopt a new physically motivated intrinsic alignment model that depends jointly on the galaxy sample's halo mass and spectral type distributions, and that is informed by previous direct alignment measurements. We also marginalise over our uncertainty on the impact of baryon feedback on the non-linear matter power spectrum. Comparing to previous KiDS analyses, we conclude that the increase seen in $S_8$ primarily results from our improved redshift distribution estimation and calibration, as well as new survey area and improved image reduction. Our companion paper Stölzner et al. (submitted) presents a full suite of internal and external consistency tests, finding the KiDS-Legacy data set to be the most internally robust sample produced by KiDS to date.

astro-ph.CO↗

KiDS-Legacy: Redshift distributions and their calibration

We present the redshift calibration methodology and bias estimates for the cosmic shear analysis of the fifth and final data release (DR5) of the Kilo-Degree Survey (KiDS). KiDS-DR5 includes a greatly expanded compilation of calibrating spectra, drawn from $27$ square degrees of dedicated optical and near-IR imaging taken over deep spectroscopic fields. The redshift distribution calibration leverages a range of new methods and updated simulations to produce the most precise $N(z)$ bias estimates used by KiDS to date. Improvements to our colour-based redshift distribution measurement method (SOM) mean that we are able to use many more sources per tomographic bin for our cosmological analyses, and better estimate the representation of our source sample given the available spec-$z$. We validate our colour-based redshift distribution estimates with spectroscopic cross-correlations (CC). We find that improvements to our cross-correlation redshift distribution measurement methods mean that redshift distribution biases estimated between the SOM and CC methods are fully consistent on simulations, and the data calibration is consistent to better than $2σ$ in all tomographic bins.

astro-ph.CO↗

KiDS-Legacy: Consistency of cosmic shear measurements and joint cosmological constraints with external probes

We present a cosmic shear consistency analysis of the final data release from the Kilo-Degree Survey (KiDS-Legacy). By adopting three tiers of consistency metrics, we compare cosmological constraints between subsets of the KiDS-Legacy dataset split by redshift, angular scale, galaxy colour and spatial region. We also review a range of two-point cosmic shear statistics. With the data passing all our consistency metric tests, we demonstrate that KiDS-Legacy is the most internally consistent KiDS catalogue to date. In a joint cosmological analysis of KiDS-Legacy and DES Y3 cosmic shear, combined with data from the Pantheon+ Type Ia supernovae compilation and baryon acoustic oscillations from DESI Y1, we find constraints consistent with Planck measurements of the cosmic microwave background with $S_8\equiv σ_8\sqrt{Ω_{\rm m}/0.3} = 0.814^{+0.011}_{-0.012}$ and $σ_8 = 0.802^{+0.022}_{-0.018}$.

astro-ph.CO↗

Cosmology from UNIONS weak lensing profiles of galaxy clusters

Cosmological information is encoded in the structure of galaxy clusters. In Universes with less matter and larger initial density perturbations, clusters form earlier and have more time to accrete material, leading to a more extended infall region. Thus, measuring the mean mass distribution in the infall region provides a novel cosmological test. The infall region is largely insensitive to baryonic physics, and provides a cleaner structural test than other measures of cluster assembly time such as concentration. We consider cluster samples from three publicly available galaxy cluster catalogues: the Spectroscopic Identification of eROSITA Sources (SPIDERS) catalogue, the X-ray and Sunyaev-Zeldovich effect selected clusters in the meta-catalogue M2C, and clusters identified in the Dark Energy Spectroscopic Instrument (DESI) Legacy Imaging Survey. Using a preliminary shape catalogue from the Ultraviolet Near Infrared Optical Northern Survey (UNIONS), we derive excess surface mass density profiles for each sample. We then compare the mean profile for the DESI Legacy sample, which is the most complete, to predictions from a suite of simulations covering a range of $Ω_{\rm m}$ and $σ_8$, obtaining constraints of $Ω_{\rm m}=0.34\pm 0.06$ and $σ_8=0.77 \pm 0.04$. We also measure mean (comoving) splashback radii for SPIDERS, M2C and DESI Legacy Imaging Survey clusters of $1.39^{+0.21}_{-0.18} {\rm cMpc}$, $1.77^{+0.20}_{-0.18} {\rm cMpc}/h$ and $1.42^{+0.11}_{-0.12} {\rm cMpc}/h$ respectively. Performing this analysis with the final UNIONS shape catalogue and the full sample of spectroscopically observed clusters in DESI, we can expect to improve on the best current constraints from cluster abundance studies by a factor of 2 or more.

astro-ph.CO↗

Matter power spectrum reconstruction with KiDS-Legacy: Improved internal $Λ$CDM consistency and preference for strong baryonic feedback

Direct measurements of the matter power spectrum, $P_\mathrm{m}(k,z)$, provide a powerful tool to investigate observed tensions between models of structure growth while also testing the internal consistency of cosmological probes. We analyse cosmic shear data from the final data release of the Kilo-Degree Survey (KiDS), presenting a deprojected $P_\mathrm{m}(k,z)$, measured in up to three redshift bins. Compared to analyses using previous KiDS releases, we find improved internal consistency in the $z\lesssim0.7$ regime. At large scales, $k\lesssim0.1\,h\,\rm Mpc^{-1}$, our power spectrum reconstruction aligns with $Λ$CDM predictions with a density fluctuation amplitude $σ_8=0.81$. Furthermore, at small scales, $k=3$-$20\,h\,\rm Mpc^{-1}$, the average matter power spectrum is suppressed by $30\%\pm10\%\,{\rm (stat.)}\pm4\%\,{\rm (sys.)}$ with $2.8σ$ significance relative to a dark-matter-only model, consistent with expectations of strong baryonic feedback.

astro-ph.CO↗

KiDS-1000 cosmic shear reanalysis using MetaCalibration

A number of cosmic shear studies have reported results that are in mild tension with the Planck cosmic microwave measurement. To explore if this can be caused by biases in the shear estimation, we revisit the analysis of data from the Kilo-Degree Survey (KiDS) using an alternative shape measurement pipeline that is more robust to uncertainties in the calibration. To this end, we present an implementation of MetaCalibration, and compare its performance to that of lensfit, which has been used in previous analyses of these data. We find that the multiplicative bias is reduced, especially for the most distant redshifts, as derived from multi-band image simulations designed to match the KiDS data (SURFS-based KiDS-Legacy-Like Simulations: SKiLLS). For all tomographic bins we obtain a multiplicative bias $|m|<0.017$, with negligible additive bias. Importantly, the calibration has a negligible sensitivity to key galaxy properties. The resulting robust shear estimates were used to obtain cosmological parameter constraints. We find that the parameter $S_8\equiv σ_8 \sqrt{Ω_\mathrm{m}/0.3} =0.789_{-0.024}^{+0.020}$ is consistent with the previous KiDS-1000 lensfit constraint of $S_8=0.776^{+0.029 +0.002}_{-0.027-0.003}$ (statistical + systematic errors). Thanks to the higher effective source density, the constraining power is improved by about 28%. The difference in $S_8$ with the Planck value remains at a similar level, 1.8$σ$, implying that it is not caused by the shear measurements.

astro-ph.CO↗

Three-dimensional Search for Annihilating Dark Matter in CBe dSph with the MAGIC Telescopes

Dark matter (DM) candidates, such as Weakly Interacting Massive Particles (WIMPs), can annihilate to Standard Model particles, subsequently producing gamma rays. In this work, we search for DM-induced gamma-ray signals from Coma Berenices dwarf spheroidal galaxy (CBe dSph) using approximately 25 hours of observations carried out by the Major Atmospheric Gamma Imaging Cherenkov (MAGIC) Telescope, located at Roque de los Muchachos Observatory, La Palma, Spain. Building upon preceding analyses in the gamma-ray regime, we extend the DM search into three dimensions by incorporating spatial information from the assumed DM-density distribution. This approach enhances sensitivity by leveraging both energy and spatial characteristics of the expected signal. The three-dimensional search for a faint signal necessitates the construction of a background model, leading to the proposal of the exclusion-rotation method. This method stacks all observations, excludes the source region, and corrects for the Azimuth-dependent acceptance of the telescopes by rotating the model. Furthermore, the open-source Python package TITRATE is presented, introducing Asimov datasets to the high-level analysis tool Gammapy for the approximation of the test statistic. No evidence of a DM-induced signal for annihilation to $b\bar{b}$, $W^+W^-$, $μ^+μ^-$, and $τ^+τ^-$ and DM masses $m_χ$ between 0.17 TeV and 100 TeV in CBe dSph is found. Consequently, the first upper limits on the thermally averaged cross-section in energy and spatial dimensions using TITRATE are set, leading to a sensitivity improvement over previous results by MAGIC with respect to the assumed DM density in the target halo. The development of the Asimov method for DM search reduces the need for Monte Carlo simulations, paving the way for computationally efficient and scalable large-scale analyses across multiple targets and cosmic messengers.

astro-ph.HE↗

KiDS-Legacy: Covariance validation and the unified OneCovariance framework for projected large-scale structure observables

We introduce OneCovariance, an open-source software designed to accurately compute covariance matrices for an arbitrary set of two-point summary statistics across a variety of large-scale structure tracers. Utilising the halo model, we estimated the statistical properties of matter and biased tracer fields, incorporating all Gaussian, non-Gaussian, and super-sample covariance terms. The flexible configuration permits user-specific parameters, such as the complexity of survey geometry, the halo occupation distribution employed to define each galaxy sample, or the form of the real-space and/or Fourier space statistics to be analysed. We illustrate the capabilities of OneCovariance within the context of a cosmic shear analysis of the final data release of the Kilo-Degree Survey (KiDS-Legacy). Upon comparing our estimated covariance with measurements from mock data and calculations from independent software, we ascertain that OneCovariance achieves accuracy at the per cent level. When assessing the impact of ignoring complex survey geometry in the cosmic shear covariance computation, we discover misestimations at approximately the $10\%$ level for cosmic variance terms. Nonetheless, these discrepancies do not significantly affect the KiDS-Legacy recovery of cosmological parameters. We derive the cross-covariance between real-space correlation functions, bandpowers, and COSEBIs, facilitating future consistency tests among these three cosmic shear statistics. Additionally, we calculate the covariance matrix of photometric-spectroscopic galaxy clustering measurements, validating the jackknife covariance estimates for calibrating KiDS-Legacy redshift distributions. The OneCovariance can be found on GitHub, together with comprehensive documentation and examples.

astro-ph.CO↗

Unions with UNIONS: Using galaxy-galaxy lensing to probe galaxy mergers

We use galaxy-galaxy lensing to investigate how the dark matter (DM) haloes and stellar content of galaxies with $0.012 \leq z \leq 0.32$ and $10 \leq \log_{10}(M_\star/\mathrm{M}_\odot) \leq 12$ change as a result of the merger process. To this end, we construct two samples of galaxies obtained from the Ultraviolet Near Infrared Optical Northern Survey (UNIONS), comprising 1 623 post-mergers and $\sim$30 000 non-merging controls, that live in low-density environments to use as our lenses. These samples are weighted to share the same distributions of stellar mass, redshift, and geometric mean distance to a galaxy's three nearest neighbours to ensure differences in the lensing signal are due to the merger process itself. We do not detect a statistically significant difference in the excess surface density profile of post-mergers and non-merging controls with current data. Fitting haloes composed of a point-like stellar mass component and an extended DM structure described by a Navarro-Frenk-White profile to the lensing measurements yields, for both samples, halo masses of $M_\text{halo} \sim 4\times10^{12}\,\mathrm{M}_\odot$ and a moderately negative correlation between $M_\text{halo}$ and concentration $c$. This allows us to rule out, at the 95% confidence level, merger-induced starbursts in which more than 60% of the stellar mass is formed in the burst. The application of our methods to upcoming surveys that are able to provide samples $\sim$10$\times$ larger than our current catalogue are expected to detect the weak-lensing signatures of mergers and further constrain their properties.

astro-ph.GA↗

Measurement of circumgalactic extinction in the Kilo-Degree Survey's Data Release 4

Galaxies reside in extended dark matter halos, but their baryonic content, especially dust, remains less well understood. We aim to investigate the amount and distribution of dust in galactic halos by measuring shifts in the observed magnitudes of background galaxies. Dust absorbs and scatters shorter-wavelength light, reddening background sources. We quantify this effect using multi-band magnitude shifts in the Kilo-Degree Survey (KiDS) Data Release 4, distinguishing it from achromatic magnification. Our pipeline is validated using MICE2 mock catalogues, and we explore potential systematics arising from galaxy selection, in contrast to previous quasar-based studies. Simulations show that input halo and dust masses can be recovered independently and jointly using galaxy-galaxy lensing (GGL) and magnitude shifts. A minimum redshift separation of $Δz_{\mathrm B}\sim0.3$ and brightness cuts are required to minimise overlap effects and the effects of photometric noise, respectively. Applying our pipeline to KiDS data, we first confirm the achromaticity of magnitude shifts in five near-infrared filters ($ZYJHK_{\rm s}$). In optical bands ($ugri$), joint analysis constrains halo mass and dust mass to $0.2$ dex and $0.3$ dex, respectively, yielding $M_{\rm dust}=7.24^{+0.52}_{-0.64} \times 10^7\,M_\odot$ and $\log(M_{\rm halo}^{\rm DM}/M_\odot)=12.33^{+0.08}_{-0.04}$. These results agree with previous studies and represent the first successful measurement of magnitude shifts and halo extinction with KiDS, confirming that galaxies reside in extended baryonic halos enriched by gas and dust from feedback processes.

astro-ph.GA↗

Constraining the dispersion measure redshift relation with simulation-based inference

We use the dispersion measure (DM) of localised Fast Radio Bursts (FRBs) to constrain cosmological and host galaxy parameters using simulation-based inference (SBI) for the first time. By simulating the large-scale structure of the electron density with the Generator for Large-Scale Structure (GLASS), we generate log-normal realisations of the free electron density field, accurately capturing the correlations between different FRBs. For the host galaxy contribution, we rigorously test various models, including log-normal, truncated Gaussian and Gamma distributions, while modelling the Milky Way component using pulsar data. Through these simulations, we employ the truncated sequential neural posterior estimation method to obtain the posterior. Using current observational data, we successfully recover the amplitude of the DM-redshift relation, consistent with Planck, while also fitting both the mean host contribution and its shape. Notably, we find no clear preference for a specific model of the host galaxy contribution. Although SBI may not yet be strictly necessary for FRB inference, this work lays the groundwork for the future, as the increasing volume of FRB data will demand precise modelling of both the host and large-scale structure components. Our modular simulation pipeline offers flexibility, allowing for easy integration of improved models as they become available, ensuring scalability and adaptability for upcoming analyses using FRBs. The pipeline is made publicly available under https://github.com/koustav-konar/FastNeuralBurst.

astro-ph.CO↗

Fast radio bursts as a probe of gravity on cosmological scales

We explore the potential for improving constraints on gravity by leveraging correlations in the dispersion measure derived from Fast Radio Bursts (FRBs) in combination with cosmic shear. Specifically, we focus on Horndeski gravity, inferring the kinetic braiding and Planck mass run rate from a stage-4 cosmic shear mock survey alongside a survey comprising $10^4$ FRBs. For the inference pipeline, we utilise the Boltzmann code hi_class to predict the linear matter power spectrum in modified gravity scenarios, while non-linear corrections are obtained from the halo-model employed in HMcode, including feedback mechanisms. Our findings indicate that FRBs can disentangle degeneracies between baryonic feedback and cosmological parameters, as well as the mass of massive neutrinos. Since these parameters are also degenerate with modified gravity parameters, the inclusion of FRBs can enhance constraints on Horndeski parameters by up to $40$ percent, despite being a less significant measurement. Additionally, we apply our model to current FRB data and use the uncertainty in the $\mathrm{DM}-z$ relation to impose limits on gravity. However, due to the limited sample size of current data, constraints are predominantly influenced by theoretical priors. Despite this, our study demonstrates that FRBs will significantly augment the limited set of cosmological probes available, playing a critical role in providing alternative tests of feedback, cosmology, and gravity. All codes used in this work are made publicly available.

astro-ph.CO↗

Dust-obscured Galaxies with Broken Power-law Spectral Energy Distributions Discovered by UNIONS

We report on the spectral energy distributions (SEDs) of infrared-bright dust-obscured galaxies (DOGs) with $(i - [22])_{\rm AB} \geq 7.0$. Using photometry from the deep and wide Ultraviolet Near-Infrared Optical Northern Survey, combined with near-IR and mid-IR data from the UKIRT Infrared Deep Sky Survey and the Wide-field Infrared Survey Explorer, we successfully identified 382 DOGs in $\sim$ 170 deg$^2$. Among them, the vast majority (376 DOGs) were classified into two subclasses: bump DOGs (132/376) and power-law (PL) DOGs (244/376), which are dominated by star formation and active galactic nucleus (AGN), respectively. Through the SED analysis, we found that roughly half (120/244) of the PL DOGs show ``broken'' power-law SEDs. The significant red slope from optical to near-IR in the SEDs of these ``broken power-law DOGs'' (BPL DOGs) probably reflects their large amount of dust extinction. In other words, BPL DOGs are more heavily obscured AGNs, compared to PL DOGs with non-broken power-law SEDs.

astro-ph.GA↗

Quantifying the Detectability of Milky Way Satellites with Image Simulations: a Case Study with KiDS

Ultra-faint dwarf galaxies, which can be detected as resolved satellite systems of the Milky Way, are critical to understanding galaxy formation, evolution, and the nature of dark matter, as they are the oldest, smallest, most metal-poor, and most dark matter-dominated stellar systems known. Quantifying the sensitivity of surveys is essential for understanding their capability and limitations in searching for ultra-faint satellites. In this paper, we present the first study of the image-level observational selection function for Kilo-Degree Survey (KiDS) based on the Synthetic UniveRses For Surveys (surfs)-based KiDS-Legacy-Like Simulations. We generate mock satellites and simulate images that include resolved stellar populations of the mock satellites and the background galaxies, capturing realistic observational effects such as source blending, photometric uncertainties, and star-galaxy separation. The matched-filter method is applied to recover the injected satellites. We derive the observational selection function of the survey in terms of the luminosity, half-light radius, and heliocentric distance of the satellites. Compared to a catalogue-level simulation as used in previous studies, the image-level simulation provides a more realistic assessment of survey sensitivity, accounting for observational limitations that are neglected in catalogue-level simulations. The image-level simulation shows a detection loss for compact sources with a distance $d \gtrsim 100~\rm kpc$. We argue that this is because compact sources are more likely to be identified as single sources rather than being resolved during the source extraction process.

astro-ph.CO↗

The fifth data release of the Kilo Degree Survey: Multi-epoch optical/NIR imaging covering wide and legacy-calibration fields

We present the final data release of the Kilo-Degree Survey (KiDS-DR5), a public European Southern Observatory (ESO) wide-field imaging survey optimised for weak gravitational lensing studies. We combined matched-depth multi-wavelength observations from the VLT Survey Telescope and the VISTA Kilo-degree INfrared Galaxy (VIKING) survey to create a nine-band optical-to-near-infrared survey spanning $1347$ deg$^2$. The median $r$-band $5σ$ limiting magnitude is 24.8 with median seeing $0.7^{\prime\prime}$. The main survey footprint includes $4$ deg$^2$ of overlap with existing deep spectroscopic surveys. We complemented these data in DR5 with a targeted campaign to secure an additional $23$ deg$^2$ of KiDS- and VIKING-like imaging over a range of additional deep spectroscopic survey fields. From these fields, we extracted a catalogue of $126\,085$ sources with both spectroscopic and photometric redshift information, which enables the robust calibration of photometric redshifts across the full survey footprint. In comparison to previous releases, DR5 represents a $34\%$ areal extension and includes an $i$-band re-observation of the full footprint, thereby increasing the effective $i$-band depth by $0.4$ magnitudes and enabling multi-epoch science. Our processed nine-band imaging, single- and multi-band catalogues with masks, and homogenised photometry and photometric redshifts can be accessed through the ESO Archive Science Portal.

astro-ph.GA↗

UNIONS: The Ultraviolet Near-Infrared Optical Northern Survey

The Ultraviolet Near-Infrared Optical Northern Survey (UNIONS) is a "collaboration of collaborations" that is using the Canada-France-Hawai'i Telescope, the Pan-STARRS telescopes, and the Subaru Observatory to obtain $ugriz$ images of a core survey region of 6250 deg$^2$ of the northern sky. The $10σ$ point source depth of the data, as measured within a 2-arcsecond diameter aperture, are $[u,g,r,i,z] = [23.7, 24.5, 24.2, 23.8, 23.3]$\ in AB magnitudes. UNIONS is addressing some of the most fundamental questions in astronomy, including the properties of dark matter, the growth of structure in the Universe from the very smallest galaxies to large-scale structure, and the assembly of the Milky Way. It is set to become the major ground-based legacy survey for the northern hemisphere for the next decade and provides an essential northern complement to the static-sky science of the Vera C. Rubin Observatory's Legacy Survey of Space and Time. UNIONS supports the core science mission of the {\it Euclid} space mission by providing the data necessary in the northern hemisphere for the calibration of the wavelength dependence of the {\it Euclid} point-spread function and derivation of photometric redshifts in the North Galactic Cap. This region contains the highest quality sky for {\it Euclid}, with low backgrounds from the zodiacal light, stellar density, extinction, and emission from Galactic cirrus. Here, we describe the UNIONS survey components, science goals, data products, and the current status of the overall program.

astro-ph.GA↗

KiDS-1000: Weak lensing and intrinsic alignment around luminous red galaxies

We study the properties of luminous red galaxies (LRGs) selected from the fourth data release of the Kilo Degree Survey (KiDS-1000) via galaxy-galaxy lensing of the background galaxies from KiDS-1000. We used a halo model formalism to interpret our measurements and obtain estimates of the halo masses as well as the satellite fractions of the LRGs, resulting in halo masses of $2.7 \times 10^{12} h^{-1} {\rm M}_{\odot}<M_{\rm h}< 2.6 \times 10^{13} h^{-1} {\rm M}_{\odot}$. We studied the strength of intrinsic alignments (IA) using the position-shape correlations as a function of LRG luminosity, where we used a double power law to describe the relation between luminosity and halo mass to allow for a comparison with previous works. Here, we directly linked the observed IA of the (central) galaxy to the mass of the hosting halo, which is expected to be a fundamental quantity in establishing the alignment. We find that the dependence of the IA amplitude on halo mass is described well by a single power law, with an amplitude of $A = 5.74\pm{0.32}$ and slope of $β_M = 0.44\pm{0.04}$, in the range of $1.9 \times 10^{12}h^{-1} {\rm M}_{\odot}<M_{\rm h}<3.7 \times 10^{14} h^{-1} {\rm M}_{\odot}$. We also find that both red and blue galaxies from the source sample associated with the LRGs are randomly oriented, with respect to the LRGs, although our detection significance is limited by the uncertainty in our photometric redshifts.

astro-ph.CO↗

KiDS-Legacy: Angular galaxy clustering from deep surveys with complex selection effects

Photometric galaxy surveys, despite their limited resolution along the line of sight, encode rich information about the large-scale structure (LSS) of the Universe thanks to the high number density and extensive depth of the data. However, the complicated selection effects in wide and deep surveys can potentially cause significant bias in the angular two-point correlation function (2PCF) measured from those surveys. In this paper, we measure the 2PCF from the newly published KiDS-Legacy sample. Given an $r$-band $5σ$ magnitude limit of $24.8$ and survey footprint of $1347$ deg$^2$, it achieves an excellent combination of sky coverage and depth for such a measurement. We find that complex selection effects, primarily induced by varying seeing, introduce over-estimation of the 2PCF by approximately an order of magnitude. To correct for such effects, we apply a machine learning-based method to recover an organised random (OR) that presents the same selection pattern as the galaxy sample. The basic idea is to find the selection-induced clustering of galaxies using a combination of self-organising maps (SOMs) and hierarchical clustering (HC). This unsupervised machine learning method is able to recover complicated selection effects without specifying their functional forms. We validate this SOM+HC method on mock deep galaxy samples with realistic systematics and selections derived from the KiDS-Legacy catalogue. Using mock data, we demonstrate that the OR delivers unbiased 2PCF cosmological parameter constraints, removing the $27σ$ offset in the galaxy bias parameter that is recovered when adopting uniform randoms. Blinded measurements on the real KiDS-Legacy data show that the corrected 2PCF is robust to the SOM+HC configuration near the optimal set-up suggested by the mock tests.

astro-ph.CO↗