arXiv subjects

Ian L. V. Roque

Publications and source records attributed to Ian L. V. Roque.

4 recordsLinked to original sources

arXiv2026

Optimisation of calibration sources for global 21-cm experiments: the REACH case

The spin-flip 21-cm signal from the Cosmic Dawn and the Epoch of Reionization is an essential probe of the conditions that led to the formation of the first luminous objects in the early Universe. However, its detection remains a major challenge owing to its low strength compared to the bright foregrounds and the requirement of precise calibration of the instrument to prevent systematics that could hinder a detection or lead to false inferences. REACH (Radio Experiment for the Analysis of Cosmic Hydrogen) is a radiometer experiment designed to detect this sky-averaged signal in the frequency range of 50--130~MHz. Using a wide-beam antenna, REACH calibration relies on internal reference sources, covering a broad range of temperatures and reflection coefficients. The choice of type and number of calibrators used significantly influences the quality of the calibration. This work investigates these effects and introduces a novel method for selecting an optimal set of calibration sources. With an optimised set, we aim to reduce calibration time, thereby increasing sky integration time while preserving calibration accuracy. We explore two optimisation strategies: one applied across the full receiver band and another performed on a frequency-by-frequency basis. Finally, we demonstrate that, with a total calibration time comparable to the conventional full-calibrator set, an optimised set with fewer calibrators achieves approximately a $15~\%$ reduction in calibrated temperature noise and improved absolute calibration of the instrument. This has implications for better calibration strategies in similar radiometer experiments.

astro-ph.IM↗

arXiv2025

ReplicationBench: Can AI Agents Replicate Astrophysics Research Papers?

Frontier AI agents show increasing promise as scientific research assistants, and may eventually be useful for extended, open-ended research workflows. However, in order to use agents for novel research, we must first assess the underlying faithfulness and correctness of their work. To evaluate agents as research assistants, we introduce ReplicationBench, an evaluation framework that tests whether agents can replicate entire research papers drawn from the astrophysics literature. Astrophysics, where research relies heavily on archival data and computational study while requiring little real-world experimentation, is a particularly useful testbed for AI agents in scientific research. We split each paper into tasks which require agents to replicate the paper's core contributions, including the experimental setup, derivations, data analysis, and codebase. Each task is co-developed with the original paper authors and targets a key scientific result, enabling objective evaluation of both faithfulness (adherence to original methods) and correctness (technical accuracy of results). ReplicationBench is extremely challenging for current frontier language models: even the best-performing language models score under 20%. We analyze ReplicationBench trajectories in collaboration with domain experts and find a rich, diverse set of failure modes for agents in scientific research. ReplicationBench establishes the first benchmark of paper-scale, expert-validated astrophysics research tasks, reveals insights about agent performance generalizable to other domains of data-driven science, and provides a scalable framework for measuring AI agents' reliability in scientific research.

cs.CL↗

arXiv2025

Accounting for Noise and Singularities in Bayesian Calibration Methods for Global 21-cm Cosmology Experiments

Due to the large dynamic ranges involved with separating the cosmological 21-cm signal from the Cosmic Dawn from galactic foregrounds, a well-calibrated instrument is essential to avoid biases from instrumental systematics. In this paper we present three methods for calibrating a global 21-cm cosmology experiment using the noise wave parameter formalisation to characterise a low noise amplifier including a careful consideration of how calibrator temperature noise and singularities will bias the result. The first method presented in this paper builds upon the existing conjugate priors method by weighting the calibrators by a physically motivated factor, thereby avoiding singularities and normalising the noise. The second method fits polynomials to the noise wave parameters by marginalising over the polynomial coefficients and sampling the polynomial orders as parameters. The third method introduces a physically motivated noise model to the marginalised polynomial method. Running these methods on a suite of simulated datasets based on the REACH receiver design and a lab dataset, we found that our methods produced a calibration solution which is equally as or more accurate than the existing conjugate priors method when compared with an analytic estimate of the calibrator's noise. We find in the case of the measured lab dataset the conjugate priors method is biased heavily by the large noise on the shorted load calibrator, resulting in incorrect noise wave parameter fits. This is mitigated by the methods introduced in this paper which calibrate the validation source spectra to within 5% of the noise floor.

astro-ph.IM↗

arXiv2025

Receiver design for the REACH global 21-cm signal experiment

We detail the the REACH radiometric system designed to enable measurements of the 21-cm neutral hydrogen line. Included is the radiometer architecture and end-to-end system simulations as well as a discussion of the challenges intrinsic to highly-calibratable system development. Following this, we share laboratory results based on the calculation of noise wave parameters utilising an over-constrained least squares approach demonstrating a calibration RMSE of 80 mK for five hours of integration on a custom-made source with comparable impedance to that of the antenna used in the field. This paper therefore documents the state of the calibrator and data analysis in December 2022 in Cambridge before shipping to South Africa.

astro-ph.IM↗