arXiv subjects

Judd D. Bowman

Publications and source records attributed to Judd D. Bowman.

At least 37 records · Page 2Linked to original sources

arXiv2024

Impacts and Statistical Mitigation of Missing Data on the 21cm Power Spectrum: A Case Study with the Hydrogen Epoch of Reionization Array

The precise characterization and mitigation of systematic effects is one of the biggest roadblocks impeding the detection of the fluctuations of cosmological 21cm signals. Missing data in radio cosmological experiments, often due to radio frequency interference (RFI), poses a particular challenge to power spectrum analysis as it could lead to the ringing of bright foreground modes in Fourier space, heavily contaminating the cosmological signals. Here we show that the problem of missing data becomes even more arduous in the presence of systematic effects. Using a realistic numerical simulation, we demonstrate that partially flagged data combined with systematic effects can introduce significant foreground ringing. We show that such an effect can be mitigated through inpainting the missing data. We present a rigorous statistical framework that incorporates the process of inpainting missing data into a quadratic estimator of the 21cm power spectrum. Under this framework, the uncertainties associated with our inpainting method and its impact on power spectrum statistics can be understood. These results are applied to the latest Phase II observations taken by the Hydrogen Epoch of Reionization Array, forming a crucial component in power spectrum analyses as we move toward detecting 21cm signals in the ever more noisy RFI environment.

astro-ph.CO↗

arXiv2024

Direct Optimal Mapping Image Power Spectrum and its Window Functions

The key to detecting neutral hydrogen during the epoch of reionization (EoR) is to separate the cosmological signal from the dominating foreground radiation. We developed direct optimal mapping (DOM) to map interferometric visibilities; it contains only linear operations, with full knowledge of point spread functions from visibilities to images. Here, we demonstrate a fast Fourier transform-based image power spectrum and its window functions computed from the DOM images. We use noiseless simulation, based on the Hydrogen Epoch of Reionization Array Phase I configuration, to study the image power spectrum properties. The window functions show $<10^{-11}$ of the integrated power leaks from the foreground-dominated region into the EoR window; the 2D and 1D power spectra also verify the separation between the foregrounds and the EoR.

astro-ph.IM↗

arXiv2024

Hydrogen Epoch of Reionization Array (HERA) Phase II Deployment and Commissioning

This paper presents the design and deployment of the Hydrogen Epoch of Reionization Array (HERA) phase II system. HERA is designed as a staged experiment targeting 21 cm emission measurements of the Epoch of Reionization. First results from the phase I array are published as of early 2022, and deployment of the phase II system is nearing completion. We describe the design of the phase II system and discuss progress on commissioning and future upgrades. As HERA is a designated Square Kilometer Array (SKA) pathfinder instrument, we also show a number of "case studies" that investigate systematics seen while commissioning the phase II system, which may be of use in the design and operation of future arrays. Common pathologies are likely to manifest in similar ways across instruments, and many of these sources of contamination can be mitigated once the source is identified.

astro-ph.IM↗

arXiv2023

Low-Frequency Radio Recombination Lines Away From the Inner Galactic Plane

Diffuse radio recombination lines (RRLs) in the Galaxy are possible foregrounds for redshifted 21~cm experiments. We use EDGES drift scans centered at $-26.7^o$~declination to characterize diffuse RRLs across the southern sky. We find RRLs averaged over the large antenna beam ($ 72^o \times 110^o $) reach minimum amplitudes between right ascensions~2-6~h. In this region, the C$α$ absorption amplitude is $33\pm11$~mK (1$σ$) averaged over 50-87~MHz ($27\gtrsim z \gtrsim15$ for the 21~cm line) and increases strongly as frequency decreases. C$β$ and H$α$ lines are consistent with no detection with amplitudes of $13\pm14$ and $12\pm10$~mK (1$σ$), respectively. At 108-124.5~MHz ($z\approx11$) in the same region, we find no evidence for carbon or hydrogen lines at the noise level of 3.4~mK (1$σ$). Conservatively assuming observed lines come broadly from the diffuse interstellar medium, as opposed to a few compact regions, these amplitudes provide upper limits on the intrinsic diffuse lines. The observations support expectations that Galactic RRLs can be neglected as significant foregrounds for a large region of sky until redshifted 21~cm experiments, particularly those targeting Cosmic Dawn, move beyond the detection phase. We fit models of the spectral dependence of the lines averaged over the large beam of EDGES, which may contain multiple line sources with possible line blending, and find that including degrees of freedom for expected smooth, frequency-dependent deviations from local thermodynamic equilibrium (LTE) is preferred over simple LTE assumptions for C$α$ and H$α$ lines. For C$α$ we estimate departure coefficients $0.79<b_nβ_n<4.5$ along the inner Galactic Plane and $0<b_nβ_n<2.3$ away from the inner Galactic Plane.

astro-ph.GA↗

arXiv2023

A Bayesian approach to modelling spectrometer data chromaticity corrected using beam factors -- I. Mathematical formalism

Accurately accounting for spectral structure in spectrometer data induced by instrumental chromaticity on scales relevant for detection of the 21-cm signal is among the most significant challenges in global 21-cm signal analysis. In the publicly available EDGES low-band data set, this complicating structure is suppressed using beam-factor based chromaticity correction (BFCC), which works by dividing the data by a sky-map-weighted model of the spectral structure of the instrument beam. Several analyses of this data have employed models that start with the assumption that this correction is complete. However, while BFCC mitigates the impact of instrumental chromaticity on the data, given realistic assumptions regarding the spectral structure of the foregrounds, the correction is only partial. This complicates the interpretation of fits to the data with intrinsic sky models (models that assume no instrumental contribution to the spectral structure of the data). In this paper, we derive a BFCC data model from an analytic treatment of BFCC and demonstrate using simulated observations that, in contrast to using an intrinsic sky model for the data, the BFCC data model enables unbiased recovery of a simulated global 21-cm signal from beam-factor chromaticity corrected data in the limit that the data is corrected with an error-free beam-factor model.

astro-ph.CO↗

arXiv2023

Characterization Of Inpaint Residuals In Interferometric Measurements of the Epoch Of Reionization

Radio Frequency Interference (RFI) is one of the systematic challenges preventing 21cm interferometric instruments from detecting the Epoch of Reionization. To mitigate the effects of RFI on data analysis pipelines, numerous inpaint techniques have been developed to restore RFI corrupted data. We examine the qualitative and quantitative errors introduced into the visibilities and power spectrum due to inpainting. We perform our analysis on simulated data as well as real data from the Hydrogen Epoch of Reionization Array (HERA) Phase 1 upper limits. We also introduce a convolutional neural network that capable of inpainting RFI corrupted data in interferometric instruments. We train our network on simulated data and show that our network is capable at inpainting real data without requiring to be retrained. We find that techniques that incorporate high wavenumbers in delay space in their modeling are best suited for inpainting over narrowband RFI. We also show that with our fiducial parameters Discrete Prolate Spheroidal Sequences (DPSS) and CLEAN provide the best performance for intermittent ``narrowband'' RFI while Gaussian Progress Regression (GPR) and Least Squares Spectral Analysis (LSSA) provide the best performance for larger RFI gaps. However we caution that these qualitative conclusions are sensitive to the chosen hyperparameters of each inpainting technique. We find these results to be consistent in both simulated and real visibilities. We show that all inpainting techniques reliably reproduce foreground dominated modes in the power spectrum. Since the inpainting techniques should not be capable of reproducing noise realizations, we find that the largest errors occur in the noise dominated delay modes. We show that in the future, as the noise level of the data comes down, CLEAN and DPSS are most capable of reproducing the fine frequency structure in the visibilities of HERA data.

astro-ph.IM↗

arXiv2023

Search for the Epoch of Reionisation with HERA: Upper Limits on the Closure Phase Delay Power Spectrum

Radio interferometers aiming to measure the power spectrum of the redshifted 21 cm line during the Epoch of Reionisation (EoR) need to achieve an unprecedented dynamic range to separate the weak signal from overwhelming foreground emissions. Calibration inaccuracies can compromise the sensitivity of these measurements to the effect that a detection of the EoR is precluded. An alternative to standard analysis techniques makes use of the closure phase, which allows one to bypass antenna-based direction-independent calibration. Similarly to standard approaches, we use a delay spectrum technique to search for the EoR signal. Using 94 nights of data observed with Phase I of the Hydrogen Epoch of Reionization Array (HERA), we place approximate constraints on the 21 cm power spectrum at $z=7.7$. We find at 95% confidence that the 21 cm EoR brightness temperature is $\le$(372)$^2$ "pseudo" mK$^2$ at 1.14 "pseudo" $h$ Mpc$^{-1}$, where the "pseudo" emphasises that these limits are to be interpreted as approximations to the actual distance scales and brightness temperatures. Using a fiducial EoR model, we demonstrate the feasibility of detecting the EoR with the full array. Compared to standard methods, the closure phase processing is relatively simple, thereby providing an important independent check on results derived using visibility intensities, or related.

astro-ph.CO↗

arXiv2023

Optimization and Commissioning of the EPIC Commensal Radio Transient Imager for the Long Wavelength Array

Next generation aperture arrays are expected to consist of hundreds to thousands of antenna elements with substantial digital signal processing to handle large operating bandwidths of a few tens to hundreds of MHz. Conventionally, FX~correlators are used as the primary signal processing unit of the interferometer. These correlators have computational costs that scale as $\mathcal{O}(N^2)$ for large arrays. An alternative imaging approach is implemented in the E-field Parallel Imaging Correlator (EPIC) that was recently deployed on the Long Wavelength Array station at the Sevilleta National Wildlife Refuge (LWA-SV) in New Mexico. EPIC uses a novel architecture that produces electric field or intensity images of the sky at the angular resolution of the array with full or partial polarization and the full spectral resolution of the channelizer. By eliminating the intermediate cross-correlation data products, the computational costs can be significantly lowered in comparison to a conventional FX~or XF~correlator from $\mathcal{O}(N^2)$ to $\mathcal{O}(N \log N)$ for dense (but otherwise arbitrary) array layouts. EPIC can also lower the output data rates by directly yielding polarimetric image products for science analysis. We have optimized EPIC and have now commissioned it at LWA-SV as a commensal all-sky imaging back-end that can potentially detect and localize sources of impulsive radio emission on millisecond timescales. In this article, we review the architecture of EPIC, describe code optimizations that improve performance, and present initial validations from commissioning observations. Comparisons between EPIC measurements and simultaneous beam-formed observations of bright sources show spectral-temporal structures in good agreement.

astro-ph.IM↗

arXiv2023

Improved Constraints on the 21 cm EoR Power Spectrum and the X-Ray Heating of the IGM with HERA Phase I Observations

We report the most sensitive upper limits to date on the 21 cm epoch of reionization power spectrum using 94 nights of observing with Phase I of the Hydrogen Epoch of Reionization Array (HERA). Using similar analysis techniques as in previously reported limits (HERA Collaboration 2022a), we find at 95% confidence that $Δ^2(k = 0.34$ $h$ Mpc$^{-1}$) $\leq 457$ mK$^2$ at $z = 7.9$ and that $Δ^2 (k = 0.36$ $h$ Mpc$^{-1}) \leq 3,496$ mK$^2$ at $z = 10.4$, an improvement by a factor of 2.1 and 2.6 respectively. These limits are mostly consistent with thermal noise over a wide range of $k$ after our data quality cuts, despite performing a relatively conservative analysis designed to minimize signal loss. Our results are validated with both statistical tests on the data and end-to-end pipeline simulations. We also report updated constraints on the astrophysics of reionization and the cosmic dawn. Using multiple independent modeling and inference techniques previously employed by HERA Collaboration (2022b), we find that the intergalactic medium must have been heated above the adiabatic cooling limit at least as early as $z = 10.4$, ruling out a broad set of so-called "cold reionization" scenarios. If this heating is due to high-mass X-ray binaries during the cosmic dawn, as is generally believed, our result's 99% credible interval excludes the local relationship between soft X-ray luminosity and star formation and thus requires heating driven by evolved low-metallicity stars.

astro-ph.CO↗

arXiv2023

Impact of instrument and data characteristics in the interferometric reconstruction of the 21 cm power spectrum

Combining the visibilities measured by an interferometer to form a cosmological power spectrum is a complicated process. In a delay-based analysis, the mapping between instrumental and cosmological space is not a one-to-one relation. Instead, neighbouring modes contribute to the power measured at one point, with their respective contributions encoded in the window functions. To better understand the power measured by an interferometer, we assess the impact of instrument characteristics and analysis choices on these window functions. Focusing on the Hydrogen Epoch of Reionization Array (HERA) as a case study, we find that long-baseline observations correspond to enhanced low-k tails of the window functions, which facilitate foreground leakage, whilst an informed choice of bandwidth and frequency taper can reduce said tails. With simple test cases and realistic simulations, we show that, apart from tracing mode mixing, the window functions help accurately reconstruct the power spectrum estimator of simulated visibilities. The window functions depend strongly on the beam chromaticity, and less on its spatial structure - a Gaussian approximation, ignoring side lobes, is sufficient. Finally, we investigate the potential of asymmetric window functions, down-weighting the contribution of low-k power to avoid foreground leakage. The window functions presented here correspond to the latest HERA upper limits for the full Phase I data. They allow an accurate reconstruction of the power spectrum measured by the instrument and will be used in future analyses to confront theoretical models and data directly in cylindrical space.

astro-ph.CO↗

arXiv2022

Analytic approximations of scattering effects on beam chromaticity in 21-cm global experiments

Scattering from objects near an antenna produce correlated signals from strong compact radio sources in a manner similar to those used by the Sea Interferometer to measure the radio source positions using the fine frequency structure in the total power spectrum of a single antenna. These fringes or ripples due to correlated signal interference are present at a low level in the spectrum of any single antenna and are a major source of systematics in systems used to measure the global redshifted 21-cm signal from the early universe. In the Sea Interferometer a single antenna on a cliff above the sea is used to add the signal from the direct path to the signal from the path reflected from the sea thereby forming an interferometer. This was used for mapping radio sources with a single antenna by Bolton and Slee in the 1950s. In this paper we derive analytic expressions to determine the level of these ripples and compare these results in a few simple cases with electromagnetic modeling software to verify that the analytic calculations are sufficient to obtain the magnitude of the scattering effects on the measurements of the global 21-cm signal. These analytic calculations are needed to evaluate the magnitude of the effects in cases that are either too complex or take too much time to be modeled using software.

astro-ph.IM↗

arXiv2022

Direct Optimal Mapping for 21cm Cosmology: A Demonstration with the Hydrogen Epoch of Reionization Array

Motivated by the desire for wide-field images with well-defined statistical properties for 21cm cosmology, we implement an optimal mapping pipeline that computes a maximum likelihood estimator for the sky using the interferometric measurement equation. We demonstrate this direct optimal mapping with data from the Hydrogen Epoch of Reionization (HERA) Phase I observations. After validating the pipeline with simulated data, we develop a maximum likelihood figure-of-merit for comparing four sky models at 166MHz with a bandwidth of 100kHz. The HERA data agree with the GLEAM catalogs to <10%. After subtracting the GLEAM point sources, the HERA data discriminate between the different continuum sky models, providing most support for the model of Byrne et al. 2021. We report the computation cost for mapping the HERA Phase I data and project the computation for the HERA 320-antenna data; both are feasible with a modern server. The algorithm is broadly applicable to other interferometers and is valid for wide-field and non-coplanar arrays.

astro-ph.CO↗

arXiv2022

Measurements of one-point statistics in 21 cm intensity maps via foreground avoidance strategy

Measurements of the one-point probability distribution function and higher-order moments (variance, skewness, and kurtosis) of the high-redshift 21 cm fluctuations are among the most direct statistical probes of the non-Gaussian nature of structure formation and evolution during reionization. However, contamination from astrophysical foregrounds and instrument systematics pose significant challenges in measuring these statistics in real observations. In this work, we use forward modelling to investigate the feasibility of measuring 21 cm one-point statistics through a foreground avoidance strategy. Leveraging the characteristic wedge-shape of the foregrounds in k-space, we apply a wedge-cut filter that removes the foreground contaminated modes from a mock data set based on the Hydrogen Epoch of Reionization Array (HERA) instrument, and measure the one-point statistics from the image-space representation of the remaining non-contaminated modes. We experiment with varying degrees of wedge-cutting over different frequency bandwidths and find that the centre of the band is the least susceptible to bias from wedge-cutting. Based on this finding, we introduce a rolling filter method that allows reconstruction of an optimal wedge-cut 21~cm intensity map over the full bandwidth using outputs from wedge-cutting over multiple sub-bands. We perform Monte Carlo simulations to show that HERA should be able to measure the rise in skewness and kurtosis near the end of reionization with the rolling wedge-cut method if foreground leakage from the Fourier transform window function can be controlled.

astro-ph.CO↗

arXiv2022

A Bayesian Calibration Framework for EDGES

We develop a Bayesian model that jointly constrains receiver calibration, foregrounds and cosmic 21cm signal for the EDGES global 21\,cm experiment. This model simultaneously describes calibration data taken in the lab along with sky-data taken with the EDGES low-band antenna. We apply our model to the same data (both sky and calibration) used to report evidence for the first star formation in 2018. We find that receiver calibration does not contribute a significant uncertainty to the inferred cosmic signal (<1%), though our joint model is able to more robustly estimate the cosmic signal for foreground models that are otherwise too inflexible to describe the sky data. We identify the presence of a significant systematic in the calibration data, which is largely avoided in our analysis, but must be examined more closely in future work. Our likelihood provides a foundation for future analyses in which other instrumental systematics, such as beam corrections and reflection parameters, may be added in a modular manner.

astro-ph.CO↗

arXiv2022

Automated Detection of Antenna Malfunctions in Large-N Interferometers: A Case Study with the Hydrogen Epoch of Reionization Array

We present a framework for identifying and flagging malfunctioning antennas in large radio interferometers. We outline two distinct categories of metrics designed to detect outliers along known failure modes of large arrays: cross-correlation metrics, based on all antenna pairs, and auto-correlation metrics, based solely on individual antennas. We define and motivate the statistical framework for all metrics used, and present tailored visualizations that aid us in clearly identifying new and existing systematics. We implement these techniques using data from 105 antennas in the Hydrogen Epoch of Reionization Array (HERA) as a case study. Finally, we provide a detailed algorithm for implementing these metrics as flagging tools on real data sets.

astro-ph.IM↗

arXiv2021

Onboard Dynamic Image Exposure Control for the Star-Planet Activity Research CubeSat (SPARCS)

The Star-Planet Activity Research CubeSat (SPARCS) is a 6U CubeSat under development to monitor the flaring and chromospheric activity of M dwarfs at near-ultraviolet (NUV) and far-ultraviolet (FUV) wavelengths. The spacecraft hosts two UV-optimized delta-doped charge-coupled devices fed by a 9-cm telescope and a dichroic beam splitter. A dedicated science payload processor performs near real-time onboard science image processing to dynamically change detector integration times and gains to reduce the occurrence of pixel saturation during strong M dwarf flaring events and provide adequate flare light curve structure resolution while enabling the detection of low-amplitude rotational modulation. The processor independently controls the NUV and FUV detectors. For each detector, it derives control updates from the most recent completed exposure and applies them to the next exposure. The detection of a flare event in the NUV channel resets the exposure in the FUV channel with new exposure parameters. Implementation testing of the control algorithm using simulated light curves and full-frame images demonstrates a robust response to the quiescent and flaring levels expected for the stars to be monitored by the mission. The SPARCS onboard autonomous exposure control algorithm is adaptable for operation in future point source-targeting space-based and ground-based observatories geared towards the monitoring of extreme transient astrophysics phenomena.

astro-ph.IM↗

arXiv2021

Time-Resolved Photometry of the High-Energy Radiation of M Dwarfs with the Star-Planet Activity Research CubeSat (SPARCS)

Know thy star, know thy planet,... especially in the ultraviolet (UV). Over the past decade, that motto has grown from mere wish to necessity in the M dwarf regime, given that the intense and highly variable UV radiation from these stars is suspected of strongly impacting their planets' habitability and atmospheric loss. This has led to the development of the Star-Planet Activity Research CubeSat (SPARCS), a NASA-funded 6U CubeSat observatory fully devoted to the photometric monitoring of the UV flaring of M dwarfs hosting potentially habitable planets. The SPARCS science imaging system uses a 9-cm telescope that feeds two delta-doped UV-optimized CCDs through a dichroic beam splitter, enabling simultaneous monitoring of a target field in the near-UV and far-UV. A dedicated onboard payload processor manages science observations and performs near-real time image processing to sustain an autonomous dynamic exposure control algorithm needed to mitigate pixel saturation during flaring events. The mission is currently half-way into its development phase. We present an overview of the mission's science drivers and its expected contribution to our understanding of star-planet interactions. We also present the expected performance of the autonomous dynamic exposure control algorithm, a first-of-its-kind on board a space-based stellar astrophysics observatory.

astro-ph.IM↗

arXiv2021

A Real Time Processing System for Big Data in Astronomy: Applications to HERA

As current- and next-generation astronomical instruments come online, they will generate an unprecedented deluge of data. Analyzing these data in real time presents unique conceptual and computational challenges, and their long-term storage and archiving is scientifically essential for generating reliable, reproducible results. We present here the real-time processing (RTP) system for the Hydrogen Epoch of Reionization Array (HERA), a radio interferometer endeavoring to provide the first detection of the highly redshifted 21 cm signal from Cosmic Dawn and the Epoch of Reionization by an interferometer. The RTP system consists of analysis routines run on raw data shortly after they are acquired, such as calibration and detection of radio-frequency interference (RFI) events. RTP works closely with the Librarian, the HERA data storage and transfer manager which automatically ingests data and transfers copies to other clusters for post-processing analysis. Both the RTP system and the Librarian are public and open source software, which allows for them to be modified for use in other scientific collaborations. When fully constructed, HERA is projected to generate over 50 terabytes (TB) of data each night, and the RTP system enables the successful scientific analysis of these data.

astro-ph.IM↗