arXiv subjects

Joshua S. Dillon

Publications and source records attributed to Joshua S. Dillon.

At least 55 records · Page 3Linked to original sources

arXiv2020

Absolute Calibration Strategies for the Hydrogen Epoch of Reionization Array and Their Impact on the 21 cm Power Spectrum

We discuss absolute calibration strategies for Phase I of the Hydrogen Epoch of Reionization Array (HERA), which aims to measure the cosmological 21 cm signal from the Epoch of Reionization (EoR). HERA is a drift-scan array with a 10 degree wide field of view, meaning bright, well-characterized point source transits are scarce. This, combined with HERA's redundant sampling of the uv plane and the modest angular resolution of the Phase I instrument, make traditional sky-based and self-calibration techniques difficult to implement with high dynamic range. Nonetheless, in this work we demonstrate calibration for HERA using point source catalogues and electromagnetic simulations of its primary beam. We show that unmodeled diffuse flux and instrumental contaminants can corrupt the gain solutions, and present a gain smoothing approach for mitigating their impact on the 21 cm power spectrum. We also demonstrate a hybrid sky and redundant calibration scheme and compare it to pure sky-based calibration, showing only a marginal improvement to the gain solutions at intermediate delay scales. Our work suggests that the HERA Phase I system can be well-calibrated for a foreground-avoidance power spectrum estimator by applying direction-independent gains with a small set of degrees of freedom across the frequency and time axes.

astro-ph.IM↗

arXiv2019

Mitigating Internal Instrument Coupling II: A Method Demonstration with the Hydrogen Epoch of Reionization Array

We present a study of internal reflection and cross coupling systematics in Phase I of the Hydrogen Epoch of Reionization Array (HERA). In a companion paper, we outlined the mathematical formalism for such systematics and presented algorithms for modeling and removing them from the data. In this work, we apply these techniques to data from HERA's first observing season as a method demonstration. The data show evidence for systematics that, without removal, would hinder a detection of the 21 cm power spectrum for the targeted EoR line-of-sight modes in the range 0.2 < k_parallel < 0.5\ h^-1 Mpc. After systematic removal, we find we can recover these modes in the power spectrum down to the integrated noise-floor of a nightly observation, achieving a dynamic range in the EoR window of 10^-6 in power (mK^2 units) with respect to the bright galactic foreground signal. In the absence of other systematics and assuming the systematic suppression demonstrated here continues to lower noise levels, our results suggest that fully-integrated HERA Phase I may have the capacity to set competitive upper limits on the 21 cm power spectrum. For future observing seasons, HERA will have upgraded analog and digital hardware to better control these systematics in the field.

astro-ph.IM↗

arXiv2019

Mitigating Internal Instrument Coupling for 21 cm Cosmology I: Temporal and Spectral Modeling in Simulations

We study the behavior of internal signal chain reflections and antenna cross coupling as systematics for 21 cm cosmological surveys. We outline the mathematics for how these systematics appear in interferometric visibilities and describe their phenomenology. We then describe techniques for modeling and removing these systematics without attenuating the 21 cm signal in the data. This has critical implications for low-frequency radio surveys aiming to characterize the 21cm signal from the Epoch of Reionization and Cosmic Dawn, as systematics can cause bright foreground emission to contaminate the EoR window and prohibit a robust detection. We also quantify the signal loss properties of the systematic modeling algorithms, and show that our techniques demonstrate resistance against EoR signal loss. In a companion paper, we demonstrate these methods on data from the Hydrogen Epoch of Reionization Array as a proof-of-concept.

astro-ph.IM↗

arXiv2019

A simplified, lossless re-analysis of PAPER-64

We present limits on the 21cm power spectrum from the Epoch of Reionization (EoR) using data from the 64 antenna configuration of the Donald C. Backer Precision Array for Probing the Epoch of Reionization (PAPER) analyzed through a power spectrum pipeline independent from previous PAPER analyses. Previously reported results from PAPER have been found to contain significant signal loss (Cheng et al. 2018, arxiv:1810.05175). Several lossy steps from previous PAPER pipelines have not been included in this analysis, namely: delay-based foreground filtering, optimal fringe-rate filtering, and empirical covariance-based estimators. Steps which remain in common with previous analyses include redundant calibration and local sidereal time (LST) binning. The power spectra reported here are effectively the result of applying a linear Fourier transform analysis to the calibrated, LST binned data. This analysis also uses more data than previous publications, including the complete available redshift range of $z \sim 7.5$ to $11$. In previous PAPER analyses, many power spectrum measurements were found to be detections of noncosmological power at levels of significance ranging from two to hundreds of times the theoretical noise. Here, excess power is examined using redundancy between baselines and power spectrum jackknives. The upper limits we find on the 21cm power spectrum from reionization are ($1500$ mK)$^{2}$, ($1900$ mK)$^{2}$, ($280$ mK)$^{2}$, ($200$ mK)$^{2}$, ($380$ mK)$^{2}$, ($300$ mK)$^{2}$ at redshifts $z=10.87,\ 9.93,\ 8.68,\ 8.37,\ 8.13,$ and $7.48$, respectively. For reasons described in Cheng et al. 2018 (arxiv:1810.05175), these limits supersede all previous PAPER results (Ali et al. 2018, arxiv:1502.06016).

astro-ph.CO↗

arXiv2019

Research and Development for HI Intensity Mapping

Development of the hardware, data analysis, and simulation techniques for large compact radio arrays dedicated to mapping the 21 cm line of neutral hydrogen gas has proven to be more difficult than imagined twenty years ago when such telescopes were first proposed. Despite tremendous technical and methodological advances, there are several outstanding questions on how to optimally calibrate and analyze such data. On the positive side, it has become clear that the outstanding issues are purely technical in nature and can be solved with sufficient development activity. Such activity will enable science across redshifts, from early galaxy evolution in the pre-reionization era to dark energy evolution at low redshift.

astro-ph.IM↗

arXiv2019

A Roadmap for Astrophysics and Cosmology with High-Redshift 21 cm Intensity Mapping

In this white paper, we lay out a US roadmap for high-redshift 21 cm cosmology (30 < z < 6) in the 2020s. Beginning with the currently-funded HERA and MWA Phase II projects and advancing through the decade with a coordinated program of small-scale instrumentation, software, and analysis projects targeting technology development, this roadmap incorporates our current best understanding of the systematics confronting 21 cm cosmology into a plan for overcoming them, enabling next-generation, mid-scale 21 cm arrays to be proposed late in the decade. Submitted for consideration by the Astro2020 Decadal Survey Program Panel for Radio, Millimeter, and Submillimeter Observations from the Ground as a Medium-Sized Project.

astro-ph.IM↗

arXiv2019

The HERA-19 Commissioning Array: Direction Dependent Effects

Foreground power dominates the measurements of interferometers that seek a statistical detection of highly-redshifted HI emission from the Epoch of Reionization (EoR). The chromaticity of the instrument creates a boundary in the Fourier transform of frequency (proportional to $k_\parallel$) between spectrally smooth emission, characteristic of the strong synchrotron foreground (the "wedge"), and the spectrally structured emission from HI in the EoR (the "EoR window"). Faraday rotation can inject spectral structure into otherwise smooth polarized foreground emission, which through instrument effects or miscalibration could possibly pollute the EoR window. Using data from the HERA 19-element commissioning array, we investigate the polarization response of this new instrument in the power spectrum domain. We perform a simple image-based calibration based on the unpolarized diffuse emission of the Global Sky Model, and show that it achieves qualitative redundancy between the nominally-redundant baselines of the array and reasonable amplitude accuracy. We construct power spectra of all fully polarized coherencies in all pseudo-Stokes parameters. We compare to simulations based on an unpolarized diffuse sky model and detailed electromagnetic simulations of the dish and feed, confirming that in Stokes I, the calibration does not add significant spectral structure beyond the expected level. Further, this calibration is stable over the 8 days of observations considered. Excess power is seen in the power spectra of the linear polarization Stokes parameters which is not easily attributable to leakage via the primary beam, and results from some combination of residual calibration errors and actual polarized emission. Stokes V is found to be highly discrepant from the expectation of zero power, strongly pointing to the need for more accurate polarized calibration.

astro-ph.IM↗

arXiv2019

Mitigating the Effects of Antenna-to-Antenna Variation on Redundant-Baseline Calibration for 21 cm Cosmology

The separation of cosmological signal from astrophysical foregrounds is a fundamental challenge for any effort to probe the evolution of neutral hydrogen during the Cosmic Dawn and epoch of reionization (EoR) using the 21 cm hyperfine transition. Foreground separation is made possible by their intrinsic spectral smoothness, making them distinguishable from spectrally complex cosmological signal even though they are ~5 orders of magnitude brighter. Precisely calibrated radio interferometers are essential to maintaining the smoothness and thus separability of the foregrounds. One powerful calibration strategy is to use redundant measurements between pairs of antennas with the same physical separation in order to solve for each antenna's spectral response without reference to a sky model. This strategy is being employed by the Hydrogen Epoch of Reionization Array (HERA), a large radio telescope in South Africa that is now observing while being built out to 350 14-m dishes. However, the deviations from perfect redundancy inherent in any real radio telescope complicate the calibration problem. Using simulations of HERA, we show how calibration with antenna-to-antenna variations in dish construction and placement generally lead to spectral structure in otherwise smooth foregrounds that significantly reduces the number of cosmological modes available to a 21 cm measurement. However, we also show that this effect can be largely eliminated by a modified redundant-baseline calibration strategy that relies predominantly on short baselines.

astro-ph.CO↗

arXiv2019

Optimizing Sparse RFI Prediction using Deep Learning

Radio Frequency Interference (RFI) is an ever-present limiting factor among radio telescopes even in the most remote observing locations. When looking to retain the maximum amount of sensitivity and reduce contamination for Epoch of Reionization studies, the identification and removal of RFI is especially important. In addition to improved RFI identification, we must also take into account computational efficiency of the RFI-Identification algorithm as radio interferometer arrays such as the Hydrogen Epoch of Reionization Array grow larger in number of receivers. To address this, we present a Deep Fully Convolutional Neural Network (DFCN) that is comprehensive in its use of interferometric data, where both amplitude and phase information are used jointly for identifying RFI. We train the network using simulated HERA visibilities containing mock RFI, yielding a known "ground truth" dataset for evaluating the accuracy of various RFI algorithms. Evaluation of the DFCN model is performed on observations from the 67 dish build-out, HERA-67, and achieves a data throughput of 1.6$\times 10^{5}$ HERA time-ordered 1024 channeled visibilities per hour per GPU. We determine that relative to an amplitude only network including visibility phase adds important adjacent time-frequency context which increases discrimination between RFI and Non-RFI. The inclusion of phase when predicting achieves a Recall of 0.81, Precision of 0.58, and $F_{2}$ score of 0.75 as applied to our HERA-67 observations.

astro-ph.IM↗

arXiv2018

Characterizing Signal Loss in the 21 cm Reionization Power Spectrum: A Revised Study of PAPER-64

The Epoch of Reionization (EoR) is an uncharted era in our Universe's history during which the birth of the first stars and galaxies led to the ionization of neutral hydrogen in the intergalactic medium. There are many experiments investigating the EoR by tracing the 21cm line of neutral hydrogen. Because this signal is very faint and difficult to isolate, it is crucial to develop analysis techniques that maximize sensitivity and suppress contaminants in data. It is also imperative to understand the trade-offs between different analysis methods and their effects on power spectrum estimates. Specifically, with a statistical power spectrum detection in HERA's foreseeable future, it has become increasingly important to understand how certain analysis choices can lead to the loss of the EoR signal. In this paper, we focus on signal loss associated with power spectrum estimation. We describe the origin of this loss using both toy models and data taken by the 64-element configuration of the Donald C. Backer Precision Array for Probing the Epoch of Reionization (PAPER). In particular, we highlight how detailed investigations of signal loss have led to a revised, higher 21cm power spectrum upper limit from PAPER-64. Additionally, we summarize errors associated with power spectrum error estimation that were previously unaccounted for. We focus on a subset of PAPER-64 data in this paper; revised power spectrum limits from the PAPER experiment are presented in a forthcoming paper by Kolopanis et al. (in prep.) and supersede results from previously published PAPER analyses.

astro-ph.IM↗

arXiv2018

HI 21cm Cosmology and the Bi-spectrum: Closure Diagnostics in Massively Redundant Interferometric Arrays

New massively redundant low frequency arrays allow for a novel investigation of closure relations in interferometry. We employ commissioning data from the Hydrogen Epoch of Reionization Array to investigate closure quantities in this densely packed grid array of 14m antennas operating at 100 MHz to 200 MHz. We investigate techniques that utilize closure phase spectra for redundant triads to estimate departures from redundancy for redundant baseline visibilities. We find a median absolute deviation from redundancy in closure phase across the observed frequency range of about 4.5deg. This value translates into a non-redundancy per visibility phase of about 2.6deg, using prototype electronics. The median absolute deviations from redundancy decrease with longer baselines. We show that closure phase spectra can be used to identify ill-behaved antennas in the array, independent of calibration. We investigate the temporal behavior of closure spectra. The Allan variance increases after a one minute stride time, due to passage of the sky through the primary beam of the transit telescope. However, the closure spectra repeat to well within the noise per measurement at corresponding local sidereal times (LST) from day to day. In future papers in this series we will develop the technique of using closure phase spectra in the search for the HI 21cm signal from cosmic reionization.

astro-ph.IM↗

arXiv2018

Polarized Redundant-Baseline Calibration for 21 cm Cosmology Without Adding Spectral Structure

21 cm cosmology is a promising new probe of the evolution of visible matter in our universe, especially during the poorly-constrained Cosmic Dawn and Epoch of Reionization. However, in order to separate the 21 cm signal from bright astrophysical foregrounds, we need an exquisite understanding of our telescopes so as to avoid adding spectral structure to spectrally-smooth foregrounds. One powerful calibration method relies on repeated simultaneous measurements of the same interferometric baseline to solve for the sky signal and for instrumental parameters simultaneously. However, certain degrees of freedom are not constrained by asserting internal consistency between redundant measurements. In this paper, we review the origin of these "degeneracies" of redundant-baseline calibration and demonstrate how they can source unwanted spectral structure in our measurement and show how to eliminate that additional, artificial structure. We also generalize redundant calibration to dual-polarization instruments, derive the degeneracy structure, and explore the unique challenges to calibration and preserving spectral smoothness presented by a polarized measurement.

astro-ph.IM↗

arXiv2017

The Impact of Modeling Errors on Interferometer Calibration for 21 cm Power Spectra

We study the impact of sky-based calibration errors from source mismodeling on 21\,cm power spectrum measurements with an interferometer and propose a method for suppressing their effects. While emission from faint sources that are not accounted for in calibration catalogs is believed to be spectrally smooth, deviations of true visibilities from model visibilities are not, due to the inherent chromaticity of the interferometer's sky-response (the "wedge"). Thus, unmodeled foregrounds, below the confusion limit of many instruments, introduce frequency structure into gain solutions on the same line-of-sight scales on which we hope to observe the cosmological signal. We derive analytic expressions describing these errors using linearized approximations of the calibration equations and estimate the impact of this bias on measurements of the 21\,cm power spectrum during the Epoch of Reionization (EoR). Given our current precision in primary beam and foreground modeling, this noise will significantly impact the sensitivity of existing experiments that rely on sky-based calibration. Our formalism describes the scaling of calibration with array and sky-model parameters and can be used to guide future instrument design and calibration strategy. We find that sky-based calibration that down-weights long baselines can eliminate contamination in most of the region outside of the wedge with only a modest increase in instrumental noise.

astro-ph.CO↗

arXiv2017

The Hydrogen Epoch of Reionization Array Dish III: Measuring Chromaticity of Prototype Element with Reflectometry

The experimental efforts to detect the redshifted 21 cm signal from the Epoch of Reionization (EoR) are limited predominantly by the chromatic instrumental systematic effect. The delay spectrum methodology for 21 cm power spectrum measurements brought new attention to the critical impact of an antenna's chromaticity on the viability of making this measurement. This methodology established a straightforward relationship between time-domain response of an instrument and the power spectrum modes accessible to a 21 cm EoR experiment. We examine the performance of a prototype of the Hydrogen Epoch of Reionization Array (HERA) array element that is currently observing in Karoo desert, South Africa. We present a mathematical framework to derive the beam integrated frequency response of a HERA prototype element in reception from the return loss measurements between 100-200 MHz and determined the extent of additional foreground contamination in the delay space. The measurement reveals excess spectral structures in comparison to the simulation studies of the HERA element. Combined with the HERA data analysis pipeline that incorporates inverse covariance weighting in optimal quadratic estimation of power spectrum, we find that in spite of its departure from the simulated response, HERA prototype element satisfies the necessary criteria posed by the foreground attenuation limits and potentially can measure the power spectrum at spatial modes as low as $k_{\parallel} > 0.1h$~Mpc$^{-1}$. The work highlights a straightforward method for directly measuring an instrument response and assessing its impact on 21 cm EoR power spectrum measurements for future experiments that will use reflector-type antenna.

astro-ph.IM↗

arXiv2016

The Hydrogen Epoch of Reionization Array Dish I: Beam Pattern Measurements and Science Implications

The Hydrogen Epoch of Reionization Array (HERA) is a radio interferometer aiming to detect the power spectrum of 21 cm fluctuations from neutral hydrogen from the Epoch of Reionization (EOR). Drawing on lessons from the Murchison Widefield Array (MWA) and the Precision Array for Probing the Epoch of Reionization (PAPER), HERA is a hexagonal array of large (14 m diameter) dishes with suspended dipole feeds. Not only does the dish determine overall sensitivity, it affects the observed frequency structure of foregrounds in the interferometer. This is the first of a series of four papers characterizing the frequency and angular response of the dish with simulations and measurements. We focus in this paper on the angular response (i.e., power pattern), which sets the relative weighting between sky regions of high and low delay, and thus, apparent source frequency structure. We measure the angular response at 137 MHz using the ORBCOMM beam mapping system of Neben et al. We measure a collecting area of 93 m^2 in the optimal dish/feed configuration, implying HERA-320 should detect the EOR power spectrum at z~9 with a signal-to-noise ratio of 12.7 using a foreground avoidance approach with a single season of observations, and 74.3 using a foreground subtraction approach. Lastly we study the impact of these beam measurements on the distribution of foregrounds in Fourier space.

astro-ph.IM↗

arXiv2016

Delay Spectrum with Phase-Tracking Arrays: Extracting the HI power spectrum from the Epoch of Reionization

The Detection of redshifted 21 cm emission from the epoch of reionization (EoR) is a challenging task owing to strong foregrounds that dominate the signal. In this paper, we propose a general method, based on the delay spectrum approach, to extract HI power spectra that is applicable to tracking observations using an imaging radio interferometer (Delay Spectrum with Imaging Arrays (DSIA)). Our method is based on modelling the HI signal taking into account the impact of wide field effects such as the $w$-term which are then used as appropriate weights in cross-correlating the measured visibilities. Our method is applicable to any radio interferometer that tracks a phase center and could be utilized for arrays such as MWA, LOFAR, GMRT, PAPER and HERA. In the literature the delay spectrum approach has been implemented for near-redundant baselines using drift scan observations. In this paper we explore the scheme for non-redundant tracking arrays, and this is the first application of delay spectrum methodology to such data to extract the HI signal. We analyze 3 hours of MWA tracking data on the EoR1 field. We present both 2-dimensional ($k_\parallel,k_\perp$) and 1-dimensional (k) power spectra from the analysis. Our results are in agreement with the findings of other pipelines developed to analyse the MWA EoR data.

astro-ph.CO↗

arXiv2016

An Improved Model of Diffuse Galactic Radio Emission from 10 MHz to 5 THz

We present an improved Global Sky Model (GSM) of diffuse galactic radio emission from 10 MHz to 5 THz, whose uses include foreground modeling for CMB and 21 cm cosmology. Our model improves on past work both algorithmically and by adding new data sets such as the Planck maps and the enhanced Haslam map. Our method generalizes the Principal Component Analysis approach to handle non-overlapping regions, enabling the inclusion of 29 sky maps with no region of the sky common to all. We also perform a blind separation of our GSM into physical components with a method that makes no assumptions about physical emission mechanisms (synchrotron, free-free, dust, etc). Remarkably, this blind method automatically finds five components that have previously only been found "by hand", which we identify with synchrotron, free-free, cold dust, warm dust, and the CMB anisotropy, with maps and spectra agreeing with previous work but in many cases with smaller error bars. The improved GSM is available online at github.com/jeffzhen/gsm2016.

astro-ph.CO↗

arXiv2016

The Hydrogen Epoch of Reionization Array Dish II: Characterization of Spectral Structure with Electromagnetic Simulations and its science Implications

We use time-domain electromagnetic simulations to determine the spectral characteristics of the Hydrogen Epoch of Reionization Arrays (HERA) antenna. These simulations are part of a multi-faceted campaign to determine the effectiveness of the dish's design for obtaining a detection of redshifted 21 cm emission from the epoch of reionization. Our simulations show the existence of reflections between HERA's suspended feed and its parabolic dish reflector that fall below -40 dB at 150 ns and, for reasonable impedance matches, have a negligible impact on HERA's ability to constrain EoR parameters. It follows that despite the reflections they introduce, dishes are effective for increasing the sensitivity of EoR experiments at relatively low cost. We find that electromagnetic resonances in the HERA feed's cylindrical skirt, which is intended to reduce cross coupling and beam ellipticity, introduces significant power at large delays ($-40$ dB at 200 ns) which can lead to some loss of measurable Fourier modes and a modest reduction in sensitivity. Even in the presence of this structure, we find that the spectral response of the antenna is sufficiently smooth for delay filtering to contain foreground emission at line-of-sight wave numbers below $k_\parallel \lesssim 0.2$ $h$Mpc$^{-1}$, in the region where the current PAPER experiment operates. Incorporating these results into a Fisher Matrix analysis, we find that the spectral structure observed in our simulations has only a small effect on the tight constraints HERA can achieve on parameters associated with the astrophysics of reionization.

astro-ph.CO↗