arXiv subjects

Adam Brazier

Publications and source records attributed to Adam Brazier.

48 records · Page 3Linked to original sources

arXiv2020

Reproducible and Portable Workflows for Scientific Computing and HPC in the Cloud

The increasing availability of cloud computing services for science has changed the way scientific code can be developed, deployed, and run. Many modern scientific workflows are capable of running on cloud computing resources. Consequently, there is an increasing interest in the scientific computing community in methods, tools, and implementations that enable moving an application to the cloud and simplifying the process, and decreasing the time to meaningful scientific results. In this paper, we have applied the concepts of containerization for portability and multi-cloud automated deployment with industry-standard tools to three scientific workflows. We show how our implementations provide reduced complexity to portability of both the applications themselves, and their deployment across private and public clouds. Each application has been packaged in a Docker container with its dependencies and necessary environment setup for production runs. Terraform and Ansible have been used to automate the provisioning of compute resources and the deployment of each scientific application in a Multi-VM cluster. Each application has been deployed on the AWS and Aristotle Cloud Federation platforms. Variation in data management constraints, Multi-VM MPI communication, and embarrassingly parallel instance deployments were all explored and reported on. We thus present a sample of scientific workflows that can be simplified using the tools and our proposed implementation to deploy and run in a variety of cloud environments.

cs.DC↗

arXiv2019

Cyberinfrastructure Requirements to Enhance Multi-messenger Astrophysics

The identification of the electromagnetic counterpart of the gravitational wave event, GW170817, and discovery of neutrinos and gamma-rays from TXS 0506+056 heralded the new era of multi-messenger astrophysics. As the number of multi-messenger events rapidly grow over the next decade, the cyberinfrastructure requirements to handle the increase in data rates, data volume, need for event follow up, and analysis across the different messengers will also explosively grow. The cyberinfrastructure requirements to enhance multi-messenger astrophysics will both be a major challenge and opportunity for astronomers, physicists, computer scientists and cyberinfrastructure specialists. Here we outline some of these requirements and argue for a distributed cyberinfrastructure institute for multi-messenger astrophysics to meet these challenges.

astro-ph.IM↗

arXiv2018

The NANOGrav 11-year Data Set: High-precision timing of 45 Millisecond Pulsars

We present high-precision timing data over time spans of up to 11 years for 45 millisecond pulsars observed as part of the North American Nanohertz Observatory for Gravitational Waves (NANOGrav) project, aimed at detecting and characterizing low-frequency gravitational waves. The pulsars were observed with the Arecibo Observatory and/or the Green Bank Telescope at frequencies ranging from 327 MHz to 2.3 GHz. Most pulsars were observed with approximately monthly cadence, with six high--timing-precision pulsars observed weekly, and all were observed at widely separated frequencies at each observing epoch in order to fit for time-variable dispersion delays. We describe our methods for data processing, time-of-arrival (TOA) calculation, and the implementation of a new, automated method for removing outlier TOAs. We fit a timing model for each pulsar that includes spin, astrometric, and, if necessary, binary parameters, in addition to time-variable dispersion delays and parameters that quantify pulse-profile evolution with frequency. The new timing solutions provide three new parallax measurements, two new Shapiro delay measurements, and two new measurements of large orbital-period variations. We fit models that characterize sources of noise for each pulsar. We find that 11 pulsars show significant red noise, with generally smaller spectral indices than typically measured for non-recycled pulsars, possibly suggesting a different origin. Future papers will use these data to constrain or detect the signatures of gravitational-wave signals.

astro-ph.HE↗

arXiv2015

The NANOGrav Nine-year Data Set: Limits on the Isotropic Stochastic Gravitational Wave Background

We compute upper limits on the nanohertz-frequency isotropic stochastic gravitational wave background (GWB) using the 9-year data release from the North American Nanohertz Observatory for Gravitational Waves (NANOGrav) collaboration. We set upper limits for a GWB from supermassive black hole binaries under power law, broken power law, and free spectral coefficient GW spectrum models. We place a 95\% upper limit on the strain amplitude (at a frequency of yr$^{-1}$) in the power law model of $A_{\rm gw} < 1.5\times 10^{-15}$. For a broken power law model, we place priors on the strain amplitude derived from simulations of Sesana (2013) and McWilliams et al. (2014). We find that the data favor a broken power law to a pure power law with odds ratios of 22 and 2.2 to one for the McWilliams and Sesana prior models, respectively. The McWilliams model is essentially ruled out by the data, and the Sesana model is in tension with the data under the assumption of a pure power law. Using the broken power-law analysis we construct posterior distributions on environmental factors that drive the binary to the GW-driven regime including the stellar mass density for stellar-scattering, mass accretion rate for circumbinary disk interaction, and orbital eccentricity for eccentric binaries, marking the first time that the shape of the GWB spectrum has been used to make astrophysical inferences. We then place the most stringent limits so far on the energy density of relic GWs, $Ω_\mathrm{gw}(f)\,h^2 < 4.2 \times 10^{-10}$, yielding a limit on the Hubble parameter during inflation of $H_*=1.6\times10^{-2}~m_{Pl}$, where $m_{Pl}$ is the Planck mass. Our limit on the cosmic string GWB, $Ω_\mathrm{gw}(f)\, h^2 < 2.2 \times 10^{-10}$, translates to a conservative limit of $Gμ<3.3\times 10^{-8}$ - a factor of 4 better than the joint Planck and high-$l$ CMB data from other experiments.

astro-ph.GA↗

arXiv2015

Learning from FITS: Limitations in use in modern astronomical research

The Flexible Image Transport System (FITS) standard has been a great boon to astronomy, allowing observatories, scientists and the public to exchange astronomical information easily. The FITS standard, however, is showing its age. Developed in the late 1970s, the FITS authors made a number of implementation choices that, while common at the time, are now seen to limit its utility with modern data. The authors of the FITS standard could not anticipate the challenges which we are facing today in astronomical computing. Difficulties we now face include, but are not limited to, addressing the need to handle an expanded range of specialized data product types (data models), being more conducive to the networked exchange and storage of data, handling very large datasets, and capturing significantly more complex metadata and data relationships. There are members of the community today who find some or all of these limitations unworkable, and have decided to move ahead with storing data in other formats. If this fragmentation continues, we risk abandoning the advantages of broad interoperability, and ready archivability, that the FITS format provides for astronomy. In this paper we detail some selected important problems which exist within the FITS standard today. These problems may provide insight into deeper underlying issues which reside in the format and we provide a discussion of some lessons learned. It is not our intention here to prescribe specific remedies to these issues; rather, it is to call attention of the FITS and greater astronomical computing communities to these problems in the hope that it will spur action to address them.

astro-ph.IM↗

arXiv2014

A new HDF5 based raw data model for CCAT

CCAT will be a large sub-millimeter telescope to be built near the ALMA site in northern Chile. The telescope must support a varied set of instrumentation including large format KID cameras, a large heterodyne array and a KID-based direct detection multi-object spectrometer. We are developing a new raw data model based on HDF5 that can cope with the expected data rates of order Gbit/s and is flexible enough to hold raw data from all planned instruments.

astro-ph.IM↗

arXiv2014

An overview of the planned CCAT software system

CCAT will be a 25m diameter sub-millimeter telescope capable of operating in the 0.2 to 2.1mm wavelength range. It will be located at an altitude of 5600m on Cerro Chajnantor in northern Chile near the ALMA site. The anticipated first generation instruments include large format (60,000 pixel) kinetic inductance detector (KID) cameras, a large format heterodyne array and a direct detection multi-object spectrometer. The paper describes the architecture of the CCAT software and the development strategy.

astro-ph.IM↗

arXiv2014

Map-making for the Next Generation of Ground-based Submillimeter Instruments

Current ground-based submillimeter instruments (e.g. SCUBA-2, SHARC-2 and LABOCA) have hundreds to thousands of detectors, sampled at tens to hundreds of hertz, generating up to hundreds of gigabytes per night. Since noise is correlated between detectors and in time, due to atmospheric signals and temperature oscillations, naive map-making is not applicable. In addition, the size of the data sets makes direct likelihood based inversion techniques intractable. As a result, the data reduction approach for most current submm cameras is to adopt iterative methods in order to separate noise from sky signal, and hence effectively produce astronomical images. We investigate how today's map-makers scale to the next generation of instruments, which will have tens of thousands of detectors sampled at thousands of hertz, leading to data sets of challenging size. We propose strategies for reducing such large data sets.

astro-ph.IM↗

arXiv2014

A hunt for dual radio active galactic nuclei in the VLASS

This whitepaper describes how the VLASS could be designed in a manner to allow the identification of candidate dual active galactic nuclei (AGN) at separations <7 kpc. Dual AGN represent a clear marker of two supermassive black holes within an ongoing merger. A dual AGN survey will provide a wealth of studies in structure growth and gravitational-wave science. Radio wavelengths are ideal for identifying close pairs, as disturbed stellar and gaseous material can obscure their presence in optical and shorter wavelengths. With sufficiently high resolution and sensitivity, a large-scale radio imaging survey like the VLASS will uncover many of these systems and provide the means to broadly study the radio properties of candidate dual systems revealed at other wavelengths. We determine that the ideal survey for our purposes will be at as high a resolution as possible, with significantly more science return in A array at L-band or higher, or B array at C-band or higher. We describe a range of potential survey parameters within this document. Based on the analysis outlined in this whitepaper, our ideal survey would create a catalogue of $\gtrsim$100 dual AGN in either: 1) a medium-sensitivity (~1 mJy detection threshold), wide-field (few thousand square degree) survey, or 2) a high-sensitivity (~10 uJy threshold) survey of several hundred square degrees.

astro-ph.CO↗

arXiv2014

The CCAT Software System

CCAT will be a 25-meter telescope for sub millimeter astronomy located at 5600m altitude on Cerro Chajnantor in northern Chile. CCAT will combine high sensitivity, a wide field of view, and a broad wavelength range (0.35 to 2.1mm) to provide an unprecedented capability for deep, large-area multicolor submillimeter surveys. It is planned to have a suite of instruments including large format KID cameras, a large heterodyne array and a KID-based direct detection multi-object spectrometer. The remote location drives a desire for fully autonomous observing coupled with data reduction pipelines and fast feedback to principal investigators.

astro-ph.IM↗

arXiv2005

Probabilistic programmable quantum processors with multiple copies of program state

We examine the execution of general U(1) transformations on programmable quantum processors. We show that, with only the minimal assumption of availability of copies of the one-qubit program state, that the apparent advantage of existing schemes proposed by G.Vidal it et al. [Phys. Rev. Lett. 88, 047905 (2002)] and M.Hillery et al. [Phys. Rev. A. 65, 022301 (2003)] to execute a general U(1) transformation with greater probability using complex program states appears not to hold.

quant-ph↗

arXiv2004

Broken Promises and Quantum Algorithms

In the black-box model, problems constrained by a `promise' are the only ones that admit a quantum exponential speedup over the best classical algorithm in terms of query complexity. The most prominent example of this is the Deutsch-Jozsa algorithm. More recently, Wim van Dam put forward an algorithm for unstructured problems (i.e., those without a promise). We consider the Deutsch-Jozsa algorithm with a less restrictive (or `broken') promise and study the transition to an unstructured problem. We compare this to the success of van Dam's algorithm. These are both compared with a standard classical sampling algorithm. The Deutsch-Jozsa algorithm remains good as the problem initially becomes less structured, but the van Dam algorithm can be adapted so as to become superior to the Deutsch-Jozsa algorithm as the promise is weakened.

quant-ph↗