arXiv subjects

Albert-Jan Boonstra

Publications and source records attributed to Albert-Jan Boonstra.

13 recordsLinked to original sources

arXiv2024

Energy and polarization based on-line interference mitigation in radio interferometry

Radio frequency interference (RFI) is a persistent contaminant in terrestrial radio astronomy. While new radio interferometers are becoming operational, novel sources of RFI are also emerging. In order to strengthen the mitigation of RFI in modern radio interferometers, we propose an on-line RFI mitigation scheme that can be run in the correlator of such interferometers. We combine statistics based on the energy as well as the polarization alignment of the correlated signal to develop an on-line RFI mitigation scheme that can be applied to a data stream produced by the correlator in real-time, especially targeted at low duty-cycle or transient RFI detection. In order to improve the computational efficiency, we explore the use of both single precision and half precision floating point operations in implementing the RFI mitigation algorithm. This ideally suits its deployment in accelerator computing devices such as graphics processing units (GPUs) as used by the LOFAR correlator. We provide results based on real data to demonstrate the efficacy of the proposed method.

astro-ph.IM↗

arXiv2023

The ROAD to discovery: machine learning-driven anomaly detection in radio astronomy spectrograms

As radio telescopes increase in sensitivity and flexibility, so do their complexity and data-rates. For this reason automated system health management approaches are becoming increasingly critical to ensure nominal telescope operations. We propose a new machine learning anomaly detection framework for classifying both commonly occurring anomalies in radio telescopes as well as detecting unknown rare anomalies that the system has potentially not yet seen. To evaluate our method, we present a dataset consisting of 7050 autocorrelation-based spectrograms from the Low Frequency Array (LOFAR) telescope and assign 10 different labels relating to the system-wide anomalies from the perspective of telescope operators. This includes electronic failures, miscalibration, solar storms, network and compute hardware errors among many more. We demonstrate how a novel Self Supervised Learning (SSL) paradigm, that utilises both context prediction and reconstruction losses, is effective in learning normal behaviour of the LOFAR telescope. We present the Radio Observatory Anomaly Detector (ROAD), a framework that combines both SSL-based anomaly detection and a supervised classification, thereby enabling both classification of both commonly occurring anomalies and detection of unseen anomalies. We demonstrate that our system is real-time in the context of the LOFAR data processing pipeline, requiring <1ms to process a single spectrogram. Furthermore, ROAD obtains an anomaly detection F-2 score of 0.92 while maintaining a false positive rate of ~2\%, as well as a mean per-class classification F-2 score 0.89, outperforming other related works.

astro-ph.IM↗

arXiv2022

Learning to detect RFI in radio astronomy without seeing it

Radio Frequency Interference (RFI) corrupts astronomical measurements, thus affecting the performance of radio telescopes. To address this problem, supervised segmentation models have been proposed as candidate solutions to RFI detection. However, the unavailability of large labelled datasets, due to the prohibitive cost of annotating, makes these solutions unusable. To solve these shortcomings, we focus on the inverse problem; training models on only uncontaminated emissions thereby learning to discriminate RFI from all known astronomical signals and system noise. We use Nearest-Latent-Neighbours (NLN) - an algorithm that utilises both the reconstructions and latent distances to the nearest-neighbours in the latent space of generative autoencoding models for novelty detection. The uncontaminated regions are selected using weak-labels in the form of RFI flags (generated by classical RFI flagging methods) available from most radio astronomical data archives at no additional cost. We evaluate performance on two independent datasets, one simulated from the HERA telescope and another consisting of real observations from LOFAR telescope. Additionally, we provide a small expert-labelled LOFAR dataset (i.e., strong labels) for evaluation of our and other methods. Performance is measured using AUROC, AUPRC and the maximum F1-score for a fixed threshold. For the simulated data we outperform the current state-of-the-art by approximately 1% in AUROC and 3% in AUPRC for the HERA dataset. Furthermore, our algorithm offers both a 4% increase in AUROC and AUPRC at a cost of a degradation in F1-score performance for the LOFAR dataset, without any manual labelling.

astro-ph.IM↗

arXiv2022

Improving Novelty Detection using the Reconstructions of Nearest Neighbours

We show that using nearest neighbours in the latent space of autoencoders (AE) significantly improves performance of semi-supervised novelty detection in both single and multi-class contexts. Autoencoding methods detect novelty by learning to differentiate between the non-novel training class(es) and all other unseen classes. Our method harnesses a combination of the reconstructions of the nearest neighbours and the latent-neighbour distances of a given input's latent representation. We demonstrate that our nearest-latent-neighbours (NLN) algorithm is memory and time efficient, does not require significant data augmentation, nor is reliant on pre-trained networks. Furthermore, we show that the NLN-algorithm is easily applicable to multiple datasets without modification. Additionally, the proposed algorithm is agnostic to autoencoder architecture and reconstruction error method. We validate our method across several standard datasets for a variety of different autoencoding architectures such as vanilla, adversarial and variational autoencoders using either reconstruction, residual or feature consistent losses. The results show that the NLN algorithm grants up to a 17% increase in Area Under the Receiver Operating Characteristics (AUROC) curve performance for the multi-class case and 8% for single-class novelty detection.

cs.LG↗

arXiv2020

Deep Learning Assisted Data Inspection for Radio Astronomy

Modern radio telescopes combine thousands of receivers, long-distance networks, large-scale compute hardware, and intricate software. Due to this complexity, failures occur relatively frequently. In this work we propose novel use of unsupervised deep learning to diagnose system health for modern radio telescopes. The model is a convolutional Variational Autoencoder (VAE) that enables the projection of the high dimensional time-frequency data to a low-dimensional prescriptive space. Using this projection, telescope operators are able to visually inspect failures thereby maintaining system health. We have trained and evaluated the performance of the VAE quantitatively in controlled experiments on simulated data from HERA. Moreover, we present a qualitative assessment of the the model trained and tested on real LOFAR data. Through the use of a naive SVM classifier on the projected synthesised data, we show that there is a trade-off between the dimensionality of the projection and the number of compounded features in a given spectrogram. The VAE and SVM combination scores between 65% and 90% accuracy depending on the number of features in a given input. Finally, we show the prototype system-health-diagnostic web framework that integrates the evaluated model. The system is currently undergoing testing at the ASTRON observatory.

astro-ph.IM↗

arXiv2019

Peering into the Dark (Ages) with Low-Frequency Space Interferometers

Neutral hydrogen pervades the infant Universe, and its redshifted 21-cm signal allows one to chart the Universe. This signal allows one to probe astrophysical processes such as the formation of the first stars, galaxies, (super)massive black holes and enrichment of the pristine gas from z~6 to z~30, as well as fundamental physics related to gravity, dark matter, dark energy and particle physics at redshifts beyond that. As one enters the Dark Ages (z>30), the Universe becomes pristine. Ground-based low-frequency radio telescopes aim to detect the spatial fluctuations of the 21-cm signal. Complementary, global 21-cm experiments aim to measure the sky-averaged 21-cm signal. Escaping RFI and the ionosphere has motivated space-based missions, such as the Dutch-Chinese NCLE instrument (currently in lunar L2), the proposed US-driven lunar or space-based instruments DAPPER and FARSIDE, the lunar-orbit interferometer DSL (China), and PRATUSH (India). To push beyond the current z~25 frontier, though, and measure both the global and spatial fluctuations (power-spectra/tomography) of the 21-cm signal, low-frequency (1-100MHz; BW~50MHz; z>13) space-based interferometers with vast scalable collecting areas (1-10-100 km2), large filling factors (~1) and large fields-of-view (4pi sr.) are needed over a mission lifetime of >5 years. In this ESA White Paper, we argue for the development of new technologies enabling interferometers to be deployed, in space (e.g. Earth-Sun L2) or in the lunar vicinity (e.g. surface, orbit or Earth-Moon L2), to target this 21-cm signal. This places them in a stable environment beyond the reach of most RFI from Earth and its ionospheric corruptions, enabling them to probe the Dark Ages as well as the Cosmic Dawn, and allowing one to investigate new (astro)physics that is inaccessible in any other way in the coming decades. [Abridged]

astro-ph.IM↗

arXiv2019

Near-Memory Computing: Past, Present, and Future

The conventional approach of moving data to the CPU for computation has become a significant performance bottleneck for emerging scale-out data-intensive applications due to their limited data reuse. At the same time, the advancement in 3D integration technologies has made the decade-old concept of coupling compute units close to the memory --- called near-memory computing (NMC) --- more viable. Processing right at the "home" of data can significantly diminish the data movement problem of data-intensive applications. In this paper, we survey the prior art on NMC across various dimensions (architecture, applications, tools, etc.) and identify the key challenges and open issues with future research directions. We also provide a glimpse of our approach to near-memory computing that includes i) NMC specific microarchitecture independent application characterization ii) a compiler framework to offload the NMC kernels on our target NMC platform and iii) an analytical model to evaluate the potential of NMC.

cs.AR↗

arXiv2019

Discovering the Sky at the Longest Wavelengths with Small Satellite Constellations

Due to ionosphere absorption and the interference by natural and artificial radio emissions, ground observation of the sky at the decameter or longer is very difficult. This unexplored part of electromagnetic spectrum has the potential of great discoveries, notably in the study of cosmic dark ages and dawn, but also in heliophysics and space weather, planets, cosmic ray and neutrinos, pulsar and interstellar medium, extragalactic radio sources, and even SETI. At a forum organized by the International Space Science Institute-Beijing (ISSI-BJ), we discussed the prospect of opening up this window for astronomical observations by using a constellation of small or micro-satellites. We discussed the past experiments and the current ones such as the low frequency payload on Chang'e-4 mission lander, relay satellite and the Longjiang satellite, and also the future DSL mission, which is a linear array on lunar orbit which can make synthesized map of the whole sky as well as measure the global spectrum. We also discuss the synergy with other experiments, including ground global experiments such as EDGES, SARAS, SCI-HI and High-z, PRIZM/Albatros, ground imaging facillities such as LOFAR and MWA, and space experiments such as SUNRISE, DARE/DAPPER and PRATUSH. We also discussed some technical aspects of the DSL concept.

astro-ph.IM↗

arXiv2017

NOIRE Study Report: Towards a Low Frequency Radio Interferometer in Space

Ground based low frequency radio interferometers have been developed in the last decade and are providing the scientific community with high quality observations. Conversely, current radioastronomy instruments in space have a poor angular resolution with single point observation systems. Improving the observation capabilities of the low frequency range (a few kHz to 100 MHz) requires to go to space and to set up a space based network of antenna that can be used as an interferometer. We present the outcome of the NOIRE (Nanosatellites pour un Observatoire Interférométrique Radio dans l'Espace / Nanosatellites for a Radio Interferometer Observatory in Space) study which assessed, with help of CNES PASO (Architecture Platform for Orbital Systems is CNES' cross-disciplinary team in charge of early mission and concept studies), the feasibility of a swarm of nanosatellites dedicated to a low frequency radio observatory. With such a platform, space system engineering and instrument development must be studied as a whole: each node is a sensor and all sensors must be used together to obtain a measurement. The study was conducted on the following topics: system principle and concept (swarm, node homogeneity); Space and time management (ranging, clock synchronization); Orbitography (Moon orbit, Lagrange point options); Telecommunication (between nodes and with ground) and networking; Measurements and processing; Propulsion; Power; Electromagnetic compatibility. No strong show-stopper was identified during the preliminary study, although the concept is not yet ready. Several further studies and milestones are identified. The NOIRE team will collaborate with international teams to try and build this next generation of space systems.

astro-ph.IM↗

arXiv2015

Space-based Aperture Array For Ultra-Long Wavelength Radio Astronomy

The past decade has seen the rise of various radio astronomy arrays, particularly for low-frequency observations below 100MHz. These developments have been primarily driven by interesting and fundamental scientific questions, such as studying the dark ages and epoch of re-ionization, by detecting the highly red-shifted 21cm line emission. However, Earth-based radio astronomy below frequencies of 30MHz is severely restricted due to man-made interference, ionospheric distortion and almost complete non-transparency of the ionosphere below 10MHz. Therefore, this narrow spectral band remains possibly the last unexplored frequency range in radio astronomy. A straightforward solution to study the universe at these frequencies is to deploy a space-based antenna array far away from Earths' ionosphere. Various studies in the past were principally limited by technology and computing resources, however current processing and communication trends indicate otherwise. We briefly present the achievable science cases, and discuss the system design for selected scenarios, such as extra-galactic surveys. An extensive discussion is presented on various sub-systems of the potential satellite array, such as radio astronomical antenna design, the on-board signal processing, communication architectures and joint space-time estimation of the satellite network. In light of a scalable array and to avert single point of failure, we propose both centralized and distributed solutions for the ULW space-based array. We highlight the benefits of various deployment locations and summarize the technological challenges for future space-based radio arrays.

astro-ph.IM↗

arXiv2014

A Sustainable approach to large ICT Science based infrastructures; the case for Radio Astronomy

Large sensor-based infrastructures for radio astronomy will be among the most intensive data-driven projects in the world, facing very high power demands. The geographically wide distribution of these infrastructures and their associated processing High Performance Computing (HPC) facilities require Green Information and Communications Technologies (ICT). A combination is needed of low power computing, efficient data storage, local data services, Smart Grid power management, and inclusion of Renewable Energies. Here we outline the major characteristics and innovation approaches to address power efficiency and long-term power sustainability for radio astronomy projects, focusing on Green ICT for science.

astro-ph.IM↗

arXiv2012

Radio astronomy with the Lunar Lander: opening up the last unexplored frequency regime

The active broadband (1 kHz-100 MHz) tripole antenna now envisaged to be placed on the European Lunar Lander located at the Lunar South Pole allows for sensitive measurements of the exosphere and ionosphere, and their interaction with the Earths magnetosphere, solar particles, wind and CMEs and studies of radio communication on the moon, that are essential for future lunar human and science exploration. In addition, the lunar South pole provides an excellent opportunity for radio astronomy. Placing a single radio antenna in an eternally dark crater or behind a mountain at the south (or north) pole would potentially provide perfect shielding from man-made radio interference (RFI), absence of ionospheric distortions, and high temperature and antenna gain stability that allows detection of the 21 cm wave emission from pristine hydrogen formed after the big bang and into the period where the first stars formed. A detection of the 21 cm line from the moon at these frequencies would allow for the first time a clue on the distribution and evolution on mass in the early universe between the Epoch of Recombination and Epoch of Reionization (EoR). A single lunar radio antenna would also allow for studies of the effect of solar flares and Coronal Mass Ejections (CMEs) on the solar wind at distances close to earth (space weather) and would open up the study of low frequency radio events from planets such as Jupiter and Saturn, which are known to emit bright (kJy-MJy) radio emission below 30 MHz (Jester & Falcke, 2009). Finally, a single radio antenna on the lunar lander would pave the way for a future large lunar radio interferometer; not only will it demonstrate the possibilities for lunar radio science and open up the last unexplored radio regime, but it will also allow a determination of the limitations of lunar radio science by measuring the local radio background noise.

astro-ph.IM↗

arXiv2000

Multichannel interference mitigation methods in radio astronomy

Radio-astronomical observations are increasingly corrupted by RF interference, and online detection and filtering algorithms are becoming essential. To facilitate the introduction of such techniques into radio astronomy, we formulate the astronomical problem in an array signal processing language, and give an introduction to some elementary algorithms from that field. We consider two topics in detail: interference detection by rank estimation of short-term covariance matrices, and spatial filtering by subspace estimation and projection. We discuss experimental data collected at the Westerbork radio telescope, and illustrate the effectiveness of the space-time detection and blanking process on the recovery of a 3C48 absorption line in the presence of GSM mobile telephony interference.

astro-ph↗