SearcharxivSearch

arXiv subjects

Karel Adamek

Publications and source records attributed to Karel Adamek.

9 recordsLinked to original sources

Real-Time RFI Mitigation in SPOTLIGHT: A Two-Stage Approach for Transient Searches

Radio Frequency Interference (RFI) remains one of the primary challenges limiting the sensitivity and reliability of modern radio transient surveys, particularly for real-time searches of fast radio transients. The SPOTLIGHT system is a commensal real-time transient search backend operating at the upgraded Giant Metrewave Radio Telescope (uGMRT), where robust and computationally efficient RFI mitigation is essential for sustained operations. We present the real-time two-stage RFI mitigation framework developed for SPOTLIGHT, comprising an antenna-level voltage-filtering module (VOLT) operating prior to correlation beamforming and the SPOTLIGHT Time-domain RFI Processing Engine (STRIPE), a statistical RFI-filtering framework applied to beamformed data. Together, these complementary techniques mitigate a broad spectrum of RFI, ranging from broadband impulsive interference mitigated by VOLT to narrowband spectrally confined spurious signals mitigated by STRIPE, while remaining computationally efficient enough to satisfy the stringent requirements of real-time processing. The framework is evaluated using routine commensal GMRT observations, controlled 76 pulsar observations, and benchmarking against PRESTO's rfifind. The deployed system reduced the false detection rate by 98%. The recovered astrophysical pulses exhibit a 2.7x improvement in S/N after the two-stage filtering compared with the unfiltered data. These improvements enhance SPOTLIGHT's detection efficiency, sensitivity, and operational reliability, strengthening its capability to discover radio transients with the uGMRT.

astro-ph.IM

The SPOTLIGHT Multibeam Real-Time Transient Detection System

Fast Radio Bursts (FRBs) are among the most enigmatic transient phenomena in the Universe. In order to unravel the mystery behind these events, one requires instruments that possess the ability to search, detect, localise, and capture these events in high resolution over large fields-of-view in real-time. The SPOTLIGHT project is one such backend, leveraging the upgraded Giant Metrewave Radio Telescope (uGMRT) to conduct a commensal search for FRBs and other radio transients, using a dedicated high-performance computing facility, comprised of 90 NVIDIA A100 GPUs and 60 compute servers. Here we present the design, implementation, and performance of SPOTLIGHT's real-time transient search pipeline, a GPU-accelerated system capable of processing up to 2000 post-correlation beams in real time. The pipeline combines AstroAccelerate-powered brute-force dedispersion and single pulse search, with a multi-stage and robust candidate optimisation framework, as well as a triggering system for automatic capture of high-resolution visibility and baseband data. To ensure continuous validation of pipeline performance, we have also developed a real-time signal injection framework capable of injecting synthetic bursts directly into SPOTLIGHT's beamformed data stream. The system operates commensally with routine uGMRT observations, processing data streams in real-time while maintaining high sensitivity to ms-duration transients across dispersion measures extending up to 2000 pc cm$^{-3}$. During its initial deployment in uGMRT Cycle 49 and Cycle 50, the pipeline detected 2870 bursts from 42 known sources, and demonstrated sensitivity consistent with the predicted survey threshold of $\sim$ 0.2 Jy ms. The SPOTLIGHT system establishes a scalable framework for wide-field, low-frequency transient discovery and localisation, and provides a key technological foundation for next-generation radio transient surveys.

astro-ph.IM

Double-Exponential Increases in Inference Energy: The Cost of the Race for Accuracy

Deep learning models in computer vision have achieved significant success but pose increasing concerns about energy consumption and sustainability. Despite these concerns, there is a lack of comprehensive understanding of their energy efficiency during inference. In this study, we conduct a comprehensive analysis of the inference energy consumption of 1,200 ImageNet classification models - the largest evaluation of its kind to date. Our findings reveal a steep diminishing return in accuracy gains relative to the increase in energy usage, highlighting sustainability concerns in the pursuit of marginal improvements. We identify key factors contributing to energy consumption and demonstrate methods to improve energy efficiency. To promote more sustainable AI practices, we introduce an energy efficiency scoring system and develop an interactive web application that allows users to compare models based on accuracy and energy consumption. By providing extensive empirical data and practical tools, we aim to facilitate informed decision-making and encourage collaborative efforts in developing energy-efficient AI technologies.

cs.CV

Part-time Power Measurements: nvidia-smi's Lack of Attention

The GPU has emerged as the go-to accelerator for high throughput and parallel workloads, spanning scientific simulations to AI, thanks to its performance and power efficiency. Given that 6 out of the top 10 fastest supercomputers in the world use NVIDIA GPUs and many AI companies each employ 10,000's of NVIDIA GPUs, an accurate understanding of GPU power consumption is essential for making progress to further improve its efficiency. Despite the limited documentation and the lack of understanding of its mechanisms, NVIDIA GPUs' built-in power sensor, providing easily accessible power readings via the nvidia-smi interface, is widely used in energy efficient computing research on GPUs. Our study seeks to elucidate the internal mechanisms of the power readings provided by nvidia-smi and assess the accuracy of the power and energy consumption data. We have developed a suite of micro-benchmarks to profile the behaviour of nvidia-smi power readings and have evaluated them on over 70 different GPUs from all architectural generations since power measurement was first introduced in the 'Fermi' generation. We have identified several unforeseen problems in terms of power/energy measurement using nvidia-smi, for example on the A100 and H100 GPUs only 25% of the runtime is sampled for power consumption, during the other 75% of the time, the GPU can be using drastically different power and nvidia-smi and results presented by it are unaware of this. This along with other findings can lead to a drastic under/overestimation of energy consumed, especially when considering data centres housing tens of thousands of GPUs. We proposed several good practices that help to mitigate these problems. By comparing our results to those measured from an external power-meter, we have reduced the error in the energy measurement by an average of 35% and in some cases by as much as 65% in the test cases we present.

cs.DC

Cutting the cost of pulsar astronomy: Saving time and energy when searching for binary pulsars using NVIDIA GPUs

Using the Fourier Domain Acceleration Search (FDAS) method to search for binary pulsars is a computationally costly process. Next generation radio telescopes will have to perform FDAS in real time, as data volumes are too large to store. FDAS is a matched filtering approach for searching time-domain radio astronomy datasets for the signatures of binary pulsars with approximately linear acceleration. In this paper we will explore how we have reduced the energy cost of an SKA-like implementation of FDAS in AstroAccelerate, utilising a combination of mixed-precision computing and dynamic frequency scaling on NVIDIA GPUs. Combining the two approaches, we have managed to save 58% of the overall energy cost of FDAS with a (<3%) sacrifice in numerical sensitivity.

astro-ph.IM

Bits missing: Finding exotic pulsars using bfloat16 on NVIDIA GPUs

The Fourier Domain Acceleration Search (FDAS) is an effective technique for detecting faint binary pulsars in large radio astronomy datasets. This paper quantifies the sensitivity impact of reducing numerical precision in the GPU accelerated FDAS pipeline of the AstroAccelerate software package. The prior implementation used IEEE-754 single-precision in the entire binary pulsar detection pipeline, spending a large fraction of the runtime computing GPU accelerated FFTs. AstroAccelerate has been modified to use bfloat16 (and IEEE754 double-precision to provide a "gold standard" comparison) within the Fourier domain convolution section of the FDAS routine. Approximately 20,000 synthetic pulsar filterbank files representing binary pulsars were generated using SIGPROC with a range of physical parameters. They have been processed using bfloat16, single and double-precision convolutions. All bfloat16 peaks are within 3% of the predicted signal-to-noise ratio of their corresponding single-precision peaks. Of 14,971 "bright" single-precision fundamental peaks above a power of 44.982 (our experimentally measured highest noise value), 14,602 (97.53%) have a peak in the same acceleration and frequency bin in the bfloat16 output plane, whilst in the remaining 369 the nearest peak is located in the adjacent acceleration bin. There is no bin drift measured between the single and double-precision results. The bfloat16 version of FDAS achieves a speedup of approximately 1.6x compared to single-precision. A comparison between AstroAccelerate and the PRESTO software package is presented using observations collected with the GMRT of PSR J1544+4937, a 2.16ms black widow pulsar in a 2.8 hour compact orbit.

astro-ph.IM

A Novel Greedy Approach To Harmonic Summing Using GPUs

Incoherent harmonic summing is a technique which is used to improve the sensitivity of Fourier domain search methods. A one dimensional harmonic sum is used in time-domain radio astronomy as part of the Fourier domain periodicity search, a type of search used to detect isolated single pulsars. The main problem faced when implementing the harmonic sum on many-core architectures, like GPUs, is the very unfavourable memory access pattern of the harmonic sum algorithm. The memory access pattern gets worse as the dimensionality of the harmonic sum increases. Here we present a set of algorithms for calculating the harmonic sum that are suited to many-core architectures such as GPUs. We present an evaluation of the sensitivity of these different approaches, and their performance. This work forms part of the AstroAccelerate project which is a GPU accelerated software package for processing time-domain radio astronomy data.

astro-ph.IM

Single Pulse Detection Algorithms for Real-time Fast Radio Burst Searches using GPUs

The detection of non-repeating or irregular events in time-domain radio astronomy has gained importance over the last decade due to the discovery of fast radio bursts. Existing or upcoming radio telescopes are gathering more and more data and consequently the software, which is an important part of these telescopes, must process large data volumes at high data rates. Data has to be searched through to detect new and interesting events, often in real-time. These requirements necessitate new and fast algorithms which must process data quickly and accurately. In this work we present new algorithms for single pulse detection using boxcar filters. We have quantified the signal loss introduced by single pulse detection algorithms which use boxcar filters and based on these results, we have designed two distinct "lossy" algorithms. Our lossy algorithms use an incomplete set of boxcar filters to accelerate detection at the expense of a small reduction in detected signal power. We present formulae for signal loss, descriptions of our algorithms and their parallel implementation on NVIDIA GPUs using CUDA. We also present tests of correctness, tests on artificial data and the performance achieved. Our implementation can process SKA-MID-like data 266$\times$ faster than real-time on a NVIDIA P100 GPU and 500x faster than real-time on a NVIDIA Titan V GPU with a mean signal power loss of 7%. We conclude with prospects for single pulse detection for beyond SKA era, nanosecond time resolution radio astronomy.

astro-ph.IM

A GPU implementation of the Correlation Technique for Real-time Fourier Domain Pulsar Acceleration Searches

The study of binary pulsars enables tests of general relativity. Orbital motion in binary systems causes the apparent pulsar spin frequency to drift, reducing the sensitivity of periodicity searches. Acceleration searches are methods that account for the effect of orbital acceleration. Existing methods are currently computationally expensive, and the vast amount of data that will be produced by next generation instruments such as the Square Kilometre Array (SKA) necessitates real-time acceleration searches, which in turn requires the use of High Performance Computing (HPC) platforms. We present our implementation of the Correlation Technique for the Fourier Domain Acceleration Search (FDAS) algorithm on Graphics Processor Units (GPUs). The correlation technique is applied as a convolution with multiple Finite Impulse Response filters in the Fourier domain. Two approaches are compared: the first uses the NVIDIA cuFFT library for applying Fast Fourier Transforms (FFTs) on the GPU, and the second contains a custom FFT implementation in GPU shared memory. We find that the FFT shared memory implementation performs between 1.5 and 3.2 times faster than our cuFFT-based application for smaller but sufficient filter sizes. It is also 4 to 6 times faster than the existing GPU and OpenMP implementations of FDAS. This work is part of the AstroAccelerate project, a many-core accelerated time-domain signal processing library for radio astronomy.

astro-ph.IM