arXiv subjects

Giuliano Taffoni

Publications and source records attributed to Giuliano Taffoni.

At least 19 recordsLinked to original sources

arXiv2026

Variability in Cosmological Hydrodynamical Simulations: how Stochastic Processes, Numerical Effects, and Reproducibility Limits impact Predictability

Cosmological hydrodynamical simulations are powerful tools for studying galaxy formation, yet their predictive precision is limited by stochastic variability and numerical uncertainty. We quantify this variability using four identical realizations of a zoom-in galaxy-cluster simulation evolved with \textsc{OpenGadget3} under tightly controlled compiler, library, and hardware settings. Variability is measured through the properties of matched galaxies across repeated runs, including a mixed linear model that separates run-to-run variation from within-run noise. Variations of approximately $10$-$25\%$ are found in galaxy dark matter and stellar masses for the baseline simulations. The variability trending above the shot-noise floor reflects the combined effects of stochastic star formation and feedback regulation, and is further amplified when black hole physics is included. Furthermore, our results indicate that feedback acts to regulate variability, reducing scatter in both stellar and black hole masses. Our inference from run-to-run variation indicates a noise-dominated regime that remains statistically reproducible, despite individual realization differences. These results establish baseline, noise-dominated variability estimates at low resolution, demonstrate how feedback modulates predictability, and provide a statistical framework for future studies of reproducibility in cosmological hydrodynamical simulations.

astro-ph.GA↗

arXiv2026

Accelerating radio astronomy imaging with RICK: a step towards SKA-Mid and SKA-Low

The data volumes generated by modern radio interferometers, such as the SKA precursors, present significant computational challenges for imaging pipelines. Addressing the need for high-performance, portable, and scalable software, we present RICK 2.0 (Radio Imaging Code Kernels). This work introduces a novel implementation that leverages the HeFFTe library for distributed Fast Fourier Transforms, ensuring portability across diverse HPC architectures, including multi-core CPUs and accelerators. We validate RICK's correctness and performance against real observational data from both MeerKAT and LOFAR. Our results demonstrate that the HeFFTe-based implementation offers substantial performance advantages, particularly when running on GPUs, and scales effectively with large pixel resolutions and a high number of frequency planes. This new architecture overcomes the critical scaling limitations identified in previous work (Paper II, Paper III), where communication overheads consumed up to 96% of the runtime due to the necessity of communicating the entire grid. This new RICK version drastically reduces this communication impact, representing a scalable and efficient imaging solution ready for the SKA era.

astro-ph.IM↗

arXiv2026

Accelerating cosmological simulations on GPUs: a step towards sustainability and green-awareness

The increasing complexity and scale of cosmological N-body simulations, driven by astronomical surveys like Euclid, call for a paradigm shift towards more sustainable and energy-efficient high-performance computing (HPC). The rising energy consumption of supercomputing facilities poses a significant environmental and financial challenge. In this work, we build upon a recently developed GPU implementation of pinocchio, a widely-used tool for the fast generation of dark matter (DM) halo catalogues, to investigate energy consumption. Using a different resource configuration, we confirmed the time-to-solution behavior observed in a companion study, and we use these runs to compare time-to-solution with energy-to-solution. By profiling the code on various HPC platforms with a newly developed implementation of the Power Measurement Toolkit (PMT), we demonstrate an 8x reduction in energy-to-solution and 8x speed-up in time-to-solution compared to the CPU-only version. Taken together, these gains translate into an overall efficiency improvement of up to 64x. Our results show that the GPU-accelerated pinocchio not only achieves substantial speed-up, making the generation of large-scale mock catalogues more tractable, but also significantly reduces the energy footprint of the simulations. This work represents an step towards ``green-aware" scientific computing in cosmology, proving that performance and sustainability can be simultaneously achieved.

astro-ph.IM↗

arXiv2025

EuroHPC SPACE CoE: Redesigning Scalable Parallel Astrophysical Codes for Exascale

High Performance Computing (HPC) based simulations are crucial in Astrophysics and Cosmology (A&C), helping scientists investigate and understand complex astrophysical phenomena. Taking advantage of exascale computing capabilities is essential for these efforts. However, the unprecedented architectural complexity of exascale systems impacts legacy codes. The SPACE Centre of Excellence (CoE) aims to re-engineer key astrophysical codes to tackle new computational challenges by adopting innovative programming paradigms and software (SW) solutions. SPACE brings together scientists, code developers, HPC experts, hardware (HW) manufacturers, and SW developers. This collaboration enhances exascale A&C applications, promoting the use of exascale and post-exascale computing capabilities. Additionally, SPACE addresses high-performance data analysis for the massive data outputs from exascale simulations and modern observations, using machine learning (ML) and visualisation tools. The project facilitates application deployment across platforms by focusing on code repositories and data sharing, integrating European astrophysical communities around exascale computing with standardised SW and data protocols.

astro-ph.IM↗

arXiv2025

Green computing toward SKA era with RICK

Square Kilometer Array is expected to generate hundreds of petabytes of data per year, two orders of magnitude more than current radio interferometers. Data processing at this scale necessitates advanced High Performance Computing (HPC) resources. However, modern HPC platforms consume up to tens of M W , i.e. megawatts, and energy-to-solution in algorithms will become of utmost importance in the next future. In this work we study the trade-off between energy-to-solution and time-to-solution of our RICK code (Radio Imaging Code Kernels), which is a novel approach to implement the w-stacking algorithm designed to run on state-of-the-art HPC systems. The code can run on heterogeneous systems exploiting the accelerators. We did both single-node tests and multi-node tests with both CPU and GPU solutions, in order to study which one is the greenest and which one is the fastest. We then defined the green productivity, i.e. a quantity which relates energy-to-solution and time-to-solution in different code configurations compared to a reference one. Configurations with the highest green productivities are the most efficient ones. The tests have been run on the Setonix machine available at the Pawsey Supercomputing Research Centre (PSC) in Perth (WA), ranked as 28th in Top500 list, updated at June 2024.

cs.DC↗

arXiv2024

Timeseria: an object-oriented time series processing library

Timeseria is an object-oriented time series processing library implemented in Python, which aims at making it easier to manipulate time series data and to build statistical and machine learning models on top of it. Unlike common data analysis frameworks, it builds up from well defined and reusable logical units (objects), which can be easily combined together in order to ensure a high level of consistency. Thanks to this approach, Timeseria can address by design several non-trivial issues which are often underestimated, such as handling data losses, non-uniform sampling rates, differences between aggregated data and punctual observations, time zones, daylight saving times, and more. Timeseria comes with a comprehensive set of base data structures, data transformations for resampling and aggregation, common data manipulation operations, and extensible models for data reconstruction, forecasting and anomaly detection. It also integrates a fully featured, interactive plotting engine capable of handling even millions of data points.

cs.LG↗

arXiv2024

Accelerating radio astronomy imaging with RICK

This paper presents an implementation of radio astronomy imaging algorithms on modern High Performance Computing (HPC) infrastructures, exploiting distributed memory parallelism and acceleration throughout multiple GPUs. Our code, called RICK (Radio Imaging Code Kernels), is capable of performing the major steps of the w-stacking algorithm presented in Offringa et al. (2014) both inter- and intra-node, and in particular has the possibility to run entirely on the GPU memory, minimising the number of data transfers between CPU and GPU. This feature, especially among multiple GPUs, is critical given the huge sizes of radio datasets involved. After a detailed description of the new implementations of the code with respect to the first version presented in Gheller et al. (2023), we analyse the performances of the code for each step involved in its execution. We also discuss the pros and cons related to an accelerated approach to this problem and its impact on the overall behaviour of the code. Such approach to the problem results in a significant improvement in terms of runtime with respect to the CPU version of the code, as long as the amount of computational resources does not exceed the one requested by the size of the problem: the code, in fact, is now limited by the communication costs, with the computation that gets heavily reduced by the capabilities of the accelerators.

astro-ph.IM↗

arXiv2023

Feasibility of access EGI resources through the ESCAPE developed ESFRI Science Analysis Platform

The EU ESCAPE project is developing ESAP, ESFRI 1 Scientific Analysis Platform, as an API gateway that enables the seamless integration of independent services accessing distributed data and computing resources. In ESCAPE we are exploring the possibility of exploiting EGI's OpenStack cloud computing services through ESAP. In our contribution we briefly describe ESCAPE and ESAP, the the use cases, the work done to automate a virtual machine creation in EGI's OpenStack cloud computing, drawbacks and possible solutions.

astro-ph.IM↗

arXiv2023

High Performance W-stacking for Imaging Radio Astronomy Data: a Parallel and Accelerated Solution

Current and upcoming radio-interferometers are expected to produce volumes of data of increasing size that need to be processed in order to generate the corresponding sky brightness distributions through imaging. This represents an outstanding computational challenge, especially when large fields of view and/or high resolution observations are processed. We have investigated the adoption of modern High Performance Computing systems specifically addressing the gridding, FFT-transform and w-correction of imaging, combining parallel and accelerated solutions. We have demonstrated that the code we have developed can support dataset and images of any size compatible with the available hardware, efficiently scaling up to thousands of cores or hundreds of GPUs, keeping the time to solution below one hour even when images of the size of the order of billion or tens of billion of pixels are generated. In addition, portability has been targeted as a primary objective, both in terms of usability on different computing platforms and in terms of performance. The presented results have been obtained on two different state-of-the-art High Performance Computing architectures.

astro-ph.IM↗

arXiv2022

Rosetta: a container-centric science platform for resource-intensive, interactive data analysis

Rosetta is a science platform for resource-intensive, interactive data analysis which runs user tasks as software containers. It is built on top of a novel architecture based on framing user tasks as microservices - independent and self-contained units - which allows to fully support custom and user-defined software packages, libraries and environments. These include complete remote desktop and GUI applications, besides common analysis environments as the Jupyter Notebooks. Rosetta relies on Open Container Initiative containers, which allow for safe, effective and reproducible code execution; can use a number of container engines and runtimes; and seamlessly supports several workload management systems, thus enabling containerized workloads on a wide range of computing resources. Although developed in the astronomy and astrophysics space, Rosetta can virtually support any science and technology domain where resource-intensive, interactive data analysis is required.

astro-ph.IM↗

arXiv2022

Galaxies in the central regions of simulated galaxy clusters

In this paper, we assess the impact of numerical resolution and of the implementation of energy input from AGN feedback models on the inner structure of cluster sub-haloes in hydrodynamic simulations. We compare several zoom-in re-simulations of a sub-sample of the cluster-sized haloes studied in Meneghetti et al. (2020), obtained by varying mass resolution, softening length and AGN energy feedback scheme. We study the impact of these different setups on the subhalo abundances, their radial distribution, their density and mass profiles and the relation between the maximum circular velocity, which is a proxy for subhalo compactness. Regardless of the adopted numerical resolution and feedback model, subhaloes with masses Msub < 1e11Msun/h, the most relevant mass-range for galaxy-galaxy strong lensing, have maximum circular velocities ~30% smaller than those measured from strong lensing observations of Bergamini et al. (2019). We also find that simulations with less effective AGN energy feedback produce massive subhaloes (Msub> 1e11 Msun/h ) with higher maximum circular velocity and that their Vmax - Msub relation approaches the observed one. However the stellar-mass number count of these objects exceeds the one found in observations and we find that the compactness of these simulated subhaloes is the result of an extremely over-efficient star formation in their cores, also leading to larger-than-observed subhalo stellar mass. We conclude that simulations are unable to simultaneously reproduce the observed stellar masses and compactness (or maximum circular velocities) of cluster galaxies. Thus, the discrepancy between theory and observations that emerged from the analysis of Meneghetti et al. (2020) persists. It remains an open question as to whether such a discrepancy reflects limitations of the current implementation of galaxy formation models or the LCDM paradigm.

astro-ph.CO↗

arXiv2022

The probability of galaxy-galaxy strong lensing events in hydrodynamical simulations of galaxy clusters

Meneghetti et al. (2020) recently reported an excess of galaxy-galaxy strong lensing (GGSL) in galaxy clusters compared to expectations from the LCDM cosmological model. Theoretical estimates of the GGSL probability are based on the analysis of numerical hydrodynamical simulations in the LCDM cosmology. We quantify the impact of the numerical resolution and AGN feedback scheme adopted in cosmological simulations on the predicted GGSL probability and determine if varying these simulation properties can alleviate the gap with observations. We repeat the analysis of Meneghetti et al. (2020) on cluster-size halos simulated with different mass and force resolutions and implementing several independent AGN feedback schemes. We find that improving the mass resolution by a factor of ten and twenty-five, while using the same galaxy formation model that includes AGN feedback, does not affect the GGSL probability. We find similar results regarding the choice of gravitational softening. On the contrary, adopting an AGN feedback scheme that is less efficient at suppressing gas cooling and star formation leads to an increase in the GGSL probability by a factor between three and six. However, we notice that such simulations form overly massive subhalos whose contribution to the lensing cross-section would be significant while their Einstein radii are too large to be consistent with the observations. The primary contributors to the observed GGSL cross-sections are subhalos with smaller masses, that are compact enough to become critical for lensing. The population with these required characteristics appears to be absent in simulations.

astro-ph.CO↗

arXiv2022

A distributed computing infrastructure for LOFAR Italian community

The LOw-Frequency ARray is a low-frequency radio interferometer composed by observational stations spread across Europe and it is the largest precursor of SKA in terms of effective area and generated data rates. In 2018, the Italian community officially joined LOFAR project, and it deployed a distributed computing and storage infrastructure dedicated to LOFAR data analysis. The infrastructure is based on 4 nodes distributed in different Italian locations and it offers services for pipelines execution, storage of final and intermediate results and support for the use of the software and infrastructure. As the analysis of the LOw-Frequency ARray data requires a very complex computational procedure, a container-based approach has been adopted to distribute software environments to the different computing resources. A science platform approach is used to facilitate interactive access to computational resources. In this paper, we describe the architecture and main features of the infrastructure.

astro-ph.IM↗

arXiv2021

The Virtual Observatory Ecosystem Facing the European Open Science Cloud

The International Virtual Observatory Alliance (IVOA) has developed and built, in the last two decades, an ecosystem of distributed resources, interoperable and based upon open shared technological standards. In doing so the IVOA has anticipated, putting into practice for the astrophysical domain, the ideas of FAIR-ness of data and service resources and the Open-ness of sharing scientific results, leveraging on the underlying open standards required to fill the above. In Europe, efforts in supporting and developing the ecosystem proposed by the IVOA specifications has been provided by a continuous set of EU funded projects up to current H2020 ESCAPE ESFRI cluster. In the meantime, in the last years, Europe has realised the importance of promoting the Open Science approach for the research communities and started the European Open Science Cloud (EOSC) project to create a distributed environment for research data, services and communities. In this framework the European VO community, had to face the move from the interoperability scenario in the astrophysics domain into a larger audience perspective that includes a cross-domain FAIR approach. Within the ESCAPE project the CEVO Work Package (Connecting ESFRI to EOSC through the VO) has one task to deal with this integration challenge: a challenge where an existing, mature, distributed e-infrastructure has to be matched to a forming, more general architecture. CEVO started its works in the first months of 2019 and has already worked on the integration of the VO Registry into the EOSC e-infrastructure. This contribution reports on the first year and a half of integration activities, that involve applications, services and resources being aware of the VO scenario and compatible with the EOSC architecture.

astro-ph.IM↗

arXiv2020

Performance and energy footprint assessment of FPGAs and GPUs on HPC systems using Astrophysics application

New challenges in Astronomy and Astrophysics (AA) are urging the need for a large number of exceptionally computationally intensive simulations. "Exascale" (and beyond) computational facilities are mandatory to address the size of theoretical problems and data coming from the new generation of observational facilities in AA. Currently, the High Performance Computing (HPC) sector is undergoing a profound phase of innovation, in which the primary challenge to the achievement of the "Exascale" is the power-consumption. The goal of this work is to give some insights about performance and energy footprint of contemporary architectures for a real astrophysical application in an HPC context. We use a state-of-the-art N-body application that we re-engineered and optimized to exploit the heterogeneous underlying hardware fully. We quantitatively evaluate the impact of computation on energy consumption when running on four different platforms. Two of them represent the current HPC systems (Intel-based and equipped with NVIDIA GPUs), one is a micro-cluster based on ARM-MPSoC, and one is a "prototype towards Exascale" equipped with ARM-MPSoCs tightly coupled with FPGAs. We investigate the behavior of the different devices where the high-end GPUs excel in terms of time-to-solution while MPSoC-FPGA systems outperform GPUs in power consumption. Our experience reveals that considering FPGAs for computationally intensive application seems very promising, as their performance is improving to meet the requirements of scientific applications. This work can be a reference for future platforms development for astrophysics applications where computationally intensive calculations are required.

astro-ph.IM↗

arXiv2020

CHIPP: INAF pilot project for HTC, HPC and HPDA

CHIPP (Computing HTC in INAF Pilot Project) is an Italian project funded by the Italian Institute for Astrophysics (INAF) and promoted by the ICT office of INAF. The main purpose of the CHIPP project is to coordinate the use of, and access to, already existing high throughput computing and high-performance computing and data processing resources (for small/medium size programs) for the INAF community. Today, Tier2/Tier3 systems (1,200 CPU/core) are provided at the INAF institutes at Trieste and Catania, but in the future, the project will evolve including also other computing infrastructures. During the last two years, more than 30 programs have been approved for a total request of 30 Million CPU-h. Most of the programs are HPC, data reduction and analysis, machine learning. In this paper, we describe in details the CHIPP infrastructures and the results of the first two years of activity.

astro-ph.IM↗

arXiv2019

Exposing SED Models And Snapshots Via VO Simulation Artefacts

The Virtual Observatory (VO) simulation standards, Simulation Data Model (SimDM) and Simulation Data Access Layer (SimDAL), establish a framework for the discoverability and dissemination of data created in simulation projects. These standards address the complexity of having a standard access and facade for data which is expected to be multifaceted and, of a diverse range. In this paper, we detail the realisation of an application exposing the theoretical products of one such scientific project via the simulation facades proposed by the VO. The scientific project in question, is a study of the evolution of young clusters in dense molecular clumps. The theoretical products arising from this study include a grid of 20 million SED (Spectral Energy Distribution) models for synthetic young clusters and related data products. Details on the implementation of SimDAL components in the application as well as the ways in which the data structures of SimDM are incorporated onto the existing data products are provided.

cs.DL↗

arXiv2019

Integrating the VO Framework in the EOSC

The European Open Science Cloud (EOSC) is in its early stages, but already some aspects of the EOSC vision are starting to become reality, for example the EOSC portal and the development of metadata catalogues. In the astrophysical domain already exists an open approach to science data: the Virtual Observatory view put in place by the International Virtual Observatory Alliance (IVOA) architecture of standards. The ESCAPE (European Science Cluster of Astronomy & Particle physics ESFRI research infrastructures) project has, among its tasks, to demonstrate that the VO architecture can be integrated within the EOSC building one and to provide guidelines to ESFRI partners (European Strategy Forum on Research Infrastructures) in doing this. This contribution reports on the progress of this integration after the first months of work inside ESCAPE.

astro-ph.IM↗