SearcharxivSearch

arXiv subjects

Eva Sciacca

Publications and source records attributed to Eva Sciacca.

At least 19 recordsLinked to original sources

Developing a Portable Solution for Post-Event Analysis Pipelines

In recent years, the monitoring and study of natural hazards have gained significant attention, particularly due to climate change, which exacerbates incidents like floods, droughts, storm surges, and landslides. Together with the constant risk of earthquakes, these climate-induced events highlight the critical necessity for enhanced risk assessment and mitigation strategies in susceptible areas such as Italy. In this work, we present a Science Gateway framework for the development of portable and fully automated post-event analysis pipelines integrating Photogrammetry techniques, Data Visualization and Artificial Intelligence technologies, applied on aerial images, to assess extreme natural events and evaluate their impact on risk-exposed assets.

cs.DC

EuroHPC SPACE CoE: Redesigning Scalable Parallel Astrophysical Codes for Exascale

High Performance Computing (HPC) based simulations are crucial in Astrophysics and Cosmology (A&C), helping scientists investigate and understand complex astrophysical phenomena. Taking advantage of exascale computing capabilities is essential for these efforts. However, the unprecedented architectural complexity of exascale systems impacts legacy codes. The SPACE Centre of Excellence (CoE) aims to re-engineer key astrophysical codes to tackle new computational challenges by adopting innovative programming paradigms and software (SW) solutions. SPACE brings together scientists, code developers, HPC experts, hardware (HW) manufacturers, and SW developers. This collaboration enhances exascale A&C applications, promoting the use of exascale and post-exascale computing capabilities. Additionally, SPACE addresses high-performance data analysis for the massive data outputs from exascale simulations and modern observations, using machine learning (ML) and visualisation tools. The project facilitates application deployment across platforms by focusing on code repositories and data sharing, integrating European astrophysical communities around exascale computing with standardised SW and data protocols.

astro-ph.IM

Exascale In-situ visualization for Astronomy & Cosmology

Modern simulations and observations in Astronomy & Cosmology (A&C) produce massively large data volumes, posing significant challenges for storage, access and data analysis. A long-standing bottleneck in high-performance computing, especially now in the exascale era, has been the requirement to write these large datasets to disks, which limits the performance. A promising solution to this challenge is in-situ processing, where analysis and visualization are performed concurrently with the simulation itself, bypassing the storage of the simulation data. In this work, we present new results from an approach for in-situ processing based on Hecuba, a framework that provides a highly distributed database for streaming A&C simulation data directly into the visualization pipeline to make possible on-line visualization. By integrating Hecuba with the high-performance cosmological simulator ChaNGa, we enable real-time, in-situ visualization of N-body simulation results using tools such as ParaView and VisIVO.

astro-ph.IM

In-Situ High Performance Visualization for Astronomy & Cosmology

The Astronomy & Cosmology (A&C) community is presently witnessing an unprecedented growth in the quality and quantity of data coming from simulations and observations. Writing results of numerical simulations to disk files has long been a bottleneck in high-performance computing. To access effectively and extract the scientific content of such large-scale data sets appropriate tools and techniques are needed. This is especially true for visualization tools, where petascale data size problems cannot be visualized without some data filtering, which reduces either the resolution or the amount of data volume managed by the visualization tool. A solution to this problem is to run the analysis and visualization concurrently (in-situ) with the simulation and bypass the storage of the full results. In particular we use Hecuba, a framework offering a highly distributed database to stream A\&C simulation data for on-line visualization. We will demonstrate the Hecuba platform integration with the Changa high performant cosmological simulator and the in-situ visualization of its N-body results with the ParaView and VisIVO tools.

astro-ph.IM

Interactive High-Performance Visualization for Astronomy and Cosmology

The exponential growth of data in Astrophysics and Cosmology demands scalable computational tools and intuitive interfaces for analysis and visualization. In this work, we present an innovative integration of the VisIVO scientific visualization framework with the InterActive Computing (IAC) service at Cineca, enabling interactive, high-performance visual workflows directly within HPC environments. Through seamless integration into Jupyter-based science gateways, users can now access GPU-enabled compute nodes to perform complex 3D visualizations using VisIVO via custom Python wrappers and preconfigured interactive notebooks. We demonstrate how this infrastructure simplifies access to advanced HPC resources, enhances reproducibility, and accelerates exploratory workflows in astronomical research. Our approach has been validated through a set of representative use cases involving large-scale simulations from the GADGET code, highlighting the effectiveness of this system in visualizing the large-scale structure of the Universe. This work exemplifies how science gateways can bridge domain-specific tools and advanced infrastructures, fostering user-centric, scalable, and reproducible research environments.

astro-ph.IM

High performance visualization for Astronomy and Cosmology: the VisIVO's pathway toward Exascale systems

Petabyte-scale data volumes are generated by observations and simulations in modern astronomy and astrophysics. Storage, access, and data analysis are significantly hampered by such data volumes and are leading to the development of a new generation of software tools. The Visualization Interface for the Virtual Observatory (VisIVO) has been designed, developed and maintained by INAF since 2005 to perform multi-dimensional data analysis and knowledge discovery in multivariate astrophysical datasets. Utilizing containerization and virtualization technologies, VisIVO has already been used to exploit distributed computing infrastructures including the European Open Science Cloud (EOSC). We intend to adapt VisIVO solutions for high performance visualization of data generated on the (pre-)Exascale systems by HPC applications in Astrophysics and Cosmology (A\&C), including GADGET (GAlaxies with Dark matter and Gas) and PLUTO simulations, thanks to the collaboration within the SPACE Center of Excellence, the H2020 EUPEX Project, and the ICSC National Research Centre. In this work, we outline the evolution's course as well as the execution strategies designed to achieve the following goals: enhance the portability of the VisIVO modular applications and their resource requirements; foster reproducibility and maintainability; take advantage of a more flexible resource exploitation over heterogeneous HPC facilities; and, finally, minimize data-movement overheads and improve I/O performances.

astro-ph.IM

From Local to Remote: VisIVO Visual Analytics in the Era of the Square Kilometre Array

The field of astrophysics is continuously advancing, with an ever-growing influx of data requiring robust and efficient analysis tools. As the Square Kilometre Array (SKA) radio telescopes come fully operational, we anticipate the generation of hundreds of petabytes of data annually, characterized by unprecedented resolution and detail. In this context, scientific visualization becomes a critical component, enabling researchers to interpret complex datasets and extract meaningful insights. The immense volume of data demands not only suitable tools but also substantial infrastructure and computational capacity to analyze it effectively. In this work, we will discuss how we are addressing these challenges with the development of our interactive visualization tool named VisIVO Visual Analytics. The tool is transitioning from a local visualizer to a remote visualizer, utilizing a client-server architecture. This evolution will allow the software to run parallel visualization pipelines on high-performance computing (HPC) clusters, thereby enhancing its capacity to handle extensive datasets efficiently.

astro-ph.IM

RADiff: Controllable Diffusion Models for Radio Astronomical Maps Generation

Along with the nearing completion of the Square Kilometre Array (SKA), comes an increasing demand for accurate and reliable automated solutions to extract valuable information from the vast amount of data it will allow acquiring. Automated source finding is a particularly important task in this context, as it enables the detection and classification of astronomical objects. Deep-learning-based object detection and semantic segmentation models have proven to be suitable for this purpose. However, training such deep networks requires a high volume of labeled data, which is not trivial to obtain in the context of radio astronomy. Since data needs to be manually labeled by experts, this process is not scalable to large dataset sizes, limiting the possibilities of leveraging deep networks to address several tasks. In this work, we propose RADiff, a generative approach based on conditional diffusion models trained over an annotated radio dataset to generate synthetic images, containing radio sources of different morphologies, to augment existing datasets and reduce the problems caused by class imbalances. We also show that it is possible to generate fully-synthetic image-annotation pairs to automatically augment any annotated dataset. We evaluate the effectiveness of this approach by training a semantic segmentation model on a real dataset augmented in two ways: 1) using synthetic images obtained from real masks, and 2) generating images from synthetic semantic masks. We show an improvement in performance when applying augmentation, gaining up to 18% in performance when using real masks and 4% when augmenting with synthetic masks. Finally, we employ this model to generate large-scale radio maps with the objective of simulating Data Challenges.

cs.CV

Radio astronomical images object detection and segmentation: A benchmark on deep learning methods

In recent years, deep learning has been successfully applied in various scientific domains. Following these promising results and performances, it has recently also started being evaluated in the domain of radio astronomy. In particular, since radio astronomy is entering the Big Data era, with the advent of the largest telescope in the world - the Square Kilometre Array (SKA), the task of automatic object detection and instance segmentation is crucial for source finding and analysis. In this work, we explore the performance of the most affirmed deep learning approaches, applied to astronomical images obtained by radio interferometric instrumentation, to solve the task of automatic source detection. This is carried out by applying models designed to accomplish two different kinds of tasks: object detection and semantic segmentation. The goal is to provide an overview of existing techniques, in terms of prediction performance and computational efficiency, to scientists in the astrophysics community who would like to employ machine learning in their research.

cs.CV

Radio source analysis services for the SKA and precursors

New developments in data processing and visualization are being made in preparation for upcoming radioastronomical surveys planned with the Square Kilometre Array (SKA) and its precursors. A major goal is enabling extraction of science information from the data in a mostly automated way, possibly exploiting the capabilities offered by modern computing infrastructures and technologies. In this context, the integration of source analysis algorithms into data visualization tools is expected to significantly improve and speed up the cataloguing process of large area surveys. To this aim, the CIRASA (Collaborative and Integrated platform for Radio Astronomical Source Analysis) project was recently started to develop and integrate a set of services for source extraction, classification and analysis into the ViaLactea visual analytic platform and knowledge base archive. In this contribution, we will present the project objectives and tools that have been developed, interfaced and deployed so far on the prototype European Open Science Cloud (EOSC) infrastructure provided by the H2020 NEANIAS project.

astro-ph.IM

Modelling Biological and Ecological Systems with the Calculus of Wrapped Compartments

The modelling and analysis of biological systems has deep roots in Mathematics, specifically in the field of Ordinary Differential Equations. Alternative approaches based on formal calculi, often derived from process algebras or term rewriting systems, provide a quite complementary way to analyse the behaviour of biological systems. These calculi allow to cope in a natural way with notions like compartments and membranes, which are not easy (sometimes impossible) to handle with purely numerical approaches, and are often based on stochastic simulation methods. The Calculus of Wrapped Compartments is a framework based on stochastic multiset rewriting in a compartmentalised setting used for the description of biological and ecological systems. We provide an extended presentation of the Calculus of Wrapped Compartments, sketch a few modelling guidelines to encode biological and ecological interactions, show how spatial properties can be handled within the framework and define a hybrid simulation algorithm. Several applications in Biology and Ecology are proposed as modelling case studies.

q-bio.QM

Optimization of the storage database for the Monitoring system of the CTA

We present preliminary test results for the correct sizing of the bare metal hardware that will host the database of the Monitoring system (MON) for the Cherenkov Telescope Array (CTA). The MON is the subsystem of the Array Control and Data Acquisition System (ACADA) that is responsible for monitoring and logging the overall CTA array. It acquires and stores monitoring points and logging information from the array elements, at each of the CTA sites. MON is designed and built in order to deal with big data time series, and exploits some of the currently most advanced technologies in the fields of databases and Internet of Things (IoT). To dimension the bare metal hardware required by the monitoring system (excluding the logging), we performed the test campaign that is discussed in this paper. We discuss here the best set of parameters and the optimized configuration to maximize the database data writing in terms of the number of updated rows per second. We also demonstrate the feasibility of our approach in the frame of the CTA requirements.

astro-ph.IM

LOgging UnifieD for ASTRI Mini Array

The ASTRI (Astrofisica con Specchi a Tecnologia Replicante Italiana) Mini-Array (MA) project is an international collaboration led by the Italian National Institute for Astrophysics (INAF). ASTRI MA is composed of nine Cherenkov telescopes operating in the energy range 1-100 TeV, and it aims to study very high-energy gamma ray astrophysics and optical intensity interferometry of bright stars. ASTRI MA is currently under construction, and will be installed at the site of the Teide Observatory in Tenerife (Spain). The hardware and software system that is responsible of monitoring and controlling all the operations carried out at the ASTRI MA site is the Supervision Control and Data Acquisition (SCADA). The LOgging UnifieD (LOUD) subsystem is one of the main components of SCADA. It provides the service responsible for collecting, filtering, exposing and storing log events collected by all the array elements (telescopes, LIDAR, devices, etc.). In this paper, we present the LOUD architecture and the software stack explicitly designed for distributed computing environments exploiting Internet of Things technologies (IoT).

astro-ph.IM

The Monitoring, Logging, and Alarm system for the Cherenkov Telescope Array

We present the current development of the Monitoring, Logging and Alarm subsystems in the framework of the Array Control and Data Acquisition System (ACADA) for the Cherenkov Telescope Array (CTA). The Monitoring System (MON) is the subsystem responsible for monitoring and logging the overall array (at each of the CTA sites) through the acquisition of monitoring and logging information from the array elements. The MON allows us to perform a systematic approach to fault detection and diagnosis supporting corrective and predictive maintenance to minimize the downtime of the system. We present a unified tool for monitoring data items from the telescopes and other devices deployed at the CTA array sites. Data are immediately available for the operator interface and quick-look quality checks and stored for later detailed inspection. The Array Alarm System (AAS) is the subsystem that provides the service that gathers, filters, exposes, and persists alarms raised by both the ACADA processes and the array elements supervised by the ACADA system. It collects alarms from the telescopes, the array calibration, the environmental monitoring instruments and the ACADA systems. The AAS sub-system also creates new alarms based on the analysis and correlation of the system software logs and the status of the system hardware providing the filter mechanisms for all the alarms. Data from the alarm system are then sent to the operator via the human-machine interface.

astro-ph.IM

A Comparative Study of Convolutional Neural Networks for the Detection of Strong Gravitational Lensing

As we enter the era of large-scale imaging surveys with the up-coming telescopes such as LSST and SKA, it is envisaged that the number of known strong gravitational lensing systems will increase dramatically. However, these events are still very rare and require the efficient processing of millions of images. In order to tackle this image processing problem, we present Machine Learning techniques and apply them to the Gravitational Lens Finding Challenge. The Convolutional Neural Networks (CNNs) presented have been re-implemented within a new modular, and extendable framework, LEXACTUM. We report an Area Under the Curve (AUC) of 0.9343 and 0.9870, and an execution time of 0.0061s and 0.0594s per image, for the Space and Ground datasets respectively, showing that the results obtained by CNNs are very competitive with conventional methods (such as visual inspection and arc finders) for detecting gravitational lenses.

astro-ph.IM

Novel EOSC Services for Space Challenges: The NEANIAS First Outcomes

The European Open Science Cloud (EOSC) initiative faces the challenge of developing an agile, fit-for-purpose, and sustainable service-oriented platform that can address the evolving needs of scientific communities. The NEANIAS project plays an active role in the materialization of the EOSC ecosystem by actively contributing to the technological, procedural, strategic and business development of EOSC. We present the first outcomes of the NEANIAS activities relating to co-design and delivery of new innovative services for space research for data management and visualization (SPACE-VIS), map making and mosaicing (SPACE-MOS) and pattern and structure detection (SPACE-ML). We include a summary of collected user requirements driving our services and methodology for their delivery, together with service access details and pointers to future works.

astro-ph.IM

Toward porting Astrophysics Visual Analytics Services to the European Open Science Cloud

The European Open Science Cloud (EOSC) aims to create a federated environment for hosting and processing research data to support science in all disciplines without geographical boundaries, such that data, software, methods and publications can be shared as part of an Open Science community of practice. This work presents the ongoing activities related to the implementation of visual analytics services, integrated into EOSC, towards addressing the diverse astrophysics user communities needs. These services rely on visualisation to manage the data life cycle process under FAIR principles, integrating data processing for imaging and multidimensional map creation and mosaicing, and applying machine learning techniques for detection of structures in large scale multidimensional maps.

astro-ph.IM

INDIGO-DataCloud:A data and computing platform to facilitate seamless access to e-infrastructures

This paper describes the achievements of the H2020 project INDIGO-DataCloud. The project has provided e-infrastructures with tools, applications and cloud framework enhancements to manage the demanding requirements of scientific communities, either locally or through enhanced interfaces. The middleware developed allows to federate hybrid resources, to easily write, port and run scientific applications to the cloud. In particular, we have extended existing PaaS (Platform as a Service) solutions, allowing public and private e-infrastructures, including those provided by EGI, EUDAT, and Helix Nebula, to integrate their existing services and make them available through AAI services compliant with GEANT interfederation policies, thus guaranteeing transparency and trust in the provisioning of such services. Our middleware facilitates the execution of applications using containers on Cloud and Grid based infrastructures, as well as on HPC clusters. Our developments are freely downloadable as open source components, and are already being integrated into many scientific applications.

cs.DC