arXiv subjects

Bruno Regaldo-Saint Blancard

Publications and source records attributed to Bruno Regaldo-Saint Blancard.

10 recordsLinked to original sources

arXiv2026

Walrus: A Cross-Domain Foundation Model for Continuum Dynamics

Foundation models have transformed machine learning for language and vision, but achieving comparable impact in physical simulation remains a challenge. Data heterogeneity and unstable long-term dynamics inhibit learning from sufficiently diverse dynamics, while varying resolutions and dimensionalities challenge efficient training on modern hardware. Through empirical and theoretical analysis, we incorporate new approaches to mitigate these obstacles, including a harmonic-analysis-based stabilization method, load-balanced distributed 2D and 3D training strategies, and compute-adaptive tokenization. Using these tools, we develop Walrus, a transformer-based foundation model developed primarily for fluid-like continuum dynamics. Walrus is pretrained on nineteen diverse scenarios spanning astrophysics, geoscience, rheology, plasma physics, acoustics, and classical fluids. Experiments show that Walrus outperforms prior foundation models on both short and long term prediction horizons on downstream tasks and across the breadth of pretraining data, while ablation studies confirm the value of our contributions to forecast stability, training throughput, and transfer performance over conventional approaches. Code and weights are released for community use.

cs.LG↗

arXiv2025

AION-1: Omnimodal Foundation Model for Astronomical Sciences

While foundation models have shown promise across a variety of fields, astronomy still lacks a unified framework for joint modeling across its highly diverse data modalities. In this paper, we present AION-1, a family of large-scale multimodal foundation models for astronomy. AION-1 integrates heterogeneous imaging, spectroscopic, and scalar data using a two-stage architecture: modality-specific tokenization followed by transformer-based masked modeling of cross-modal token sequences. The model is pretrained on five large-scale surveys: Legacy Survey, Hyper Suprime-Cam (HSC), Sloan Digital Sky Survey (SDSS), Dark Energy Spectroscopic Instrument (DESI), and Gaia. These span more than 200 million observations of stars, galaxies, and quasars. With a single frozen encoder, AION-1 achieves strong results on a broad suite of downstream tasks, including galaxy and stellar property estimation, galaxy morphology classification, similarity-based retrieval, galaxy image segmentation, and spectral super-resolution. We release AION-1 model variants ranging from 300 M to 3.1 B parameters. Beyond astronomy, AION-1 provides a scalable blueprint for multimodal scientific foundation models that can seamlessly integrate noisy, instrument-specific observations. All code, tokenizers, pretrained weights, and a lightweight evaluation suite are released under an open-source license.

astro-ph.IM↗

arXiv2024

AstroCLIP: A Cross-Modal Foundation Model for Galaxies

We present AstroCLIP, a single, versatile model that can embed both galaxy images and spectra into a shared, physically meaningful latent space. These embeddings can then be used - without any model fine-tuning - for a variety of downstream tasks including (1) accurate in-modality and cross-modality semantic similarity search, (2) photometric redshift estimation, (3) galaxy property estimation from both images and spectra, and (4) morphology classification. Our approach to implementing AstroCLIP consists of two parts. First, we embed galaxy images and spectra separately by pretraining separate transformer-based image and spectrum encoders in self-supervised settings. We then align the encoders using a contrastive loss. We apply our method to spectra from the Dark Energy Spectroscopic Instrument and images from its corresponding Legacy Imaging Survey. Overall, we find remarkable performance on all downstream tasks, even relative to supervised baselines. For example, for a task like photometric redshift prediction, we find similar performance to a specifically-trained ResNet18, and for additional tasks like physical property estimation (stellar mass, age, metallicity, and sSFR), we beat this supervised baseline by 19\% in terms of $R^2$. We also compare our results to a state-of-the-art self-supervised single-modal model for galaxy images, and find that our approach outperforms this benchmark by roughly a factor of two on photometric redshift estimation and physical property prediction in terms of $R^2$, while remaining roughly in-line in terms of morphology classification. Ultimately, our approach represents the first cross-modal self-supervised model for galaxies, and the first self-supervised transformer-based architectures for galaxy images and spectra.

astro-ph.IM↗

arXiv2023

SimBIG: Field-level Simulation-Based Inference of Galaxy Clustering

We present the first simulation-based inference (SBI) of cosmological parameters from field-level analysis of galaxy clustering. Standard galaxy clustering analyses rely on analyzing summary statistics, such as the power spectrum, $P_\ell$, with analytic models based on perturbation theory. Consequently, they do not fully exploit the non-linear and non-Gaussian features of the galaxy distribution. To address these limitations, we use the {\sc SimBIG} forward modelling framework to perform SBI using normalizing flows. We apply SimBIG to a subset of the BOSS CMASS galaxy sample using a convolutional neural network with stochastic weight averaging to perform massive data compression of the galaxy field. We infer constraints on $Ω_m = 0.267^{+0.033}_{-0.029}$ and $σ_8=0.762^{+0.036}_{-0.035}$. While our constraints on $Ω_m$ are in-line with standard $P_\ell$ analyses, those on $σ_8$ are $2.65\times$ tighter. Our analysis also provides constraints on the Hubble constant $H_0=64.5 \pm 3.8 \ {\rm km / s / Mpc}$ from galaxy clustering alone. This higher constraining power comes from additional non-Gaussian cosmological information, inaccessible with $P_\ell$. We demonstrate the robustness of our analysis by showcasing our ability to infer unbiased cosmological constraints from a series of test simulations that are constructed using different forward models than the one used in our training dataset. This work not only presents competitive cosmological constraints but also introduces novel methods for leveraging additional cosmological information in upcoming galaxy surveys like DESI, PFS, and Euclid.

astro-ph.CO↗

arXiv2022

Wavelet Moments for Cosmological Parameter Estimation

Extracting non-Gaussian information from the non-linear regime of structure formation is key to fully exploiting the rich data from upcoming cosmological surveys probing the large-scale structure of the universe. However, due to theoretical and computational complexities, this remains one of the main challenges in analyzing observational data. We present a set of summary statistics for cosmological matter fields based on 3D wavelets to tackle this challenge. These statistics are computed as the spatial average of the complex modulus of the 3D wavelet transform raised to a power $q$ and are therefore known as invariant wavelet moments. The 3D wavelets are constructed to be radially band-limited and separable on a spherical polar grid and come in three types: isotropic, oriented, and harmonic. In the Fisher forecast framework, we evaluate the performance of these summary statistics on matter fields from the Quijote suite, where they are shown to reach state-of-the-art parameter constraints on the base $Λ$CDM parameters, as well as the sum of neutrino masses. We show that we can improve constraints by a factor 5 to 10 in all parameters with respect to the power spectrum baseline.

astro-ph.CO↗

arXiv2021

Single frequency CMB B-mode inference with realistic foregrounds from a single training image

With a single training image and using wavelet phase harmonic augmentation, we present polarized Cosmic Microwave Background (CMB) foreground marginalization in a high-dimensional likelihood-free (Bayesian) framework. We demonstrate robust foreground removal using only a single frequency of simulated data for a BICEP-like sky patch. Using Moment Networks we estimate the pixel-level posterior probability for the underlying {E,B} signal and validate the statistical model with a quantile-type test using the estimated marginal posterior moments. The Moment Networks use a hierarchy of U-Net convolutional neural networks. This work validates such an approach in the most difficult limiting case: pixel-level, noise-free, highly non-Gaussian dust foregrounds with a single training image at a single frequency. For a real CMB experiment, a small number of representative sky patches would provide the training data required for full cosmological inference. These results enable robust likelihood-free, simulation-based parameter and model inference for primordial B-mode detection using observed CMB polarization data.

astro-ph.CO↗

arXiv2021

A new approach for the statistical denoising of Planck interstellar dust polarization data

Dust emission is the main foreground for cosmic microwave background (CMB) polarization. Its statistical characterization must be derived from the analysis of observational data because the precision required for a reliable component separation is far greater than what is currently achievable with physical models of the turbulent magnetized interstellar medium. This letter takes a significant step toward this goal by proposing a method that retrieves non-Gaussian statistical characteristics of dust emission from noisy Planck polarization observations at 353 GHz. We devised a statistical denoising method based on wavelet phase harmonics (WPH) statistics, which characterize the coherent structures in non-Gaussian random fields and define a generative model of the data. The method was validated on mock data combining a dust map from a magnetohydrodynamic simulation and Planck noise maps. The denoised map reproduces the true power spectrum down to scales where the noise power is an order of magnitude larger than that of the signal. It remains highly correlated to the true emission and retrieves some of its non-Gaussian properties. Applied to Planck data, the method provides a new approach to building a generative model of dust polarization that will characterize the full complexity of the dust emission. We also release PyWPH, a public Python package, to perform GPU-accelerated WPH analyses on images.

astro-ph.CO↗

arXiv2021

Statistical exploration of halo anisotropic clustering and intrinsic alignments with the mass-Peak Patch algorithm

The anisotropy or triaxiality of massive dark matter haloes largely defines the structure of the cosmic web, in particular the filaments that join the haloes together. Here we investigate such oriented correlations in mass-Peak Patch halo catalogues by using the initial strain tensor of spherical proto-halo regions to orient the haloes. To go beyond the spherically averaged two-point correlation function of haloes we use oriented stacks to compute oriented two-point correlations: we explicitly break isotropy by imposing a local frame set by the strain tensor of the reference halo before stacking neighbouring haloes. Beyond the exclusion zone of the reference halo, clustering is found to be strongly enhanced along the major direction of the strain tensor as expected. This anisotropic clustering of haloes along filaments is further quantified by using a spherical harmonics decomposition. Furthermore, we compute the evolution of cluster-scale halo principal directions relative to those of their neighbours and show that there are strong correlations extending up to very large scales. In order to provide calculations more suitable to observational confrontations, we also utilize 2D projected versions of some equivalent correlation functions. Finally, we show that the multipole structure of the mass-peak patch halo's anisotropic clustering can be qualitatively captured in an analytic treatment based on peak theory. Though highly informative, analytic evaluation involves extensive use of Monte Carlo methods, which is also what the simulated catalogue uses, taking into account as they do the adaptive nature of the mass-peak patch mass hierarchy and all non-local complexities associated with the exclusion of smaller haloes overlapping with larger ones: there is no substitute for the mass-Peak Patch simulation-based determination of oriented and anisotropic correlations.

astro-ph.CO↗

arXiv2020

Statistical description of dust polarized emission from the diffuse interstellar medium -- A RWST approach

The statistical characterization of the diffuse magnetized ISM and Galactic foregrounds to the CMB poses a major challenge. To account for their non-Gaussian statistics, we need a data analysis approach capable of efficiently quantifying statistical couplings across scales. This information is encoded in the data, but most of it is lost when using conventional tools, such as one-point statistics and power spectra. The wavelet scattering transform (WST), a low-variance statistical descriptor of non-Gaussian processes introduced in data science, opens a path towards this goal. We applied the WST to noise-free maps of dust polarized thermal emission computed from a numerical simulation of MHD turbulence. We analyzed normalized complex Stokes maps and maps of the polarization fraction and polarization angle. The WST yields a few thousand coefficients; some of them measure the amplitude of the signal at a given scale, and the others characterize the couplings between scales and orientations. The dependence on orientation can be fitted with the reduced WST (RWST), an angular model introduced in previous works. The RWST provides a statistical description of the polarization maps, quantifying their multiscale properties in terms of isotropic and anisotropic contributions. It allowed us to exhibit the dependence of the map structure on the orientation of the mean magnetic field and to quantify the non-Gaussianity of the data. We also used RWST coefficients, complemented by additional constraints, to generate random synthetic maps with similar statistics. Their agreement with the original maps demonstrates the comprehensiveness of the statistical description provided by the RWST. This work is a step forward in the analysis of observational data and the modeling of CMB foregrounds. We also release PyWST, a Python package to perform WST/RWST analyses at: https://github.com/bregaldo/pywst.

astro-ph.CO↗

arXiv2019

Automatic detection of Interplanetary Coronal Mass Ejections from in-situ data: a deep learning approach

Decades of studies have suggested several criteria to detect Interplanetary coronal mass ejections (ICME) in time series from in-situ spacecraft measurements. Among them the most common are an enhanced and smoothly rotating magnetic field, a low proton temperature and a low plasma beta. However, these features are not all observed for each ICME due to their strong variability. Visual detection is time-consuming and biased by the observer interpretation leading to non exhaustive, subjective and thus hardly reproducible catalogs. Using convolutional neural networks on sliding windows and peak detection, we provide a fast, automatic and multi-scale detection of ICMEs. The method has been tested on the in-situ data from WIND between 1997 and 2015 and on the 657 ICMEs that were recorded during this period. The method offers an unambiguous visual proxy of ICMEs that gives an interpretation of the data similar to what an expert observer would give. We found at a maximum 197 of the 232 ICMEs of the 2010-2015 period (recall 84 +-4.5 % including 90% of the ICMEs present in the lists of Nieves-Chinchilla et al. (2015) and Chi et al. (2016). The minimal number of False Positives was 25 out of 158 predicted ICMEs (precision 84+-2.6%). Although less accurate, the method also works with one or several missing input parameters. The method has the advantage of improving its performance by just increasing the amount of input data. The generality of the method paves the way for automatic detection of many different event signatures in spacecraft in-situ measurements.

astro-ph.SR↗