SearcharxivSearch

arXiv subjects

Jean-Eric Campagne

Publications and source records attributed to Jean-Eric Campagne.

17 recordsLinked to original sources

nufftcf: Fast Auto- and Cross-Correlation Function Estimation for Irregularly-Sampled Time Series via the Non-Uniform FFT

Estimating the auto-correlation function (ACF) and the cross-correlation function (CCF) of sampled series is a standard task across different physics fields, such as astronomy, and environmental sciences. We aim to provide an ACF/CCF estimator primarily designed for irregularly sampled series that is numerically consistent with established, well-validated kernel-weighted definitions, while scaling as O(n log n) rather than O(n^2). nufftcf evaluates the Wiener-Khinchin theorem for irregularly sampled data using the Non-Uniform Fast Fourier Transform (NUFFT), via the Flatiron Institute's FINUFFT library, and using Gaussian and rectangular kernel estimators. An O(n) two-pointer scan replaces the naive O(n^2) computation of the effective pair count that normalizes each lag bin. Direct, real-space implementations of the same estimators for small series and for reference, and dedicated classical-FFT estimators for regularly sampled data, are provided alongside the NUFFT implementation, all sharing a single calling convention. With synthetic time series, we validate nufftcf for ACF against pastas, a library known in groundwater time series analysis, and for CCF against pyZDCF, known in astronomical time series analysis. Benchmarks confirm the expected asymptotic scalings: O(n log n) for nufftcf versus O(n^2) for the pastas slotting technique, with nufftcf already advantageous at moderate series lengths thanks to its low (millisecond-scale) overhead. On regularly sampled data, nufftcf's dedicated FFT path further reduces both cost and overhead relative to its own NUFFT estimator. Beyond this cross-validation exercise, we further demonstrate nufftcf on a simulated ground-based stellar light curve combining a quasi-periodic rotation signal, correlated flicker noise, seasonal sampling gaps, and heteroscedastic measurement errors.

astro-ph.IM

Differentiable Forward Modeling for Efficient and Accurate Shear Inference

Forthcoming Stage-IV dark energy optical surveys, such as LSST, have the ambitious goal of measuring cosmological parameters at sub-percent precision. Realizing their full scientific potential requires very precise measurement of the cosmic shear signal and control of corresponding systematics. In this work, we present a modern implementation of the Bayesian shear inference framework in Schneider et al. (2015), in the case that the PSF and sky background are known. This framework automatically propagates the pixel-noise measurement error from each galaxy into the final shear estimate, and thus requires no external calibration to handle noise bias. As a first application of this new implementation, we infer the cosmic shear posterior from simulated images consisting of isolated exponential galaxies with semi-realistic noise levels. In this simplified scenario, we estimate the absolute multiplicative bias $|m|$ of our approach to be below $0.9 \times 10^{-3}\,[3σ]$ when the intrinsic distribution of galaxy properties is known, and below $1.3 \times 10^{-3}\,[3σ]$ when these distributions are inferred alongside shear. Additionally, we make progress towards the algorithm's computational feasibility in the context of modern wide-field surveys, where billions of galaxies must be processed, by leveraging differentiable forward models of galaxies, gradient-based samplers, and GPUs. Our final galaxy-fitting MCMC produces $300$ effective samples of galaxy properties in $0.45$ seconds per galaxy using a single A100 GPU. In the future, we seek to generalize our algorithm to handle selection, detection, and model shear biases so it can be applied to real survey data.

astro-ph.IM

Opportunities in AI/ML for the Rubin LSST Dark Energy Science Collaboration

The Vera C. Rubin Observatory's Legacy Survey of Space and Time (LSST) will produce unprecedented volumes of heterogeneous astronomical data (images, catalogs, and alerts) that challenge traditional analysis pipelines. The LSST Dark Energy Science Collaboration (DESC) aims to derive robust constraints on dark energy and dark matter from these data, requiring methods that are statistically powerful, scalable, and operationally reliable. Artificial intelligence and machine learning (AI/ML) are already embedded across DESC science workflows, from photometric redshifts and transient classification to weak lensing inference and cosmological simulations. Yet their utility for precision cosmology hinges on trustworthy uncertainty quantification, robustness to covariate shift and model misspecification, and reproducible integration within scientific pipelines. This white paper surveys the current landscape of AI/ML across DESC's primary cosmological probes and cross-cutting analyses, revealing that the same core methodologies and fundamental challenges recur across disparate science cases. Since progress on these cross-cutting challenges would benefit multiple probes simultaneously, we identify key methodological research priorities, including Bayesian inference at scale, physics-informed methods, validation frameworks, and active learning for discovery. With an eye on emerging techniques, we also explore the potential of the latest foundation model methodologies and LLM-driven agentic AI systems to reshape DESC workflows, provided their deployment is coupled with rigorous evaluation and governance. Finally, we discuss critical software, computing, data infrastructure, and human capital requirements for the successful deployment of these new methodologies, and consider associated risks and opportunities for broader coordination with external actors.

astro-ph.IM

Blind Deconvolution in Astronomy: How Does a Standalone U-Net Perform?

Aims: This study investigates whether a U-Net architecture can perform standalone end-to-end blind deconvolution of astronomical images without any prior knowledge of the Point Spread Function (PSF) or noise characteristics. Our goal is to evaluate its performance against the number of training images, classical Tikhonov deconvolution and to assess its generalization capability under varying seeing conditions and noise levels. Methods: Realistic astronomical observations are simulated using the GalSim toolkit, incorporating random transformations, PSF convolution (accounting for both optical and atmospheric effects), and Gaussian white noise. A U-Net model is trained using a Mean Square Error (MSE) loss function on datasets of varying sizes, up to 40,000 images of size 48x48 from the COSMOS Real Galaxy Dataset. Performance is evaluated using PSNR, SSIM, and cosine similarity metrics, with the latter employed in a two-model framework to assess solution stability. Results: The U-Net model demonstrates effectiveness in blind deconvolution, with performance improving consistently as the training dataset size increases, saturating beyond 5,000 images. Cosine similarity analysis reveals convergence between independently trained models, indicating stable solutions. Remarkably, the U-Net outperforms the oracle-like Tikhonov method in challenging conditions (low PSNR/medium SSIM). The model also generalizes well to unseen seeing and noise conditions, although optimal performance is achieved when training parameters include validation conditions. Experiments on synthetic $C^α$ images further support the hypothesis that the U-Net learns a geometry-adaptive harmonic basis, akin to sparse representations observed in denoising tasks. These results align with recent mathematical insights into its adaptive learning capabilities.

astro-ph.IM

Galaxy Imaging with Generative Models: Insights from a Two-Models Framework

Generative models have recently revolutionized image generation tasks across diverse domains, including galaxy image synthesis. This study investigates the statistical learning and consistency of three generative models: light-weight-gan (a GAN-based model), Glow (a Normalizing Flow-based model), and a diffusion model based on a U-Net denoiser, all trained on non-overlapping subsets of the SDSS dataset of 64x64 grayscale images. While all models produce visually realistic images with well-preserved morphological variable distributions, we focus on their ability to learn and generalize the underlying data distribution. The diffusion model shows a transition from memorization to generalization as the dataset size increases, confirming previous findings. Smaller datasets lead to overfitting, while larger datasets enable novel sample generation, supported by the denoising process's theoretical basis. For the flow-based model, we propose an "inversion test" leveraging its bijective nature. Similarly, the GAN-based model achieves comparable morphological consistency but lacks bijectivity. We then introduce a "discriminator test", which shows successful learning for larger datasets but poorer confidence with smaller ones. Across all models, dataset sizes below O(100,000) pose challenges to learning. Along our experiments, the "two-models" framework enables robust evaluations, highlighting both the potential and limitations of these models. These findings provide valuable insights into statistical learning in generative modeling, with applications certainly extending beyond galaxy image generation.

astro-ph.IM

Denoising: from classical methods to deep CNNs

This paper aims to explore the evolution of image denoising in a pedagological way. We briefly review classical methods such as Fourier analysis and wavelet bases, highlighting the challenges they faced until the emergence of neural networks, notably the U-Net, in the 2010s. The remarkable performance of these networks has been demonstrated in studies such as Kadkhodaie et al. (2024). They exhibit adaptability to various image types, including those with fixed regularity, facial images, and bedroom scenes, achieving optimal results and biased towards geometry-adaptive harmonic basis. The introduction of score diffusion has played a crucial role in image generation. In this context, denoising becomes essential as it facilitates the estimation of probability density scores. We discuss the prerequisites for genuine learning of probability densities, offering insights that extend from mathematical research to the implications of universal structures.

cs.CV

JAX-COSMO: An End-to-End Differentiable and GPU Accelerated Cosmology Library

We present jax-cosmo, a library for automatically differentiable cosmological theory calculations. It uses the JAX library, which has created a new coding ecosystem, especially in probabilistic programming. As well as batch acceleration, just-in-time compilation, and automatic optimization of code for different hardware modalities (CPU, GPU, TPU), JAX exposes an automatic differentiation (autodiff) mechanism. Thanks to autodiff, jax-cosmo gives access to the derivatives of cosmological likelihoods with respect to any of their parameters, and thus enables a range of powerful Bayesian inference algorithms, otherwise impractical in cosmology, such as Hamiltonian Monte Carlo and Variational Inference. In its initial release, jax-cosmo implements background evolution, linear and non-linear power spectra (using halofit or the Eisenstein and Hu transfer function), as well as angular power spectra with the Limber approximation for galaxy and weak lensing probes, all differentiable with respect to the cosmological parameters and their other inputs. We illustrate how autodiff can be a game-changer for common tasks involving Fisher matrix computations, or full posterior inference with gradient-based techniques. In particular, we show how Fisher matrices are now fast, exact, no longer require any fine tuning, and are themselves differentiable. Finally, using a Dark Energy Survey Year 1 3x2pt analysis as a benchmark, we demonstrate how jax-cosmo can be combined with Probabilistic Programming Languages to perform posterior inference with state-of-the-art algorithms including a No U-Turn Sampler, Automatic Differentiation Variational Inference,and Neural Transport HMC. We further demonstrate that Normalizing Flows using Neural Transport are a promising methodology for model validation in the early stages of analysis.

astro-ph.CO

Predicting regrowth of low-grade gliomas after radiotherapy

Diffuse low grade gliomas are invasive and incurable brain tumours that inevitably transform into higher grade ones. A classical treatment to delay this transition is radiotherapy (RT). Following RT, the tumour gradually shrinks during a period of typically 6 months to 4 years before regrowing. To improve the patient's health-related quality of life and help clinicians build personalised follow-ups, one would benefit from predictions of the time during which the tumour is expected to decrease. The challenge is to provide a reliable estimate of this regrowth time shortly after RT (i.e. with few data), although patients react differently to the treatment. To this end, we analyse the tumour size dynamics from a batch of 20 high-quality longitudinal data, and propose a simple and robust analytical model, with just 4 parameters. From the study of their correlations, we build a statistical constraint that helps determine the regrowth time even for patients for which we have only a few measurements of the tumour size. We validate the procedure on the data and predict the regrowth time at the moment of the first MRI after RT, with precision of, typically, 6 months. Using virtual patients, we study whether some forecast is still possible just three months after RT. We obtain some reliable estimates of the regrowth time in 75\% of the cases, in particular for all "fast-responders". The remaining 25\% represent cases where the actual regrowth time is large and can be safely estimated with another measurement a year later. These results show the feasibility of making personalised predictions of the tumour regrowth time shortly after RT.

physics.med-ph

The LSST-DESC 3x2pt Tomography Optimization Challenge

This paper presents the results of the Rubin Observatory Dark Energy Science Collaboration (DESC) 3x2pt tomography challenge, which served as a first step toward optimizing the tomographic binning strategy for the main DESC analysis. The task of choosing an optimal tomographic binning scheme for a photometric survey is made particularly delicate in the context of a metacalibrated lensing catalogue, as only the photometry from the bands included in the metacalibration process (usually riz and potentially g) can be used in sample definition. The goal of the challenge was to collect and compare bin assignment strategies under various metrics of a standard 3x2pt cosmology analysis in a highly idealized setting to establish a baseline for realistically complex follow-up studies; in this preliminary study, we used two sets of cosmological simulations of galaxy redshifts and photometry under a simple noise model neglecting photometric outliers and variation in observing conditions, and contributed algorithms were provided with a representative and complete training set. We review and evaluate the entries to the challenge, finding that even from this limited photometry information, multiple algorithms can separate tomographic bins reasonably well, reaching figures-of-merit scores close to the attainable maximum. We further find that adding the g band to riz photometry improves metric performance by ~15% and that the optimal bin assignment strategy depends strongly on the science case: which figure-of-merit is to be optimized, and which observables (clustering, lensing, or both) are included.

astro-ph.IM

The Tianlai Dish Pathfinder Array: design, operation and performance of a prototype transit radio interferometer

The Tianlai Dish Pathfinder Array is a radio interferometer designed to test techniques for 21~cm intensity mapping in the post-reionization universe as a means for measuring large-scale cosmic structure. It performs drift scans of the sky at constant declination. We describe the design, calibration, noise level, and stability of this instrument based on the analysis of about $\sim 5 \%$ of 6,200 hours of on-sky observations through October, 2019. Beam pattern determinations using drones and the transit of bright sources are in good agreement, and compatible with electromagnetic simulations. Combining all the baselines, we make maps around bright sources and show that the array behaves as expected. A few hundred hours of observations at different declinations have been used to study the array geometry and pointing imperfections, as well as the instrument noise behaviour. We show that the system temperature is below 80~K for most feed antennas, and that noise fluctuations decrease as expected with integration time, at least up to a few hundred seconds. Analysis of long integrations, from 10 nights of observations of the North Celestial Pole, yielded visibilities with amplitudes of 20-30~mK, consistent with the expected signal from the NCP radio sky with $<10\,$mK precision for $1 ~\mathrm{MHz} \times 1~ \mathrm{min}$ binning. Hi-pass filtering the spectra to remove smooth spectrum signal yields a residual consistent with zero signal at the $0.5\,$mK level.

astro-ph.IM

Fink, a new generation of broker for the LSST community

Fink is a broker designed to enable science with large time-domain alert streams such as the one from the upcoming Vera C. Rubin Observatory Legacy Survey of Space and Time (LSST). It exhibits traditional astronomy broker features such as automatised ingestion, annotation, selection and redistribution of promising alerts for transient science. It is also designed to go beyond traditional broker features by providing real-time transient classification which is continuously improved by using state-of-the-art Deep Learning and Adaptive Learning techniques. These evolving added values will enable more accurate scientific output from LSST photometric data for diverse science cases while also leading to a higher incidence of new discoveries which shall accompany the evolution of the survey. In this paper we introduce Fink, its science motivation, architecture and current status including first science verification cases using the Zwicky Transient Facility alert stream.

astro-ph.IM

Adversarial training applied to Convolutional Neural Network for photometric redshift predictions

The use of Convolutional Neural Networks (CNN) to estimate the galaxy photometric redshift probability distribution by analysing the images in different wavelength bands has been developed in the recent years thanks to the rapid development of the Machine Learning (ML) ecosystem. Authors have set-up CNN architectures and studied their performances and some sources of systematics using standard methods of training and testing to ensure the generalisation power of their models. So far so good, but one piece was missing : does the model generalisation power is well measured? The present article shows clearly that very small image perturbations can fool the model completely and opens the Pandora's box of \textit{adversarial} attack. Among the different techniques and scenarios, we have chosen to use the Fast Sign Gradient one-step Method and its Projected Gradient Descent iterative extension as adversarial generator tool kit. However, as unlikely as it may seem these adversarial samples which fool not only a single model, reveal a weakness both of the model and the classical training. A revisited algorithm is shown and applied by injecting a fraction of adversarial samples during the training phase. Numerical experiments have been conducted using a specific CNN model for illustration although our study could be applied to other models - not only CNN ones - and in other contexts - not only redshift measurements - as it deals with the complexity of the boundary decision surface.

astro-ph.IM

Core Cosmology Library: Precision Cosmological Predictions for LSST

The Core Cosmology Library (CCL) provides routines to compute basic cosmological observables to a high degree of accuracy, which have been verified with an extensive suite of validation tests. Predictions are provided for many cosmological quantities, including distances, angular power spectra, correlation functions, halo bias and the halo mass function through state-of-the-art modeling prescriptions available in the literature. Fiducial specifications for the expected galaxy distributions for the Large Synoptic Survey Telescope (LSST) are also included, together with the capability of computing redshift distributions for a user-defined photometric redshift model. A rigorous validation procedure, based on comparisons between CCL and independent software packages, allows us to establish a well-defined numerical accuracy for each predicted quantity. As a result, predictions for correlation functions of galaxy clustering, galaxy-galaxy lensing and cosmic shear are demonstrated to be within a fraction of the expected statistical uncertainty of the observables for the models and in the range of scales of interest to LSST. CCL is an open source software package written in C, with a python interface and publicly available at https://github.com/LSSTDESC/CCL.

astro-ph.CO

Progress in the Construction and Testing of the Tianlai Radio Interferometers

The Tianlai Pathfinder is designed to demonstrate the feasibility of using a wide field of view radio interferometers to map the density of neutral hydrogen in the Universe after the Epoch of Reionizaton. This approach, called 21~cm intensity-mapping, promises an inexpensive means for surveying the large-scale structure of the cosmos. The Tianlai Pathfinder presently consists of an array of three, 15~m $\times$ 40~m cylinder telescopes and an array of sixteen, 6~m diameter dish antennas located in a radio-quiet part of western China. The two types of arrays were chosen to determine the advantages and disadvantages of each approach. The primary goal of the Pathfinder is to make 3D maps by surveying neutral hydrogen over large areas of the sky %$20,000 {\rm deg}^2$ in two different redshift ranges: first at $1.03 > z > 0.78$ ($700 - 800$~MHz) and later at $0.21 > z > 0.12$ ($1170 - 1270$~MHz). The most significant challenge to $21$~cm intensity-mapping is the removal of strong foreground radiation that dwarfs the cosmological signal. It requires exquisite knowledge of the instrumental response, i.e. calibration. In this paper, we provide an overview of the status of the Pathfinder and discuss the details of some of the analysis that we have carried out to measure the beam function of both arrays. We compare electromagnetic simulations of the arrays to measurements, discuss measurements of the gain and phase stability of the instrument, and provide a brief overview of the data processing pipeline.

astro-ph.IM

Sky reconstruction for the Tianlai cylinder array

In this paper, we apply our sky map reconstruction method for transit type interferometers to the Tianlai cylinder array. The method is based on the spherical harmonic decomposition, and can be applied to cylindrical array as well as dish arrays and we can compute the instrument response, synthesised beam, transfer function and the noise power spectrum. We consider cylinder arrays with feed spacing larger than half wavelength, and as expected, we find that the arrays with regular spacing have grating lobes which produce spurious images in the reconstructed maps. We show that this problem can be overcome, using arrays with different feed spacing on each cylinder. We present the reconstructed maps, and study the performance in terms of noise power spectrum, transfer function and beams for both regular and irregular feed spacing configurations.

astro-ph.IM

Sky reconstruction from transit visibilities: PAON-4 and Tianlai Dish Array

The spherical harmonics $m$-mode decomposition is a powerful sky map reconstruction method suitable for radio interferometers operating in transit mode. It can be applied to various configurations, including dish arrays and cylinders. We describe the computation of the instrument response function, the point spread function (PSF), transfer function, the noise covariance matrix and noise power spectrum. The analysis in this paper is focused on dish arrays operating in transit mode. We show that arrays with regular spacing have more pronounced side lobes as well as structures in their noise power spectrum, compared to arrays with irregular spacing, specially in the north-south direction. A good knowledge of the noise power spectrum $C^{\mathrm{noise}}(\ell)$ is essential for intensity mapping experiments as non uniform $C^{\mathrm{noise}}(\ell)$ is a potential problem for the measurement of the HI power spectrum. Different configurations have been studied to optimise the PAON-4 and Tianlai dish array layouts. We present their expected performance and their sensitivities to the 21-cm emission of the Milky Way and local extragalactic HI clumps

astro-ph.IM

BAORadio: A digital pipeline for radio interferometry and 21 cm mapping of large scale structures

3D mapping of matter distribution in the universe through the 21 cm radio emission of atomic hydrogen HI is a complementary approach to optical surveys for the study of the Large Scale Structures, in particular for measuring the BAO (Baryon Acoustic Oscillation) scale up to redshifts z < 3, and therefore constraining dark energy parameters. We propose a novel method to map the HI mass distribution in three dimensions in radio, without detecting or identifying individual compact sources. This method would require an instrument with a large instantaneous bandwidth (> 100 MHz) and high sensitivity, while a rather modest angular resolution (~ 10 arcmin) should be sufficient. These requirements can be met by a dense interferometric array or a phased array (FPA) in the focal plane of a large primary reflector, representing a total collecting area of a few thousand square meters with few hundred simultaneous beams covering a 20 to 100 square degrees field of view. We describe the development and qualification of an electronic and data processing system for digital radio interferometry and beam forming suitable for such instruments with several hundred receiver elements.

astro-ph.CO