arXiv subjects

Yashar Hezaveh

Publications and source records attributed to Yashar Hezaveh.

At least 37 records · Page 2Linked to original sources

arXiv2025

Solving Bayesian inverse problems with diffusion priors and off-policy RL

This paper presents a practical application of Relative Trajectory Balance (RTB), a recently introduced off-policy reinforcement learning (RL) objective that can asymptotically solve Bayesian inverse problems optimally. We extend the original work by using RTB to train conditional diffusion model posteriors from pretrained unconditional priors for challenging linear and non-linear inverse problems in vision, and science. We use the objective alongside techniques such as off-policy backtracking exploration to improve training. Importantly, our results show that existing training-free diffusion posterior methods struggle to perform effective posterior inference in latent space due to inherent biases.

cs.LG↗

arXiv2025

Tackling the Problem of Distributional Shifts: Correcting Misspecified, High-Dimensional Data-Driven Priors for Inverse Problems

Bayesian inference for inverse problems hinges critically on the choice of priors. In the absence of specific prior information, population-level distributions can serve as effective priors for parameters of interest. With the advent of machine learning, the use of data-driven population-level distributions (encoded, e.g., in a trained deep neural network) as priors is emerging as an appealing alternative to simple parametric priors in a variety of inverse problems. However, in many astrophysical applications, it is often difficult or even impossible to acquire independent and identically distributed samples from the underlying data-generating process of interest to train these models. In these cases, corrupted data or a surrogate, e.g. a simulator, is often used to produce training samples, meaning that there is a risk of obtaining misspecified priors. This, in turn, can bias the inferred posteriors in ways that are difficult to quantify, which limits the potential applicability of these models in real-world scenarios. In this work, we propose addressing this issue by iteratively updating the population-level distributions by retraining the model with posterior samples from different sets of observations, and we showcase the potential of this method on the problem of background image reconstruction in strong gravitational lensing when score-based models are used as data-driven priors. We show that, starting from a misspecified prior distribution, the updated distribution becomes progressively closer to the underlying population-level distribution, and the resulting posterior samples exhibit reduced bias after several updates.

astro-ph.IM↗

arXiv2025

Causal Discovery in Astrophysics: Unraveling Supermassive Black Hole and Galaxy Coevolution

Correlation does not imply causation, but patterns of statistical association between variables can be exploited to infer a causal structure (even with purely observational data) with the burgeoning field of causal discovery. As a purely observational science, astrophysics has much to gain by exploiting these new methods. The supermassive black hole (SMBH)--galaxy interaction has long been constrained by observed scaling relations, that is low-scatter correlations between variables such as SMBH mass and the central velocity dispersion of stars in a host galaxy's bulge. This study, using advanced causal discovery techniques and an up-to-date dataset, reveals a causal link between galaxy properties and dynamically-measured SMBH masses. We apply a score-based Bayesian framework to compute the exact conditional probabilities of every causal structure that could possibly describe our galaxy sample. With the exact posterior distribution, we determine the most likely causal structures and notice a probable causal reversal when separating galaxies by morphology. In elliptical galaxies, bulge properties (built from major mergers) tend to influence SMBH growth, while in spiral galaxies, SMBHs are seen to affect host galaxy properties, potentially through feedback in gas-rich environments. For spiral galaxies, SMBHs progressively quench star formation, whereas in elliptical galaxies, quenching is complete, and the causal connection has reversed. Our findings support theoretical models of hierarchical assembly of galaxies and active galactic nuclei feedback regulating galaxy evolution. Our study suggests the potentiality for further exploration of causal links in astrophysical and cosmological scaling relations, as well as any other observational science.

astro-ph.GA↗

arXiv2025

IRIS: A Bayesian Approach for Image Reconstruction in Radio Interferometry with expressive Score-Based priors

Inferring sky surface brightness distributions from noisy interferometric data in a principled statistical framework has been a key challenge in radio astronomy. In this work, we introduce Imaging for Radio Interferometry with Score-based models (IRIS). We use score-based models trained on optical images of galaxies as an expressive prior in combination with a Gaussian likelihood in the uv-space to infer images of protoplanetary disks from visibility data of the DSHARP survey conducted by ALMA. We demonstrate the advantages of this framework compared with traditional radio interferometry imaging algorithms, showing that it produces plausible posterior samples despite the use of a misspecified galaxy prior. Through coverage testing on simulations, we empirically evaluate the accuracy of this approach to generate calibrated posterior samples.

astro-ph.IM↗

arXiv2024

Gravitational-Wave Parameter Estimation in non-Gaussian noise using Score-Based Likelihood Characterization

Gravitational-wave (GW) parameter estimation typically assumes that instrumental noise is Gaussian and stationary. Obvious departures from this idealization are typically handled on a case-by-case basis, e.g., through bespoke procedures to ``clean'' non-Gaussian noise transients (glitches), as was famously the case for the GW170817 neutron-star binary. Although effective, manipulating the data in this way can introduce biases in the inference of key astrophysical properties, like binary precession, and compound in unpredictable ways when combining multiple observations; alternative procedures free of the same biases, like joint inference of noise and signal properties, have so far proved too computationally expensive to execute at scale. Here we take a different approach: rather than explicitly modeling individual non-Gaussianities to then apply the traditional GW likelihood, we seek to learn the true distribution of instrumental noise without presuming Gaussianity and stationarity in the first place. Assuming only noise additivity, we employ score-based diffusion models to learn an empirical noise distribution directly from detector data and then combine it with a deterministic waveform model to provide an unbiased estimate of the likelihood function. We validate the method by performing inference on a subset of GW parameters from 400 mock observations, containing real LIGO noise from either the Livingston or Hanford detectors. We show that the proposed method can recover the true parameters even in the presence of loud glitches, and that the inference is unbiased over a population of signals without applying any cleaning to the data. This work provides a promising avenue for extracting unbiased source properties in future GW observations over the coming decade.

astro-ph.IM↗

arXiv2024

Beyond Causal Discovery for Astronomy: Learning Meaningful Representations with Independent Component Analysis

We present the first steps toward applying causal representation learning to astronomy. Following up on previous work that introduced causal discovery to the field for the first time, here we solve a long standing conundrum by identifying the direction of the causal relation between supermassive black hole (SMBH) mass and their host galaxy properties. This leverages a score-based causal discovery approach with an exact posterior calculation. Causal relations between SMBHs and their host galaxies are further clarified by Independent Component Analysis (ICA). The astrophysical problem we focus on is one of the most important open issues in the field and one that has not seen a definitive resolution in decades. We consider the space of six physical properties of galaxies, subdivided by morphology: elliptical, lenticular, and spiral, plus SMBH mass. We calculate an exact posterior over the space of directed acyclic graphs for these variables based on a flat prior and the Bayesian Gaussian equivalent score. The nature of the causal relation between galaxy properties and SMBH mass is found to vary smoothly with morphology, with galaxy properties determining SMBH mass in ellipticals and vice versa in spirals. This settles a long-standing debate and is compatible with our theoretical understanding of galaxy evolution. ICA reveals a decreasing number of meaningful Independent Components (ICs) from ellipticals and lenticular to spiral. Moreover, we find that only one IC correlates with SMBH mass in spirals while multiple ones do in ellipticals, further confirming our finding that SMBH mass causes galaxy properties in spirals, but the reverse holds in ellipticals.

astro-ph.GA↗

arXiv2024

Inpainting Galaxy Counts onto N-Body Simulations over Multiple Cosmologies and Astrophysics

Cosmological hydrodynamical simulations, while the current state-of-the art methodology for generating theoretical predictions for the large scale structures of the Universe, are among the most expensive simulation tools, requiring upwards of 100 millions CPU hours per simulation. N-body simulations, which exclusively model dark matter and its purely gravitational interactions, represent a less resource-intensive alternative, however, they do not model galaxies, and as such cannot directly be compared to observations. In this study, we use conditional score-based models to learn a mapping from N-body to hydrodynamical simulations, specifically from dark matter density fields to the observable distribution of galaxies. We demonstrate that our model is capable of generating galaxy fields statistically consistent with hydrodynamical simulations at a fraction of the computational cost, and demonstrate our emulator is significantly more precise than traditional emulators over the scales 0.36 $h\ \text{Mpc}^{-1}$ $\leq$ k $\leq$ 3.88 $h\ \text{Mpc}^{-1}$.

astro-ph.CO↗

arXiv2024

Variable Star Light Curves in Koopman Space

We present the first application of data-driven techniques for dynamical system analysis based on Koopman theory to variable stars. We focus on light curves of RRLyrae type variables, in the Galactic globular cluster $ω$ Centauri. Light curves are thus summarized by a handful of complex eigenvalues, corresponding to oscillatory or fading dynamical modes. We find that variable stars of the RRc subclass can be summarized in terms of fewer ($\approx 8$) eigenvalues, while RRab need comparatively more ($\approx 12$). This result can be leveraged for classification and reflects the simpler structure of RRc light curves. We then consider variable stars displaying secular variations due to the Tseraskaya-Blazhko effect and find a change in relevant eigenvalues with time, with possible implications for the physical interpretation of the effect.

astro-ph.SR↗

arXiv2024

Caustics: A Python Package for Accelerated Strong Gravitational Lensing Simulations

Gravitational lensing is the deflection of light rays due to the gravity of intervening masses. This phenomenon is observed in a variety of scales and configurations, involving any non-uniform mass such as planets, stars, galaxies, clusters of galaxies, and even the large scale structure of the universe. Strong lensing occurs when the distortions are significant and multiple images of the background source are observed. The lens objects must align on the sky of order ~1 arcsecond for galaxy-galaxy lensing, or 10's of arcseonds for cluster-galaxy lensing. As the discovery of lens systems has grown to the low thousands, these systems have become pivotal for precision measurements and addressing critical questions in astrophysics. Notably, they facilitate the measurement of the Universe's expansion rate, dark matter, supernovae, quasars, and the first stars among other topics. With future surveys expected to discover hundreds of thousands of lensing systems, the modelling and simulation of such systems must occur at orders of magnitude larger scale then ever before. Here we present `caustics`, a Python package designed to handle the extensive computational demands of modeling such a vast number of lensing systems.

astro-ph.IM↗

arXiv2023

Improving Gradient-guided Nested Sampling for Posterior Inference

We present a performant, general-purpose gradient-guided nested sampling algorithm, ${\tt GGNS}$, combining the state of the art in differentiable programming, Hamiltonian slice sampling, clustering, mode separation, dynamic nested sampling, and parallelization. This unique combination allows ${\tt GGNS}$ to scale well with dimensionality and perform competitively on a variety of synthetic and real-world problems. We also show the potential of combining nested sampling with generative flow networks to obtain large amounts of high-quality samples from the posterior distribution. This combination leads to faster mode discovery and more accurate estimates of the partition function.

cs.LG↗

arXiv2023

Echoes in the Noise: Posterior Samples of Faint Galaxy Surface Brightness Profiles with Score-Based Likelihoods and Priors

Examining the detailed structure of galaxy populations provides valuable insights into their formation and evolution mechanisms. Significant barriers to such analysis are the non-trivial noise properties of real astronomical images and the point spread function (PSF) which blurs structure. Here we present a framework which combines recent advances in score-based likelihood characterization and diffusion model priors to perform a Bayesian analysis of image deconvolution. The method, when applied to minimally processed \emph{Hubble Space Telescope} (\emph{HST}) data, recovers structures which have otherwise only become visible in next-generation \emph{James Webb Space Telescope} (\emph{JWST}) imaging.

astro-ph.IM↗

arXiv2023

Active learning meets fractal decision boundaries: a cautionary tale from the Sitnikov three-body problem

Chaotic systems such as the gravitational N-body problem are ubiquitous in astronomy. Machine learning (ML) is increasingly deployed to predict the evolution of such systems, e.g. with the goal of speeding up simulations. Strategies such as active Learning (AL) are a natural choice to optimize ML training. Here we showcase an AL failure when predicting the stability of the Sitnikov three-body problem, the simplest case of N-body problem displaying chaotic behavior. We link this failure to the fractal nature of our classification problem's decision boundary. This is a potential pitfall in optimizing large sets of N-body simulations via AL in the context of star cluster physics, galactic dynamics, or cosmology.

astro-ph.GA↗

arXiv2023

Bayesian Imaging for Radio Interferometry with Score-Based Priors

The inverse imaging task in radio interferometry is a key limiting factor to retrieving Bayesian uncertainties in radio astronomy in a computationally effective manner. We use a score-based prior derived from optical images of galaxies to recover images of protoplanetary disks from the DSHARP survey. We demonstrate that our method produces plausible posterior samples despite the misspecified galaxy prior. We show that our approach produces results which are competitive with existing radio interferometry imaging algorithms.

astro-ph.IM↗

arXiv2023

Learning an Effective Evolution Equation for Particle-Mesh Simulations Across Cosmologies

Particle-mesh simulations trade small-scale accuracy for speed compared to traditional, computationally expensive N-body codes in cosmological simulations. In this work, we show how a data-driven model could be used to learn an effective evolution equation for the particles, by correcting the errors of the particle-mesh potential incurred on small scales during simulations. We find that our learnt correction yields evolution equations that generalize well to new, unseen initial conditions and cosmologies. We further demonstrate that the resulting corrected maps can be used in a simulation-based inference framework to yield an unbiased inference of cosmological parameters. The model, a network implemented in Fourier space, is exclusively trained on the particle positions and velocities.

astro-ph.CO↗

arXiv2023

The search for the lost attractor

N-body systems characterized by inverse square attractive forces may display a self similar collapse known as the gravo-thermal catastrophe. In star clusters, collapse is halted by binary stars, and a large fraction of Milky Way clusters may have already reached this phase. It has been speculated -- with guidance from simulations -- that macroscopic variables such as central density and velocity dispersion are governed post-collapse by an effective, low-dimensional system of ODEs. It is still hard to distinguish chaotic, low dimensional motion, from high dimensional stochastic noise. Here we apply three machine learning tools to state-of-the-art dynamical simulations to constrain the post collapse dynamics: topological data analysis (TDA) on a lag embedding of the relevant time series, Sparse Identification of Nonlinear Dynamics (SINDY), and Tests of Accuracy with Random Points (TARP).

astro-ph.GA↗

arXiv2023

Interpretable machine learning for finding intermediate-mass black holes

Definitive evidence that globular clusters (GCs) host intermediate-mass black holes (IMBHs) is elusive. Machine learning (ML) models trained on GC simulations can in principle predict IMBH host candidates based on observable features. This approach has two limitations: first, an accurate ML model is expected to be a black box due to complexity; second, despite our efforts to realistically simulate GCs, the simulation physics or initial conditions may fail to fully reflect reality. Therefore our training data may be biased, leading to a failure in generalization on observational data. Both the first issue -- explainability/interpretability -- and the second -- out of distribution generalization and fairness -- are active areas of research in ML. Here we employ techniques from these fields to address them: we use the anchors method to explain an XGBoost classifier; we also independently train a natively interpretable model using Certifiably Optimal RulE ListS (CORELS). The resulting model has a clear physical meaning, but loses some performance with respect to XGBoost. We evaluate potential candidates in real data based not only on classifier predictions but also on their similarity to the training data, measured by the likelihood of a kernel density estimation model. This measures the realism of our simulated data and mitigates the risk that our models may produce biased predictions by working in extrapolation. We apply our classifiers to real GCs, obtaining a predicted classification, a measure of the confidence of the prediction, an out-of-distribution flag, a local rule explaining the prediction of XGBoost and a global rule from CORELS.

astro-ph.GA↗

arXiv2023

Searching for strong gravitational lenses

Strong gravitational lenses provide unique laboratories for cosmological and astrophysical investigations, but they must first be discovered - a task that can be met with significant contamination by other astrophysical objects and asterisms. Here we review strong lens searches, covering various sources (quasars, galaxies, supernovae, FRBs, GRBs, and GWs), lenses (early- and late-type galaxies, groups, and clusters), datasets (imaging, spectra, and lightcurves), and wavelengths. We first present the physical characteristics of the lens and source populations, highlighting relevant details for constructing targeted searches. Search techniques are described based on the main lensing feature that is required for the technique to work, namely one of: (i) an associated magnification, (ii) multiple spatially-resolved images, (iii) multiple redshifts, or (iv) a non-zero time delay between images. To use the current lens samples for science, and for the design of future searches, we list several selection biases that exist due to these discovery techniques. We conclude by discussing the future of lens searches in upcoming surveys and the new population of lenses that will be discovered.

astro-ph.GA↗

arXiv2023

Time Delay Cosmography with a Neural Ratio Estimator

We explore the use of a Neural Ratio Estimator (NRE) to determine the Hubble constant ($H_0$) in the context of time delay cosmography. Assuming a Singular Isothermal Ellipsoid (SIE) mass profile for the deflector, we simulate time delay measurements, image position measurements, and modeled lensing parameters. We train the NRE to output the posterior distribution of $H_0$ given the time delay measurements, the relative Fermat potentials (calculated from the modeled parameters and the measured image positions), the deflector redshift, and the source redshift. We compare the accuracy and precision of the NRE with traditional explicit likelihood methods in the limit where the latter is tractable and reliable, using Gaussian noise to emulate measurement uncertainties in the input parameters. The NRE posteriors track the ones from the conventional method and, while they show a slight tendency to overestimate uncertainties, they can be combined in a population inference without bias.

astro-ph.IM↗