arXiv subjects

Philipp Frank

Publications and source records attributed to Philipp Frank.

At least 37 records · Page 2Linked to original sources

arXiv2024

Electric Field Reconstruction with Information Field Theory

Reconstructing the electric field from the measured voltages in an antenna, unfolding the antenna response, comes with several problems. Due to the noisiness of the signal it is often necessary to disregard part of the bandwidth of the antenna. It is also not guaranteed, that this system of equations can be inverted at all. In any case, the noise of the measurement will be converted into noise on the electric field. This could be solved by Bayesian inference, however, the electric field is continuous, which would lead to an infinite-dimensional latent space. Information field theory (IFT) has been developed to deal with this problem and allow for Bayesian reasoning on fields. It provides a theoretical backbone and effective tools to approach the inference as a discrete problem in the continuum limit, taking the continuous nature of fields into account. We will present a first working signal model that can be used with IFT-based inference algorithms, which can successfully reconstruct the electric field. The model is based on the current understanding of air shower emission physics, modelling geomagnetic and charge-excess emission and their respective polarisation and spectra separately. Since Bayesian inference provides the posterior distribution, this method also gives an estimate on the uncertainty of the measured field. The performance of this method will be demonstrated with Monte-Carlo simulations of air shower radio signals.

physics.data-an↗

arXiv2024

J-UBIK: The JAX-accelerated Universal Bayesian Imaging Kit

Many advances in astronomy and astrophysics originate from accurate images of the sky emission across multiple wavelengths. This often requires reconstructing spatially and spectrally correlated signals detected from multiple instruments. To facilitate the high-fidelity imaging of these signals, we introduce the universal Bayesian imaging kit (UBIK). Specifically, we present J-UBIK, a flexible and modular implementation leveraging the JAX-accelerated NIFTy.re software as its backend. J-UBIK streamlines the implementation of the key Bayesian inference components, providing for all the necessary steps of Bayesian imaging pipelines. First, it provides adaptable prior models for different sky realizations. Second, it includes likelihood models tailored to specific instruments. So far, the package includes three instruments: Chandra and eROSITA for X-ray observations, and the James Webb Space Telescope (JWST) for the near- and mid-infrared. The aim is to expand this set in the future. Third, these models can be integrated with various inference and optimization schemes, such as maximum a posteriori estimation and variational inference. Explicit demos show how to integrate the individual modules into a full analysis pipeline. Overall, J-UBIK enables efficient generation of high-fidelity images via Bayesian pipelines that can be tailored to specific research objectives.

astro-ph.IM↗

arXiv2024

Towards a Field Based Bayesian Evidence Inference from Nested Sampling Data

Nested sampling (NS) is a stochastic method for computing the log-evidence of a Bayesian problem. It relies on stochastic estimates of prior volumes enclosed by likelihood contours, which limits the accuracy of the log-evidence calculation. We propose to transform the prior volume estimation into a Bayesian inference problem, which allows us to incorporate a smoothness assumption for likelihood-prior volume relations. As a result, we aim to increase the accuracy of the volume estimates and thus improve the overall log-evidence calculation using NS. The method presented works as a post-processing step for NS and provides posterior samples of the likelihood-prior-volume relation, from which the log-evidence can be calculated. We demonstrate an implementation of the algorithm and compare its results with plain NS on two synthetic datasets for which the underlying evidence is known. We find a significant improvement in accuracy for runs with less than one hundred active samples in NS, but are prone to numerical problems beyond this point.

physics.comp-ph↗

arXiv2024

Disentangling the Faraday rotation sky

Magnetic fields permeate the diffuse interstellar medium (ISM) of the Milky Way, and are essential to explain the dynamical evolution and current shape of the Galaxy. Magnetic fields reveal themselves via their influence on the surrounding matter, and as such are notoriously hard to measure independently of other tracers. In this work, we attempt to disentangle an all sky map of the line-of-sight parallel component of the Galactic magnetic field from the Faraday effect, utilizing several tracers of the Galactic thermal electron density. Additionally, we aim to produce a Galactic electron dispersion measure map and quantify several tracers of the structure of the ionized medium of the Milky Way. We rely on compiled catalogs of extragalactic Faraday rotation measures and Galactic pulsar dispersion measures, a well as data on bremsstrahlung and the hydrogen $α$ spectral line to trace the ionized medium of the Milky Way. We present the first full sky map of the line-of-sight averaged Galactic magnetic field. Within this map, we find LoS parallel and LoS-averaged magnetic field strengths of up to 4 $μ$G, with an all-sky root-mean-square of 1.1 $μ$G, which is consistent with previous local measurements and global magnetic field models. Additionally, we produce a detailed electron dispersion measure map, which agrees with already existing parametric models at high latitudes, but suffers from systematic effects in the disk. Further analysis of our results with regard to the 3D structure of $n_{th}$ reveals that it follows a Kolmogorov-type turbulence for most of the sky. From the reconstructed dispersion measure and emission measure maps we construct several tracers of variability of $n_{th}$ along the LoS.

astro-ph.GA↗

arXiv2024

Re-Envisioning Numerical Information Field Theory (NIFTy.re): A Library for Gaussian Processes and Variational Inference

Imaging is the process of transforming noisy, incomplete data into a space that humans can interpret. NIFTy is a Bayesian framework for imaging and has already successfully been applied to many fields in astrophysics. Previous design decisions held the performance and the development of methods in NIFTy back. We present a rewrite of NIFTy, coined NIFTy.re, which reworks the modeling principle, extends the inference strategies, and outsources much of the heavy lifting to JAX. The rewrite dramatically accelerates models written in NIFTy, lays the foundation for new types of inference machineries, improves maintainability, and enables interoperability between NIFTy and the JAX machine learning ecosystem.

astro-ph.IM↗

arXiv2024

fast-resolve: Fast Bayesian Radio Interferometric Imaging

Context: Interferometric imaging is algorithmically and computationally challenging as there is no unique inversion from the measurement data back to the sky maps, and the datasets can be very large. Many imaging methods already exist, but most of them focus either on the accuracy or the computational aspect. Aims: This paper aims to reduce the computational complexity of the Bayesian imaging algorithm resolve, enabling the application of Bayesian imaging for larger datasets. Methods: By combining computational shortcuts of the CLEAN algorithm with the Bayesian imaging algorithm resolve we developed an accurate and fast imaging algorithm which we name fast-resolve. Results: We validate the accuracy of the presented fast-resolve algorithm by comparing it with results from resolve on VLA Cygnus A data. Furthermore, we demonstrate the computational advantages of fast-resolve on a large MeerKAT ESO 137-006 dataset which is computationally out of reach for resolve. Conclusions: The presented algorithm is significantly faster than previous Bayesian imaging algorithms, broadening the applicability of Bayesian interferometric imaging. Specifically for the single channel VLA Cygnus A datasets fast-resolve is about $144$ times faster than resolve. For the MeerKAT dataset with multiple channels the computational speedup of fast-resolve is even larger.

astro-ph.IM↗

arXiv2024

Non-parametric Bayesian reconstruction of Galactic magnetic fields using Information Field Theory: The inclusion of line-of-sight information in ultra-high energy cosmic ray backtracking

(abridged) Ultra-high energy cosmic rays (UHECRs) are extremely energetic charged particles with energies surpassing $10^{18}$ eV. Their sources remain elusive, obscured by deflections caused by the Galactic magnetic field (GMF). This challenge is further complicated by our limited understanding of the three-dimensional structure of the GMF, as current GMF observations consist primarily of quantities integrated along the line-of-sight (LOS). Nevertheless, data from upcoming stellar polarisation surveys along with Gaia's stellar parallax data are expected to yield local GMF measurements.. In this work, we employ methods of Bayesian statistical inference in order to sample the posterior distribution of the GMF within part of the Galaxy. By assuming a known rigidity and arrival direction of an UHECR, we backtrack its trajectory through various GMF configurations drawn from the posterior distribution. Our objective is to rigorously evaluate our algorithm's performance in scenarios that closely mirror the setting of expected future applications. In pursuit of this, we condition the posterior to synthetic integrated LOS measurements of the GMF, in addition to synthetic local POS-component measurements. In this proof of concept work, we assume the ground truth to be a magnetic field produced by a dynamo simulation of the Galactic ISM. Our results demonstrate that for all locations of the observed arrival direction on the POS, our algorithm is able to substantially update our knowledge on the original arrival direction of UHECRs with rigidity $E/Z = 5 \times 10^{19}$ eV, even in the case of complete absence of LOS information. If integrated data is included in the inference, then the regions of the celestial sphere where the maximum error occurs diminishes greatly. Even in those regions the maximum error is diminished by a factor of about $3$ in the specific setting studied.

astro-ph.HE↗

arXiv2024

A parsec-scale Galactic 3D dust map out to 1.25 kpc from the Sun

High-resolution 3D maps of interstellar dust are critical for probing the underlying physics shaping the structure of the interstellar medium, and for foreground correction of astrophysical observations affected by dust. We aim to construct a new 3D map of the spatial distribution of interstellar dust extinction out to a distance of 1.25 kpc from the Sun. We leveraged distance and extinction estimates to 54 million nearby stars derived from the Gaia BP/RP spectra. Using the stellar distance and extinction information, we inferred the spatial distribution of dust extinction. We modeled the logarithmic dust extinction with a Gaussian process in a spherical coordinate system via iterative charted refinement and a correlation kernel inferred in previous work. In total, our posterior has over 661 million degrees of freedom. We probed the posterior distribution using the variational inference method MGVI. Our 3D dust map has an angular resolution of up to 14' (Nside = 256), and we achieve parsec-scale distance resolution, sampling the dust in 516 logarithmically spaced distance bins spanning 69 pc to 1250 pc. We generated 12 samples from the variational posterior of the 3D dust distribution and release the samples alongside the mean 3D dust map and its corresponding uncertainty. Our map resolves the internal structure of hundreds of molecular clouds in the solar neighborhood and will be broadly useful for studies of star formation, Galactic structure, and young stellar populations. It is available for download in a variety of coordinate systems online and can also be queried via the publicly available dustmaps Python package.

astro-ph.GA↗

arXiv2024

Attention to Entropic Communication

The concept of attention, numerical weights that emphasize the importance of particular data, has proven to be very relevant in artificial intelligence. Relative entropy (RE, aka Kullback-Leibler divergence) plays a central role in communication theory. Here we combine these concepts, attention and RE. RE guides optimal encoding of messages in bandwidth-limited communication as well as optimal message decoding via the maximum entropy principle (MEP). In the coding scenario, RE can be derived from four requirements, namely being analytical, local, proper, and calibrated. Weighted RE, used for attention steering in communications, turns out to be improper. To see how proper attention communication can emerge, we analyze a scenario of a message sender who wants to ensure that the receiver of the message can perform well-informed actions. If the receiver decodes the message using the MEP, the sender only needs to know the receiver's utility function to inform optimally, but not the receiver's initial knowledge state. In case only the curvature of the utility function maxima are known, it becomes desirable to accurately communicate an attention function, in this case a by this curvature weighted and re-normalized probability function. Entropic attention communication is here proposed as the desired generalization of entropic communication that permits weighting while being proper, thereby aiding the design of optimal communication protocols in technical applications and helping to understand human communication. For example, our analysis shows how to derive the level of cooperation expected under misaligned interests of otherwise honest communication partners.

cs.IT↗

arXiv2023

Inferring Evidence from Nested Sampling Data via Information Field Theory

Nested sampling provides an estimate of the evidence of a Bayesian inference problem via probing the likelihood as a function of the enclosed prior volume. However, the lack of precise values of the enclosed prior mass of the samples introduces probing noise, which can hamper high-accuracy determinations of the evidence values as estimated from the likelihood-prior-volume function. We introduce an approach based on information field theory, a framework for non-parametric function reconstruction from data, that infers the likelihood-prior-volume function by exploiting its smoothness and thereby aims to improve the evidence calculation. Our method provides posterior samples of the likelihood-prior-volume function that translate into a quantification of the remaining sampling noise for the evidence estimate, or for any other quantity derived from the likelihood-prior-volume function.

physics.comp-ph↗

arXiv2023

First spatio-spectral Bayesian imaging of SN1006 in X-ray

Supernovae are an important source of energy in the interstellar medium. Young remnants of supernovae have a peak emission in the X-ray region, making them interesting objects for X-ray observations. In particular, the supernova remnant SN1006 is of great interest due to its historical record, proximity and brightness. It has therefore been studied by several X-ray telescopes. Improving the X-ray imaging of this and other remnants is important but challenging as it requires to address a spatially varying instrument response in order to achieve a high signal-to-noise ratio. Here, we use Chandra observations to demonstrate the capabilities of Bayesian image reconstruction using information field theory. Our objective is to reconstruct denoised, deconvolved and spatio-spectral resolved images from X-ray observations and to decompose the emission into different morphologies, namely diffuse and point-like. Further, we aim to fuse data from different detectors and pointings into a mosaic and quantify the uncertainty of our result. Utilizing prior knowledge on the spatial and spectral correlation structure of the two components, diffuse emission and point sources, the presented method allows the effective decomposition of the signal into these. In order to accelerate the imaging process, we introduce a multi-step approach, in which the spatial reconstruction obtained for a single energy range is used to derive an informed starting point for the full spatio-spectral reconstruction. The method is applied to 11 Chandra observations of SN1006 from 2008 and 2012, providing a detailed, denoised and decomposed view of the remnant. In particular, the separated view of the diffuse emission should provide new insights into its complex small-scale structures in the center of the remnant and at the shock front profiles.

astro-ph.HE↗

arXiv2023

Multi-Component Imaging of the Fermi Gamma-ray Sky in the Spatio-spectral Domain

We perform two distinct spatio-spectral reconstructions of the gamma-ray sky in the range of 0.56-316 GeV based on Fermi Large Area Telescope (LAT) data. Both describe the sky brightness to be composed of a diffuse-emission and a point-source component. The first model requires minimal assumptions and provides a template-free reconstruction as a reference. It makes use of spatial and spectral correlations to distinguish between the different components. The second model is physics-informed and further differentiates between diffuse emission of hadronic and leptonic origin. For this, we assume parametric, but spatially varying energy spectra to distinguish between the processes and use thermal Galactic dust observations to indicate the preferred sites of hadronic interactions. To account for instrumental effects we model the point-spread, the energy dispersion, and the exposure of the telescope throughout the observation. The reconstruction problem is formulated as a Bayesian inference task, that is solved by variational inference. We show decompositions of the Gamma-ray flux into diffuse and point-like emissions, and of the diffuse emissions into multiple physically motivated components. The diffuse decomposition provides an unprecedented view of the Galactic leptonic diffuse emission. It shows the Fermi bubbles and their spectral variations in high fidelity and other areas exhibiting strong cosmic ray electron contents, such as a thick disk in the inner Galaxy and outflow regions. Furthermore, we report a hard spectrum gamma ray arc in the northern outer bubble co-spatial with the reported X-ray arc by the eROSITA collaboration. All our spatio-spectral sky reconstructions and their uncertainty quantification are publicly available.

astro-ph.HE↗

arXiv2023

Quantum Measurement and Objective Classical Reality

We explore quantum measurement in the context of Everettian unitary quantum mechanics and construct an explicit unitary measurement procedure. We propose the existence of prior correlated states that enable this procedure to work and therefore argue that correlation is a resource that is consumed when measurements take place. It is also argued that a network of such measurements establishes a stable objective classical reality.

quant-ph↗

arXiv2022

Causal, Bayesian, & Non-parametric Modeling of the SARS-CoV-2 Viral Load Distribution vs. Patient's Age

The viral load of patients infected with SARS-CoV-2 varies on logarithmic scales and possibly with age. Controversial claims have been made in the literature regarding whether the viral load distribution actually depends on the age of the patients. Such a dependence would have implications for the COVID-19 spreading mechanism, the age-dependent immune system reaction, and thus for policymaking. We hereby develop a method to analyze viral-load distribution data as a function of the patients' age within a flexible, non-parametric, hierarchical, Bayesian, and causal model. The causal nature of the developed reconstruction additionally allows to test for bias in the data. This could be due to, e.g., bias in patient-testing and data collection or systematic errors in the measurement of the viral load. We perform these tests by calculating the Bayesian evidence for each implied possible causal direction. The possibility of testing for bias in data collection and identifying causal directions can be very useful in other contexts as well. For this reason we make our model freely available. When applied to publicly available age and SARS-CoV-2 viral load data, we find a statistically significant increase in the viral load with age, but only for one of the two analyzed datasets. If we consider this dataset, and based on the current understanding of viral load's impact on patients' infectivity, we expect a non-negligible difference in the infectivity of different age groups. This difference is nonetheless too small to justify considering any age group as noninfectious.

stat.AP↗

arXiv2022

Sparse Kernel Gaussian Processes through Iterative Charted Refinement (ICR)

Gaussian Processes (GPs) are highly expressive, probabilistic models. A major limitation is their computational complexity. Naively, exact GP inference requires $\mathcal{O}(N^3)$ computations with $N$ denoting the number of modeled points. Current approaches to overcome this limitation either rely on sparse, structured or stochastic representations of data or kernel respectively and usually involve nested optimizations to evaluate a GP. We present a new, generative method named Iterative Charted Refinement (ICR) to model GPs on nearly arbitrarily spaced points in $\mathcal{O}(N)$ time for decaying kernels without nested optimizations. ICR represents long- as well as short-range correlations by combining views of the modeled locations at varying resolutions with a user-provided coordinate chart. In our experiment with points whose spacings vary over two orders of magnitude, ICR's accuracy is comparable to state-of-the-art GP methods. ICR outperforms existing methods in terms of computational speed by one order of magnitude on the CPU and GPU and has already been successfully applied to model a GP with $122$ billion parameters.

cs.LG↗

arXiv2022

Variable structures in M87* from space, time and frequency resolved interferometry

Observing the dynamics of compact astrophysical objects provides insights into their inner workings, thereby probing physics under extreme conditions. The immediate vicinity of an active supermassive black hole with its event horizon, photon ring, accretion disk, and relativistic jets is a perfect place to study general relativity and magneto-hydrodynamics. The observations of M87* with Very Long Baseline Interferometry (VLBI) by the Event Horizon Telescope (EHT) allows to investigate its dynamical processes on time scales of days. Compared to regular radio interferometers, VLBI networks typically have fewer antennas and low signal to noise ratios (SNRs). Furthermore, the source is variable, prohibiting integration over time to improve SNR. Here, we present an imaging algorithm that copes with the data scarcity and temporal evolution, while providing uncertainty quantification. Our algorithm views the imaging task as a Bayesian inference problem of a time-varying brightness, exploits the correlation structure in time, and reconstructs a ${2+1+1}$ dimensional time-variable and spectrally resolved image at once. We apply this method to the EHT observation of M87* and validate our approach on synthetic data. The time- and frequency-resolved reconstruction of M87* confirms variable structures on the emission ring. The reconstruction indicates extended and time-variable emission structures outside the ring itself.

astro-ph.IM↗

arXiv2021

Probabilistic Autoencoder using Fisher Information

Neural Networks play a growing role in many science disciplines, including physics. Variational Autoencoders (VAEs) are neural networks that are able to represent the essential information of a high dimensional data set in a low dimensional latent space, which have a probabilistic interpretation. In particular the so-called encoder network, the first part of the VAE, which maps its input onto a position in latent space, additionally provides uncertainty information in terms of a variance around this position. In this work, an extension to the Autoencoder architecture is introduced, the FisherNet. In this architecture, the latent space uncertainty is not generated using an additional information channel in the encoder, but derived from the decoder, by means of the Fisher information metric. This architecture has advantages from a theoretical point of view as it provides a direct uncertainty quantification derived from the model, and also accounts for uncertainty cross-correlations. We can show experimentally that the FisherNet produces more accurate data reconstructions than a comparable VAE and its learning performance also apparently scales better with the number of latent space dimensions.

stat.ML↗

arXiv2021

Geometric variational inference

Efficiently accessing the information contained in non-linear and high dimensional probability distributions remains a core challenge in modern statistics. Traditionally, estimators that go beyond point estimates are either categorized as Variational Inference (VI) or Markov-Chain Monte-Carlo (MCMC) techniques. While MCMC methods that utilize the geometric properties of continuous probability distributions to increase their efficiency have been proposed, VI methods rarely use the geometry. This work aims to fill this gap and proposes geometric Variational Inference (geoVI), a method based on Riemannian geometry and the Fisher information metric. It is used to construct a coordinate transformation that relates the Riemannian manifold associated with the metric to Euclidean space. The distribution, expressed in the coordinate system induced by the transformation, takes a particularly simple form that allows for an accurate variational approximation by a normal distribution. Furthermore, the algorithmic structure allows for an efficient implementation of geoVI which is demonstrated on multiple examples, ranging from low-dimensional illustrative ones to non-linear, hierarchical Bayesian inverse problems in thousands of dimensions.

stat.ME↗