arXiv subjects

Maximilian Baum

Publications and source records attributed to Maximilian Baum.

3 recordsLinked to original sources

arXiv2026

Recovering manifold structure in LLM responses through a joint Euclidean mirror

Understanding the behavior of black-box large language models and determining effective means of comparing their performance is a key task in modern machine learning. We consider how large language models respond to a specific query by analyzing how the distributions of responses vary over different values of tuning parameters. We frame this problem in a general mathematical setting, treating the mapping from model parameters to response distributions as a structured family of probability measures, endowed with a geometry via a dissimilarity measure. We show how dissimilarities between response distributions can be represented in low-dimensional Euclidean space through a joint Euclidean mirror surface encoding the underlying geometry, which permits both qualitative and quantitative analysis of large language models and provides insight into predicting response distributions for different values of tuning parameters. We propose an estimation procedure for the underlying joint Euclidean mirror based on observed samples from the response distributions, and we prove its asymptotic properties. Additionally, we propose a statistically consistent procedure to infer the value of an unknown model parameter based on samples from the corresponding response distribution and the estimated joint Euclidean mirror. In an experimental setting with large language models, we find that changes in different tuning parameter values correspond to distinct directions in the embedding space, making it possible to estimate the tuning parameters that were used to generate a given response.

stat.ME↗

arXiv2025

Statistical hypothesis testing for differences between layers in dynamic multiplex networks

With the emergence of dynamic multiplex networks, corresponding to graphs where multiple types of edges evolve over time, a key inferential task is to determine whether the layers associated with different edge types differ in their connectivity. In this work, we introduce a hypothesis testing framework, under a latent space network model, for assessing whether the layers share a common latent representation. The method we propose extends previous literature related to the problem of pairwise testing for random graphs and enables global testing of differences between layers in multiplex graphs. While we introduce the method as a test for differences between layers, it can easily be adapted to test for differences between time points. We construct a test statistic based on a spectral embedding of an unfolded representation of the graph adjacency matrices and demonstrate its ability to detect differences across layers in the asymptotic regime where the number of nodes in each graph tends to infinity. The finite-sample properties of the test are empirically demonstrated by assessing its performance on both simulated data and a biological dataset describing the neural activity of larval Drosophila.

stat.ME↗

arXiv2024

Doubly unfolded adjacency spectral embedding of dynamic multiplex graphs

Many real-world networks evolve dynamically over time and present different types of connections between nodes, often called layers. In this work, we propose a latent position model for these objects, called the dynamic multiplex random dot product graph (DMPRDPG), which uses an inner product between layer-specific and time-specific latent representations of the nodes to obtain edge probabilities. We further introduce a computationally efficient spectral embedding method for estimation of DMPRDPG parameters, called doubly unfolded adjacency spectral embedding (DUASE). The DUASE estimates are proved to be both consistent and asymptotically normally distributed. A key strength of our method is the encoding of time-specific node representations and layer-specific effects in separate latent spaces, which allows the model to capture complex behaviors while maintaining relatively low dimensionality. The embedding method we propose can also be efficiently used for subsequent inference tasks. In particular, we highlight the use of the ISOMAP algorithm in conjunction with DUASE as a way to efficiently capture trends and global changepoints within a network, and the use of DUASE for graph clustering. Applications on real-world networks describing geopolitical interactions between countries and financial news reporting demonstrate practical uses of our method.

stat.ME↗