SearcharxivSearch

arXiv subjects

Sebastian Springer

Publications and source records attributed to Sebastian Springer.

5 recordsLinked to original sources

Unsupervised Domain Shift Detection with Interpretable Subspace Attribution

We developed a tool for detecting domain shifts, namely subtle differences in the probability distributions of datasets. We identify these shifts using an algorithm designed to detect localised density anomalies in high-dimensional feature spaces. If an anomaly is present, we then identify the feature subspace in which the anomaly is most pronounced. This allows us to trace the domain shift to a small set of features, making the shift interpretable. Moreover, we provide a protocol for compensating domain shifts by extracting, from two unlabelled datasets, subsets of samples with no detectable residual distributional difference. We validate the framework on controlled 20-dimensional benchmarks with known ground truth, recovering both broad and localized shifts together with their supporting feature subspaces. We then apply it to healthy electrocardiogram (ECG) recordings represented by 782 features. In age- and sex-matched cohort comparisons differing in measurement-device composition, the method detects device-induced shifts, extracts representative subsets enriched in the imbalanced device components, and identifies ECG features associated with the acquisition contrast. These results suggest that density-shift detection and subspace attribution provide a practical framework for uncovering hidden cohort biases before downstream modelling.

stat.ML

Detecting Localized Density Anomalies in Multivariate Data via Coin-Flip Statistics

Detecting localized differences between two samples is a central task in scientific data analysis, required for the identification of signal events, regime changes, or model mismatch. We introduce EagleEye, a method that pinpoints local over- and under-densities in multivariate feature spaces. EagleEye assigns each point an anomaly score by encoding its ordered k-nearest-neighbour list as a binary membership sequence and testing whether the cumulative number of successes in this sequence is consistent with a binomial (coin-flipping) null model. In the presence of a genuine local anomaly, neighbours will preferentially belong to one of the two datasts, yielding an excess of ``successes'' relative to the binomial null model. These local, pointwise detections are consolidated into interpretable anomaly sets through a deterministic refinement procedure that can also estimate the irreducible background and local density anomaly purity. We demonstrate EagleEye's efficacy in three scenarios. We first consider an artificial data example with known localized over- and under-densities. Second, we demonstrate how EagleEye may be used for new physics searches at particle collider experiments in the presence of systematic background modelling differences. Finally, we conduct a climate analysis study that reveals localized changes in spatiotemporal temperature-pattern recurrence.

stat.ML

Agnostic detection of large-scale weather patterns in the northern hemisphere: from blockings to teleconnections

Detecting recurrent weather patterns and understanding the transitions between such regimes are key to advancing our knowledge on the low-frequency variability of the atmosphere and have important implications in terms of weather and climate-related risks. We adapt an analysis pipeline inspired by Markov State Modelling and detect in an unsupervised manner the dominant winter mid-latitude Northern Hemisphere weather patterns in the Atlantic and Pacific sectors. The daily 500 hPa geopotential height fields are first classified in $\sim 200$ microstates. The weather dynamics is then represented in the basis of these microstates and the slowest decaying modes are identified from the spectral properties of the transition probability matrix. These modes are defined on the basis of the nonlinear dynamical processes of the system and not as tentative metastable states as often done in Markov state analysis. In the Atlantic and Pacific sectors slow relaxation processes are mainly related to transitions between blocked regimes and zonal flow. We also find strong evidence of a dynamical regime associated with the simultaneous Atlantic-Pacific blocking. When the analysis is performed in a broader geographical region of the Atlantic sector, we discover that the slowest relaxation modes of the system are associated with transitions between dynamical regimes that resemble teleconnection patterns like the North Atlantic Oscillation and weather regimes like the Scandinavian and Greenland blocking, yet have a much stronger dynamical foundation than classical methods based e.g. on EOF analysis. Our method clarifies that, as a result of the lack of a time-scale separation in the atmospheric variability of the mid-latitudes, there is no clear-cut way to represent the atmospheric dynamics in terms of few, well-defined modes of variability.

physics.ao-ph

Reconstruction and segmentation from sparse sequential X-ray measurements of wood logs

In industrial applications, it is common to scan objects on a moving conveyor belt. If slice-wise 2D computed tomography (CT) measurements of the moving object are obtained we call it a sequential scanning geometry. In this case, each slice on its own does not carry sufficient information to reconstruct a useful tomographic image. Thus, here we propose the use of a Dimension reduced Kalman Filter to accumulate information between slices and allow for sufficiently accurate reconstructions for further assessment of the object. Additionally, we propose to use an unsupervised clustering approach known as Density Peak Advanced, to perform a segmentation and spot density anomalies in the internal structure of the reconstructed objects. We evaluate the method in a proof of concept study for the application of wood log scanning for the industrial sawing process, where the goal is to spot anomalies within the wood log to allow for optimal sawing patterns. Reconstruction and segmentation quality are evaluated from experimental measurement data for various scenarios of severely undersampled X-measurements. Results show clearly that an improvement in reconstruction quality can be obtained by employing the Dimension reduced Kalman Filter allowing to robustly obtain the segmented logs.

eess.SP

Hierarchical Bayesian propulsion power models for marine vessels

Assessing the magnitude of fuel consumption of marine traffic is a challenging task. The consumption can be reduced by the ways the vessels are operated, to achieve both improved cost efficiency and reduced CO2 emissions. Mathematical models for predicting ships' consumption are in a central role in both of these tasks. Nowadays, many ships are equipped with data collection systems, which enable data-based calibration of the consumption models. Typically this calibration procedure is carried out independently for each particular ship, using only data collected from the ship in question. In this paper, we demonstrate a hierarchical Bayesian modeling approach, where we fit a single model over many vessels, with the assumption that the parameters of vessels of same type and similar characteristics (e.g. vessel size) are likely close to each other. The benefits of such an approach are two-fold; 1) we can borrow information about parameters that are not well informed by the vessel-specific data using data from similar ships, and 2) we can use the final hierarchical model to predict the behavior of a vessel from which we don't have any data, based only on its characteristics. In this paper, we discuss the basic concept and present a first simple version of the model. We apply the Stan statistical modeling tool for the model fitting and use real data from 64 cruise ships collected via the widely used commercial Eniram platform. By using Bayesian statistical methods we obtain uncertainties for the model predictions, too. The prediction accuracy of the model is compared to an existing data-free modeling approach.

stat.AP