Searcharxiv⌕ Search

arXiv · 2611.14541

Bayesian Evidence Fusion for Capability Tracking-A Simulation Study and Historical CI Pilot

Abstract

SaaS capability assessments can become stale between questionnaires, while delivery telemetry offers incomplete and correlated evidence. Continuous assessment and Bayesian delivery analysis already exist, leaving uncertainty about how biased surveys and missing observations should influence capability estimates.We implement SAAS-MATURITY-TWIN, an anchored Gaussian state model that jointly filters capability proxies and persistent survey offsets. Source covariance prevents correlated observations from being counted independently. Conditional uncertainty supports forecasting and budgeted intervention screening, with action effects estimated from randomized synthetic cohorts. Ten seeds generate forty paired worlds spanning reference observations, extensive missingness, informative missingness, and increased noise. Reference latent root mean squared error is 0.1261, compared with 0.1452 for a tuned moving average; nominal ninety percent intervals cover 90.3 percent. Improved state recovery produces only small incident forecasting differences. Adaptive conformal inference and an adapted conformal PID controller are evaluated separately for observed telemetry, where noise shifts expose calibration limitations. A licensed TravisTorrent pilot evaluates build prediction on 13 074 held out builds from 224 projects. Logistic regression achieves a Brier score of 0.1289, close to random forests. These results support reproducible methodological testing, but do not establish real organizational maturity, intervention effectiveness, or production readiness. Independent calibration and longitudinal validation remain necessary.

Explore related subjects

Keep this discovery

Explore connections, maps & timelines

BibTeXRIS

Taimoor Ahmad. 2026-10-19. Bayesian Evidence Fusion for Capability Tracking-A Simulation Study and Historical CI Pilot. https://searcharxiv.com/abs/2611.14541

Citations retain the original authors and DOI and include this site’s record URL. If this discovery service contributed to your research, you can also cite Searcharxiv by Indiciae: BibTeX · RIS.

KEEP EXPLORING

Related papers

A Bayesian Framework for Latent Compliance Modeling in Cluster Randomized Trials with One-Sided Noncompliance

In pragmatic cluster randomized controlled trials (PCRCTs), healthcare providers are randomized, but intervention delivery and patient receipt may vary after assignment. In many PCRCTs, cluster-level implementation is measured using continuous implementation metrics, while individual compliance is recorded as a binary indicator. Standard complier average causal effect (CACE) estimands focus on individual-level compliance and do not account for heterogeneity in implementation across clusters. When intervention uptake is shaped by both cluster- and individual-level processes, it is of scientific interest to characterize how effects vary across these sources of compliance. We propose a Bayesian framework for PCRCTs with one-sided binary noncompliance at the individual level and one-sided partial compliance at the cluster level. The method uses a latent mixture model to summarize heterogeneity in cluster-level implementation based on baseline characteristics and treatment-arm implementation measures, and links these latent implementation strata to individual compliance and outcomes through a joint model. Because individual compliance and treatment-defined implementation measures are observed only under treatment assignment, the model imputes these quantities for control clusters and individuals assigned to control. The framework enables estimation of finite- and super-population intent-to-treat (ITT) and CACE estimands, both marginally and within latent implementation strata. We apply the method to the METRIcAL trial, a pragmatic cluster randomized study evaluating a personalized music intervention for nursing home residents with dementia. The analysis illustrates how accounting for implementation heterogeneity and individual compliance can provide insights beyond standard ITT analyses.

stat.AP↗

Copula-Based Synthetic Data Generation: A Use-Inspired Perspective on Trade-offs

The generation of synthetic data offers a promising way to address challenges related to data scarcity and privacy concerns. While many approaches have been developed, tabular synthetic data generation methods often require complex models and extensive training data, while lacking interpretability. In this work, we investigate versatile probabilistic approaches using copulas, and leverage in particular the Gaussian Mixture Copula Model, to model the joint distribution of multivariate data, with a main focus on moderate-dimensional data sets. Taking a use-inspired perspective, we examine key trade-offs inherent to synthetic data evaluation, spanning fidelity, utility, and privacy, and demonstrate that copula-based methods achieve a sound balance across all three dimensions while remaining interpretable and providing an explicit probabilistic model. We illustrate and highlight the potential benefits of the method on a test case focusing on systematic missing values in a cardiovascular risk calculator and develop specific evaluation metrics for this application.

stat.AP↗

JALE: A new Python toolbox for coordinate-based neuroimaging meta-analysis using activation likelihood estimation

Coordinate-based neuroimaging meta-analysis using activation likelihood estimation (ALE) is commonly used to synthesize reported results of functional or structural magnetic resonance imaging studies. We here present JALE, a new, open-source Python package for conducting ALE meta-analyses. Besides computing standard ALE main effects and contrast analyses, this toolbox implements several novel analytical approaches including new options for thresholding (threshold-free cluster enhancement statistics, significance threshold prediction) as well as sensitivity and cluster analyses that were only available as in-house scripts in the past. The purpose of this paper is to provide an integrated conceptual foundation of recent developments in the ALE meta-analysis framework, with a particular focus on novel methodological implementations that can be executed in a straightforward and standardized manner using the new JALE toolbox.

stat.AP↗