arXiv subjects

James K. Ruffle

Publications and source records attributed to James K. Ruffle.

4 recordsLinked to original sources

arXiv2026

Fairboard: a quantitative framework for equity assessment of healthcare models

Despite there now being more than 1,000 FDA-authorised AI medical devices, formal equity assessments -- whether model performance is uniform across patient subgroups -- are rare. Here, we evaluate the equity of 18 open-source brain tumour segmentation models across 648 glioma patients from two independent datasets (n = 11,664 model inferences) along distinct univariate, Bayesian multivariate, spatial, and representational dimensions. We find that patient identity consistently explains more performance variance than model choice, with clinical factors, including molecular diagnosis, tumour grade, and extent of resection, predicting segmentation accuracy more strongly than model architecture. A voxel-wise spatial meta-analysis identifies neuroanatomically localised biases that are compartment-specific yet often consistent across models. Within a high-dimensional latent space of lesion masks and clinic-demographic features, model performance clusters significantly, indicating that the patient feature space contains axes of algorithmic vulnerability. Although newer models tend toward greater equity, none provide a formal fairness guarantee. Lastly, we release Fairboard, an open-source, no-code dashboard that lowers barriers to equitable model monitoring in medical imaging.

cs.LG↗

arXiv2025

Individualized prescriptive inference in ischaemic stroke

The gold standard in the treatment of ischaemic stroke is set by evidence from randomized controlled trials, based on simple descriptions of presumptively homogeneous populations. Yet the manifest complexity of the brain's functional, connective, and vascular architectures introduces heterogeneities that violate the underlying statistical premisses, potentially leading to substantial errors at both individual and population levels. The counterfactual nature of interventional inference renders quantifying the impact of this defect difficult. Here we conduct a comprehensive series of semi-synthetic, biologically plausible, virtual interventional trials across 100M+ distinct simulations. We generate empirically grounded virtual trial data from large-scale meta-analytic connective, functional, genetic expression, and receptor distribution data, with high-resolution maps of 4K+ acute ischaemic lesions. Within each trial, we estimate treatment effects using models varying in complexity, in the presence of increasingly confounded outcomes and noisy treatment responses. Individualized prescriptions inferred from simple models, fitted to unconfounded data, were less accurate than those from complex models, fitted to confounded data. Our results indicate that complex modelling with richly represented lesion data is critical to individualized prescriptive inference in ischaemic stroke.

q-bio.QM↗

arXiv2025

Generalizable automated ischaemic stroke lesion segmentation with vision transformers

Ischaemic stroke, a leading cause of death and disability, critically relies on neuroimaging for characterising the anatomical pattern of injury. Diffusion-weighted imaging (DWI) provides the highest expressivity in ischemic stroke but poses substantial challenges for automated lesion segmentation: susceptibility artefacts, morphological heterogeneity, age-related comorbidities, time-dependent signal dynamics, instrumental variability, and limited labelled data. Current U-Net-based models therefore underperform, a problem accentuated by inadequate evaluation metrics that focus on mean performance, neglecting anatomical, subpopulation, and acquisition-dependent variability. Here, we present a high-performance DWI lesion segmentation tool addressing these challenges through optimized vision transformer-based architectures, integration of 3563 annotated lesions from multi-site data, and algorithmic enhancements, achieving state-of-the-art results. We further propose a novel evaluative framework assessing model fidelity, equity (across demographics and lesion subtypes), anatomical precision, and robustness to instrumental variability, promoting clinical and research utility. This work advances stroke imaging by reconciling model expressivity with domain-specific challenges and redefining performance benchmarks to prioritize equity and generalizability, critical for personalized medicine and mechanistic research.

eess.IV↗

arXiv2022

Focal and Connectomic Mapping of Transiently Disrupted Brain Function

The distributed nature of the neural substrate, and the difficulty of establishing necessity from correlative data, combine to render the mapping of brain function a far harder task than it seems. Methods capable of combining connective anatomical information with focal disruption of function are needed to disambiguate local from global neural dependence, and critical from merely coincidental activity. Here we present a comprehensive framework for focal and connective spatial inference based on sparse disruptive data, and demonstrate its application in the context of transient direct electrical stimulation of the human medial frontal wall during the pre-surgical evaluation of patients with focal epilepsy. Our framework formalizes voxel-wise mass-univariate inference on sparsely sampled data within the statistical parametric mapping framework, encompassing the analysis of distributed maps defined by any criterion of connectivity. Applied to the medial frontal wall, this transient dysconnectome approach reveals marked discrepancies between local and distributed associations of major categories of motor and sensory behaviour, revealing differentiation by remote connectivity to which purely local analysis is blind. Our framework enables disruptive mapping of the human brain based on sparsely sampled data with minimal spatial assumptions, good statistical efficiency, flexible model formulation, and explicit comparison of local and distributed effects.

q-bio.NC↗