Searcharxiv⌕ Search

arXiv subjects

John A. D. Aston

Publications and source records attributed to John A. D. Aston.

At least 19 recordsLinked to original sources

A functional mixed-effects model for the joint analysis of amplitude and phase variations in function-valued traits

Quantitative genetics is the study of continuous traits and the statistical analysis of phenotypic variation, that is, the observable differences in physical traits among individuals within a population. If family relationships between individuals are known, phenotypic variation can be partitioned into genetic and environmental components. Some traits, such as growth trajectories, can be described as a function of a continuous index and are known as function-valued traits. However, function-valued traits from different individuals often vary not only in their shape (amplitude) but also in the speed at which the biological process develops (phase). In this work, we present and compare two approaches to account for amplitude and phase variations in estimating the additive genetic and environmental components. The first one follows from a conventional framework where warping functions remove phase variations, and then the aligned curves are analysed. The second approach adopts the perspective of looking at the aligned curve and the warping function as a joint functional object. In both cases, we propose a functional mixed-effects framework that uses functional principal components as the data-driven basis for genetically correlated data. The proposed procedure is applied to simulations and a real-case study of Tribolium castaneum growth trajectories.

stat.AP↗

A Nonparametric and Functional Wombling Methodology

Wombling methods, first introduced in 1951, have been widely applied to detect boundaries and variations across spatial domains, particularly in biological, public health and meteorological studies. Traditional applications focus on finite-dimensional observations, where significant changes in measurable traits indicate structural boundaries. In this work, wombling methodologies are extended to functional data, enabling the identification of spatial variation in infinite-dimensional settings. Proposed is a nonparametric approach that accommodates functional observations without imposing strict distributional assumptions. This methodology successfully captures complex spatial structures and discontinuities, demonstrating superior sensitivity and robustness compared to existing finite-dimensional techniques. This methodology is then applied to analyse regional epidemiological disparities between London and the rest of the UK, identifying key spatial boundaries in the shape of the first trajectory of Covid-19 incidence in 2020. Through extensive simulations and empirical validation, demonstrated is the method's effectiveness in uncovering meaningful spatial variations, with potential applications in a wide variety of fields.

stat.ME↗

Exploring Covid-19 Spatiotemporal Dynamics: Non-Euclidean Spatially Aware Functional Registration

When it came to Covid-19, timing was everything. This paper considers the spatiotemporal dynamics of the Covid-19 pandemic via a developed methodology of non-Euclidean spatially aware functional registration. In particular, the daily SARS-CoV-2 incidence in each of 380 local authorities in the UK from March to June 2020 is analysed to understand the phase variation of the waves when considered as curves. This is achieved by adapting a traditional registration method (that of local variation analysis) to account for the clear spatial dependencies in the data. This adapted methodology is shown via simulation studies to perform substantially better for the estimation of the registration functions than the non-spatial alternative. Moreover, it is found that the driving time between locations represents the spatial dependency in the Covid-19 data better than geographical distance. However, since driving time is non-Euclidean, the traditional spatial frameworks break down; to solve this, a methodology inspired by multidimensional scaling is developed to approximate the driving times by a Euclidean distance which enables the established theory to be applied. Finally, the resulting estimates of the registration/warping processes are analysed by taking functionals to understand the qualitatively observable earliness/lateness and sharpness/flatness of the Covid-19 waves quantitatively.

stat.AP↗

Symmetry: a General Structure in Nonparametric Regression

In this paper we present the framework of symmetry in nonparametric regression. This generalises the framework of covariate sparsity, where the regression function depends only on at most $s < d$ of the covariates, which is a special case of translation symmetry with linear orbits. In general this extends to other types of functions that capture lower dimensional behavior even when these structures are non-linear. We show both that known symmetries of regression functions can be exploited to give similarly faster rates, and that unknown symmetries with Lipschitz actions can be estimated sufficiently quickly to obtain the same rates. This is done by explicit constructions of partial symmetrisation operators that are then applied to usual estimators, and with a two step M-estimator of the maximal symmetry of the regression function. We also demonstrate the finite sample performance of these estimators on synthetic data.

math.ST↗

Estimating Maximal Symmetries of Regression Functions via Subgroup Lattices

We present a method for estimating the maximal symmetry of a continuous regression function. Knowledge of such a symmetry can be used to significantly improve modelling by removing the modes of variation resulting from the symmetries. Symmetry estimation is carried out using hypothesis testing for invariance strategically over the subgroup lattice of a search group G acting on the feature space. We show that the estimation of the unique maximal invariant subgroup of G generalises useful tools from linear dimension reduction to a non linear context. We show that the estimation is consistent when the subgroup lattice chosen is finite, even when some of the subgroups themselves are infinite. We demonstrate the performance of this estimator in synthetic settings and apply the methods to two data sets: satellite measurements of the earth's magnetic field intensity; and the distribution of sunspots.

stat.ME↗

Recent Methodological Advances in Federated Learning for Healthcare

For healthcare datasets, it is often not possible to combine data samples from multiple sites due to ethical, privacy or logistical concerns. Federated learning allows for the utilisation of powerful machine learning algorithms without requiring the pooling of data. Healthcare data has many simultaneous challenges which require new methodologies to address, such as highly-siloed data, class imbalance, missing data, distribution shifts and non-standardised variables. Federated learning adds significant methodological complexity to conventional centralised machine learning, requiring distributed optimisation, communication between nodes, aggregation of models and redistribution of models. In this systematic review, we consider all papers on Scopus that were published between January 2015 and February 2023 and which describe new federated learning methodologies for addressing challenges with healthcare data. We performed a detailed review of the 89 papers which fulfilled these criteria. Significant systemic issues were identified throughout the literature which compromise the methodologies in many of the papers reviewed. We give detailed recommendations to help improve the quality of the methodology development for federated learning in healthcare.

cs.LG↗

Reinterpreting survival analysis in the universal approximator age

Survival analysis is an integral part of the statistical toolbox. However, while most domains of classical statistics have embraced deep learning, survival analysis only recently gained some minor attention from the deep learning community. This recent development is likely in part motivated by the COVID-19 pandemic. We aim to provide the tools needed to fully harness the potential of survival analysis in deep learning. On the one hand, we discuss how survival analysis connects to classification and regression. On the other hand, we provide technical tools. We provide a new loss function, evaluation metrics, and the first universal approximating network that provably produces survival curves without numeric integration. We show that the loss function and model outperform other approaches using a large numerical study.

cs.LG↗

Dis-AE: Multi-domain & Multi-task Generalisation on Real-World Clinical Data

Clinical data is often affected by clinically irrelevant factors such as discrepancies between measurement devices or differing processing methods between sites. In the field of machine learning (ML), these factors are known as domains and the distribution differences they cause in the data are known as domain shifts. ML models trained using data from one domain often perform poorly when applied to data from another domain, potentially leading to wrong predictions. As such, developing machine learning models that can generalise well across multiple domains is a challenging yet essential task in the successful application of ML in clinical practice. In this paper, we propose a novel disentangled autoencoder (Dis-AE) neural network architecture that can learn domain-invariant data representations for multi-label classification of medical measurements even when the data is influenced by multiple interacting domain shifts at once. The model utilises adversarial training to produce data representations from which the domain can no longer be determined. We evaluate the model's domain generalisation capabilities on synthetic datasets and full blood count (FBC) data from blood donors as well as primary and secondary care patients, showing that Dis-AE improves model generalisation on multiple domains simultaneously while preserving clinically relevant information.

cs.LG↗

Joint Modeling for Geometry and Functionality of Cerebral Cortical Surface Images

We propose a framework for jointly modeling the geometry and functionality in high dimensional functional surfaces. The proposed mixed effects model characterizes effects of subject-specific covariates and exogenous stimuli on functional surfaces while accounting for potential mutual-influence of their geometry and functionality. This is achieved through a computationally efficient estimation method that incorporates regularized estimation of the precision matrix of the random effects. We perform a thorough analysis of cerebral cortical surface structural MRI and task fMRI data from the Human Connectome Project and discover relationships between the geometric shapes of cortical surface and neuronal activation responding to task stimuli. Our findings highlight new modes of correspondence between cortical surface shape and functional activation relevant to emotion processing.

stat.AP↗

Navigating the challenges in creating complex data systems: a development philosophy

In this perspective, we argue that despite the democratization of powerful tools for data science and machine learning over the last decade, developing the code for a trustworthy and effective data science system (DSS) is getting harder. Perverse incentives and a lack of widespread software engineering (SE) skills are among many root causes we identify that naturally give rise to the current systemic crisis in reproducibility of DSSs. We analyze why SE and building large complex systems is, in general, hard. Based on these insights, we identify how SE addresses those difficulties and how we can apply and generalize SE methods to construct DSSs that are fit for purpose. We advocate two key development philosophies, namely that one should incrementally grow -- not biphasically plan and build -- DSSs, and one should always employ two types of feedback loops during development: one which tests the code's correctness and another that evaluates the code's efficacy.

cs.SE↗

Statistical Depth for Big Functional Data with Application to Neuroimaging

Functional depth is the functional data analysis technique that orders a functional data set. Unlike the case of data on the real line, defining this order is non-trivial, and particularly, with functional data, there are a number of properties that any depth should satisfy. We propose a new depth which both satisfies the properties required of a functional depth but also one which can be used in the case where there are a very large number of functional observations or in the case where the observations are functions of several continuous variables (such as images, for example). We give theoretical justification for our choice, and evaluate our proposed depth through simulation. We finally apply the proposed depth to the problem of yielding a completely non-parametric deconvolution of Positron Emission Tomography (PET) data for a very large number of curves across the image, as well as to the problem of finding a representative subject from a set of PET scans.

stat.ME↗

Classification of datasets with imputed missing values: does imputation quality matter?

Classifying samples in incomplete datasets is a common aim for machine learning practitioners, but is non-trivial. Missing data is found in most real-world datasets and these missing values are typically imputed using established methods, followed by classification of the now complete, imputed, samples. The focus of the machine learning researcher is then to optimise the downstream classification performance. In this study, we highlight that it is imperative to consider the quality of the imputation. We demonstrate how the commonly used measures for assessing quality are flawed and propose a new class of discrepancy scores which focus on how well the method recreates the overall distribution of the data. To conclude, we highlight the compromised interpretability of classifier models trained using poorly imputed data.

cs.LG↗

Testing for Geometric Invariance and Equivariance

Invariant and equivariant models incorporate the symmetry of an object to be estimated (here non-parametric regression functions $f : \mathcal{X} \rightarrow \mathbb{R}$). These models perform better (with respect to $L^2$ loss) and are increasingly being used in practice, but encounter problems when the symmetry is falsely assumed. In this paper we present a framework for testing for $G$-equivariance for any semi-group $G$. This will give confidence to the use of such models when the symmetry is not known a priori. These tests are independent of the model and are computationally quick, so can be easily used before model fitting to test their validity.

stat.ML↗

Functional random effects modeling of brain shape and connectivity

We present a statistical framework that jointly models brain shape and functional connectivity, which are two complex aspects of the brain that have been classically studied independently. We adopt a Riemannian modeling approach to account for the non-Euclidean geometry of the space of shapes and the space of connectivity that constrains trajectories of co-variation to be valid statistical estimates. In order to disentangle genetic sources of variability from those driven by unique environmental factors, we embed a functional random effects model in the Riemannian framework. We apply the proposed model to the Human Connectome Project dataset to explore spontaneous co-variation between brain shape and connectivity in young healthy individuals.

stat.ME↗

Representation and reconstruction of covariance operators in linear inverse problems

We introduce a framework for the reconstruction and representation of functions in a setting where these objects cannot be directly observed, but only indirect and noisy measurements are available, namely an inverse problem setting. The proposed methodology can be applied either to the analysis of indirectly observed functional images or to the associated covariance operators, representing second-order information, and thus lying on a non-Euclidean space. To deal with the ill-posedness of the inverse problem, we exploit the spatial structure of the sample data by introducing a flexible regularizing term embedded in the model. Thanks to its efficiency, the proposed model is applied to MEG data, leading to a novel approach to the investigation of functional connectivity.

stat.ME↗

Statistical Analysis of Functions on Surfaces, with an application to Medical Imaging

In Functional Data Analysis, data are commonly assumed to be smooth functions on a fixed interval of the real line. In this work, we introduce a comprehensive framework for the analysis of functional data, whose domain is a two-dimensional manifold and the domain itself is subject to variability from sample to sample. We formulate a statistical model for such data, here called Functions on Surfaces, which enables a joint representation of the geometric and functional aspects, and propose an associated estimation framework. We assess the validity of the framework by performing a simulation study and we finally apply it to the analysis of neuroimaging data of cortical thickness, acquired from the brains of different subjects, and thus lying on domains with different geometries.

stat.ME↗

A Spatial Modeling Approach for Linguistic Object Data: Analysing dialect sound variations across Great Britain

Dialect variation is of considerable interest in linguistics and other social sciences. However, traditionally it has been studied using proxies (transcriptions) rather than acoustic recordings directly. We introduce novel statistical techniques to analyse geolocalised speech recordings and to explore the spatial variation of pronunciations continuously over the region of interest, as opposed to traditional isoglosses, which provide a discrete partition of the region. Data of this type require an explicit modeling of the variation in the mean and the covariance. Usual Euclidean metrics are not appropriate, and we therefore introduce the concept of $d$-covariance, which allows consistent estimation both in space and at individual locations. We then propose spatial smoothing for these objects which accounts for the possibly non convex geometry of the domain of interest. We apply the proposed method to data from the spoken part of the British National Corpus, deposited at the British Library, London, and we produce maps of the dialect variation over Great Britain. In addition, the methods allow for acoustic reconstruction across the domain of interest, allowing researchers to listen to the statistical analysis.

stat.ME↗

The statistical analysis of acoustic phonetic data: exploring differences between spoken Romance languages

The historical and geographical spread from older to more modern languages has long been studied by examining textual changes and in terms of changes in phonetic transcriptions. However, it is more difficult to analyze language change from an acoustic point of view, although this is usually the dominant mode of transmission. We propose a novel analysis approach for acoustic phonetic data, where the aim will be to statistically model the acoustic properties of spoken words. We explore phonetic variation and change using a time-frequency representation, namely the log-spectrograms of speech recordings. We identify time and frequency covariance functions as a feature of the language; in contrast, mean spectrograms depend mostly on the particular word that has been uttered. We build models for the mean and covariances (taking into account the restrictions placed on the statistical analysis of such objects) and use these to define a phonetic transformation that models how an individual speaker would sound in a different language, allowing the exploration of phonetic differences between languages. Finally, we map back these transformations to the domain of sound recordings, allowing us to listen to the output of the statistical analysis. The proposed approach is demonstrated using recordings of the words corresponding to the numbers from "one" to "ten" as pronounced by speakers from five different Romance languages.

stat.AP↗