SearcharxivSearch

arXiv subjects

Robert O'Shea

Publications and source records attributed to Robert O'Shea.

4 recordsLinked to original sources

Closed-Form Feedback-Free Learning with Forward Projection

State-of-the-art backpropagation-free learning methods employ local error feedback to direct iterative optimisation via gradient descent. Here, we examine the more restrictive setting where retrograde communication from neuronal outputs is unavailable for pre-synaptic weight optimisation. We propose Forward Projection (FP), a randomised closed-form training method requiring only a single forward pass over the dataset without retrograde communication. FP generates target values for pre-activation membrane potentials through randomised nonlinear projections of pre-synaptic inputs and labels. Local loss functions are optimised using closed-form regression without feedback from downstream layers. A key advantage is interpretability: membrane potentials in FP-trained networks encode information interpretable layer-wise as label predictions. Across several biomedical datasets, FP achieves generalisation comparable to gradient descent-based local learning methods while requiring only a single forward propagation step, yielding significant training speedup. In few-shot learning tasks, FP produces more generalisable models than backpropagation-optimised alternatives, with local interpretation functions successfully identifying clinically salient diagnostic features.

cs.LG

Gextext: Disease Network Extraction from Biomedical Literature

PURPOSE: We propose a fully unsupervised method to learn latent disease networks directly from unstructured biomedical text corpora. This method addresses current challenges in unsupervised knowledge extraction, such as the detection of long-range dependencies and requirements for large training corpora. METHODS: Let C be a corpus of n text chunks. Let V be a set of p disease terms occurring in the corpus. Let X indicate the occurrence of V in C. Gextext identifies disease similarities by positively correlated occurrence patterns. This information is combined to generate a graph on which geodesic distance describes dissimilarity. Diseasomes were learned by Gextext and GloVE on corpora of 100-1000 PubMed abstracts. Similarity matrix estimates were validated against biomedical semantic similarity metrics and gene profile similarity. RESULTS: Geodesic distance on Gextext-inferred diseasomes correlated inversely with external measures of semantic similarity. Gene profile similarity also correlated significant with proximity on the inferred graph. Gextext outperformed GloVE in our experiments. The information contained on the Gextext graph exceeded the explicit information content within the text. CONCLUSIONS: Gextext extracts latent relationships from unstructured text, enabling fully unsupervised modelling of diseasome graphs from PubMed abstracts.

cs.DL

Interpreting Missing Data Patterns in the ICU

PURPOSE: Clinical examinations are performed on the basis of necessity. However, our decisions to investigate and document are influenced by various other factors, such as workload and preconceptions. Data missingness patterns may contain insights into conscious and unconscious norms of clinical practice. METHODS: We examine data from the SPOTLIGHT study, a multi-centre cohort study of the effect of prompt ICU admission on mortality. We identify missing values and generate an auxiliary dataset indicating the missing entries. We deploy sparse Gaussian Graphical modelling techniques to identify conditional dependencies between the observed data and missingness patterns. We quantify these associations with sparse partial correlation, correcting for multiple collinearity. RESULTS: We identify 35 variables which significantly influence data missingness patterns (alpha = 0.01). We identify reduced recording of essential monitoring such as temperature (partial corr. = -0.0542, p = 6.65e-10), respiratory rate (partial corr. = -0.0437, p = 5.15e-07) and urea (partial corr. = -0.0263, p = 0.001611) in patients with reduced consciousness. We demonstrate reduction of temperature (partial corr. = -0.04, p = 8.5e-06), urine output (partial corr. = -0.05, p = 7.5e-09), lactate (partial corr. = -0.03, p = 0.00032) and bilirubin (partial corr. = -0.03, p = 0.00137) monitoring due to winter pressures. We provide statistical evidence of Missing Not at Random patterns in FiO2 and SF ratio recording. CONCLUSIONS: Graphical missingness analysis offers valuable insights into critical care delivery, identifying specific areas for quality improvement.

stat.AP

Model Selection With Graphical Neighbour Information

Accurate model selection is a fundamental requirement for statistical analysis. In many real-world applications of graphical modelling, correct model structure identification is the ultimate objective. Standard model validation procedures such as information theoretic scores and cross validation have demonstrated poor performance in the high dimensional setting. Specialised methods such as EBIC, StARS and RIC have been developed for the explicit purpose of high-dimensional Gaussian graphical model selection. We present a novel model score criterion, Graphical Neighbour Information. This method demonstrates oracle performance in high-dimensional model selection, outperforming the current state-of-the-art in our simulations. The Graphical Neighbour Information criterion has the additional advantage of efficient, closed-form computability, sparing the costly inference of multiple models on data subsamples. We provide a theoretical analysis of the method and benchmark simulations versus the current state of the art.

stat.ML