SearcharxivSearch

arXiv subjects

Andrew Taylor

Publications and source records attributed to Andrew Taylor.

At least 19 recordsLinked to original sources

Precipitation Downscaling Using Foundation Model-Conditioned Diffusion

High-resolution precipitation fields are essential for hydrological impact assessment, yet global climate model outputs are too coarse and biased for direct use. AI-based statistical downscaling with diffusion models offers a promising approach, but the mechanism by which large-scale atmospheric predictors condition generation remains largely unexplored. We investigate three conditioning strategies for a denoising diffusion probabilistic model applied to daily precipitation downscaling: channel concatenation of upsampled coarse predictors, cross-attention conditioning with a learned convolutional encoder, and cross-attention conditioning with the frozen encoder of the pretrained Prithvi WxC weather foundation model. All strategies are evaluated against an unconditioned baseline under identical conditions using probabilistic, distributional, spectral, and extreme-event metrics for the Colorado River Basin. Concatenation conditioning achieves the lowest point-wise CRPS and MSE, but tends to produce over-smoothed fields that suppress high-intensity events. In contrast, cross-attention conditioning provides substantially better distributional realism and modest improvements in spectral fidelity. Improvements are greatest for extremes: the Prithvi-WxC conditioned model retains over half of >100mm/day events, although estimates are uncertain due to limited samples. When trained on the full dataset, the learned convolutional model performs similarly to the foundation model-conditioned approach while requiring lower computational resources. However, the Prithvi-WxC-conditioned model achieves comparable performance with only five years of training data. These results indicate that cross-attention conditioning offers advantages over simple concatenation for probabilistic precipitation downscaling, and that pre-trained foundation model representations may offer benefits in data-limited settings.

cs.CV

The Clinician's Veto: Navigating Trust, Liability, and Uncertainty in Autonomous AI Prescribing

Autonomous AI systems are transitioning from advisory roles to autonomous ones for medication prescriptions. Recent U.S. bill H.R. 238 and Utah's prescription-renewal pilot program both authorize AI to prescribe medications in an agentic capacity. While many regulatory guidelines suggest aggregate model performance metrics at the point of clearance, they do not require i) calibrated per-prediction confidence for action-gated thresholds, ii) differentiated communication between uncertainty arising from model ignorance (epistemic) from genuine clinical ambiguity (aleatoric), and iii) inferential transparency at the moment of decision enabling liability allocation. Here, we argue these three architectural features are minimum conditions for safe autonomous prescribing, and validate them with a survey of 136 U.S. prescribing clinicians. Our results suggest prescribing clinicians i) would not permit autonomous prescribing without a confidence-based escalation mechanism, ii) preferred a competing-options summary for aleatoric uncertainty but preferred abstention for epistemic uncertainty, and iii) were only willing to accept liability when inferential transparency enabled them to make a decision under acknowledged uncertainty. These findings indicate that our recommended architectural features would encourage higher rates of clinician adoption of autonomous AI prescribing, largely through collapsing much of what "autonomy" conventionally means.

cs.AI

Rethinking Retrieval-Augmented Generation for Medicine: A Large-Scale, Systematic Expert Evaluation and Practical Insights

Large language models (LLMs) are transforming the landscape of medicine, yet two fundamental challenges persist: keeping up with rapidly evolving medical knowledge and providing verifiable, evidence-grounded reasoning. Retrieval-augmented generation (RAG) has been widely adopted to address these limitations by supplementing model outputs with retrieved evidence. However, whether RAG reliably achieves these goals remains unclear. Here, we present the most comprehensive expert evaluation of RAG in medicine to date. Eighteen medical experts contributed a total of 80,502 annotations, assessing 800 model outputs generated by GPT-4o and Llama-3.1-8B across 200 real-world patient and USMLE-style queries. We systematically decomposed the RAG pipeline into three components: (i) evidence retrieval (relevance of retrieved passages), (ii) evidence selection (accuracy of evidence usage), and (iii) response generation (factuality and completeness of outputs). Contrary to expectation, standard RAG often degraded performance: only 22% of top-16 passages were relevant, evidence selection remained weak (precision 41-43%, recall 27-49%), and factuality and completeness dropped by up to 6% and 5%, respectively, compared with non-RAG variants. Retrieval and evidence selection remain key failure points for the model, contributing to the overall performance drop. We further show that simple yet effective strategies, including evidence filtering and query reformulation, substantially mitigate these issues, improving performance on MedMCQA and MedXpertQA by up to 12% and 8.2%, respectively. These findings call for re-examining RAG's role in medicine and highlight the importance of stage-aware evaluation and deliberate system design for reliable medical LLM applications.

cs.CL

A Sentinel-3 foundation model for ocean colour

Artificial Intelligence (AI) Foundation models (FMs), pre-trained on massive unlabelled datasets, have the potential to drastically change AI applications in ocean science, where labelled data are often sparse and expensive to collect. In this work, we describe a new foundation model using the Prithvi-EO Vision Transformer architecture which has been pre-trained to reconstruct data from the Sentinel-3 Ocean and Land Colour Instrument (OLCI). We evaluate the model by fine-tuning on two downstream marine earth observation tasks. We first assess model performance compared to current baseline models used to quantify chlorophyll concentration. We then evaluate the FMs ability to refine remote sensing-based estimates of ocean primary production. Our results demonstrate the utility of self-trained FMs for marine monitoring, in particular for making use of small amounts of high quality labelled data and in capturing detailed spatial patterns of ocean colour whilst matching point observations. We conclude that this new generation of geospatial AI models has the potential to provide more robust, data-driven insights into ocean ecosystems and their role in global climate processes.

cs.CV

Future Collider Measurements for Cosmic Ray Induced Air Shower Modelling

The identification of gamma-ray induced air showers with Cherenkov telescopes suffers from contamination with a specific class of cosmic ray induced air showers. The predictions for this background show strong discrepancies between the available event generators. In this study, we identify collision events of cosmic rays with atmospheric nuclei in which a large fraction of the original beam energy is transmitted to the electromagnetic part of the shower as the main source for this background. Consequently, we define a pseudorapidity region of interest for hadron collider experiments that corresponds to this background, taking into account the center-of-mass energy. This region of interest is compared with the available datasets and the pseudorapidity coverage of the detectors that recorded it. We find that the LHCf and RHICf detectors are the only ones covering substantial parts of this region of interest and suggest a measurement of the energy spectra of reconstructed neutral pions to be made with this data. Such results could serve as valuable constraints for a future parameter tuning of the event generators to improve the background estimation uncertainties for gamma-ray induced air shower identification.

hep-ph

Supervised Fine-Tuning LLMs to Behave as Pedagogical Agents in Programming Education

Large language models (LLMs) are increasingly being explored in higher education, yet their effectiveness as teaching agents remains underexamined. In this paper, we present the development of GuideLM, a fine-tuned LLM designed for programming education. GuideLM has been integrated into the Debugging C Compiler (DCC), an educational C compiler that leverages LLMs to generate pedagogically sound error explanations. Previously, DCC relied on off-the-shelf OpenAI models, which, while accurate, often over-assisted students by directly providing solutions despite contrary prompting. To address this, we employed supervised fine-tuning (SFT) on a dataset of 528 student-question/teacher-answer pairs, creating two models: GuideLM and GuideLM-mini, fine-tuned on ChatGPT-4o and 4o-mini, respectively. We conducted an expert analysis of 400 responses per model, comparing their pedagogical effectiveness against base OpenAI models. Our evaluation, grounded in constructivism and cognitive load theory, assessed factors such as conceptual scaffolding, clarity, and Socratic guidance. Results indicate that GuideLM and GuideLM-mini improve pedagogical performance, with an 8% increase in Socratic guidance and a 58% improvement in economy of words compared to GPT-4o. However, this refinement comes at the cost of a slight reduction in general accuracy. While further work is needed, our findings suggest that fine-tuning LLMs with targeted datasets is a promising approach for developing models better suited to educational contexts.

cs.CL

Towards Pedagogical LLMs with Supervised Fine Tuning for Computing Education

This paper investigates supervised fine-tuning of large language models (LLMs) to improve their pedagogical alignment in computing education, addressing concerns that LLMs may hinder learning outcomes. The project utilised a proprietary dataset of 2,500 high quality question/answer pairs from programming course forums, and explores two research questions: the suitability of university course forums in contributing to fine-tuning datasets, and how supervised fine-tuning can improve LLMs' alignment with educational principles such as constructivism. Initial findings suggest benefits in pedagogical alignment of LLMs, with deeper evaluations required.

cs.CL

Scaling CS1 Support with Compiler-Integrated Conversational AI

This paper introduces DCC Sidekick, a web-based conversational AI tool that enhances an existing LLM-powered C/C++ compiler by generating educational programming error explanations. The tool seamlessly combines code display, compile- and run-time error messages, and stack frame read-outs alongside an AI interface, leveraging compiler error context for improved explanations. We analyse usage data from a large Australian CS1 course, where 959 students engaged in 11,222 DCC Sidekick sessions, resulting in 17,982 error explanations over seven weeks. Notably, over 50% of interactions occurred outside business hours, underscoring the tool's value as an always-available resource. Our findings reveal strong adoption of AI-assisted debugging tools, demonstrating their scalability in supporting extensive CS1 courses. We provide implementation insights and recommendations for educators seeking to incorporate AI tools with appropriate pedagogical safeguards.

cs.CY

MedCalc-Bench: Evaluating Large Language Models for Medical Calculations

As opposed to evaluating computation and logic-based reasoning, current benchmarks for evaluating large language models (LLMs) in medicine are primarily focused on question-answering involving domain knowledge and descriptive reasoning. While such qualitative capabilities are vital to medical diagnosis, in real-world scenarios, doctors frequently use clinical calculators that follow quantitative equations and rule-based reasoning paradigms for evidence-based decision support. To this end, we propose MedCalc-Bench, a first-of-its-kind dataset focused on evaluating the medical calculation capability of LLMs. MedCalc-Bench contains an evaluation set of over 1000 manually reviewed instances from 55 different medical calculation tasks. Each instance in MedCalc-Bench consists of a patient note, a question requesting to compute a specific medical value, a ground truth answer, and a step-by-step explanation showing how the answer is obtained. While our evaluation results show the potential of LLMs in this area, none of them are effective enough for clinical settings. Common issues include extracting the incorrect entities, not using the correct equation or rules for a calculation task, or incorrectly performing the arithmetic for the computation. We hope our study highlights the quantitative knowledge and reasoning gaps in LLMs within medical settings, encouraging future improvements of LLMs for various clinical calculation tasks.

cs.CL

AgentMD: Empowering Language Agents for Risk Prediction with Large-Scale Clinical Tool Learning

Clinical calculators play a vital role in healthcare by offering accurate evidence-based predictions for various purposes such as prognosis. Nevertheless, their widespread utilization is frequently hindered by usability challenges, poor dissemination, and restricted functionality. Augmenting large language models with extensive collections of clinical calculators presents an opportunity to overcome these obstacles and improve workflow efficiency, but the scalability of the manual curation process poses a significant challenge. In response, we introduce AgentMD, a novel language agent capable of curating and applying clinical calculators across various clinical contexts. Using the published literature, AgentMD has automatically curated a collection of 2,164 diverse clinical calculators with executable functions and structured documentation, collectively named RiskCalcs. Manual evaluations show that RiskCalcs tools achieve an accuracy of over 80% on three quality metrics. At inference time, AgentMD can automatically select and apply the relevant RiskCalcs tools given any patient description. On the newly established RiskQA benchmark, AgentMD significantly outperforms chain-of-thought prompting with GPT-4 (87.7% vs. 40.9% in accuracy). Additionally, we also applied AgentMD to real-world clinical notes for analyzing both population-level and risk-level patient characteristics. In summary, our study illustrates the utility of language agents augmented with clinical calculators for healthcare analytics and patient care.

cs.CL

Dcc --help: Generating Context-Aware Compiler Error Explanations with Large Language Models

In the challenging field of introductory programming, high enrollments and failure rates drive us to explore tools and systems to enhance student outcomes, especially automated tools that scale to large cohorts. This paper presents and evaluates the dcc --help tool, an integration of a Large Language Model (LLM) into the Debugging C Compiler (DCC) to generate unique, novice-focused explanations tailored to each error. dcc --help prompts an LLM with contextual information of compile- and run-time error occurrences, including the source code, error location and standard compiler error message. The LLM is instructed to generate novice-focused, actionable error explanations and guidance, designed to help students understand and resolve problems without providing solutions. dcc --help was deployed to our CS1 and CS2 courses, with 2,565 students using the tool over 64,000 times in ten weeks. We analysed a subset of these error/explanation pairs to evaluate their properties, including conceptual correctness, relevancy, and overall quality. We found that the LLM-generated explanations were conceptually accurate in 90% of compile-time and 75% of run-time cases, but often disregarded the instruction not to provide solutions in code. Our findings, observations and reflections following deployment indicate that dcc-help provides novel opportunities for scaffolding students' introduction to programming.

cs.SE

MotionInput v2.0 supporting DirectX: A modular library of open-source gesture-based machine learning and computer vision methods for interacting and controlling existing software with a webcam

Touchless computer interaction has become an important consideration during the COVID-19 pandemic period. Despite progress in machine learning and computer vision that allows for advanced gesture recognition, an integrated collection of such open-source methods and a user-customisable approach to utilising them in a low-cost solution for touchless interaction in existing software is still missing. In this paper, we introduce the MotionInput v2.0 application. This application utilises published open-source libraries and additional gesture definitions developed to take the video stream from a standard RGB webcam as input. It then maps human motion gestures to input operations for existing applications and games. The user can choose their own preferred way of interacting from a series of motion types, including single and bi-modal hand gesturing, full-body repetitive or extremities-based exercises, head and facial movements, eye tracking, and combinations of the above. We also introduce a series of bespoke gesture recognition classifications as DirectInput triggers, including gestures for idle states, auto calibration, depth capture from a 2D RGB webcam stream and tracking of facial motions such as mouth motions, winking, and head direction with rotation. Three use case areas assisted the development of the modules: creativity software, office and clinical software, and gaming software. A collection of open-source libraries has been integrated and provide a layer of modular gesture mapping on top of existing mouse and keyboard controls in Windows via DirectX. With ease of access to webcams integrated into most laptops and desktop computers, touchless computing becomes more available with MotionInput v2.0, in a federated and locally processed method.

cs.CV

Making cosmic particle accelerators visible and audible

In a collaboration between astroparticle physicists, animation artists from the award-winning Science Communication Lab, and musician Carsten Nicolai (a.k.a. Alva Noto), two cosmic particle accelerators have been brought to life: the massive binary star Eta Carinae, and the exploding star, which resulted in the gamma-ray burst GRB190829A. For Eta Carinae, the computer-generated images are close to reality because the measured orbital, stellar and wind parameters were used for this purpose. Particle acceleration in the jet of GRB190829A has also been animated at a level of detail not seen before. The internationally acclaimed multimedia artist Carsten Nicolai, who uses the pseudonym Alva Noto for his musical works, exclusively composed the sound for the animations. The multimedia projects aim at making the discoveries more accessible to the general public, and to mediate scientific results and their reference to reality from an artistic point of view.

astro-ph.HE

Extragalactic magnetic field constraints from ultra-high-energy cosmic rays from local galaxies

We interpret the correlation between local star-forming galaxy positions and ultra-high-energy cosmic ray (UHECR) directions, recently detected by the Pierre Auger Observatory (PAO), in terms of physical parameters: the local density of sources and the magnetic fields governing the UHECR propagation. We include a Galactic magnetic field model on top of a random extragalactic magnetic field description to determine the level of UHECR deflections expected from an ensemble of source positions. Besides deflections in magnetic fields, we also take into account energy losses with background photon fields as well as spectrum and composition measurements by the PAO. We find consistency between the PAO anisotropy measurement and the local star-forming galaxy density for large extragalactic magnetic field strengths with $B > 0.2 \ \rm nG$ (for a coherence length of $1 \ \rm Mpc$) at the $5\sigma$ confidence level. Larger source densities lead to more isotropic background and consequently allow for weaker extragalactic magnetic fields. However, the acceleration of UHECR by such abundant sources is more challenging to motivate. Too large source densities and extragalactic magnetic field strengths, on the other hand, are also disfavored as that decreases the expected level of anisotropy. This leads to upper limits of $B < 22 \ \rm nG$ and $\rho_0 < 8.4 \cdot 10^{-2} \ \rm Mpc^{-3}$ at the 90\% confidence level.

astro-ph.HE

Extension of the synchrotron radiation of electrons to very high energies in clumpy environments

The synchrotron cooling of relativistic electrons is one of the most effective radiation mechanisms in astrophysics. It not only accompanies the process of particle acceleration but also has feedback on the formation of the energy distribution of the parent electrons. The radiative cooling time of electrons decreases with energy as $t_{\rm syn} \propto 1/E$; correspondingly the overall radiation efficiency increases with energy. On the other hand, this effect strictly limits the maximum energy of individual photons. Even in the so-called extreme accelerators, where the acceleration proceeds at the highest possible rate, $t_{\rm acc}^{-1} = eBc/E$, allowed in an ideal magnetohydrodynamic plasma, the synchrotron radiation cannot extend well beyond the characteristic energy determined by the electron mass and the fine-structure constant: $h \nu^{\rm max} \sim m_e c^2/\alpha \sim 70 \rm\,MeV$. In this paper, we propose a model in which the formation of synchrotron radiation takes place in compact magnetic blobs located inside the particle accelerator and develop a formalism for calculations of synchrotron radiation emerging from such systems. We demonstrate that for certain combinations of parameters characterizing the accelerator and the magnetic blobs, the synchrotron radiation can extend beyond this limit by a several orders of magnitude. This scenario requires a weak magnetization of the particle accelerator, and an efficient conversion of gas internal energy into magnetic energy in sufficiently small blobs. The required size of the blobs is constrained by the magnetic mirroring effect, that can prevent particle penetration into the regions of strong magnetic field under certain conditions.

astro-ph.HE

Progress in unveiling extreme particle acceleration in persistent astrophysical jets

The most powerful persistent accelerators in the Universe are jetted active galaxies. Blazars, galaxies whose jets are directed towards Earth, dominate the extragalactic gamma-ray sky. Still, most of the highest-energy particle accelerators likely elude detection. These extreme blazars, whose radiated energy can peak beyond 10 TeV, are ideal targets to study particle acceleration and radiative processes, and may provide links to cosmic rays and astrophysical neutrinos. The growing number of extreme blazars observed at TeV energies has been critical for the emergence of gamma-ray cosmology, including measurements of the extragalactic background light, tight bounds on the intergalactic magnetic field, and constraints on exotic physics at energies inaccessible with human-made accelerators. Tremendous progress has been achieved over the past decade, which bodes well for the future, particularly with the deployment of the Cherenkov Telescope Array.

astro-ph.HE

Learning for Safety-Critical Control with Control Barrier Functions

Modern nonlinear control theory seeks to endow systems with properties of stability and safety, and have been deployed successfully in multiple domains. Despite this success, model uncertainty remains a significant challenge in synthesizing safe controllers, leading to degradation in the properties provided by the controllers. This paper develops a machine learning framework utilizing Control Barrier Functions (CBFs) to reduce model uncertainty as it impact the safe behavior of a system. This approach iteratively collects data and updates a controller, ultimately achieving safe behavior. We validate this method in simulation and experimentally on a Segway platform.

eess.SY

I-Love-Q Relations for Realistic White Dwarfs

The space-borne gravitational wave interferometer, LISA, is expected to detect signals from numerous binary white dwarfs. At small orbital separation, rapid rotation and large tidal bulges may allow for the stellar internal structure to be probed through such observations. Finite-size effects are encoded in quantities like the moment of inertia ($I$), tidal Love number (Love), and quadrupole moment ($Q$). The universal relations among them (I-Love-Q relations) can be used to reduce the number of parameters in the gravitational-wave templates. We here study I-Love-Q relations for more realistic white dwarf models than used in previous studies. In particular, we extend previous works by including (i) differential rotation and (ii) internal temperature profiles taken from detailed stellar evolution calculations. We use the publicly available stellar evolution code MESA to generate cooling models of both low- and high-mass white dwarfs. We show that differential rotation causes the I-Q relation (and similarly the Love-Q relation) to deviate from that of constant rotation. We also find that the introduction of finite temperatures causes the white dwarf to move along the zero-temperature mass sequence of I-Q values, moving towards values that suggest a lower mass. We further find that after only a few Myrs, high-mass white dwarfs are well-described by the zero-temperature model, suggesting that the relations with zero-temperature may be good enough in most practical cases. Low-mass, He-core white dwarfs with thick hydrogen envelopes may undergo long periods of H burning which sustain the stellar temperature and allow deviations from the I-Love-Q relations for longer times.

gr-qc