SearcharxivSearch

arXiv subjects

Loïc Coquelin

Publications and source records attributed to Loïc Coquelin.

2 recordsLinked to original sources

Effect of Photoplethysmogram Artifacts on Uncertainty in Atrial Fibrillation Detection

Detection of atrial fibrillation (AF) from photoplethysmogram (PPG) is highly sensitive to artifacts, yet their effect on uncertainty of different AF detectors remains poorly understood. This work aims to quantify how different PPG artifact types affect the uncertainty of AF detectors. Two machine learning approaches to AF detection were explored: one using 25-s PPG signals as input ($\mathit{D}_r$) and another using AF-related rhythm irregularity features ($\mathit{D}_f$). The detectors were trained on wrist PPG signals acquired during cardiac rehabilitation and then systematically evaluated on 260,000 PPG signals containing controlled artifact types and durations. Uncertainty was quantified using a threshold-based error rate, conformal prediction, and Monte Carlo dropout. Using artifact-free PPG signals, $\mathit{D}_f$ outperforms $\mathit{D}_r$ with sensitivity/specificity of 0.94/0.94 versus 0.92/0.86. Relative to artifact-free performance, sensitivity/specificity drops by 0.52/0.03, 0.25/0.03, 0.16/0.02, and 0.07/0.02 using $\mathit{D}_r$ for 12-s artifacts of device displacement, forearm motion, hand motion, and poor contact respectively. For $\mathit{D}_f$, the respective drops are 0.31/0.07, 0.19/0.11, 0.14/0.15, and 0.13/0.21 for the same artifacts. $\mathit{D}_f$ is more robust to short artifacts but exhibits increasing uncertainty with longer artifact durations, whereas $\mathit{D}_r$ shows an abrupt performance drop when artifacts occur but is less sensitive to artifact duration. Applying conformal prediction with 90$\%$ coverage reduces the false-positive rate by up to 12$\%$ for $\mathit{D}_r$ and up to 64$\%$ for $\mathit{D}_f$. Artifact type and duration have detector-specific effects on AF detection uncertainty. Device displacement causes the largest increase in uncertainty.

eess.SP

A systematic evaluation of uncertainty quantification techniques in deep learning: a case study in photoplethysmography signal analysis

In principle, deep learning models trained on medical time-series, including wearable photoplethysmography (PPG) sensor data, can provide a means to continuously monitor physiological parameters outside of clinical settings. However, there is considerable risk of poor performance when deployed in practical measurement scenarios leading to negative patient outcomes. Reliable uncertainties accompanying predictions can provide guidance to clinicians in their interpretation of the trustworthiness of model outputs. It is therefore of interest to compare the effectiveness of different approaches. Here we implement an unprecedented set of eight uncertainty quantification (UQ) techniques to models trained on two clinically relevant prediction tasks: Atrial Fibrillation (AF) detection (classification), and two variants of blood pressure regression. We formulate a comprehensive evaluation procedure to enable a rigorous comparison of these approaches. We observe a complex picture of uncertainty reliability across the different techniques, where the most optimal for a given task depends on the chosen expression of uncertainty, evaluation metric, and scale of reliability assessed. We find that assessing local calibration and adaptivity provides practically relevant insights about model behaviour that otherwise cannot be acquired using more commonly implemented global reliability metrics. We emphasise that criteria for evaluating UQ techniques should cater to the model's practical use case, where the use of a small number of measurements per patient places a premium on achieving small-scale reliability for the chosen expression of uncertainty, while preserving as much predictive performance as possible.

cs.LG