SearcharxivSearch

arXiv subjects

Chris Perry

Publications and source records attributed to Chris Perry.

3 recordsLinked to original sources

Towards reliable use of artificial intelligence to classify otitis media using otoscopic images: Addressing bias and improving data quality

Ear disease contributes significantly to global hearing loss, with recurrent otitis media being a primary preventable cause in children, impacting development. Artificial intelligence (AI) offers promise for early diagnosis via otoscopic image analysis, but dataset biases and inconsistencies limit model generalizability and reliability. This retrospective study systematically evaluated three public otoscopic image datasets (Chile; Ohio, USA; T\"urkiye) using quantitative and qualitative methods. Two counterfactual experiments were performed: (1) obscuring clinically relevant features to assess model reliance on non-clinical artifacts, and (2) evaluating the impact of hue, saturation, and value on diagnostic outcomes. Quantitative analysis revealed significant biases in the Chile and Ohio, USA datasets. Counterfactual Experiment I found high internal performance (AUC > 0.90) but poor external generalization, because of dataset-specific artifacts. The T\"urkiye dataset had fewer biases, with AUC decreasing from 0.86 to 0.65 as masking increased, suggesting higher reliance on clinically meaningful features. Counterfactual Experiment II identified common artifacts in the Chile and Ohio, USA datasets. A logistic regression model trained on clinically irrelevant features from the Chile dataset achieved high internal (AUC = 0.89) and external (Ohio, USA: AUC = 0.87) performance. Qualitative analysis identified redundancy in all the datasets and stylistic biases in the Ohio, USA dataset that correlated with clinical outcomes. In summary, dataset biases significantly compromise reliability and generalizability of AI-based otoscopic diagnostic models. Addressing these biases through standardized imaging protocols, diverse dataset inclusion, and improved labeling methods is crucial for developing robust AI solutions, improving high-quality healthcare access, and enhancing diagnostic accuracy.

cs.CY

Gemma 2: Improving Open Language Models at a Practical Size

In this work, we introduce Gemma 2, a new addition to the Gemma family of lightweight, state-of-the-art open models, ranging in scale from 2 billion to 27 billion parameters. In this new version, we apply several known technical modifications to the Transformer architecture, such as interleaving local-global attentions (Beltagy et al., 2020a) and group-query attention (Ainslie et al., 2023). We also train the 2B and 9B models with knowledge distillation (Hinton et al., 2015) instead of next token prediction. The resulting models deliver the best performance for their size, and even offer competitive alternatives to models that are 2-3 times bigger. We release all our models to the community.

cs.CL

A sufficient set of experimentally implementable thermal operations

Recent work using tools from quantum information theory has shown that at the nanoscale where quantum effects become prevalent, there is not one thermodynamical second law but many. Derivations of these laws assume that an experimenter has very precise control of the system and heat bath. Here we show that these multitude of laws can be saturated using two very simple operations: changing the energy levels of the system and thermalizing over any two system energy levels. Using these two operations, one can distill the optimal amount of work from a system, as well as perform the reverse formation process. Even more surprisingly, using only these two operations and one ancilla qubit in a thermal state, one can transform any state into any other state allowable by the second laws. We thus have the remarkable result that the second laws hold for fine-grained manipulation of system and bath, but can be achieved using very coarse control. This brings the full array of thermal operations into a regime accessible by experiment, and establishes the physical relevance of these second laws.

quant-ph