arXiv subjects

David Kersting

Publications and source records attributed to David Kersting.

3 recordsLinked to original sources

arXiv2026

GazeXPErT: An Expert Eye-tracking Dataset for Interpretable and Explainable AI in Oncologic FDG-PET/CT Scans

[18F]FDG-PET/CT is a cornerstone imaging modality for guiding oncology therapies, yet human expert shortages necessitate more efficient diagnostic aids. While standalone AI models for automatic lesion detection exist, clinical translation remains hindered by AI explainability, reliability, and workflow integration. Meanwhile, human-computer-interaction in radiology remain limited to keyboard, mouse and voice, ignoring experts' faster, natural gaze signal. We present GazeXPErT, a 4D eye-tracking dataset with annotated expert decision windows for tumor detection and measurement on 346 dual-read FDG-PET/CTs. The dataset contributes 9,030 gaze-to-lesion trajectories derived from 3,948 minutes of 60 Hz eye-tracking data, rendered in COCO-style format. GazeXPErT captures experts' visual reasoning patterns when adjudicating suspicious lesions. It aims to facilitate development of trusted, explainable and interactive AI models through understanding expert gaze patterns. Baseline feasibility experiments suggest salient signal is extractable from routinely collected expert gaze (3D nnU-Net Dice: 0.6819 versus 0.6008 without), that gaze-trained vision transformers may aid dynamic lesion localization (74.95% predicted gaze closer to tumor), and that experts' intent may be predictable from raw gaze (Accuracy 67.53%, AUROC 0.747).

eess.IV↗

arXiv2023

Mirror U-Net: Marrying Multimodal Fission with Multi-task Learning for Semantic Segmentation in Medical Imaging

Positron Emission Tomography (PET) and Computer Tomography (CT) are routinely used together to detect tumors. PET/CT segmentation models can automate tumor delineation, however, current multimodal models do not fully exploit the complementary information in each modality, as they either concatenate PET and CT data or fuse them at the decision level. To combat this, we propose Mirror U-Net, which replaces traditional fusion methods with multimodal fission by factorizing the multimodal representation into modality-specific branches and an auxiliary multimodal decoder. At these branches, Mirror U-Net assigns a task tailored to each modality to reinforce unimodal features while preserving multimodal features in the shared representation. In contrast to previous methods that use either fission or multi-task learning, Mirror U-Net combines both paradigms in a unified framework. We explore various task combinations and examine which parameters to share in the model. We evaluate Mirror U-Net on the AutoPET PET/CT and on the multimodal MSD BrainTumor datasets, demonstrating its effectiveness in multimodal segmentation and achieving state-of-the-art performance on both datasets. Our code will be made publicly available.

eess.IV↗

arXiv2022

AutoPET Challenge: Combining nn-Unet with Swin UNETR Augmented by Maximum Intensity Projection Classifier

Tumor volume and changes in tumor characteristics over time are important biomarkers for cancer therapy. In this context, FDG-PET/CT scans are routinely used for staging and re-staging of cancer, as the radiolabeled fluorodeoxyglucose is taken up in regions of high metabolism. Unfortunately, these regions with high metabolism are not specific to tumors and can also represent physiological uptake by normal functioning organs, inflammation, or infection, making detailed and reliable tumor segmentation in these scans a demanding task. This gap in research is addressed by the AutoPET challenge, which provides a public data set with FDG-PET/CT scans from 900 patients to encourage further improvement in this field. Our contribution to this challenge is an ensemble of two state-of-the-art segmentation models, the nn-Unet and the Swin UNETR, augmented by a maximum intensity projection classifier that acts like a gating mechanism. If it predicts the existence of lesions, both segmentations are combined by a late fusion approach. Our solution achieves a Dice score of 72.12\% on patients diagnosed with lung cancer, melanoma, and lymphoma in our cross-validation. Code: https://github.com/heiligerl/autopet_submission

eess.IV↗