arXiv · 2611.22009
DiagTrace: An Interactive Benchmark for Clinical Decision Making
Abstract
Large language models (LLMs) have shown strong performance on medical question answering and diagnostic reasoning benchmarks. However, existing evaluations typically provide all patient information upfront and assess only the final diagnosis or rationale. This setup ignores the need to acquire diagnostic evidence incrementally from incomplete information in real-world diagnosis. To bridge this gap, we introduce DiagTrace, a source-grounded benchmark for evaluating whether LLMs can reconstruct the documented diagnostic trajectory through interactive information seeking. Each benchmark instance is built from a PubMed Central case report and includes an initial presentation, an event bank, a clinical course, and diagnostic references. DiagTrace contains 510 cases across eight specialties, with 225 used to evaluate four LLMs on clinical-course alignment, interaction quality, and efficiency. Results reveal trade-offs in coverage, source-consistent ordering, and turn use.
Explore related subjects
Keep this discovery
Explore connections, maps & timelines
Yufan Wang, Rui Yang, Yi Lin, Chunhua Weng, Yifan Peng. 2026-11-16. DiagTrace: An Interactive Benchmark for Clinical Decision Making. https://searcharxiv.com/abs/2611.22009
Citations retain the original authors and DOI and include this site’s record URL. If this discovery service contributed to your research, you can also cite Searcharxiv by Indiciae: BibTeX · RIS.