arXiv · 2611.22726
Stress Testing a Multimodal Large Language Model Grading Assistant on Kinematics Graph Reading
Abstract
Multimodal large language models (MLLMs) can recognize graph features yet award credit without sufficient graphical support. This exploratory study examines selected grading outputs for synthetic responses to four kinematics exercises, generated through visual distortion and progressive transformation toward reference graphs. Different model and prompt configurations were used. Some judgments correctly distinguished instantaneous zero velocity from rest over a finite interval and recognized positive curvature. Yet a severely distorted velocity--time graph received full credit despite disconnected and branching traces and an unclear zero-velocity reference. Other submissions graded under the same configuration lost substantial credit. Numerical cutoffs intended to distinguish meaningful features from drawing irregularities were supplied without a coordinate convention for unnumbered graphs, leaving the basis of exact partial-credit awards unresolved. Stress testing can expose unsupported awards before classroom use. For the configurations examined, we do not recommend accepting scores as final grades without instructor review, including review of full-credit responses.
Explore related subjects
Keep this discovery
Explore connections, maps & timelines
Ons Zammel, Carlos Soares, Flávia Carvalhido, Gerd Kortemeyer. 2026-11-17. Stress Testing a Multimodal Large Language Model Grading Assistant on Kinematics Graph Reading. https://searcharxiv.com/abs/2611.22726
Citations retain the original authors and DOI and include this site’s record URL. If this discovery service contributed to your research, you can also cite Searcharxiv by Indiciae: BibTeX · RIS.