arXiv subjects
Publications and source records attributed to Joshua Southerland.
Subtrait (latent-trait components) assessment presents a promising path toward enhancing transparency of automated writing scores. We prototype explainability and subtrait scoring with generative language models and show modest correlation between human subtrait and trait scores, and between automated and human subtrait scores. Our approach provides details to demystify scores for educators and students.
In high-stakes English Language Assessments, low-skill test takers may employ memorized materials called ``templates'' on essay questions to ``game'' or fool the automated scoring system. In this study, we introduce the automated detection of inauthentic, templated responses (AuDITR) task, describe a machine learning-based approach to this task and illustrate the importance of regularly updating these models in production.
We prove an effective slope gap distribution result first for the square torus and then for general lattice translation surfaces. As a corollary, we obtain a dynamical proof for an effective gap distribution result for the Farey fractions. As an intermediate step, we prove an effective equidistribution result for the intersection points of long horocycles with a particular transversal of the horocycle flow in $\mathrm{SL}_2 (\mathbb R)/Γ$ where $Γ$ is a lattice.