SearcharxivSearch

arXiv · 2609.12753

A Framework for Characterizing Learning Contributions Across the Initial Achievement Spectrum

Abstract

Conceptual assessments are widely used in physics education research to evaluate changes in student understanding, yet class average measures can obscure how those changes are distributed across students with different levels of initial achievement. We introduce a Learning Contribution Framework that characterizes this distribution through the Learning Contribution Curve (LCC) and Learning Contribution Profile (LCP). For a general contribution measure G, the LCC represents cumulative contribution across students ranked by initial achievement, whereas the LCP describes the local mean contribution relative to the population mean of the individual G values. We apply the framework to the individual Hake normalized gain and develop a statistical model linking LCC and LCP behavior to the joint structure of pretest and posttest scores. Under the central assumption that the conditional mean of the subsequent score is linear in the initial score, we identify a score structure parameter $β$ and a critical score structure parameter $β_c$. Whether $β$ is greater than, less than, or equal to $β_c$ determines whether the expected LCP increases, decreases, or remains constant across initial achievement. Given the pretest distribution, the model further yields analytical predictions for the complete LCP and LCC that closely reproduce simulation results. Application to classroom concept-assessment data illustrates how the framework reveals local and cumulative patterns of learning contribution that are not evident from an overall class average revealed by the traditional Hake's normalized gain.

Explore related subjects

Keep this discovery

Explore connections, maps & timelines

BibTeXRIS

Tianlong Zu. 2026-09-11. A Framework for Characterizing Learning Contributions Across the Initial Achievement Spectrum. https://arxiv.org/abs/2609.12753

Cite the original work for its findings. Save a collection to share your selection of sources.

KEEP EXPLORING

Related papers

The Force Concept Inventory Across Continents: Testing Q-Matrix Transferability and Cross-Cultural Differences in Mechanics Reasoning

The Force Concept Inventory (FCI) is one of the most widely used research-based assessments in physics education, yet the assumption that its underlying cognitive structure is transferable across educational contexts remains largely untested. This study investigates the transferability of FCI Q-matrices using the Generalized Deterministic Inputs, Noisy "And" Gate (G-DINA) cognitive diagnostic applied to two large cohorts: students from the Learning About STEM Student Outcomes (LASSO) online system database in the United States (N = 4,750) and introductory physics students at the University of Johannesburg, South Africa (N = 1,016). Rather than treating the analysis as a local model calibration exercise, we frame the problem as one of cross-context cognitive invariance. Differential Item Functioning (DIF) analyses revealed substantial cross-cultural differences, with 14 of 30 items exhibiting high DIF after controlling for latent skill mastery. These differences were concentrated in force dynamics and contact-force reasoning and remained invariant under alternative Q-matrix specifications. The findings suggest that observed differences reflect genuine variations in students' conceptual reasoning rather than psychometric artifacts, highlighting the importance of validating Q-matrix structures before deploying cognitive diagnostic and adaptive assessments across diverse non-local educational settings.

physics.ed-ph

"I don't have a good metric for what other people think:" Unpacking the double empathy problem in neurodivergent physics problem-solving

Learning is a social act and requires communication between interlocutors. It is a process that takes place in a socially constructed neurotypical-normative system. These neurotypical-normative systems can marginalize neurodivergent students, who oftentimes have non-normative socio-cognitive differences. We investigate 3 neurodivergent physics students' experiences solving physics problems and navigating physics culture. We use a Double-Empathy Problem lens to uncover how communication breakdowns can manifest for neurodivergent students in physics. We find that the 3 neurodivergent students experience communication breakdowns in their interactions with peers and instructors and in interpreting problem statements. Furthermore, we find evidence that neurotypical-normative communication expectations in physics culture could be the source of negative effects present in participants' interviews, such as participants' fear of being misinterpreted or feeling as though they are viewed as stupid.

physics.ed-ph

AI-Assisted Assessment of Experimental Physics Laboratory Reports: Potential, Limitations, and Support for Teaching Practice

The incorporation of AI into the assessment of physics laboratory reports offers opportunities to support the review of student work and the provision of feedback. This article revisits an experience involving the use of ChatGPT models to analyze laboratory reports and examines the conditions that influence their usefulness in teaching practice. The analysis considers the evolution of AI models, document-processing procedures, and different modes of interaction, with particular attention to the effective availability of evidence contained in student reports. The findings indicate that differences between AI-generated and teacher assessments may be related not only to model capabilities but also to difficulties in retrieving and interpreting equations, graphs, tables, units, and other visual elements. The possibilities of systematic processing of sets of reports and conversational review of cases requiring more focused analysis are also examined. Based on these observations, a working strategy is proposed in which AI serves as a complementary resource for organizing assessment, supporting feedback, and identifying recurring difficulties in student work. The analysis highlights the importance of document-processing conditions and evidence availability, as well as the teacher's role in interpreting AI-generated information and making evaluative and pedagogical decisions.

physics.ed-ph