arXiv subjects

Gerd Kortemeyer

Publications and source records attributed to Gerd Kortemeyer.

24 records · Page 2Linked to original sources

arXiv2023

Could an Artificial-Intelligence agent pass an introductory physics course?

Massive pre-trained language models have garnered attention and controversy due to their ability to generate human-like responses: attention due to their frequent indistinguishability from human-generated phraseology and narratives, and controversy due to the fact that their convincingly presented arguments and facts are frequently simply false. Just how human-like are these responses when it comes to dialogues about physics, in particular about the standard content of introductory physics courses? This study explores that question by having ChatGTP, the pre-eminent language model in 2023, work through representative assessment content of an actual calculus-based physics course and grading the responses in the same way human responses would be graded. As it turns out, ChatGPT would narrowly pass this course while exhibiting many of the preconceptions and errors of a beginning learner.

physics.ed-ph↗

arXiv2015

A New Item Response Theory Model for Open-Ended Online Homework with Multiple Allowed Attempts

Item Response Theory (IRT) was originally developed in traditional exam settings, and it has been shown that the model does not readily transfer to formative assessment in the form of online homework. We investigate if this is mostly due to learner traits that do not become apparent in exam settings, namely random guessing due to lack of diligence or dedication, and copying work from other students or resources. Both of these traits mask the true ability of the learner, which is the only trait considered in most mainstream unidimensional IRT models. We find that indeed the introduction of these traits allows to better assess the true ability of the learners, as well as to better gauge the quality of assessment items. Correspondence of the model traits to self-reported behavior is investigated and confirmed. We find that of these two traits, copying answers has a larger influence on initial homework attempts than random guessing.

physics.ed-ph↗

arXiv2014

An Empirical Study of the Effect of Granting Multiple Tries for Online Homework

When deploying online homework in physics courses, an important consideration is how many attempts should be allowed in order to solve numerical free-response problems. While on the one hand, the maximum number of attempts should be large enough to allow learners mastery of the concepts and disincentivize copying, on the other hand, too many allowed attempts encourage counter-productive problem-solving behavior. In a study of an introductory calculus-based physics course for scientists and engineers which had different numbers of allowed attempts in different semesters, it was found that except for the initial tries, students are not making productive use of later attempts, and that in fact higher numbers of allowed attempts lead to less successful homework completion.

physics.ed-ph↗

arXiv2014

Extending Item Response Theory to Online Homework

Item Response Theory becomes an increasingly important tool when analyzing ``Big Data'' gathered from online educational venues. However, the mechanism was originally developed in traditional exam settings, and several of its assumptions are infringed upon when deployed in the online realm. For a large enrollment physics course for scientists and engineers, the study compares outcomes from IRT analyses of exam and homework data, and then proceeds to investigate the effects of each confounding factor introduced in the online realm. It is found that IRT yields the correct trends for learner ability and meaningful item parameters, yet overall agreement with exam data is moderate. It is also found that learner ability and item discrimination is over wide ranges robust with respect to model assumptions and introduced noise, less so than item difficulty.

physics.ed-ph↗

arXiv2012

An empirical approach to interpreting card-sorting data

Since it was first published 30 years ago, Chi et al.'s seminal paper on expert and novice categorization of introductory problems led to a plethora of follow-up studies within and outside of the area of physics [Chi et al. Cognitive Science 5, 121 - 152 (1981)]. These studies frequently encompass "card-sorting" exercises whereby the participants group problems. While this technique certainly allows insights into problem solving approaches, simple descriptive statistics more often than not fail to find significant differences between experts and novices. In moving beyond descriptive statistics, we describe a novel microscopic approach that takes into account the individual identity of the cards and uses graph theory and models to visualize, analyze, and interpreting problem categorization experiments. We apply these methods to an introductory physics (mechanics) problem categorization experiment, and find that most of the variation in sorting outcome is not due to the sorter being an expert versus a novice, but rather due to an independent characteristic that we named "stacker" versus "spreader." The fact that the expert-novice distinction only accounts for a smaller amount of the variation may explain the frequent null-results when conducting these experiments.

physics.ed-ph↗

arXiv1999

Virial corrections to simulations of heavy ion reactions

Within QMD simulations we demonstrate the effect of virial corrections on heavy ion reactions. Unlike in standard codes, the binary collisions are treated as non-local so that the contribution of the collision flux to the reaction dynamics is covered. A comparison with standard QMD simulations shows that the virial corrections lead to a broader proton distribution bringing theoretical spectra closer towards experimental values. Complementary BUU simulations reveal that the non-locality enhances the collision rate in the early stage of the reaction. It suggests that the broader distribution appears due to an enhanced pre-equilibrium emission of particles.

nucl-th↗