arXiv subjects

Ido Roll

Publications and source records attributed to Ido Roll.

4 recordsLinked to original sources

arXiv2026

AI in the Wild: A Large Scale Analysis of Authentic Interactions of College Students with Generative AI

Generative AI tools (GenAI) are increasingly used by students during coursework, yet empirical understanding of how students engage with these systems in authentic learning contexts remains limited. Existing studies have largely relied on controlled settings, single-domain analyses, or small-scale qualitative data, leaving open how student-AI interaction unfolds across courses and forms of academic work. We present a large-scale analysis of naturally occurring student-AI interactions collected from undergraduate students across multiple university courses and academic domains. The dataset comprises over 15,000 student-AI interaction units drawn from voluntary use of generative AI during real coursework. To characterize these interactions, we analyze each student turn along two complementary dimensions, cognitive intent and interaction context, capturing whether requests are directed toward the task or domain, the student's own work, or prior AI output. Using instruction-guided annotation applied at scale, we examine how these interaction patterns are distributed overall and how they vary across courses. Our analysis reveals that student-AI interaction is highly structured. Across courses, interactions concentrate in a small number of recurring patterns rather than exhibiting highly idiosyncratic use. At the same time, systematic differences emerge across courses, giving rise to distinct interaction profiles associated with different forms of academic work.

cs.CY↗

arXiv2019

Participating in the Physics Lab: Does Gender Matter?

It is a well-studied notion that women are under-represented in the physical sciences, with a "leaky pipeline" metaphor describing how the number of women decreases at higher levels in academia[1,2]. It is unclear, however, where the major leaks exist and what factors are responsible for this[2]. Our focus here is on women in physics with an emphasis on practical laboratory work.

physics.ed-ph↗

arXiv2016

Active learning in pre-class assignments: Exploring the use of interactive simulations to enhance reading assignments

Pre-class reading assignments help prepare students for active classes by providing a first exposure to the terms and concepts to be used during class. We investigate if the use of inquiry-oriented PhET-based activities in conjunction with pre-class reading assignments can improve both the preparation of students for in-class learning and student attitudes towards and engagement with pre-class assignments. Over three course modules covering different topics, students were assigned randomly to complete either a textbook-only pre-class assignment or both a textbook pre-class assignment and a PhET-based activity. The assignments helped prepare students for class, as measured by performance on the pre-class quiz relative to a beginning-of-semester pre-test, but no evidence for increased learning due the PhET activity was observed. Students rated the assignments which included PhET as more enjoyable and, for the topic latest in the semester, reported engaging more with the assignments when PhET was included.

physics.ed-ph↗

arXiv2013

Interactions between teaching assistants and students boost engagement in physics labs

Through in-class observations of teaching assistants (TAs) and students in the lab sections of a large introductory physics course, we study which TA behaviors can be used to predict student engagement and, in turn, how this engagement relates to learning. For the TAs, we record data to determine how they adhere to and deliver the lesson plan and how they interact with students during the lab. For the students, we use observations to record the level of student engagement and pre- and post-tests of lab skills to measure learning. We find that the frequency of TA-student interactions, especially those initiated by the TAs, is a positive and significant predictor of student engagement. Interestingly, the length of interactions is not significantly correlated with student engagement. In addition, we find that student engagement was a better predictor of post-test performance than pre-test scores. These results shed light on the manner in which students learn how to conduct inquiry and suggest that, by proactively engaging students, TAs may have a positive effect on student engagement, and therefore learning, in the lab.

physics.ed-ph↗