Searcharxiv⌕ Search

arXiv subjects

Karina E. Avila

Publications and source records attributed to Karina E. Avila.

13 recordsLinked to original sources

AI-based Verbal and Visual Scaffolding in a Serious Game: Effects on Learning and Cognitive Load

Due to their interactive nature, serious games offer valuable opportunities for supporting learning in educational contexts. Recent advances in large language models (LLMs) have further opened the door to new forms of personalized scaffolding in education. In this study, we combine both worlds and study three types of AI-based scaffolding designs in a serious game: (i) no scaffolding, (ii) chat-based (verbal) scaffolding provided by an AI-based non-player character (NPC), and (iii) combined chat-(verbal) and action-based (visual) scaffolding in which the AI may both try to explain or demonstrate the next step towards a solution. The scaffolding conditions are embedded in Qookies, a serious game designed to introduce fundamental concepts of quantum technologies. A total of 152 school students, university students, and members of the general public were randomly assigned to one of the three conditions. The results show that all groups experience significant learning gains, confirming the overall effectiveness of the serious game itself. No significant differences in learning outcomes emerged between scaffolding conditions. However, intrinsic cognitive load was lower in the combined chat-and-action (verbal+visual) scaffolding condition compared to the chat (verbal)-only condition, suggesting that visual demonstrations may offer more accessible support. Interaction analyses further revealed that players engaged with the AI character primarily for level-related questions and action recommendations, while deeper interactions were relatively rare.

physics.ed-ph↗

Personalized Multimodal Feedback Using Multiple External Representations: Strategy Profiles and Learning in High School Physics

Multiple external representations (MERs) and personalized feedback support physics learning, yet evidence on how personalized feedback can effectively integrate MERs remains limited. This question is particularly timely given the emergence of multimodal large language models. We conducted a 16-24 week observational study in high school physics (N=661) using a computer-based platform that provided verification and optional elaborated feedback in verbal, graphical and mathematical forms. Linear mixed-effects models and strategy-cluster analyses (ANCOVA-adjusted comparisons) tested associations between feedback use and post-test performance and moderation by representational competence. Elaborated multirepresentational feedback showed a small but consistent positive association with post-test scores independent of prior knowledge and confidence. Learners adopted distinct representation-selection strategies; among students with lower representational competence, using a diverse set of representations related to higher learning, whereas this advantage diminished as competence increased. These findings motivate adaptive feedback designs and inform intelligent tutoring systems capable of tailoring feedback elaboration and representational format to learner profiles, advancing personalized instruction in physics education.

physics.ed-ph↗

Lessons Learned from Designing an Open-Source Automated Feedback System for STEM Education

As distance learning becomes increasingly important and artificial intelligence tools continue to advance, automated systems for individual learning have attracted significant attention. However, the scarcity of open-source online tools that are capable of providing personalized feedback has restricted the widespread implementation of research-based feedback systems. In this work, we present RATsApp, an open-source automated feedback system (AFS) that incorporates research-based features such as formative feedback. The system focuses on core STEM competencies such as mathematical competence, representational competence, and data literacy. It also allows lecturers to monitor students' progress. We conducted a survey based on the technology acceptance model (TAM2) among a set of students (N=64). Our findings confirm the applicability of the TAM2 framework, revealing that factors such as the relevance of the studies, output quality, and ease of use significantly influence the perceived usefulness. We also found a linear relation between the perceived usefulness and the intention to use, which in turn is a significant predictor of the frequency of use. Moreover, the formative feedback feature of RATsApp received positive feedback, indicating its potential as an educational tool. Furthermore, as an open-source platform, RATsApp encourages public contributions to its ongoing development, fostering a collaborative approach to improve educational tools.

cs.CY↗

Challenges and Opportunities of Moderating Usage of Large Language Models in Education

The increased presence of large language models (LLMs) in educational settings has ignited debates concerning negative repercussions, including overreliance and inadequate task reflection. Our work advocates moderated usage of such models, designed in a way that supports students and encourages critical thinking. We developed two moderated interaction methods with ChatGPT: hint-based assistance and presenting multiple answer choices. In a study with students (N=40) answering physics questions, we compared the effects of our moderated models against two baseline settings: unmoderated ChatGPT access and internet searches. We analyzed the interaction strategies and found that the moderated versions exhibited less unreflected usage (e.g., copy \& paste) compared to the unmoderated condition. However, neither ChatGPT-supported condition could match the ratio of reflected usage present in internet searches. Our research highlights the potential benefits of moderating language models, showing a research direction toward designing effective AI-supported educational strategies.

cs.HC↗

Harnessing Large Language Models to Enhance Self-Regulated Learning via Formative Feedback

Effectively supporting students in mastering all facets of self-regulated learning is a central aim of teachers and educational researchers. Prior research could demonstrate that formative feedback is an effective way to support students during self-regulated learning (SRL). However, for formative feedback to be effective, it needs to be tailored to the learners, requiring information about their learning progress. In this work, we introduce LEAP, a novel platform that utilizes advanced large language models (LLMs), such as ChatGPT, to provide formative feedback to students. LEAP empowers teachers with the ability to effectively pre-prompt and assign tasks to the LLM, thereby stimulating students' cognitive and metacognitive processes and promoting self-regulated learning. We demonstrate that a systematic prompt design based on theoretical principles can provide a wide range of types of scaffolds to students, including sense-making, elaboration, self-explanation, partial task-solution scaffolds, as well as metacognitive and motivational scaffolds. In this way, we emphasize the critical importance of synchronizing educational technological advances with empirical research and theoretical frameworks.

physics.ed-ph↗

Unreflected Acceptance -- Investigating the Negative Consequences of ChatGPT-Assisted Problem Solving in Physics Education

Large language models (LLMs) have recently gained popularity. However, the impact of their general availability through ChatGPT on sensitive areas of everyday life, such as education, remains unclear. Nevertheless, the societal impact on established educational methods is already being experienced by both students and educators. Our work focuses on higher physics education and examines problem solving strategies. In a study, students with a background in physics were assigned to solve physics exercises, with one group having access to an internet search engine (N=12) and the other group being allowed to use ChatGPT (N=27). We evaluated their performance, strategies, and interaction with the provided tools. Our results showed that nearly half of the solutions provided with the support of ChatGPT were mistakenly assumed to be correct by the students, indicating that they overly trusted ChatGPT even in their field of expertise. Likewise, in 42% of cases, students used copy & paste to query ChatGPT -- an approach only used in 4% of search engine queries -- highlighting the stark differences in interaction behavior between the groups and indicating limited reflection when using ChatGPT. In our work, we demonstrated a need to (1) guide students on how to interact with LLMs and (2) create awareness of potential shortcomings for users.

physics.ed-ph↗

Physics task development of prospective physics teachers using ChatGPT

The recent advancement of large language models presents numerous opportunities for teaching and learning. Despite widespread public debate regarding the use of large language models, empirical research on their opportunities and risks in education remains limited. In this work, we demonstrate the qualities and shortcomings of using ChatGPT 3.5 for physics task development by prospective teachers. In a randomized controlled trial, 26 prospective physics teacher students were divided into two groups: the first group used ChatGPT 3.5 to develop text-based physics tasks for four different concepts in the field of kinematics for 10th grade high school students, while the second group used a classical textbook to create tasks for the same concepts and target group. The results indicate no difference in task correctness, but students using the textbook achieved a higher clarity and more frequently embedded their questions in a meaningful context. Both groups adapted the level of task difficulty easily to the target group but struggled strongly with sufficient task specificity, i.e., relevant information to solve the tasks were missing. Students using ChatGPT for problem posing rated high system usability but experienced difficulties with output quality. These results provide insights into the opportunities and pitfalls of using large language models in education.

physics.ed-ph↗

Structure and size of the plastic zone formed during nanoindentation of a metallic glass

Using molecular dynamics simulation, we study the plastic zone created during nanoindentation of a large CuZr glass system. The plastic zone consists of a core region, in which virtually every atom undergoes plastic rearrangement, and a tail, where the density distribution of the plastically active atoms decays to zero. Compared to crystalline substrates, the plastic zone in metallic glasses is significantly smaller than in crystals. The so-called plastic-zone size factor, which relates the radius of the plastic zone to the contact radius of the indenter with the substrate, assumes values around 1, while in crystals -- depending on the crystal structure -- values of 2--3 are common. The small plastic zone in metallic glasses is caused by the essentially homogeneous deformation in the amorphous matrix, while in crystals heterogeneous dislocations prevail, whose growth leads to a marked extension of the plastic zone.

physics.comp-ph↗

Nanoscratching of metallic glasses -- An atomistic study

Tribological properties of materials play an important role in engineering applications. Up to now, a number of experimental studies have identified correlations between tribological parameters and the mechanical response. Using molecular dynamics simulations, we study abrasive wear behavior via nanoscratching of a Cu$_{64.5}$Zr$_{35.5}$ metallic glass. The evolution of the normal and transverse forces and hardness values follows the behavior well known for crystalline substrates. In particular, the generation of the frontal pileup weakens the response of the material to the scratching tip and leads to a decrease of the transverse hardness as compared to the normal hardness. However, metallic glasses soften with increasing temperature, particularly above the glass transition temperature thus showing a higher tendency to structurally relax an applied stress. This plastic response is analyzed focusing on local regions of atoms which underwent strong von-Mises strains, since these are the basis of shear-transformation zones and shear bands. The volume occupied by these atoms increases with temperature, but large increases are only observed above the glass transition temperature. We quantify the generation of plasticity by the concept of plastic efficiency, which relates the generation of plastic volume inside the sample with the formation of external damage, viz. the scratch groove. In comparison to nanoindentation, the generation rate of the plastic volume during nanoscratching is significantly temperature dependent making the glass inside more damage-tolerant at lower temperature but more damage-susceptible at elevated temperatures.

physics.comp-ph↗

Slow and Long-ranged Dynamical Heterogeneities in Dissipative Fluids

A two-dimensional bidisperse granular fluid is shown to exhibit pronounced long-ranged dynamical heterogeneities as dynamical arrest is approached. Here we focus on the most direct approach to study these heterogeneities: we identify clusters of slow particles and determine their size, $N_c$, and their radius of gyration, $R_G$. We show that $N_c\propto R_G^{d_f}$, providing direct evidence that the most immobile particles arrange in fractal objects with a fractal dimension, $d_f$, that is observed to increase with packing fraction $ϕ$. The cluster size distribution obeys scaling, approaching an algebraic decay in the limit of structural arrest, i.e., $ϕ\toϕ_c$. Alternatively, dynamical heterogeneities are analyzed via the four-point structure factor $S_4(q,t)$ and the dynamical susceptibility $χ_4(t)$. $S_4(q,t)$ is shown to obey scaling in the full range of packing fractions, $0.6\leqϕ\leq 0.805$, and to become increasingly long-ranged as $ϕ\toϕ_c$. Finite size scaling of $χ_4(t)$ provides a consistency check for the previously analyzed divergences of $χ_4(t)\propto (ϕ-ϕ_c)^{-γ_χ}$ and the correlation length $ξ\propto (ϕ-ϕ_c)^{-γ_ξ}$. We check the robustness of our results with respect to our definition of mobility. The divergences and the scaling for $ϕ\toϕ_c$ suggest a non-equilibrium glass transition which seems qualitatively independent of the coefficient of restitution.

cond-mat.dis-nn↗

Strong Dynamical Heterogeneity and Universal Scaling in Driven Granular Fluids

Large scale simulations of two-dimensional bidisperse granular fluids allow us to determine spatial correlations of slow particles via the four-point structure factor $S_4(q,t)$. Both cases, elastic ($\varepsilon=1$) as well as inelastic ($\varepsilon < 1$) collisions, are studied. As the fluid approaches structural arrest, i.e. for packing fractions in the range $0.6 \le ϕ\le 0.805$, scaling is shown to hold: $S_4(q,t)/χ_4(t)=s(qξ(t))$. Both the dynamic susceptibility, $χ_4(τ_α)$, as well as the dynamic correlation length, $ξ(τ_α)$, evaluated at the $α$ relaxation time, $τ_α$, can be fitted to a power law divergence at a critical packing fraction. The measured $ξ(τ_α)$ widely exceeds the largest one previously observed for hard sphere 3d fluids. The number of particles in a slow cluster and the correlation length are related by a robust power law, $χ_4(τ_α) \approxξ^{d-p}(τ_α)$, with an exponent $d-p\approx 1.6$. This scaling is remarkably independent of $\varepsilon$, even though the strength of the dynamical heterogeneity increases dramatically as $\varepsilon$ grows.

cond-mat.stat-mech↗

Fluctuations in the Time Variable and Dynamical Heterogeneity in Glass-Forming Systems

We test a hypothesis for the origin of dynamical heterogeneity in slowly relaxing systems, namely that it emerges from soft (Goldstone) modes associated with a broken continuous symmetry under time reparametrizations. We do this by constructing coarse grained observables and decomposing the fluctuations of these observables into transverse components, which are associated with the postulated time-fluctuation soft modes, and a longitudinal component, which represents the rest of the fluctuations. Our test is performed on data obtained in simulations of four models of structural glasses. As the hypothesis predicts, we find that the time reparametrization fluctuations become increasingly dominant as temperature is lowered and timescales are increased. More specifically, the ratio between the strengths of the transverse fluctuations and the longitudinal fluctuations grows as a function of the dynamical susceptibility, χ4, which represents the strength of the dynamical heterogeneity; and the correlation volumes for the transverse fluctuations are approximately proportional to those for the dynamical heterogeneity, while the correlation volumes for the longitudinal fluctuations remain small and approximately constant.

cond-mat.dis-nn↗

Mapping dynamical heterogeneity in structural glasses to correlated fluctuations of the time variables

Dynamical heterogeneities -- strong fluctuations near the glass transition -- are believed to be crucial to explain much of the glass transition phenomenology. One possible hypothesis for their origin is that they emerge from soft (Goldstone) modes associated with a broken continuous symmetry under time reparametrizations. To test this hypothesis, we use numerical simulation data from four glass-forming models to construct coarse grained observables that probe the dynamical heterogeneity, and decompose the fluctuations of these observables into two transverse components associated with the postulated time-fluctuation soft modes and a longitudinal component unrelated to them. We find that as temperature is lowered and timescales are increased, the time reparametrization fluctuations become increasingly dominant, and that their correlation volumes grow together with the correlation volumes of the dynamical heterogeneities, while the correlation volumes for longitudinal fluctuations remain small.

cond-mat.soft↗