SearcharxivSearch

arXiv subjects

Sacha Friedli

Publications and source records attributed to Sacha Friedli.

3 recordsLinked to original sources

AI Meets Mathematics Education: A Case Study on Supporting an Instructor in a Large Mathematics Class with Context-Aware AI

Large-enrollment university courses face persistent challenges in providing timely and scalable instructional support. While generative AI holds promise, its effective use depends on reliability and pedagogical alignment. We present a human-centered case study of AI-assisted support in a Calculus I course, implemented in close collaboration with the course instructor. We developed a system to answer students' questions on a discussion forum, fine-tuning a lightweight language model on 2,588 historical student-instructor interactions. The model achieved 75.3% accuracy on a benchmark of 150 representative questions annotated by five instructors, and in 36% of cases, its responses were rated equal to or better than instructor answers. Post-deployment student survey (N = 105) indicated that students valued the alignment of the responses with the course materials and their immediate availability, while still relying on the instructor verification for trust. We highlight the importance of hybrid human-AI workflows for safe and effective course support.

cs.CY

Could ChatGPT get an Engineering Degree? Evaluating Higher Education Vulnerability to AI Assistants

AI assistants are being increasingly used by students enrolled in higher education institutions. While these tools provide opportunities for improved teaching and education, they also pose significant challenges for assessment and learning outcomes. We conceptualize these challenges through the lens of vulnerability, the potential for university assessments and learning outcomes to be impacted by student use of generative AI. We investigate the potential scale of this vulnerability by measuring the degree to which AI assistants can complete assessment questions in standard university-level STEM courses. Specifically, we compile a novel dataset of textual assessment questions from 50 courses at EPFL and evaluate whether two AI assistants, GPT-3.5 and GPT-4 can adequately answer these questions. We use eight prompting strategies to produce responses and find that GPT-4 answers an average of 65.8% of questions correctly, and can even produce the correct answer across at least one prompting strategy for 85.1% of questions. When grouping courses in our dataset by degree program, these systems already pass non-project assessments of large numbers of core courses in various degree programs, posing risks to higher education accreditation that will be amplified as these models improve. Our results call for revising program-level assessment design in higher education in light of advances in generative AI.

cs.CY

Rigorous Analysis of Singularities and Absence of Analytic Continuation at First Order Phase Transition Points in Lattice Spin Models

We report about two new rigorous results on the non-analytic properties of thermodynamic potentials at first order phase transition. The first one is valid for lattice models ($d\geq 2$) with arbitrary finite state space, and finite-range interactions which have two ground states. Under the only assumption that the Peierls Condition is satisfied for the ground states and that the temperature is sufficiently low, we prove that the pressure has no analytic continuation at the first order phase transition point. The second result concerns Ising spins with Kac potentials $J_γ(x)=γ^dϕ(γx)$, where $0<γ<1$ is a small scaling parameter, and $ϕ$ a fixed finite range potential. In this framework, we relate the non-analytic behaviour of the pressure at the transition point to the range of interaction, which equals $γ^{-1}$. Our analysis exhibits a crossover between the non-analytic behaviour of finite range models ($γ>0$) and analyticity in the mean field limit ($γ\searrow 0$). In general, the basic mechanism responsible for the appearance of a singularity blocking the analytic continuation is that arbitrarily large droplets of the other phase become stable at the transition point.

cond-mat.stat-mech