Generative AI Availability, Grades, and Student Satisfaction at a Large University
The availability of generative AI (GenAI) has raised concerns that college students substitute GenAI for cognitive effort, earning high grades without learning. If this "GenAI substitution hypothesis" is true, grades should rise disproportionately in GenAI-susceptible courses--those relying more on assessments like take-home problem sets and essays rather than in-class exams. Student satisfaction (self-reported understanding and interest) may also shift. We test this hypothesis using syllabus and administrative data from a large U.S. university (2016-2025; 138,386 students; 72,730 course offerings). We measure GenAI susceptibility by extracting assessment types from syllabi with a human-validated LLM pipeline. We then use a difference-in-differences design comparing courses before and after ChatGPT's release, modeling COVID-19 effects as persistent or transient. Effects on grades and satisfaction are small and sensitive to COVID modeling choices, with no detectable differences by students' prior academic preparation. Exploratory analyses show that the link between pre-college test scores and grades has not detectably weakened in more susceptible courses, and that instructors have been making courses less susceptible since before ChatGPT. Our findings temper concerns that GenAI inflates grades and reduces satisfaction, partly because instructors may adapt their pedagogy.