arXiv subjects

Philip Eaton

Publications and source records attributed to Philip Eaton.

8 recordsLinked to original sources

arXiv2025

Assessing physics quantitative literacy development in algebra-based physics

Quantitative reasoning is an essential learning objective of physics instruction. The Physics Inventory for Quantitative Literacy (PIQL) is an assessment tool that has been developed for calculus-based physics courses to help instructors evaluate whether their students learn to reason this way (White Brahmia, et al., 2019). However, the PIQL is not appropriate for the large population of students taking physics who are not enrolled in, or have not completed, calculus. To address this need, we have developed the General Equation-based Reasoning inventory of QuaNtity (GERQN). The GERQN is an algebra-based version of the PIQL and is appropriate for most physics students; the only requirement is that students have taken algebra so they are familiar with the use of variable, negative quantities, and linear functions. In this paper we present the development and validation of the GERQN, and a short discussion on how the GERQN can be used by instructors to help their students learn.

physics.ed-ph↗

arXiv2021

The Physics Inventory of Quantitative Literacy: A tool for assessing mathematical reasoning in introductory physics

One desired outcome of introductory physics instruction is that students will develop facility with reasoning quantitatively about physical phenomena. Little research has been done regarding how students develop the algebraic concepts and skills involved in reasoning productively about physics quantities, which is different from either understanding of physics concepts or problem-solving abilities. We introduce the Physics Inventory of Quantitative Literacy (PIQL) as a tool for measuring quantitative literacy, a foundation of mathematical reasoning, in the context of introductory physics. We present the development of the PIQL and evidence of its validity for use in calculus-based introductory physics courses. Unlike concept inventories, the PIQL is a reasoning inventory, and can be used to assess reasoning over the span of students' instruction in introductory physics. Although mathematical reasoning associated with the PIQL is taught in prior mathematics courses, pre/post test scores reveal that this reasoning isn't readily used by most students in physics, nor does it develop as part of physics instruction--even in courses that use high-quality, research-based curricular materials. As has been the case with many inventories in physics education, we expect use of the PIQL to support the development of instructional strategies and materials--in this case, designed to meet the course objective that all students become quantitatively literate in introductory physics.

physics.ed-ph↗

arXiv2021

Online test administration results in students selecting more responses to multiple-choice-multiple-response items

Multiple-choice multiple-response (MCMR) items (i.e., multiple-choice questions for which more than one response may be selected) can be a valuable tool for assessment. Like traditional multiple-choice single-response questions, they are easy to score, but MCMR items can provide more information about student thinking by probing multiple reasoning facets in a single problem context. In this paper, we discuss differences in performance on MCMR items that result from differences in administration method (paper vs. online). In particular, we find a tendency for ``clickiness'' in online administration: students choose more responses to MCMR items when taking the electronic version of the assessment. Based on these findings, we recommend that online administration be compared only to other online administrations and not to paper administrations when comparing student results on MCMR items. These results also suggest that MCMR items provide a unique opportunity to probe differences in online and on-paper administration of low-stakes assessments.

physics.ed-ph↗

arXiv2020

Exploring student facility with "goes like'' reasoning in introductory physics

Covariational reasoning -- reasoning about how changes in one quantity relate to changes in another quantity -- has been examined extensively in mathematics education research. Little research has been done, however, on covariational reasoning in introductory physics contexts. We explore one aspect of covariational reasoning: ``goes like'' reasoning. ``Goes like'' reasoning refers to ways physicists relate two quantities through a simplified function. For example, physicists often say that ``the electric field goes like one over r squared.'' While this reasoning mode is used regularly by physicists and physics instructors, how students make sense of and use it remains unclear. We present evidence from reasoning inventory items which indicate that many students are sense making with tools from prior math instruction, that could be developed into expert ``goes like'' thinking with direct instruction. Recommendations for further work in characterizing student sense making as a foundation for future development of instruction are made.

physics.ed-ph↗

arXiv2020

Online administration of a reasoning inventory in development

We are developing a new research based assessment (RBA) focused on quantitative reasoning -- rather than conceptual understanding -- in physics contexts. We rapidly moved administration of the RBA online in Spring 2020 due to the COVID-19 pandemic. We present our experiences with online, unproctored administration of an RBA in development to students enrolled in a large-enrollment, calculus-based, introductory physics course. We describe our attempts to adhere to best practices on a limited time frame, and present a preliminary analysis of the results, comparing results from the online administration to earlier results from in-person, proctored administration. We include discussion of online administration of multiple-choice/multiple-response (MCMR) items, which we use on the instrument as a way to probe multiple facets of student reasoning. Our initial comparison indicates little difference between online and paper administrations of the RBA, consistent with previous work by other researchers.

physics.ed-ph↗

arXiv2020

Toward a valid instrument for measuring physics quantitative literacy

We have developed the Physics Inventory of Quantitative Literacy (PIQL) as a tool to measure students' quantitative literacy in the context of introductory physics topics. We present the results from various quantitative analyses used to establish the validity of both the individual items and the PIQL as a whole. We show how examining the results from classical test theory analyses, factor analysis, and item response curves informed decisions regarding the inclusion, removal, or modification of items. We also discuss how the choice to include multiple-choice/multiple-response items has informed both our choices for analyses and the interpretations of their results. We are confident that the most recent version of the PIQL is a valid and reliable instrument for measuring students' physics quantitative literacy in calculus-based introductory physics courses at our primary research site. More data are needed to establish its validity for use at other institutions and in other courses.

physics.ed-ph↗

arXiv2019

Using psychometric tools as a window into students' quantitative reasoning in introductory physics

The Physics Inventory of Quantitative Literacy (PIQL), a reasoning inventory under development, aims to assess students' physics quantitative literacy at the introductory level. The PIQL's design presents the challenge of isolating types of mathematical reasoning that are independent of each other in physics questions. In its current form, the PIQL spans three principle reasoning subdomains previously identified in mathematics and physics education research: ratios and proportions, covariation, and signed (negative) quantities. An important psychometric objective is to test the orthogonality of these three reasoning subdomains. We present results from exploratory factor analysis, confirmatory factor analysis, and module analysis that inform interpretations of the underlying structure of the PIQL from a student viewpoint, emphasizing ways in which these results agree and disagree with expert categorization. In addition to informing the development of existing and new PIQL assessment items, these results are also providing exciting insights into students' quantitative reasoning at the introductory level.

physics.ed-ph↗

arXiv2019

Developing a reasoning inventory for measuring physics quantitative literacy

In an effort to improve the quality of citizen engagement in workplace, politics, and other domains in which quantitative reasoning plays an important role, Quantitative Literacy (QL) has become the focus of considerable research and development efforts in mathematics education. QL is characterized by sophisticated reasoning with elementary mathematics. In this project, we extend the notions of QL to include the physics domain and call it Physics Quantitative Literacy (PQL). We report on early stage development from a collaboration that focuses on reasoning inventory design and data analysis methodology for measuring the development of PQL across the introductory physics sequence. We have piloted a prototype assessment designed to measure students' PQL in introductory physics: Physics Inventory of Quantitative Literacy (PIQL). This prototype PIQL focuses on two components of PQL: proportional reasoning, and reasoning with negative quantities. We present preliminary results from approximately 1,000 undergraduate and 20 graduate students.

physics.ed-ph↗