arXiv subjects

Andrew Boudreaux

Publications and source records attributed to Andrew Boudreaux.

14 recordsLinked to original sources

arXiv2022

Online test administration results in students selecting more responses to multiple-choice-multiple-response items

Multiple-choice multiple-response (MCMR) items (i.e., multiple-choice questions for which more than one response may be selected) can be a valuable tool for assessment. Like traditional multiple-choice single-response questions, they are easy to score, but MCMR items can provide more information about student thinking by probing multiple reasoning facets in a single problem context. In this paper, we discuss differences in performance on MCMR items that result from differences in administration method (paper vs. online). In particular, we find a tendency for ``clickiness'' in online administration: students choose more responses to MCMR items when taking the electronic version of the assessment. Based on these findings, we recommend that online administration be compared only to other online administrations and not to paper administrations when comparing student results on MCMR items. These results also suggest that MCMR items provide a unique opportunity to probe differences in online and on-paper administration of low-stakes assessments.

physics.ed-ph↗

arXiv2021

The Physics Inventory of Quantitative Literacy: A tool for assessing mathematical reasoning in introductory physics

One desired outcome of introductory physics instruction is that students will develop facility with reasoning quantitatively about physical phenomena. Little research has been done regarding how students develop the algebraic concepts and skills involved in reasoning productively about physics quantities, which is different from either understanding of physics concepts or problem-solving abilities. We introduce the Physics Inventory of Quantitative Literacy (PIQL) as a tool for measuring quantitative literacy, a foundation of mathematical reasoning, in the context of introductory physics. We present the development of the PIQL and evidence of its validity for use in calculus-based introductory physics courses. Unlike concept inventories, the PIQL is a reasoning inventory, and can be used to assess reasoning over the span of students' instruction in introductory physics. Although mathematical reasoning associated with the PIQL is taught in prior mathematics courses, pre/post test scores reveal that this reasoning isn't readily used by most students in physics, nor does it develop as part of physics instruction--even in courses that use high-quality, research-based curricular materials. As has been the case with many inventories in physics education, we expect use of the PIQL to support the development of instructional strategies and materials--in this case, designed to meet the course objective that all students become quantitatively literate in introductory physics.

physics.ed-ph↗

arXiv2020

Cross-disciplinary learning: A framework for assessing application of concepts across STEM disciplines

We propose and define the construct, cross-disciplinary learning, which can guide learning and assessment in programs that feature sequential learning across multiple STEM disciplines. Cross-disciplinary learning combines insights from interdisciplinary learning, transfer, and resources frameworks and highlights the processes of resource activation, transformation, and integration to support sensemaking in a novel disciplinary context by drawing on knowledge from other, prerequisite disciplines. We describe two measurement approaches based on this construct: A paired multiple choice instrument set to measure the extent of cross-disciplinary learning, and a think-aloud interview approach to provide insights into which resources are activated, and how they are used, in making sense of an unfamiliar phenomenon. We offer implications for program and course assessment.

physics.ed-ph↗

arXiv2020

Exploring student facility with "goes like'' reasoning in introductory physics

Covariational reasoning -- reasoning about how changes in one quantity relate to changes in another quantity -- has been examined extensively in mathematics education research. Little research has been done, however, on covariational reasoning in introductory physics contexts. We explore one aspect of covariational reasoning: ``goes like'' reasoning. ``Goes like'' reasoning refers to ways physicists relate two quantities through a simplified function. For example, physicists often say that ``the electric field goes like one over r squared.'' While this reasoning mode is used regularly by physicists and physics instructors, how students make sense of and use it remains unclear. We present evidence from reasoning inventory items which indicate that many students are sense making with tools from prior math instruction, that could be developed into expert ``goes like'' thinking with direct instruction. Recommendations for further work in characterizing student sense making as a foundation for future development of instruction are made.

physics.ed-ph↗

arXiv2020

When negative is not "less than zero": Electric charge as a signed quantity

Electromagnetism (E&M) is often challenging for students enrolled in introductory college-level physics courses. Compared to mechanics, the mathematics of E&M is more sophisticated and the representations are more abstract. Furthermore, students may lack productive intuitions they had with force and motion. In this article, we explore the mathematization of electric charge. Specifically, we explore how difficulties with positive and negative signs can arise for learners who approach integers primarily as positions on a number line.

physics.ed-ph↗

arXiv2020

Online administration of a reasoning inventory in development

We are developing a new research based assessment (RBA) focused on quantitative reasoning -- rather than conceptual understanding -- in physics contexts. We rapidly moved administration of the RBA online in Spring 2020 due to the COVID-19 pandemic. We present our experiences with online, unproctored administration of an RBA in development to students enrolled in a large-enrollment, calculus-based, introductory physics course. We describe our attempts to adhere to best practices on a limited time frame, and present a preliminary analysis of the results, comparing results from the online administration to earlier results from in-person, proctored administration. We include discussion of online administration of multiple-choice/multiple-response (MCMR) items, which we use on the instrument as a way to probe multiple facets of student reasoning. Our initial comparison indicates little difference between online and paper administrations of the RBA, consistent with previous work by other researchers.

physics.ed-ph↗

arXiv2020

Toward a valid instrument for measuring physics quantitative literacy

We have developed the Physics Inventory of Quantitative Literacy (PIQL) as a tool to measure students' quantitative literacy in the context of introductory physics topics. We present the results from various quantitative analyses used to establish the validity of both the individual items and the PIQL as a whole. We show how examining the results from classical test theory analyses, factor analysis, and item response curves informed decisions regarding the inclusion, removal, or modification of items. We also discuss how the choice to include multiple-choice/multiple-response items has informed both our choices for analyses and the interpretations of their results. We are confident that the most recent version of the PIQL is a valid and reliable instrument for measuring students' physics quantitative literacy in calculus-based introductory physics courses at our primary research site. More data are needed to establish its validity for use at other institutions and in other courses.

physics.ed-ph↗

arXiv2019

A Conceptual Blend Analysis of Physics Quantitative Literacy Reasoning Inventory Items

Mathematical reasoning flexibility across physics contexts is a desirable learning outcome of introductory physics, where the math world and physical world meet. Physics Quantitative Literacy (PQL) is a set of interconnected skills and habits of mind that support quantitative reasoning about the physical world. The Physics Inventory of Quantitative Literacy (PIQL), which we are currently refining and validating, assesses students proportional reasoning, covariational reasoning, and reasoning with signed quantities in physics contexts. In this paper, we apply a Conceptual Blending Theory analysis of two exemplar PIQL items to demonstrate how we are using this theory to help develop an instrument that represents the kind of blended reasoning that characterizes expertise in physics. A Conceptual Blending Theory analysis allows for assessment of hierarchical partially correct reasoning patterns, and thereby holds potential to map the emergence of mathematical reasoning flexibility throughout the introductory physics sequence.

physics.ed-ph↗

arXiv2019

Towards understanding and characterizing expert covariational reasoning in physics

Relating two quantities to describe a physical system or process is at the heart of "doing physics" for novices and experts alike. In this paper, we explore the ways in which experts use covariational reasoning when solving introductory physics graphing problems. Here, graduate students are considered experts for the introductory level material, as they often take the role of instructor at large research universities. Drawing on work from Research in Undergraduate Mathematics Education (RUME), we replicated a study of mathematics experts' covariational reasoning done by Hobson and Moore with physics experts [N. L. F. Hobson and K. C. Moore, in RUME Conference Proceedings, pp. 664-672 (2017)]. We conducted think-aloud interviews with 10 physics graduate students using tasks minimally adapted from the mathematics study. Adaptations were made solely for the purpose of participant understanding of the question, and validated by preliminary interviews. Preliminary findings suggest physics experts approach covariational reasoning problems significantly differently than mathematics experts. In particular, two behaviors are identified in the reasoning of expert physicists that were not seen in the mathematics study. We introduce these two behaviors, which we call Using Compiled Relationships and Neighborhood Analysis, and articulate their differences from the behaviors articulated by Hobson and Moore. Finally, we share implications for instruction and questions for further research.

physics.ed-ph↗

arXiv2019

Using psychometric tools as a window into students' quantitative reasoning in introductory physics

The Physics Inventory of Quantitative Literacy (PIQL), a reasoning inventory under development, aims to assess students' physics quantitative literacy at the introductory level. The PIQL's design presents the challenge of isolating types of mathematical reasoning that are independent of each other in physics questions. In its current form, the PIQL spans three principle reasoning subdomains previously identified in mathematics and physics education research: ratios and proportions, covariation, and signed (negative) quantities. An important psychometric objective is to test the orthogonality of these three reasoning subdomains. We present results from exploratory factor analysis, confirmatory factor analysis, and module analysis that inform interpretations of the underlying structure of the PIQL from a student viewpoint, emphasizing ways in which these results agree and disagree with expert categorization. In addition to informing the development of existing and new PIQL assessment items, these results are also providing exciting insights into students' quantitative reasoning at the introductory level.

physics.ed-ph↗

arXiv2019

A framework for the natures of negativity in introductory physics

Mathematical reasoning skills are a desired outcome of many introductory physics courses, particularly calculus-based physics courses. Positive and negative quantities are ubiquitous in physics, and the sign carries important and varied meanings. Novices can struggle to understand the many roles signed numbers play in physics contexts, and recent evidence shows that unresolved struggle can carry over to subsequent physics courses. The mathematics education research literature documents the cognitive challenge of conceptualizing negative numbers as mathematical objects--both for experts, historically, and for novices as they learn. We contribute to the small but growing body of research in physics contexts that examines student reasoning about signed quantities and reasoning about the use and interpretation of signs in mathematical models. In this paper we present a framework for categorizing various meanings and interpretations of the negative sign in physics contexts, inspired by established work in algebra contexts from the mathematics education research community. Such a framework can support innovation that can catalyze deeper mathematical conceptualizations of signed quantities in the introductory courses and beyond.

physics.ed-ph↗

arXiv2019

Developing a reasoning inventory for measuring physics quantitative literacy

In an effort to improve the quality of citizen engagement in workplace, politics, and other domains in which quantitative reasoning plays an important role, Quantitative Literacy (QL) has become the focus of considerable research and development efforts in mathematics education. QL is characterized by sophisticated reasoning with elementary mathematics. In this project, we extend the notions of QL to include the physics domain and call it Physics Quantitative Literacy (PQL). We report on early stage development from a collaboration that focuses on reasoning inventory design and data analysis methodology for measuring the development of PQL across the introductory physics sequence. We have piloted a prototype assessment designed to measure students' PQL in introductory physics: Physics Inventory of Quantitative Literacy (PIQL). This prototype PIQL focuses on two components of PQL: proportional reasoning, and reasoning with negative quantities. We present preliminary results from approximately 1,000 undergraduate and 20 graduate students.

physics.ed-ph↗

arXiv2017

Developing Mathematical Creativity with Physics Invention Tasks

Modeling the creative mathematical sensemaking that characterizes expert thinking in physics is typically a struggle for new learners. To help students learn to reason this way, we created a set of supplemental activities called Physics Invention Tasks (PITs)*. PITs engage students in quantification, the process of mathematically generating quantities central to modeling in physics. PITs depict a scenario in which students need to engage in decision-making associated with creating quantities in order to resolve a problem. Students make decisions about the arithmetic construction, the magnitude and associated unit, and in some cases spatial direction of a new quantity. The design of PITs is informed by Inventing with Contrasting Cases, an instructional approach shown to foster generativity, i.e., creativity with mathematical structures. In this paper, we describe the theoretical foundation of PITs, and their structure and implementation. We share preliminary observations of the impact of PITs in one course, averaged over two years, as measured by the FCI and CLASS. We see an improvement in the FCI normalized gain corresponding to the introduction of PITS and we see CLASS pre- to post-test gains that may be the highest reported from a large enrollment calculus-based physics course. We discuss future research into the learning mechanisms and instructor influence associated with PITs. *available at http://inventiontasks.physics.rutgers.edu

physics.ed-ph↗

arXiv2015

Student facility with ratio and proportion: Mapping the reasoning space in introductory physics

Six specific modes of reasoning about ratio and proportion have been delineated as a means of operationalizing expert practice. These modes stem from consideration of how physicists reason in context, are informed by prior work in physics and mathematics education, and have grain size matched to the steps in reasoning needed to solve problems commonly used in physics instruction. A suite of assessment questions has been developed and validated to probe student facility with the reasoning modes. Responses to open-ended and multiple-choice versions of the assessment questions have been collected from more than 3000 students at Western Washington University, Rutgers University, and New Mexico State University. Results have been used to identify specific reasoning difficulties, to document differences in performance between student populations, and to explore the effect of question context on student reasoning. We find that students enrolled in university physics courses have difficulty interpreting and applying ratios in context, and in many cases lack facility with the reasoning underlying basic arithmetic operations of division and multiplication.

physics.ed-ph↗