arXiv subjects

Marcos D. Caballero

Publications and source records attributed to Marcos D. Caballero.

At least 37 records · Page 2Linked to original sources

arXiv2019

Identifying features predictive of faculty integrating computation into physics courses

Computation is a central aspect of 21st century physics practice; it is used to model complicated systems, to simulate impossible experiments, and to analyze mountains of data. Physics departments and their faculty are increasingly recognizing the importance of teaching computation to their students. We recently completed a national survey of faculty in physics departments to understand the state of computational instruction and the factors that underlie that instruction. The data collected from the faculty responding to the survey included a variety of scales, binary questions, and numerical responses. We then used Random Forest, a supervised learning technique, to explore the factors that are most predictive of whether a faculty member decides to include computation in their physics courses. We find that experience using computation with students in their research, or lack thereof and various personal beliefs to be most predictive of a faculty member having experience teaching computation. Interestingly, we find demographic and departmental factors to be less useful factors in our model. The results of this study inform future efforts to promote greater integration of computation into the physics curriculum as well as comment on the current state of computational instruction across the United States.

physics.ed-ph↗

arXiv2018

What counts in laboratories: toward a practice-based identity survey

An essential step in the process of developing a physics identity is the opportunity to engage in authentic physics practices - an ideal place to gain these experiences is physics laboratory courses. We are designing a practice-based identity survey to be used in physics laboratory courses. A first step in determining the impact of these physics practices is understanding student's interpretations of them. In physics education research, discussions of physics practices, are typically grounded in definitions from experts. Our students are not necessarily experts so, asking questions about what these practices mean to the students and what counts is fundamental to insure that our survey questions are being interpreted correctly. This interpretation also varies between levels (advanced lab vs intro) and between courses (transformed vs traditional). Covering the entire space of student interpretations allows us to apply this survey to lab courses across the board.

physics.ed-ph↗

arXiv2018

How computation can facilitate sensemaking about physics: A case study

We present a case study featuring a first-year bio-science university student using computation to solve a radioactive decay problem and interpret the results. In a semi-structured cognitive interview, we use this case to examine the process of sensemaking in a computational science context. We observe the student entering the sensemaking process by inspecting and comparing computational outputs. She then makes several attempts to resolve the perceived inconsistency, foregrounding knowledge from different domains. The key to making sense of the model for this student proves to be thinking about how to implement a better model computationally. This demonstrates that integrating computation in physics activities may provide students with opportunities to engage in sensemaking and critical thinking. We finally discuss some implications for instruction.

physics.ed-ph↗

arXiv2018

Examining the relationship between student performance and video interactions

In this work, we attempted to predict student performance on a suite of laboratory assessments using students' interactions with associated instructional videos. The students' performance is measured by a graded presentation for each of four laboratory presentations in an introductory mechanics course. Each lab assessment was associated with between one and three videos of instructional content. Using video clickstream data, we define summary features (number of pauses, seeks) and contextual information (fraction of time played, in-semester order). These features serve as inputs to a logistic regression (LR) model that aims to predict student performance on the laboratory assessments. Our findings show that LR models are unable to predict student performance. Adding contextual information did not change the model performance. We compare our findings to findings from other studies and explore caveats to the null-result such as representation of the features, the possibility of underfitting, and the complexity of the assessment.

physics.ed-ph↗

arXiv2018

On the Prevalence and Nature of Computational Instruction in Undergraduate Physics Programs across the United States

A national survey of physics faculty was conducted to investigate the prevalence and nature of computational instruction in physics courses across the United States. 1246 faculty from 357 unique institutions responded to the survey. The results suggest that more faculty have some form of computational teaching experience than a decade ago, but it appears that this experience does not necessarily translate to computational instruction in undergraduate students' formal course work. Further, we find that formal programs in computational physics are absent from most departments. A majority of faculty do report using computation on homework and in projects, but few report using computation with interactive engagement methods in the classroom or on exams. Specific factors that underlie these results are the subject of future work, but we do find that there is a variation on the reported experience with computation and the highest degree that students can earn at the surveyed institutions.

physics.ed-ph↗

arXiv2018

The difficulties associated with integrating computation into undergraduate physics

From a department being resistant to change to students not buying into the new computational activities, the challenges that are faced with integrating computation into the physics undergraduate curriculum are varied. The Partnership for Integration of Computation into Undergraduate Physics (PICUP) aims to expand the role of computation in the undergraduate physics curriculum. The research presented in this paper is part of a larger project examining the role of the PICUP workshop in facilitating both the integration of computation into classrooms and developing a supportive community to support this integration. An important part of providing the necessary supports for integration is understanding and categorizing the problems members of this community of integrators face when integrating computation in their courses. Through individual and group interviews, we discuss the barriers to integration that new and experienced community members of PICUP have experienced in the past or perceive could exist in the future.

physics.ed-ph↗

arXiv2018

Denoting and Comparing Leadership Attributes and Behaviors in Group Work

Projects and Practices in Physics (P$^3$) is an introductory physics class at Michigan State University that replaces lectures with a problem based learning environment. To promote the development of group based practices, students all receive group and individual feedback at the end of each week. The groups are comprised of four students, one of which often takes on the role of being the group's "leader." Developing leadership based skills is a specific learning goal of the P$^3$ learning environment and the goal of this research is to examine what leadership-specific actions/traits students in P$^3$ demonstrate while working in their group. The initial phase of this study examined multiple pieces of literature to identify possible characteristics and behaviors that may present themselves in potential leaders -- creating a codebook. This phase of the study applies the codebook to in-class data to compare two tutor-labeled leaders and their leadership styles.

physics.ed-ph↗

arXiv2018

Development of a Modes of Collaboration framework

Group work is becoming increasingly common in introductory physics classrooms. Understanding how students engage in these group learning environments is important for designing and facilitating productive learning opportunities for students. We conducted a study in which we collected video of groups of students working on conceptual electricity and magnetism problems in an introductory physics course. In this setting, students needed to negotiate a common understanding and coordinate group decisions in order to complete the activity successfully. We observed students interacting in several distinct ways while solving these problems. Analysis of these observations focused on identifying the different ways students interacted and articulating what defines and distinguishes them, resulting in the development of the Modes of Collaboration framework. The Modes of Collaboration framework defines student interactions along three dimensions: social, discursive, and disciplinary content. This multi-dimensional approach offers a unique lens through which to consider group work and provides a flexibility that could allow the framework to be adapted for a variety of contexts. We present the framework and several examples of its application here.

physics.ed-ph↗

arXiv2017

What are we assessing? An analysis of the most common concept inventories in physics

Assessing student learning is a cornerstone of educational practice. Standardized assessments have played a significant role in the development of instruction, curricula, and educational spaces in college physics. However, the use of these assessments to evaluate student learning is only productive if they continue to align with our learning goals. Recently, there have been calls to elevate the process of science ("scientific practices") to the same level of importance and emphasis as the concepts of physics ("core ideas" and "crosscutting concepts"). We use the recently developed 3D-LAP to investigate how well the most commonly used standardized assessments in introductory physics (i.e. concept inventories) align with this modern understanding of physics education's learning goals. We find that many of the questions on concept inventories do elicit evidence of student understanding of core ideas, but do not have the potential to elicit evidence of scientific practices or crosscutting concepts. Furthermore, we find that the individual scientific practices and crosscutting concepts that are assessed using these tools are limited to a select few. We discuss the implications that these findings have on designing and testing curricula and instruction both in the past and for the future.

physics.ed-ph↗

arXiv2016

Characterizing College Science Assessments: The Three-Dimensional Learning Assessment Protocol

Many calls to improve science education in college and university settings have focused on improving instructor pedagogy. Meanwhile, science education at the K-12 level is undergoing significant changes as a result of the emphasis on scientific and engineering practices, crosscutting concepts, and disciplinary core ideas. This framework of "three-dimensional learning" is based on the literature about how people learn science and how we can help students put their knowledge to use. Recently, similar changes are underway in higher education by incorporating three-dimensional learning into college science courses. As these transformations move forward, it will become important to assess three-dimensional learning both to align assessments with the learning environment, and to assess the extent of the transformations. In this paper we introduce the Three-Dimensional Learning Assessment Protocol (3D-LAP), which is designed to characterize and support the development of assessment tasks in biology, chemistry, and physics that align with transformation efforts. We describe the development process used by our interdisciplinary team, discuss the validity and reliability of the protocol, and provide evidence that the protocol can distinguish between assessments that have the potential to elicit evidence of three-dimensional learning and those that do not.

physics.ed-ph↗

arXiv2016

${\rm P}^3$: A Practice Focused Learning Environment

There has been an increased focus on the integration of practices into physics curricula, with a particular emphasis on integrating computation into the undergraduate curriculum of scientists and engineers. In this paper, we present a university-level, introductory physics course for science and engineering majors at Michigan State University (MSU) called ${\rm P}^3$ (Projects and Practices in Physics) that is centered around providing introductory physics students with the opportunity to appropriate various science and engineering practices. The ${\rm P}^3$ design integrates computation with analytical problem solving and is built upon a curriculum foundation of problem-based learning, the principles of constructive alignment and the theoretical framework of community of practice. The design includes an innovative approach to computational physics instruction, instructional scaffolds, and a unique approach to assessment that enables instructors to guide students in the development of the practices of a physicist. We present the very positive student related outcomes of the design gathered via attitudinal and conceptual inventories and research interviews of students' reflecting on their experiences in the ${\rm P}^3$ classroom.

physics.ed-ph↗

arXiv2016

Methods for Analyzing Pathways through a Physics Major

Physics Education Research frequently investigates what students studying physics do on small time scales (e.g. single courses, observations within single courses), or post-education time scales (e.g., what jobs do physics majors get?) but there is little research into how students get from the beginning to the end of a physics degree. Our work attempts to visualize students paths through the physics major, and quantitatively describe the students who take physics courses, receive physics degrees, and change degree paths into and out of the physics program at Michigan State University.

physics.ed-ph↗

arXiv2016

Assessing Learning Outcomes in Middle-Division Classical Mechanics: The Colorado Classical Mechanics/Math Methods Instrument

Reliable and validated assessments of introductory physics have been instrumental in driving curricular and pedagogical reforms that lead to improved student learning. As part of an effort to systematically improve our sophomore-level Classical Mechanics and Math Methods course (CM 1) at CU Boulder, we have developed a tool to assess student learning of CM 1 concepts in the upper-division. The Colorado Classical Mechanics/Math Methods Instrument (CCMI) builds on faculty consensus learning goals and systematic observations of student difficulties. The result is a 9-question open-ended post-test that probes student learning in the first half of a two-semester classical mechanics / math methods sequence. In this paper, we describe the design and development of this instrument, its validation, and measurements made in classes at CU Boulder and elsewhere.

physics.ed-ph↗

arXiv2015

Computation across the curriculum: What skills are needed?

Computation, the use of a computer to solve, simulate, or visualize a physical problem, has revolutionized how physics research is done. Computation is used widely to model systems, to simulate experiments, and to analyze data. Yet, in most undergraduate programs, students have little formal opportunity to engage with computation and, thus, are left to their own to develop their computational expertise. As part of a larger project to study how computation is incorporated in some undergraduate physics programs (and how it might be incorporated further), we convened a mini-conference and conducted a series of interviews with industry professionals, academic faculty, and employed bachelor's graduates who make use of computation in their everyday work. We present preliminary results that speak to how participants developed the requisite skills to do professional computational work and what skills they perceive are necessary to conduct such work.

physics.ed-ph↗

arXiv2015

A Case Study: Novel Group Interactions through Introductory Computational Physics

With the advent of high-level programming languages capable of quickly rendering three-dimensional simulations, the inclusion of computers as a learning tool in the classroom has become more prevalent. Although work has begun to study the patterns seen in implementing and assessing computation in introductory physics, more insight is needed to understand the observed effects of blending computation with physics in a group setting. In a newly adopted format of introductory calculus-based mechanics, called Projects and Practices in Physics, groups of students work on short modeling projects -- which make use of a novel inquiry-based approach -- to develop their understanding of both physics content and practice. Preliminary analyses of observational data of groups engaging with computation, coupled with synchronized computer screencast, has revealed a unique group interaction afforded by the practices specific to computational physics -- problem debugging.

physics.ed-ph↗

arXiv2015

Developing the Next Generation of Physics Assessments

Science education at all levels is currently undergoing dramatic changes to its curricula and developing assessments for these new curricula is paramount. We have used the basis of many of these new changes (scientific practices, crosscutting concepts, and core ideas) to develop sets of criteria that can be used to guide assessment development for this new curriculum. We present a case study that uses the criteria we have developed to revise a traditional physics assessment item into an assessment item that is much more aligned with the goals of current transformation efforts. Assessment items developed using this criteria can be used to assess student learning of both the concepts and process of science.

physics.ed-ph↗

arXiv2015

Unpacking Students' Use of Mathematics in Upper-division Physics

In their study of physics beyond the first year of University -- termed upper-division in the US, many of students' primary learning opportunities come from working long, complex back-of-the-book style problems, and from trying to develop an understanding of the underlying physics through solving such problems. Some of the research at the upper-division focuses on how students use mathematics in these problems, and what challenges students encounter along the way. There are a number of different and diverse research studies on students' use of mathematics in the upper-division. These typically utilize one of two broad approaches, with some researchers primarily seeking out and addressing challenges students face, and others working chiefly to unpack students' in-the-moment reasoning. In this paper, we present and discuss both approaches, and then review research efforts that strive to connect these two approaches in order to make sense of students' use of mathematics as well as to uncover particular challenges that students encounter. These recent efforts represent a small step towards synthesizing the two approaches, which we argue is necessary to more meaningfully impact student learning at the upper-division. We close our review and discussion with suggested refinements for future research questions for the physics education research community to consider while it works to understand how students use math in upper-division courses.

physics.ed-ph↗

arXiv2014

Just Math: A new epistemic frame

A goal of PER is to understand how students use math in physics contexts. To investigate how students use math, we need to identify transitions between conceptual sense-making about physical systems and using mathematics to describe and to make predictions about those systems. We reviewed video of students solving a variety of physics problems in small groups through the lens of epistemic frames (e-frames). In this paper, we present a new e-frame, which we are calling "Just Math", that is similar to the Worksheet e-frame, but is characterized by brief, low-level, math-focused utterances between students. Future work will focus on analyzing the transitions into and out of this e-frame so that we may develop a more coherent understanding of students' use of math in physics.

physics.ed-ph↗