arXiv subjects

Bethany R. Wilcox

Publications and source records attributed to Bethany R. Wilcox.

At least 37 records · Page 2Linked to original sources

arXiv2019

Faculty survey on upper-division thermal physics content coverage

Thermal physics is a core course requirement for most physics degrees and encompasses both thermodynamics and statistical mechanics content. However, the primary content foci of thermal physics courses vary across universities. This variation can make creation of materials or assessment tools for thermal physics difficult. To determine the scope and content variability of thermal physics courses across institutions, we distributed a survey to over 140 institutions to determine content priorities from faculty and instructors who have taught upper-division thermodynamics and/or statistical mechanics. We present results from the survey, which highlight key similarities and differences in thermal physics content coverage across institutions. Though we see variations in content coverage, we found 9 key topical areas covered by all respondents in their upper-division thermal physics courses. We discuss implications of these findings for the development of instructional tools and assessments that are useful to the widest range of institutions and physics instructors.

physics.ed-ph↗

arXiv2019

Investigating students' behavior and performance in online conceptual assessment

Historically, the implementation of research-based assessments (RBAs) has been a driver of educational change within physics and helped motivate adoption of interactive engagement pedagogies. Until recently, RBAs were given to students exclusively on paper and in-class; however, this approach has important drawbacks including decentralized data collection and the need to sacrifice class time. Recently, some RBAs have been moved to online platforms to address these limitations. Yet, online RBAs present new concerns such as student participation rates, test security, and students' use of outside resources. Here, we report on a study addressing these concerns in both upper-division and lower-division undergraduate physics courses. We gave RBAs to courses at five institutions; the RBAs were hosted online and featured embedded JavaScript code which collected information on students' behaviors (e.g., copying text, printing). With these data, we examine the prevalence of these behaviors, and their correlation with students' scores, to determine if online and paper-based RBAs are comparable. We find that browser loss of focus is the most common online behavior while copying and printing events were rarer. We found that correlations between these behaviors and student performance varied significantly between introductory and upper-division student populations, particularly with respect to the impact of students copying text in order to utilize internet resources. However, while the majority of students engaged in one or more of the targeted online behaviors, we found that, for our sample, none of these behaviors resulted in a significant change in the population's average performance that would threaten our ability to interpret this performance or compare it to paper-based implementations of the RBA.

physics.ed-ph↗

arXiv2019

A cross-context look at upper-division student difficulties with integration

We investigate upper-division student difficulties with direct integration in multiple contexts involving the calculation of a potential from a continuous distribution (e.g., mass, charge, or current). Integration is a tool that has been historically studied at several different points in the curriculum including introductory and upper-division levels. We build off of these prior studies and contribute additional data around student difficulties with multi-variable integration at two new points in the curriculum: middle-division classical mechanics, and upper-division magnetostatics. To facilitate comparisons across prior studies as well as the current work, we utilize an analytical framework that focuses on how students activate, construct, execute, and reflect on mathematical tools during physics problem solving (i.e., the ACER framework). Using a mixed-methods approach involving coded exam solutions and student problem-solving interviews, we identify and compare students' difficulties in these two different context and relate them to what has been found previously in other levels and contexts. We find that some of the observed student difficulties were persistent accross all three contexts (e.g., identifying integration as the appropriate tool, and expressing the difference vector), while other difficulties seemed to fade as students advanced through the curriculum (e.g., expressing differential line, area, and volume elements). We also identified new difficulties that appear in different contexts (e.g., interpreting and expressing the current density).

physics.ed-ph↗

arXiv2018

Correlation Between Student Collaboration Network Centrality and Academic Performance

We compute nodal centrality measures on the collaboration networks of students enrolled in three upper-division physics courses, usually taken sequentially, at the Colorado School of Mines. These are complex networks in which links between students indicate assistance with homework. The courses included in the study are intermediate Classical Mechanics, introductory Quantum Mechanics, and intermediate Electromagnetism. By correlating these nodal centrality measures with students' scores on homework and exams, we find four centrality measures that correlate significantly with students' homework scores in all three courses: in-strength, out-strength, closeness centrality, and harmonic centrality. These correlations suggest that students who not only collaborate often, but also collaborate significantly with many different people tend to achieve higher grades. Centrality measures between simultaneous collaboration networks (analytical vs. numerical homework collaboration) composed of the same students also correlate with each other, suggesting that students' collaboration strategies remain relatively stable when presented with homework assignments targeting different skills. Additionally, we correlate centrality measures between collaboration networks from different courses and find that the four centrality measures with the strongest relationship to students' homework scores are also the most stable measures across networks involving different courses. Correlations of centrality measures with exam scores were generally smaller than the correlations with homework scores, though this finding varied across courses.

physics.ed-ph↗

arXiv2017

Students' views about the nature of experimental physics

The physics community explores and explains the physical world through a blend of theoretical and experimental studies. The future of physics as a discipline depends on training of students in both the theoretical and experimental aspects of the field. However, while student learning within lecture courses has been the subject of extensive research, lab courses remain relatively under-studied. In particular, there is little, if any, data available that addresses the effectiveness of physics lab courses at encouraging students to recognize the nature and importance of experimental physics within the discipline as a whole. To address this gap, we present the first large-scale, national study ($N_{institutions}=75$ and $N_{students}=7167$) of undergraduate physics lab courses through analysis of students' responses to a research-validated assessment designed to investigate students' beliefs about the nature of experimental physics. We find that students often enter and leave physics lab courses with ideas about experimental physics as practiced in their courses that are inconsistent with the views of practicing experimental physicists, and this trend holds at both the introductory and upper-division levels. Despite this inconsistency, we find that both introductory and upper-division students are able to accurately predict the expert-like response even in cases where their views about experimentation in their lab courses disagree. These finding have implications for the recruitment, retention, and adequate preparation of students in physics.

physics.ed-ph↗

arXiv2017

Improvement or selection? A longitudinal analysis of students' views about experimental physics in their lab courses

Laboratory courses represent a unique and potentially important component of the undergraduate physics curriculum, which can be designed to allow students to authentically engage with the process of experimental physics. Among other possible benefits, participation in these courses throughout the undergraduate physics curriculum presents an opportunity to develop students' understanding of the nature and importance of experimental physics within the discipline as a whole. Here, we present and compare both a longitudinal and pseudo-longitudinal analysis of students' responses to a research-based assessment targeting students' views about experimental physics -- the Colorado Learning Attitudes about Science Survey for Experimental Physics (E-CLASS) -- across multiple, required lab courses at a single institution. We find that, while pseudo-longitudinal averages showed increases in students' E-CLASS scores in each consecutive course, analysis of longitudinal data indicates that this increase was not driven by a cumulative impact of laboratory instruction. Rather, the increase was driven by a selection effect in which students who persisted into higher-level lab courses already had more expert-like beliefs, attitudes, and expectations than their peers when they started the lower-level courses.

physics.ed-ph↗

arXiv2017

Student Difficulties with Boundary Conditions in Electrodynamics

Identifying and understanding student difficulties with physics content in a wide variety of topical areas is an active research area within the PER community. In many cases, physics topics appear multiple times in different contexts across the undergraduate physics curriculum. As these common topics reappear, student difficulties can perpetuate from one context to the next, or new difficulties can emerge as students encounter new physical contexts. One example of such a topic is boundary conditions. It is broadly considered to be an important topic that advanced physics undergraduates are expected to understand and apply in multiple topical areas including classical mechanics, quantum mechanics, and throughout electricity and magnetism (EM). We report findings from an investigation of student difficulties using boundary conditions focusing on the context of electrodynamics. Our data sources include student responses to traditional exam questions, conceptual survey questions, and think aloud interviews. The analysis was guided by an analytical framework that characterizes how students activate, construct, execute, and reflect on boundary conditions. Common observed student difficulties include: activating boundary conditions in appropriate contexts; constructing a complex expression for the E&M waves; mathematically simplifying and manipulating complex exponential and, checking if the reflection and transmission coefficient are physical. We also present potential pedagogical implications based on our observations.

physics.ed-ph↗

arXiv2016

Developing skills vs reinforcing concepts in physics labs: Insight from E-CLASS

Physics laboratory courses have been generally acknowledged as an important component of the undergraduate curriculum, particularly with respect to developing students' interest in, and understanding of, experimental physics. There are a number of possible learning goals for these courses including reinforcing physics concepts, developing laboratory skills, and promoting expert-like beliefs about the nature of experimental physics. However, there is little consensus among instructors and researchers interested in the laboratory learning environment as to relative importance of these various learning goals. Here, we contribute data to this debate through the analysis of students' responses to the laboratory-focused assessment known as the Colorado Learning Attitudes about Science Survey for Experimental Physics (E-CLASS). Using a large, national data set of students' responses, we compare students' E-CLASS performance in classes in which the instructor self-reported focusing on developing skills, reinforcing concepts, or both. As the classification of courses was based on instructor self-report, we also provide additional description of these course with respect to how often students engage in particular activities in the lab. We find that courses that focus specifically on developing lab skills have more expert-like postinstruction E-CLASS responses than courses that focus either on reinforcing physics concepts or on both goals. Within first-year courses, this effect is larger for women. Moreover, these findings hold when controlling for the variance in postinstruction scores that is associated with preinstruction E-CLASS score, student major, and student gender.

physics.ed-ph↗

arXiv2016

Impact of instructional approach on students' epistemologies about experimental physics

Student learning in undergraduate physics laboratory courses has garnered increased attention within the PER community. Considerable work has been done to develop curricular materials and pedagogical techniques designed to enhance student learning within laboratory learning environments. Examples of these transformation efforts include the Investigative Science Learning Environment (ISLE), Modeling Instruction, and integrated lab/lecture environments (e.g., studio physics). In addition to improving students' understanding of the physics content, lab courses often have an implicit or explicit goal of increasing students' understanding and appreciation of the nature of experimental physics. We examine students' responses to a laboratory-focused epistemological assessment -- the Colorado Learning Attitudes about Science Survey for Experimental Physics (E-CLASS) -- to explore whether courses using transformed curricula or pedagogy show more expert-like student epistemologies relative to courses using traditional guided labs, as well as how this trend varies based on student major or gender. Data for this study are drawn from an existing data set of responses to the E-CLASS from multiple courses and institutions.

physics.ed-ph↗

arXiv2016

Research-based assessment of students' beliefs about experimental physics: When is gender a factor?

The existence of gender differences in student performance on conceptual assessments and their responses to attitudinal assessments has been repeatedly demonstrated. This difference is often present in students' preinstruction responses and persists in their postinstruction responses. However, one area in which the presence of gender differences has not been extensively explored is undergraduate laboratory courses. For example, one of the few laboratory focused research-based assessments, the Colorado Learning Attitudes about Science Survey for Experimental Physics (E-CLASS), has not been tested for the existence of gender differences in students' responses. Here, we utilize a national data set of responses to the E-CLASS to determine if they demonstrate significant gender differences. We also investigate how these differences vary along multiple student and course demographic slices, including course level (first-year vs.\ beyond-first-year) and major (physics vs.\ non-physics). We observe a gender gap in pre- and postinstruction E-CLASS scores in the aggregate data both for the overall score and for most items individually. However, for some subpopulations (e.g., beyond-first-year students) the size or even existence of the gender gap depends on another dimension (e.g., student major). We also find that for all groups the gap in postinstruction scores vanishes or is greatly reduced when controlling for preinstruction scores, course level, and student major.

physics.ed-ph↗

arXiv2016

Open-ended versus guided laboratory activities: Impact on students' beliefs about experimental physics

Improving students' understanding of the nature of experimental physics is often an explicit or implicit goal of undergraduate laboratory physics courses. However, lab activities in traditional lab courses are typically characterized by highly structured, guided labs that often do not require or encourage students to engage authentically in the process of experimental physics. Alternatively, open-ended laboratory activities can provide a more authentic learning environment by, for example, allowing students to exercise greater autonomy in what and how physical phenomena are investigated. Engaging in authentic practices may be a critical part of improving students' beliefs around the nature of experimental physics. Here, we investigate the impact of open-ended activities in undergraduate lab courses on students' epistemologies and expectations about the nature of experimental physics, as well as their confidence and affect, as measured by the Colorado Learning Attitudes about Science Survey for Experimental Physics (E-CLASS). Using a national data set of student responses to the E-CLASS, we find that the inclusion of some open-ended lab activities in a lab course correlates with more expert-like postinstruction responses relative to courses that include only traditional guided lab activities. This finding holds when examining postinstruction E-CLASS scores while controlling for the variance associated with preinstruction scores, course level, student major, and student gender.

physics.ed-ph↗

arXiv2016

SETI Observations of Exoplanets with the Allen Telescope Array

We report radio SETI observations on a large number of known exoplanets and other nearby star systems using the Allen Telescope Array (ATA). Observations were made over about 19000 hours from May 2009 to Dec 2015. This search focused on narrow-band radio signals from a set totaling 9293 stars, including 2015 exoplanet stars and Kepler objects of interest and an additional 65 whose planets may be close to their Habitable Zone. The ATA observations were made using multiple synthesized beams and an anticoincidence filter to help identify terrestrial radio interference. Stars were observed over frequencies from 1- 9 GHz in multiple bands that avoid strong terrestrial communication frequencies. Data were processed in near-real time for narrow-band (0.7- 100 Hz) continuous and pulsed signals, with transmitter/receiver relative accelerations from -0.3 to 0.3 m/s^2. A total of 1.9 x 10^8 unique signals requiring immediate follow-up were detected in observations covering more than 8 x 10^6 star-MHz. We detected no persistent signals from extraterrestrial technology exceeding our frequency-dependent sensitivity threshold of 180 - 310 x 10^-26 W / m^2.

astro-ph.EP↗

arXiv2016

Students' epistemologies about experimental physics: Validating the Colorado Learning Attitudes about Science Survey for Experimental Physics

Student learning in instructional physics labs represents a growing area of research that includes investigations of students' beliefs and expectations about the nature of experimental physics. To directly probe students' epistemologies about experimental physics and support broader lab transformation efforts at the University of Colorado Boulder (CU) and elsewhere, we developed the Colorado Learning Attitudes about Science Survey for Experimental Physics (E-CLASS). Previous work with this assessment has included establishing the accuracy and clarity of the instrument through student interviews and preliminary testing. Several years of data collection at multiple institutions has resulted in a growing national data set of student responses. Here, we report on results of the analysis of these data to investigate the statistical validity and reliability of the E-CLASS as a measure of students' epistemologies for a broad student population. We find that the E-CLASS demonstrates an acceptable level of both validity and reliability on measures of, item and test discrimination, test-retest reliability, partial-sample reliability, internal consistency, concurrent validity, and convergent validity. We also examine students' responses using Principal Component Analysis and find that, as expected, the E-CLASS does not exhibit strong factors.

physics.ed-ph↗

arXiv2016

Alternative model for the administration and analysis of research-based assessments

Research-based assessments represent a valuable tool for both instructors and researchers interested in improving undergraduate physics education. However, the historical model for disseminating and propagating conceptual and attitudinal assessments developed by the physics education research (PER) community has not resulted in widespread adoption of these assessments within the broader community of physics instructors. Within this historical model, assessment developers create high quality, validated assessments, make them available for a wide range of instructors to use, and provide minimal (if any) support to assist with administration or analysis of the results. Here, we present and discuss an alternative model for assessment dissemination, which is characterized by centralized data collection and analysis. This model provides a greater degree of support for both researchers and instructors in order to more explicitly support adoption of research-based assessments. Specifically, we describe our experiences developing a centralized, automated system for an attitudinal assessment we previously created to examine students' epistemologies and expectations about experimental physics. This system provides a proof-of-concept that we use to discuss the advantages associated with centralized administration and data collection for research-based assessments in PER. We also discuss the challenges that we encountered while developing, maintaining, and automating this system. Ultimately, we argue that centralized administration and data collection for standardized assessments is a viable and potentially advantageous alternative to the default model characterized by decentralized administration and analysis. Moreover, with the help of online administration and automation, this model can support the long-term sustainability of centralized assessment systems.

physics.ed-ph↗

arXiv2015

Student difficulties with Boundary Conditions in electrodynamics

Boundary conditions (BCs) are considered as an important topic that advanced physics under- graduates are expected to understand and apply. We report findings from an investigation of student difficulties using boundary conditions (BCs) in electrodynamics. Our data sources include student responses to traditional exam questions, conceptual survey questions, and think-aloud interviews. The analysis was guided by an analytical framework that characterizes how students activate, con- struct, execute, and reflect on boundary conditions. Common student difficulties include: activating boundary conditions in appropriate contexts; constructing a complex expression for the E&M waves; mathematically simplifying complex exponentials and checking if the reflection and transmission co- efficient are physical. We also present potential pedagogical implications based on our observations.

physics.ed-ph↗

arXiv2015

Correlating students' beliefs about experimental physics with lab course success

Student learning in instructional physics labs is a growing area of research that includes studies exploring students' beliefs and expectations about experimental physics. To directly probe students' epistemologies about experimental physics and support broader lab transformation efforts both at the University of Colorado Boulder (CU) and nationally, we developed the Colorado Learning Attitudes about Science Survey for Experimental Physics (E-CLASS). Previous work focused on establishing the accuracy and clarity of the instrument through student interviews and preliminary testing. Ongoing validation efforts include establishing the extent to which student epistemologies as measured by E-CLASS align with other measures of student learning outcomes (e.g., course grades). Here, we report on correlations between final course grades and E-CLASS scores from two semesters of introductory and upper-division lab courses at CU and discuss implications of our findings for the validity of the E-CLASS instrument.

physics.ed-ph↗

arXiv2015

Validation and analysis of the coupled multiple response Colorado upper-division electrostatics (CUE) diagnostic

Standardized conceptual assessment represents a widely-used tool for educational researchers interested in student learning within the standard undergraduate physics curriculum. For example, these assessments are often used to measure student learning across educational contexts and instructional strategies. However, to support the large-scale implementation often required for cross-institutional testing, it is necessary for these instruments to have question formats that facilitate easy grading. Previously, we created a multiple-response version of an existing, validated, upper-division electrostatics diagnostic with the goal of increasing the instrument's potential for large-scale implementation. Here, we report on the validity and reliability of this new version as an independent instrument. These findings establish the validity of the multiple-response version as measured by multiple test statistics including item difficulty, item discrimination, and internal consistency. Moreover, we demonstrate that the majority of student responses to the new version are internally consistent even when they are incorrect, and provide an example of how the new format can be used to gain insight into student difficulties with specific content in electrostatics.

physics.ed-ph↗

arXiv2015

Upper-division student difficulties with Separation of Variables

Separation of variables can be a powerful technique for solving many of the partial differential equations that arise in physics contexts. Upper-division physics students encounter this technique in multiple topical areas including electrostatics and quantum mechanics. To better understand the difficulties students encounter when utilizing the separation of variables technique, we examined students' responses to midterm exam questions and a standardized conceptual assessment, and conducted think-aloud, problem-solving interviews. Our analysis was guided by an analytical framework that focuses on how students activate, construct, execute, and reflect on the separation of variables technique when solving physics problems. Here we focus on student difficulties with separation of variables as a technique to solve Laplace's equation in both Cartesian and spherical coordinates in the context of junior-level electrostatics. Challenges include: recognizing when separation of variables is the appropriate tool; recalling/justifying the separated form of the potential and the need for the infinite sum; identifying implicit boundary conditions; and spontaneously reflecting on their solutions. Moreover, the type and frequency of errors was often different for SoV problems in Cartesian and spherical geometries. We also briefly discuss implication of these our findings for instruction.

physics.ed-ph↗