arXiv subjects

Edit Yerushalmi

Publications and source records attributed to Edit Yerushalmi.

15 recordsLinked to original sources

arXiv2021

The challenges of changing teaching assistants' grading practices: Requiring students to show evidence of understanding

Teaching assistants (TAs) are often responsible for grading in introductory physics courses at large research universities. Their grading practices can shape students' approaches to problem solving and learning. Physics education research recommends grading practices that encourage students to provide evidence of understanding via explication of the problem-solving process. However, TAs may not necessarily grade in a manner that encourages students to provide evidence of understanding in their solutions. Within the context of a semester-long TA professional development course, we investigated whether encouraging TAs to use a grading rubric that appropriately weights the problem-solving process and having them reflect upon the benefits of using such a rubric prompts TAs to require evidence of understanding in student solutions. We examined how the TAs graded realistic student solutions to introductory physics problems before they were provided a rubric, whether TAs used the rubric as intended, whether they were consistent in grading similar solutions, and how TAs' grading criteria changed after discussing the benefits of a well-designed rubric. We find that many TAs typically applied the rubric consistently when grading similar student solutions but did not require students to provide evidence of understanding. TAs' written responses, class discussions, and individual interviews suggest that the instructional activities involving the grading rubrics in this study were not sufficient to change their grading practices. Interviews and class discussions suggest that helping TAs value a rubric that appropriately weights the problem-solving process may be challenging partly due to the TAs past educational experiences and the departmental context.

physics.ed-ph↗

arXiv2019

Physics teaching assistants' views of different types of introductory problems: Challenge of perceiving the instructional benefits of context-rich and multiple-choice problems

Given a physics scenario, different problem types presenting that scenario in various ways can emphasize different instructional goals. In this investigation, we examined the views of physics graduate teaching assistants (TAs) about the instructional benefits of different types of introductory problems based upon the same problem scenario. Here we report on TAs' views about two of these problem types that were regarded by TAs as the least instructionally beneficial of all problem types--the context rich and multiple-choice formats. Many TAs listed no pros at all for these problem types, despite being explicitly asked for at least one pro. They viewed multiple-choice questions nearly exclusively as tools for high-stakes summative assessment rather than their possible use as formative assessment tools, e.g., as clicker questions even in large classes. Similarly, TAs viewed context-rich problems as overly challenging, unnecessarily wordy, and too time-consuming to be instructionally beneficial to their students. While TAs' concerns have obvious validity and value, the benefits of well-designed multiple-choice questions as a formative assessment tool was not readily identified by them, nor did the TAs recognize the learning benefits associated with solving context-rich problems. Given the powerful ways multiple-choice and context-rich problems can be used for active engagement and formative assessment in different instructional contexts to meet diverse instructional goals, the lack of enthusiasm for these types of problems has implications for future TA professional development programs.

physics.ed-ph↗

arXiv2017

Graduate teaching assistants use different criteria when grading introductory physics vs. quantum mechanics problems

Physics graduate teaching assistants (TAs) are often responsible for grading. Physics education research suggests that grading practices that place the burden of proof for explicating the problem solving process on students can help them develop problem solving skills and learn physics. However, TAs may not have developed effective grading practices and may grade student solutions in introductory and advanced courses differently. In the context of a TA professional development course, we asked TAs to grade student solutions to introductory physics and quantum mechanics problems and explain why their grading approaches were different or similar in the two contexts. TAs expected and rewarded reasoning more frequently in the QM context. Our findings suggest that these differences may at least partly be due to the TAs not realizing that grading can serve as a formative assessment tool and also not thinking about the difficulty of an introductory physics problem from an introductory physics student's perspective.

physics.ed-ph↗

arXiv2017

Physics graduate teaching assistants' beliefs about a grading rubric: Lessons learned

Explication and reflection on expert vs. novice considerations within the problem-solving process characterize a cognitive apprenticeship approach for the development of expert-like problem solving practices. In the context of grading, a cognitive apprenticeship approach requires that instructors place the burden of proof on students, namely, that they require explanations of reasoning and explication of problem-solving processes. However, prior research on instructors' considerations when grading revealed their reluctance to use such a grading approach, motivated by a perception of teaching that places the burden of proof on the instructor. This study focuses on physics graduate teaching assistants (TAs) who play a central role in grading. A short professional development activity was designed that involved eliciting TAs' perceptions regarding grading, presenting a cognitive apprenticeship-inspired grading rubric, followed by a discussion of the dilemma between placing the burden of proof on the instructor vs. the student. In this context, we examined TAs' grading considerations and approaches towards grading and the effect of the short professional development grading activity on them.

physics.ed-ph↗

arXiv2016

Effect of Self Diagnosis on Subsequent Problem Solving Performance

"Self-diagnosis tasks" aim at fostering diagnostic behavior by explicitly requiring students to present diagnosis as part of the activity of reviewing their problem solutions. The recitation classes in an introductory physics class (~200 students) were split into a control group and three experimental groups in which different levels of guidance was provided for performing the self-diagnosis activities. We have been a) investigating how students in each group performed on subsequent near and far transfer questions given as part of the exams; and b) comparing student's initial scores on their quizzes with their performance on the exams, as well as comparing student's self-diagnosis scores with their performance on the exams. We discuss some hypotheses about the students' ability to self-diagnose with different levels of scaffolding support and emphasize the importance of teaching students how to diagnosis their own mistakes. Our findings suggest that struggling with minimal support during in-class self-diagnosis can trigger out-of-class self-diagnosis. Students therefore may be motivated to make sense of the problem they may have not been able to self diagnose, whether independently or in a collaborative effort.

physics.ed-ph↗

arXiv2016

Self-Diagnosis, Scaffolding and Transfer in a More Conventional Introductory Physics Problem

Previously we discussed how well students in an introductory physics course diagnosed their mistakes on a quiz problem with different levels of scaffolding support. In that case, the problem they self-diagnosed was unusually difficult. We also discussed issues related to transfer, particularly the fact that the transfer problem in the midterm that corresponded to the self-diagnosed problem was a far transfer problem. Here, we discuss a related intervention in which we repeated the study methodology with the same students in the same intervention groups, using a new quiz problem which was more typical for these students and a near transfer problem. We discuss how these changes affected students' ability to self-diagnose and transfer from the self-diagnosed quiz problem to a transfer problem on the midterm exam.

physics.ed-ph↗

arXiv2016

Identifying Differences In Diagnostic Skills Between Physics Students: Developing A Rubric

Expert problem solvers are characterized by continuous evaluation of their progress towards a solution. One characteristic of expertise is self-diagnosis directed towards elaboration of the solvers' conceptual understanding, knowledge organization or strategic approach. "Self-diagnosis tasks" aim at fostering diagnostic behavior by explicitly requiring students to present diagnosis as part of the activity of reviewing their problem solutions. We have been investigating how introductory physics students perform in such tasks. Developing a robust rubric is essential for objective evaluation of students' self-diagnosis skills. We discuss the development of a grading rubric that takes into account introductory physics students' content knowledge as well as analysis, planning and presentation skills. Using this rubric, we have found the inter-rater reliability to be better than 80%. The rubric can easily be adapted to other problems, as will be discussed in a companion paper.

physics.ed-ph↗

arXiv2016

Identifying Differences in Diagnostic Skills between Physics Students: Students' Self-Diagnostic Performance Given Alternative Scaffolding

"Self-diagnosis tasks" aim at fostering diagnostic behavior by explicitly requiring students to present diagnosis as part of the activity of reviewing their problem solutions. We have been investigating the extent to which introductory physics students can diagnose their own mistakes when explicitly asked to do so with different levels of scaffolding support provided to them. In our study in an introductory physics class with more than 200 students, the recitation classes were split into three different experimental groups in which different levels of guidance were provided for performing the self-diagnosis activities. We present our findings that students' performance was far from perfect. However, differences in the scaffolding in the three experimental groups (i.e. providing a correct solution and a self-diagnosis rubric) noticeably affected the resulting diagnosis.

physics.ed-ph↗

arXiv2016

Self-Diagnosis, Scaffolding and Transfer: A Tale of Two Problems

Helping students learn from their own mistakes can help them develop habits of mind while learning physics content. Based upon cognitive apprenticeship model, we asked students to self-diagnose their mistakes and learn from reflecting on their problem solution. Varying levels of scaffolding support were provided to students in different groups to diagnose their errors on two context-rich problems that students originally solved in recitation quizzes. Here, we discuss students' cognitive engagement in the two self-diagnosis activities and transfer tasks with different scaffolds.

physics.ed-ph↗

arXiv2016

Learning from mistakes: The effect of students' written self-diagnoses on subsequent problem solving

Helping students learn to think like a physicist is an important goal of many introductory physics courses. One characteristic distinguishing more experienced physicists from novice students is that they make better use of problem solving as a learning opportunity. Experts were found to spend more time than novices in monitoring their work, reflecting upon their possibly deficient approach to solving a problem, reconsidering their choices as necessary, and extending and refining their knowledge structure. Moreover, research on worked-out examples suggests that better performing students are those who self-explain, that is, elaborate to themselves what they are learning from those examples, generate inferences, acknowledge mismatches between their own approach and that of the example, and attempt to resolve conflicts (self-repair). Indeed, physics instructors often express concern that many students do not make an effort to learn from their mistakes after the graded problems are returned to them. Here, we discuss an investigation focusing on how well introductory physics students self-diagnose their mistakes in their quiz solutions and its effect on subsequent problem solving in different interventions.

physics.ed-ph↗

arXiv2016

The group administered interactive questionnaire: An alternative to individual interviews

Individual interviews are often considered to be the gold standard for researchers to understand how people think about phenomena. However, conducting and analyzing interviews is very time consuming. This paper presents the Group Administered Interactive Questionnaire (GAIQ) as an alternative to individual interviews and discusses the pros and cons of each data collection method. Use of GAIQ will be discussed in the context of a study that seeks to understand teaching assistants' reasons for the design of problem solutions for introductory physics.

physics.ed-ph↗

arXiv2016

TA-designed vs. research-oriented problem solutions

In order to study graduate teaching assistants (TAs) beliefs and values about the design of instructor problem solutions, twenty-four TAs were provided with different solutions and asked to discuss their preferences for prominent solution features. TAs preferences for solution features were examined in light of the modeling of expert-like problem solving process as recommended in the literature. Results suggest that while many of the features TAs valued align with expert-like problem solving approaches, they noticed primarily "surface features" of solutions. Moreover, self-reported preferences did not match well with the solutions TAs wrote on their own.

physics.ed-ph↗

arXiv2016

Teaching assistants' beliefs regarding example solutions in introductory physics

As part of a larger study to understand instructors' considerations regarding the learning and teaching of problem solving in an introductory physics course, we investigated beliefs of first-year graduate teaching assistants (TAs) regarding the use of example solutions in introductory physics. In particular, we examine how the goal of promoting expert-like problem solving is manifested in the considerations of graduate TAs choices of example solutions. Twenty-four first-year graduate TAs were asked to discuss their goals for presenting example solutions to students. They were also provided with different example solutions and asked to discuss their preferences for prominent solution features. TAs' awareness, preferences and actual practices related to solution features were examined in light of recommendations from the literature for the modeling of expert-like problem solving approaches. The study concludes that the goal of helping students develop an expert-like problem solving approach underlies many TAs' considerations for the use of example solutions. TAs, however, do not notice and do not use many features described in the research literature as supportive of this goal. A possible explanation for this gap between their belief and practices is that these features conflict with another powerful set of values concerned with keeping students engaged, setting adequate standards, as well as pragmatic considerations such as time requirements and the assignment of grades.

physics.ed-ph↗

arXiv2016

Instructional Goals and Grading Practices of Graduate Students after One Semester of Teaching Experience

Teaching assistants (TAs) are often responsible for grading student solutions. Since grading communicates instructors' expectations, TAs' grading decisions play a crucial role in forming students' approaches to problem solving (PS) in physics. We investigated the change in grading practices and considerations of 18 first-year graduate students participating in a TA professional development (PD) course. The TAs were asked to state their beliefs about the purpose of grading, to grade a set of specially designed student solutions, and to explain their grading decisions. We found that after one semester of teaching experience and participation in PD, TAs did not significantly change their goals for grading (i.e., a learning opportunity for both the student and the instructor) or their grading practice. In addition, TAs' grading practice frequently did not align with their goals. However, some TAs' perceptions of the level of explication required in a student solution did change. Our findings suggest that in order for PD to help TAs better coordinate their goals with appropriate grading practices, PD should focus on TAs' perception of sufficient reasoning in student solutions.

physics.ed-ph↗

arXiv2016

Grading Practices and Considerations of Graduate Students at the Beginning of their Teaching Assignment

Research shows that expert-like approaches to problem-solving can be promoted by encouraging students to explicate their thought processes and follow a prescribed problem-solving strategy. Since grading communicates instructors' expectations, teaching assistants' grading decisions play a crucial role in forming students' approaches to problem-solving in physics. We investigated the grading practices and considerations of 43 graduate teaching assistants (TAs). The TAs were asked to grade a set of specially designed student solutions and explain their grading decisions. We found that in a quiz context, a majority of TAs noticed but did not grade on solution features which promote expert-like approaches to problem-solving. In addition, TAs graded differently in quiz and homework contexts, partly because of how they considered time limitations in a quiz. Our findings can inform professional development programs for TAs.

physics.ed-ph↗