SearcharxivSearch

arXiv subjects

Dennis Zyska

Publications and source records attributed to Dennis Zyska.

4 recordsLinked to original sources

Exposía: Teaching and Assessment of Academic Writing Skills for Research Project Proposals and Peer Feedback

We present Exposía, the first public dataset that connects writing and feedback in higher education, enabling research on educationally grounded computational approaches to teaching and evaluating academic writing. Exposía includes student research project proposals and peer and instructor feedback consisting of comments and free-text reviews. The dataset was collected in the "Introduction to Scientific Work" course of the Computer Science. Exposía reflects the multi-stage nature of the academic writing process that includes drafting, receiving feedback, and revising the writing based on the feedback received. Both the project proposals and peer feedback are accompanied by human assessment scores based on a fine-grained, pedagogically-grounded schema for writing and feedback assessment that we develop. We use Exposía to benchmark state-of-the-art large language models (LLMs) on two tasks: automated scoring of (1) the proposals and (2) the student reviews. We find that the two tasks are best served by different LLMs. Furthermore, closed-source models consistently outperform open-weight models, motivating further research on improving the performance of open-weight models preferred in classroom settings. Finally, we establish that a prompting strategy that scores multiple aspects of the writing together is the most effective, paving the way for more effective classroom deployment of modern LLMs.

cs.CL

Transforming Interactions in Thesis Supervision: An Exposé-First Workflow in Higher Education

At the studied research institute, one professorship oversees approximately 20 theses per semester, while day-to-day supervision is distributed among doctoral and postdoctoral researchers. To manage this supervision demand, the institute uses an exposé-first workflow in which students prepare a research proposal before entering the main thesis-writing phase. This paper asks how students, supervisors, and administrators experience the exposé-first workflow as a structured process for early thesis preparation, and how it redistributes responsibility, supervision, and administrative coordination work across roles and two digital platforms. Based on a mixed-methods study analyzed through Frauenberger et al.'s four reflective design lenses, the findings show that the exposé-first model made thesis preparation more structured by turning early research planning into a staged process of proposal writing, feedback, and approval. Students reported that this process helped them clarify research goals and take ownership of their research plans at an early stage. However, the workflow redistributed rather than reduced work: supervisors shifted toward iterative feedback, feasibility checking, and preliminary quality assurance, while administrators carried much of the coordination across platforms, deadlines, submissions, and feedback. The paper contributes an analysis of exposé-first thesis preparation as a sociotechnical workflow, showing how workflow redesign can improve structure while leaving essential administrative coordination work underrecognized.

cs.HC

Pull Requests From The Classroom: Co-Developing Curriculum And Code

Educational technologies often misalign with instructors' pedagogical goals, forcing adaptations that compromise teaching efficacy. In this paper, we present a case study on the co-development of curriculum and technology in the context of a university course on scientific writing. Specifically, we examine how a custom-built peer feedback system was iteratively developed alongside the course to support annotation, feedback exchange, and revision. Results show that while co-development fostered stronger alignment between software features and course goals, it also exposed usability limitations and infrastructure-related frustrations, emphasizing the need for closer coordination between teaching and technical teams.

cs.HC

CARE: Collaborative AI-Assisted Reading Environment

Recent years have seen impressive progress in AI-assisted writing, yet the developments in AI-assisted reading are lacking. We propose inline commentary as a natural vehicle for AI-based reading assistance, and present CARE: the first open integrated platform for the study of inline commentary and reading. CARE facilitates data collection for inline commentaries in a commonplace collaborative reading environment, and provides a framework for enhancing reading with NLP-based assistance, such as text classification, generation or question answering. The extensible behavioral logging allows unique insights into the reading and commenting behavior, and flexible configuration makes the platform easy to deploy in new scenarios. To evaluate CARE in action, we apply the platform in a user study dedicated to scholarly peer review. CARE facilitates the data collection and study of inline commentary in NLP, extrinsic evaluation of NLP assistance, and application prototyping. We invite the community to explore and build upon the open source implementation of CARE.

cs.CL