arXiv subjects

Sunday David Ubur

Publications and source records attributed to Sunday David Ubur.

4 recordsLinked to original sources

arXiv2026

Adaptive Captioning with Emotional Cues: Supporting DHH and Neurodivergent Learners in STEM

Real-time captioning is vital for Deaf and Hard of Hearing (DHH) and neurodivergent learners (e.g., those with ADHD), yet it often omits emotional and non-verbal cues essential for comprehension. This omission is particularly consequential in STEM education, where cognitively demanding material can exacerbate the challenges faced by caption users across diverse ability profiles. In this paper, we present a design-oriented exploration of four captioning prototypes that embed emotional and multimodal cues, including facial expressions, body gestures, keyword highlighting, and emoji. Across a pilot and a main study with 24 participants, we found that certain prototypes reduced self-reported cognitive load and improved comprehension scores compared to traditional captions. Qualitative feedback reveals the importance of customizable caption features to accommodate neurodivergent users' preferences (e.g., ADHD or different levels of comfort with emojis). Our findings contribute to ongoing conversations in accessible technology research about how best to integrate emotional cues into captions in a way that is both usable and beneficial for a wide range of learners.

cs.HC↗

arXiv2025

Narrative Review of Emotional Expression Support in XR: Psychophysiology of Speech-to-Text Interfaces

This narrative review examines recent advancements, limitations, and research gaps in integrating emotional expression into speech-to-text (STT) interfaces within extended reality (XR) environments. Drawing from 37 peer-reviewed studies published between 2020 and 2024, we synthesized literature across multiple domains, including affective computing, psychophysiology, captioning innovation, and immersive human-computer interaction. Thematic categories include communication enhancement technologies for Deaf and Hard of Hearing (DHH) users, emotive captioning strategies, visual and affective augmentation in AR/VR, speech emotion recognition, and the development of empathic systems. Despite the growing accessibility of real-time STT tools, such systems largely fail to convey affective nuance, limiting the richness of communication for DHH users and other caption consumers. This review highlights emerging approaches such as animated captions, emojilization, color-coded overlays, and avatar-based emotion visualization, but finds a persistent gap in real-time emotion-aware captioning within immersive XR contexts. We identify key research opportunities at the intersection of accessibility, XR, and emotional expression, and propose future directions for the development of affect-responsive, user-centered captioning interfaces.

cs.HC↗

arXiv2025

Augmenting Captions with Emotional Cues: An AR Interface for Real-Time Accessible Communication

This paper introduces an augmented reality (AR) captioning framework designed to support Deaf and Hard of Hearing (DHH) learners in STEM classrooms by integrating non-verbal emotional cues into live transcriptions. Unlike conventional captioning systems that offer only plain text, our system fuses real-time speech recognition with affective and visual signal interpretation, including facial movements, gestures, and vocal tone, to produce emotionally enriched captions. These enhanced captions are rendered in an AR interface developed with Unity and provide contextual annotations such as speaker tone markers (e.g., "concerned") and gesture indicators (e.g., "nods"). The system leverages live camera and microphone input, processed through AI models to detect multimodal cues. Findings from preliminary evaluations suggest that this AR-based captioning approach significantly enhances comprehension and reduces cognitive effort compared to standard captions. Our work emphasizes the potential of immersive environments for inclusive, emotion-aware educational accessibility.

cs.HC↗

arXiv2023

Reviewing the Scope and Impact of Implementing a Modernised IT Event-Driven Architecture from Traditional Architecture using Agile Frameworks: A Case study of Bimodal operational strategy

Proposing and implementing software systems, especially web applications for e-commerce using the traditional monolithic approach has been the norm, however, as new user requirements force organisations and developers to add more functionalities to their systems, and as user demands increases, the performance of monolith applications decreases, and maintenance costs rise. These issues have necessitated a need for a better system and that is where Microservices event-driven applications come in. This thesis investigates the scopeand impact of migrating to Microservices, using agile frameworks, and bi-modal ITstrategy. To obtain quantitative data for analysis, prototypes of monolith and microservice websites were integrated with Dropwizard, an open source metrics, and Apache JMeter, and response time and error rate readings were collected. Results showed that monoliths have a faster response time when the number of user request calls is within tolerant range, better than Microservices, but as complexity grows over time and there is increased user requestcalls, Microservices appears to perform better.

cs.SE↗