SearcharxivSearch

arXiv subjects

Jun-Wei Yeow

Publications and source records attributed to Jun-Wei Yeow.

3 recordsLinked to original sources

MAGENTA: Magnitude and Geometry-Enhanced Training Approach for Long-Tailed Sound Event Localization and Detection

Deep learning-based Sound Event Localization and Detection (SELD) systems suffer severe performance degradation in real-world, long-tailed acoustic environments. Standard continuous regression objectives heavily bias learning toward frequent classes, causing rare events to be systematically under-recognized, an optimization bottleneck we term detection timidity. To overcome this, we propose MAGENTA (Magnitude And Geometry-ENhanced Training Approach), an architecture-agnostic loss framework that geometrically decomposes the regression error into orthogonal radial (activity) and angular (localization) components. Unlike standard methods that rely on static frequency weights, MAGENTA incorporates an intrinsic, difficulty-driven annealing mechanism. By decoupling the objective to independently modulate active detection and inactive suppression, the system can adaptively boost recall for difficult tail classes while modulating inactive penalties to prevent spurious rare-event detections. Evaluations on the STARSS23 dataset demonstrate that MAGENTA yields a 20.5% relative reduction in the aggregated SELD error, effectively recovering tail class performance without compromising head class precision. Code is available at: https://github.com/itsjunwei/MAGENTA

eess.AS

Enhancing Situational Awareness in Wearable Audio Devices Using a Lightweight Sound Event Localization and Detection System

Wearable audio devices with active noise control (ANC) enhance listening comfort but often at the expense of situational awareness. However, this auditory isolation may mask crucial environmental cues, posing significant safety risks. To address this, we propose an environmental intelligence framework that combines Acoustic Scene Classification (ASC) with Sound Event Localization and Detection (SELD). Our system first employs a lightweight ASC model to infer the current environment. The scene prediction then dynamically conditions a SELD network, tuning its sensitivity to detect and localize sounds that are most salient to the current context. On simulated headphone data, the proposed ASC-conditioned SELD system demonstrates improved spatial intelligence over a conventional baseline. This work represents a crucial step towards creating intelligent hearables that can deliver crucial environmental information, fostering a safer and more context-aware listening experience.

eess.AS

Improving Stereo 3D Sound Event Localization and Detection: Perceptual Features, Stereo-specific Data Augmentation, and Distance Normalization

This technical report presents our submission to Task 3 of the DCASE 2025 Challenge: Stereo Sound Event Localization and Detection (SELD) in Regular Video Content. We address the audio-only task in this report and introduce several key contributions. First, we design perceptually-motivated input features that improve event detection, sound source localization, and distance estimation. Second, we adapt augmentation strategies specifically for the intricacies of stereo audio, including channel swapping and time-frequency masking. We also incorporate the recently proposed FilterAugment technique that has yet to be explored for SELD work. Lastly, we apply a distance normalization approach during training to stabilize regression targets. Experiments on the stereo STARSS23 dataset demonstrate consistent performance gains across all SELD metrics. Code to replicate our work is available in this repository: https://github.com/itsjunwei/NTU_SNTL_Task3

eess.AS