Searcharxiv⌕ Search
Home/Archive/arXiv

arXiv · 2609.32504

Toward Human-Aligned Judgement of Speech Emotion Similarity

Yun-Shao Tsai·Yi-Cheng Lin·Chih-Kai Yang·Ho-Jung Cheng·Tsun-Yi Chang·Sheng-Wei Wu·Yi-Shan Chen·Hsiang-Chun Chang·Liang-Chieh Lee·Hung-yi Lee
View original source ↗Read source document ↗Export metadata ↓

Abstract

Evaluating emotion preservation in expressive speech generation involves assessing how closely generated speech matches a reference in emotion. Human listening tests assess this similarity, but their cost motivates automatic measures aligned with human judgments. To support the development and evaluation of such measures, we introduce SES-Bench, a speech emotion similarity benchmark built from human comparisons of two candidate utterances against a shared reference. These comparisons record which candidate listeners find emotionally closer to the reference and the strength of their preference. Using these annotations, we train SES-Judge to score emotion similarity between two utterances. SES-Judge significantly outperforms embedding cosine similarity and prompted large audio-language models in preference accuracy and correlation with human ratings that capture both preference direction and strength.

Explore related subjects

eess.AScs.SD

Keep this discovery

Explore connections, maps & timelines

BibTeXRIS

Yun-Shao Tsai, Yi-Cheng Lin, Chih-Kai Yang, Ho-Jung Cheng, Tsun-Yi Chang, Sheng-Wei Wu, Yi-Shan Chen, Hsiang-Chun Chang, Liang-Chieh Lee, Hung-yi Lee. 2026-09-26. Toward Human-Aligned Judgement of Speech Emotion Similarity. https://arxiv.org/abs/2609.32504

Cite the original work for its findings. Save a collection to share your selection of sources.

KEEP EXPLORING

Related papers

arXiv2026

Conditional Flow Matching for Visually-Guided Acoustic Highlighting

Visually-guided acoustic highlighting seeks to rebalance audio in alignment with the accompanying video, creating a coherent audio-visual experience. While visual saliency and enhancement have been widely studied, acoustic highlighting remains underexplored, often leading to misalignment between visual and auditory focus. Existing approaches use discriminative models, which struggle with the inherent ambiguity in audio remixing, where no natural one-to-one mapping exists between poorly-balanced and well-balanced audio mixes. To address this limitation, we reframe this task as a generative problem and introduce a Conditional Flow Matching (CFM) framework. A key challenge in iterative flow-based generation is that early prediction errors -- in selecting the correct source to enhance -- compound over steps and push trajectories off-manifold. To address this, we introduce a rollout loss that penalizes drift at the final step, encouraging self-correcting trajectories and stabilizing long-range flow integration. We further propose a conditioning module that fuses audio and visual cues before vector field regression, enabling explicit cross-modal source selection. Extensive quantitative and qualitative evaluations show that our method consistently surpasses the previous state-of-the-art discriminative approach, establishing that visually-guided audio remixing is best addressed through generative modeling.

eess.AS↗
arXiv2026

CochlearMark: Audio Watermarking via Phase Locked Auditory Nerve Representations

Modern audio watermarks achieve strong robustness with learned encoder-decoder models, but their behavior under new processing is established empirically. CochlearMark is introduced as a training-free audio watermark that uses auditory-nerve phase-locking as its feature representation. A small waveform perturbation is optimized against a keyed random projection of this representation, and the same projection is used for detection, with no trained encoder or decoder. Because phase-locking represents temporal fine structure, the resulting robustness has a direct physiological interpretation: the mark is retained when this structure is preserved and lost when it is disrupted or rebuilt. Across speech, music, and environmental audio, CochlearMark achieves signal-edit robustness and imperceptibility comparable to trained neural baselines while requiring only a lightweight computational footprint. Among the evaluated training-free methods, CochlearMark is the only one to retain substantial detectability under neural-codec re-encoding.

eess.AS↗
arXiv2026

Continued fractions and passive ladder networks for acoustic impedances: the baffled piston and the horn

Lumped-element networks give transparent, passive models of acoustic impedances whose low- and high-frequency limits can be read from the circuit, but a systematic, arbitrarily accurate construction for non-rational impedances is lacking. Continued fractions, one- and two-point Padé approximants and their identity with ladder networks and Cauer synthesis are introduced in tutorial form and applied to two examples: the radiation impedance of a baffled circular piston and the throat impedance of a horn with a piston mouth. The even contraction of the piston's continued fraction has positive coefficients, certified by interval arithmetic for the first 100 pairs, and yields a ladder of positive resistances, masses and compliances; with 14 elements the error is 4e-4 up to ka = 5. Beranek's four-element network is, to about 2%, the order-two two-point Padé approximant. A horn modelled as a cascade of waveguide sections is a continued fraction whose tail is the mouth impedance; the infinite exponential horn is a periodic continued fraction, an exact high-pass ladder. The piston networks are passive at every certified order (up to 202 elements) and are extended without changing existing elements; for a finite horn the error of the mouth network passes one to one to the throat impedance.

eess.AS↗