arXiv subjects

Wei-Ping Huang

Publications and source records attributed to Wei-Ping Huang.

21 records · Page 2Linked to original sources

arXiv2022

On the Utility of Self-supervised Models for Prosody-related Tasks

Self-Supervised Learning (SSL) from speech data has produced models that have achieved remarkable performance in many tasks, and that are known to implicitly represent many aspects of information latently present in speech signals. However, relatively little is known about the suitability of such models for prosody-related tasks or the extent to which they encode prosodic information. We present a new evaluation framework, SUPERB-prosody, consisting of three prosody-related downstream tasks and two pseudo tasks. We find that 13 of the 15 SSL models outperformed the baseline on all the prosody-related tasks. We also show good performance on two pseudo tasks: prosody reconstruction and future prosody prediction. We further analyze the layerwise contributions of the SSL models. Overall we conclude that SSL speech models are highly effective for prosody-related tasks.

cs.CL↗

arXiv2022

Few-Shot Cross-Lingual TTS Using Transferable Phoneme Embedding

This paper studies a transferable phoneme embedding framework that aims to deal with the cross-lingual text-to-speech (TTS) problem under the few-shot setting. Transfer learning is a common approach when it comes to few-shot learning since training from scratch on few-shot training data is bound to overfit. Still, we find that the naive transfer learning approach fails to adapt to unseen languages under extremely few-shot settings, where less than 8 minutes of data is provided. We deal with the problem by proposing a framework that consists of a phoneme-based TTS model and a codebook module to project phonemes from different languages into a learned latent space. Furthermore, by utilizing phoneme-level averaged self-supervised learned features, we effectively improve the quality of synthesized speeches. Experiments show that using 4 utterances, which is about 30 seconds of data, is enough to synthesize intelligible speech when adapting to an unseen language using our framework.

eess.AS↗

arXiv2021

Correlated Dirac eigenvalues around the transition temperature on $N_τ=8$ lattices

We investigate the criticality of chiral phase transition manifested in the first and second order derivatives of Dirac eigenvalue spectrum with respect to light quark mass in (2+1)-flavor lattice QCD. Simulations are performed at temperatures from about 137 MeV to 176 MeV on $N_τ=8$ lattices using the highly improved staggered quarks and the tree-level improved Symanzik gauge action. The strange quark mass is fixed to its physical value $m_s^{\text{phy}}$ and the light quark mass is set to $m_s^{\text{phy}}/40$ which corresponds to a Goldstone pion mass $m_π=110$ MeV. We find that in contrast to the case at $T\simeq 205$ MeV $m_l^{-1} \partial ρ(λ, m_l)/\partial m_l$ is no longer equal to $\partial ^2ρ(λ, m_l)/\partial m_l^2$ and $\partial ^2ρ(λ, m_l)/\partial m_l^2$ even becomes negative at certain low temperatures. This means that as temperature getting closer to $T_c$ $ρ(λ, m_l)$ is no longer proportional to $m_l^2$ and thus dilute instanton gas approximation is not valid for these temperatures. We demonstrate the temperature dependence can be factored out in $\partial ρ(λ, m_l)/ \partial m_l$ and $\partial^2 ρ(λ, m_l)/ \partial m_l^2$ at $T \in [137, 153]$ MeV, and then we propose a feasible method to estimate the power $c$ given $ρ\propto m_l^{c}$.

hep-lat↗