arXiv · 1907.06083
Unsupervised Adversarial Domain Adaptation for Cross-Lingual Speech Emotion Recognition
Abstract
Cross-lingual speech emotion recognition (SER) is a crucial task for many real-world applications. The performance of SER systems is often degraded by the differences in the distributions of training and test data. These differences become more apparent when training and test data belong to different languages, which cause a significant performance gap between the validation and test scores. It is imperative to build more robust models that can fit in practical applications of SER systems. Therefore, in this paper, we propose a Generative Adversarial Network (GAN)-based model for multilingual SER. Our choice of using GAN is motivated by their great success in learning the underlying data distribution. The proposed model is designed in such a way that can learn language invariant representations without requiring target-language data labels. We evaluate our proposed model on four different language emotional datasets, including an Urdu-language dataset to also incorporate alternative languages for which labelled data is difficult to find and which have not been studied much by the mainstream community. Our results show that our proposed model can significantly improve the baseline cross-lingual SER performance for all the considered datasets including the non-mainstream Urdu language data without requiring any labels.
Explore related subjects
Keep this discovery
Explore connections, maps & timelines
Siddique Latif, Junaid Qadir, Muhammad Bilal. 2020-07-28. Unsupervised Adversarial Domain Adaptation for Cross-Lingual Speech Emotion Recognition. https://arxiv.org/abs/1907.06083
Cite the original work for its findings. Save a collection to share your selection of sources.