arXiv · 2411.11123
Pitch-and-Spectrum-Aware Singing Quality Assessment with Bias Correction and Model Fusion
Abstract
We participated in track 2 of the VoiceMOS Challenge 2024, which aimed to predict the mean opinion score (MOS) of singing samples. Our submission secured the first place among all participating teams, excluding the official baseline. In this paper, we further improve our submission and propose a novel Pitch-and-Spectrum-aware Singing Quality Assessment (PS-SQA) method. The PS-SQA is designed based on the self-supervised-learning (SSL) MOS predictor, incorporating singing pitch and spectral information, which are extracted using pitch histogram and non-quantized neural codec, respectively. Additionally, the PS-SQA introduces a bias correction strategy to address prediction biases caused by low-resource training samples, and employs model fusion technology to further enhance prediction accuracy. Experimental results confirm that our proposed PS-SQA significantly outperforms all competing systems across all system-level metrics, confirming its strong sing quality assessment capabilities.
Explore related subjects
Keep this discovery
Explore connections, maps & timelines
Yu-Fei Shi, Yang Ai, Ye-Xin Lu, Hui-Peng Du, Zhen-Hua Ling. 2024-11-17. Pitch-and-Spectrum-Aware Singing Quality Assessment with Bias Correction and Model Fusion. https://arxiv.org/abs/2411.11123
Cite the original work for its findings. Save a collection to share your selection of sources.