arXiv · 1803.09816
Spectral feature mapping with mimic loss for robust speech recognition
Abstract
For the task of speech enhancement, local learning objectives are agnostic to phonetic structures helpful for speech recognition. We propose to add a global criterion to ensure de-noised speech is useful for downstream tasks like ASR. We first train a spectral classifier on clean speech to predict senone labels. Then, the spectral classifier is joined with our speech enhancer as a noisy speech recognizer. This model is taught to imitate the output of the spectral classifier alone on clean speech. This \textit{mimic loss} is combined with the traditional local criterion to train the speech enhancer to produce de-noised speech. Feeding the de-noised speech to an off-the-shelf Kaldi training recipe for the CHiME-2 corpus shows significant improvements in WER.
Explore related subjects
Keep this discovery
Deblin Bagchi, Peter Plantinga, Adam Stiff, Eric Fosler-Lussier. 2018-03-26. Spectral feature mapping with mimic loss for robust speech recognition. https://arxiv.org/abs/1803.09816
Cite the original work for its findings. Save a collection to share your selection of sources.