WavLM Base Microsoft's WavLM The base model pretrained on 16kHz sampled speech audio. When using the model, make sure that your speech input is also sampled at 16kHz. Note : This model does not have a tokenizer as it was pretrained on audio alone. In order to use this model speech recognition , a tokenizer should be created and the model should be fine tuned on labeled text data. Check out this blog for more in detail explanation of how to fine tune the model. The model was pre trained on 960h of Librispeech. Paper: WavLM: Large Scale Self Supervised Pre Training for Full Stack Speech Processing Authors: Sanyuan Chen, Chengyi Wang, Zhengyang Chen, Yu Wu, Shujie Liu, Zhuo Chen, Jinyu Li, Naoyuki Kanda, Takuya Yoshioka, Xiong Xiao, Jian Wu, Long Zhou, Shuo Ren, Yanmin Qian, Yao Qian, Jian Wu, Michael Zeng, Furu Wei Abstract Self supervised learning (SSL) achieves great success in speech recognition, while limited exploration has been attempted for other speech processing tasks. As speech signal contains multi faceted information including speaker identity, paralinguistics, spoken content, etc., learning universal representations for all speech tasks is challenging. In this paper, we…
We use cookies for essential functionality and analytics. You can accept or reject analytics cookies.Cookie policy