WavLM Large Microsoft's WavLM The large model pretrained on 16kHz sampled speech audio. When using the model, make sure that your speech input is also sampled at 16kHz. Note : This model does not have a tokenizer as it was pretrained on audio alone. In order to use this model speech recognition , a tokenizer should be created and the model should be fine tuned on labeled text data. Check out this blog for more in detail explanation of how to fine tune the model. The model was pre trained on: 60,000 hours of Libri Light 10,000 hours of GigaSpeech 24,000 hours of VoxPopuli Paper: WavLM: Large Scale Self Supervised Pre Training for Full Stack Speech Processing Authors: Sanyuan Chen, Chengyi Wang, Zhengyang Chen, Yu Wu, Shujie Liu, Zhuo Chen, Jinyu Li, Naoyuki Kanda, Takuya Yoshioka, Xiong Xiao, Jian Wu, Long Zhou, Shuo Ren, Yanmin Qian, Yao Qian, Jian Wu, Michael Zeng, Furu Wei Abstract Self supervised learning (SSL) achieves great success in speech recognition, while limited exploration has been attempted for other speech processing tasks. As speech signal contains multi faceted information including speaker identity, paralinguistics, spoken content, etc., learning universal represen…
We use cookies for essential functionality and analytics. You can accept or reject analytics cookies.Cookie policy