Distil Whisper: distil large v3 Distil Whisper was proposed in the paper Robust Knowledge Distillation via Large Scale Pseudo Labelling. This is the third and final installment of the Distil Whisper English series. It the knowledge distilled version of OpenAI's Whisper large v3, the latest and most performant Whisper model to date. Compared to previous Distil Whisper models, the distillation procedure for distil large v3 has been adapted to give superior long form transcription accuracy with OpenAI's sequential long form algorithm . The result is a distilled model that performs to within 1% WER of large v3 on long form audio using both the sequential and chunked algorithms, and outperforms distil large v2 by 4.8% using the sequential algorithm. The model is also faster than previous Distil Whisper models: 6.3x faster than large v3 , and 1.1x faster than distil large v2. Model Params / M Rel. Latency Short Form Sequential Long Form Chunked Long Form large v3 1550 1.0 8.4 10.0 11.0 distil large v3 756 6.3 9.7 10.8 10.9 distil large v2 756 5.8 10.1 15.6 11.6 Since the sequential algorithm is the "de facto" transcription algorithm across the most popular Whisper libraries (Whisper cpp,…
We use cookies for essential functionality and analytics. You can accept or reject analytics cookies.Cookie policy