Model Card for Kyutai STT This repo is meant to use the model with Transformers 🤗 Starting with transformers = 4.53.0 and above, you can now run Kyutai STT natively! Inference: Batched inference: See also the project page and the GitHub repository. This is a model for streaming speech to text (STT, also known as automatic speech recognition, ASR). Unlike offline speech to text, where the model needs the entire audio to produce the transcript, our model starts to output the transcript as soon as a few seconds of audio become available. Model Details The model architecture is a Transformer that consumes audio tokenized by Mimi (see the Moshi paper) and outputs text tokens. The frame rate is 12.5 Hz and each audio frame is represented by 32 audio tokens. We release two models: kyutai/stt 1b en fr , an English and French model with ~1B parameters, a 0.5 second delay, and a semantic VAD. kyutai/stt 2.6b en , an English only model with ~2.6B parameters and a 2.5 second delay. Model Description Kyutai STT is a decoder only model for streaming speech to text. It leverages the multistream architecture of Moshi to model text stream based on the speech stream. The text stream is shifted w.r.…
We use cookies for essential functionality and analytics. You can accept or reject analytics cookies.Cookie policy