Moonshine Streaming [[Paper]](https://download.moonshine.ai/docs/moonshine streaming paper.pdf) This is the model card for the Moonshine Streaming automatic speech recognition (ASR) models trained and released by Useful Sensors. Moonshine Streaming pairs a lightweight 50~Hz audio frontend with a sliding window Transformer encoder to deliver low latency streaming ASR on edge class hardware. The encoder uses bounded local attention and no positional embeddings (an "ergodic" encoder), while an adapter injects positional information before a standard autoregressive decoder. This model card follows the recommendations from Model Cards for Model Reporting (Mitchell et al.). See the paper draft in this repository for full details. Usage Moonshine Streaming is supported in Hugging Face Transformers. The following example matches the standard seq2seq ASR API and uses the streaming model checkpoint: Note: the current Transformers code path does not yet implement fully efficient streaming for these models. It uses the flash attention backend's sliding window attention when available. Model Details Model type Sequence to sequence ASR model with a streaming, sliding window Transformer encoder a…
We use cookies for essential functionality and analytics. You can accept or reject analytics cookies.Cookie policy