MOSS Audio Tokenizer v2 This is the code for the 48khz stereo version of MOSS Audio Tokenizer presented in MOSS Audio Tokenizer: Scaling Audio Tokenizers for Future Audio Foundation Models. MOSS Audio Tokenizer v2 is a unified discrete audio tokenizer based on the Cat ( C ausal A udio T okenizer with T ransformer) architecture. Scaling to 2 billion parameters, it functions as a unified discrete interface, delivering both lossless quality reconstruction and high level semantic alignment. Key Features: Extreme Compression & Variable Bitrate : It compresses 48kHz stereo audio into a remarkably low frame rate of 12.5Hz. Utilizing a 32 layer Residual Vector Quantization stack, it supports high fidelity reconstruction across a wide range of bitrates. Pure Transformer Architecture : The model features a "CNN free" homogeneous architecture built entirely from Causal Transformer blocks. With 2B combined parameters (Encoder + Decoder), it ensures exceptional scalability and supports low latency streaming inference. Large Scale General Audio Training : Trained on 3 million hours of diverse audio data, the model excels at encoding and reconstructing all audio domains, including speech, sound e…
We use cookies for essential functionality and analytics. You can accept or reject analytics cookies.Cookie policy