AudioGen Medium 1.5B AudioGen is an autoregressive transformer LM that synthesizes general audio conditioned on text (Text to Audio). Internally, AudioGen operates over discrete representations learnt from the raw waveform, using an EnCodec tokenizer. AudioGen was presented at AudioGen: Textually Guided Audio Generation by Felix Kreuk, Gabriel Synnaeve, Adam Polyak, Uriel Singer, Alexandre Défossez, Jade Copet, Devi Parikh, Yaniv Taigman, Yossi Adi . AudioGen 1.5B is a variant of the original AudioGen model that follows MusicGen architecture. More specifically, it is trained over a 16kHz EnCodec tokenizer with 4 codebooks sampled at 50 Hz with a delay pattern between the codebooks. Having only 50 auto regressive steps per second of audio, this AudioGen model allows faster generation while reaching similar performances to the original AudioGen model introduced in the paper. Audiocraft Usage You can run AudioGen locally through the original Audiocraft library: 1. First install the audiocraft library 2. Make sure to have ffmpeg installed: 3. Run the following Python code: Model details See AudioGen's model card.
We use cookies for essential functionality and analytics. You can accept or reject analytics cookies.Cookie policy