library name: transformers tags: [] QuantFactory/mamba 130m hf GGUF This is quantized version of state spaces/mamba 130m hf created using llama.cpp Original Model Card Mamba This repository contains the transfromers compatible mamba 2.8b . The checkpoints are untouched, but the full config.json and tokenizer are pushed to this repo. Usage You need to install transformers from main until transformers=4.39.0 is released. We also recommend you to install both causal conv 1d and mamba ssm using: If any of these two is not installed, the "eager" implementation will be used. Otherwise the more optimised cuda kernels will be used. Generation You can use the classic generate API: PEFT finetuning example In order to finetune using the peft library, we recommend keeping the model in float32!
We use cookies for essential functionality and analytics. You can accept or reject analytics cookies.Cookie policy