Model Card for Zamba2 1.2B Zamba2 1.2B instruct is obtained from Zamba2 1.2B by fine tuning on instruction following and chat datasets. Specifically: 1. SFT of the base Zamba2 1.2B model on ultrachat 200k and Infinity Instruct 2. DPO of the SFT checkpoint on ultrafeedback binarized, orca dpo pairs, and OpenHermesPreferences Zamba2 1.2B Instruct is a hybrid model composed of state space (Mamba2) and transformer blocks. Quick start Prerequisites To download Zamba2 1.2B instruct, install transformers from source: 1. git clone https://github.com/huggingface/transformers.git 2. cd transformers && pip install . To install dependencies necessary to run Mamba2 kernels, install mamba ssm from source (due to compatibility issues with PyTorch) as well as causal conv1d : 1. git clone https://github.com/state spaces/mamba.git 2. cd mamba && git checkout v2.1.0 && pip install . 3. pip install causal conv1d You can run the model without using the optimized Mamba2 kernels, but it is not recommended as it will result in significantly higher latency and memory usage. Inference Performance Zamba2 1.2B Instruct achieves leading instruction following and multi turn chat performance for a model of its s…
We use cookies for essential functionality and analytics. You can accept or reject analytics cookies.Cookie policy