Model Summary GritLM is a generative representational instruction tuned language model. It unifies text representation (embedding) and text generation into a single model achieving state of the art performance on both types of tasks. Repository: ContextualAI/gritlm Paper: https://arxiv.org/abs/2402.09906 Logs: https://wandb.ai/muennighoff/gritlm/runs/id130s1m/overview Script: https://github.com/ContextualAI/gritlm/blob/main/scripts/training/train gritlm 8x7b.sh Model Description GritLM 7B Mistral 7B finetuned using GRIT GritLM 8x7B Mixtral 8x7B finetuned using GRIT Use The model usage is documented here. Citation
We use cookies for essential functionality and analytics. You can accept or reject analytics cookies.Cookie policy