Model Summary This is a fork of the original GritLM model. The main difference between this fork and the original model is the name of the architecture used in the config file. The new name is chosen to make it easier to adopt this model in vLLM. GritLM is a generative representational instruction tuned language model. It unifies text representation (embedding) and text generation into a single model achieving state of the art performance on both types of tasks. Repository: ContextualAI/gritlm Paper: https://arxiv.org/abs/2402.09906 Logs: https://wandb.ai/muennighoff/gritlm/runs/0uui712t/overview Script: https://github.com/ContextualAI/gritlm/blob/main/scripts/training/train gritlm 7b.sh Model Description GritLM 7B Mistral 7B finetuned using GRIT GritLM 8x7B Mixtral 8x7B finetuned using GRIT Use The model usage is documented here. Citation
We use cookies for essential functionality and analytics. You can accept or reject analytics cookies.Cookie policy