Model Card for Mixtral 8x22B The Mixtral 8x22B Large Language Model (LLM) is a pretrained generative Sparse Mixture of Experts. For full details of this model please read our release blog post. Warning This repo contains weights that are compatible with vLLM serving of the model as well as Hugging Face transformers library. It is based on the original Mixtral torrent release, but the file format and parameter names are different. Run the model By default, transformers will load the model in full precision. Therefore you might be interested to further reduce down the memory requirements to run the model through the optimizations we offer in HF ecosystem: Notice Mixtral 8x22B is a pretrained base model and therefore does not have any moderation mechanisms. The Mistral AI Team Albert Jiang, Alexandre Sablayrolles, Alexis Tacnet, Antoine Roux, Arthur Mensch, Audrey Herblin Stoop, Baptiste Bout, Baudouin de Monicault, Blanche Savary, Bam4d, Caroline Feldman, Devendra Singh Chaplot, Diego de las Casas, Eleonore Arcelin, Emma Bou Hanna, Etienne Metzger, Gianna Lengyel, Guillaume Bour, Guillaume Lample, Harizo Rajaona, Jean Malo Delignon, Jia Li, Justus Murke, Louis Martin, Louis Ternon, L…
We use cookies for essential functionality and analytics. You can accept or reject analytics cookies.Cookie policy