Chat & support: jartine's Discord server jartine's LLM work is generously supported by a grant from mozilla Mixtral 8X7B Instruct v0.1 llamafile Model creator: Mistral AI Original model: Mixtral 8X7B Instruct v0.1 Description This repo contains llamafile format model files for Mistral AI 's Mixtral 8X7B Instruct v0.1. WARNING: This README may contain inaccuracies. It was generated automatically by forking TheBloke/Mixtral 8x7B Instruct v0.1 GGUF and piping the README through sed. Errors should be reported to jartine, and do not reflect TheBloke. You can also support his work on Patreon. About llamafile llamafile is a new format introduced by Mozilla Ocho on Nov 20th 2023. It uses Cosmopolitan Libc to turn LLM weights into runnable llama.cpp binaries that run on the stock installs of six OSes for both ARM64 and AMD64. Mixtral llamafile Support for Mixtral was merged into Llama.cpp on December 13th. These Mixtral llamafiles are known to work in: llama.cpp as of December 13th KoboldCpp 1.52 as later LM Studio 0.2.9 and later llama cpp python 0.2.23 and later Other clients/libraries, not listed above, may not yet work. Repositories available AWQ model(s) for GPU inference. GPTQ models…
We use cookies for essential functionality and analytics. You can accept or reject analytics cookies.Cookie policy