Mistral 7B Instruct v0.2 llamafile Model creator: Mistral AI Original model: Mistral 7B Instruct v0.2 Description This repo contains llamafile format model files for Mistral AI 's Mistral 7B Instruct v0.2. These files were quantised using hardware kindly provided by Massed Compute. WARNING: This README may contain inaccuracies. It was generated automatically by forking TheBloke/Mistral 7B Instruct v0.2 GGUF and piping the README through sed. Errors should be reported to jartine, and do not reflect TheBloke. You can also support his work on Patreon. About llamafile llamafile is a new format introduced by Mozilla Ocho on Nov 20th 2023. It uses Cosmopolitan Libc to turn LLM weights into runnable llama.cpp binaries that run on the stock installs of six OSes for both ARM64 and AMD64. Here is an incomplete list of clients and libraries that are known to support llamafile: llama.cpp. The source project for llamafile. Offers a CLI and a server option. text generation webui, the most widely used web UI, with many features and powerful extensions. Supports GPU acceleration. KoboldCpp, a fully featured web UI, with GPU accel across all platforms and GPU architectures. Especially good for stor…
We use cookies for essential functionality and analytics. You can accept or reject analytics cookies.Cookie policy