WizardCoder Python 34B V1.0 llamafile Model creator: WizardLM Original model: WizardCoder Python 34B V1.0 Description This repo contains llamafile format model files for WizardLM's WizardCoder Python 34B V1.0. WARNING: This README may contain inaccuracies. It was generated automatically by forking TheBloke/WizardCoder Python 34B V1.0 GGUF and piping the README through sed. Errors should be reported to jartine, and do not reflect TheBloke. You can also support his work on Patreon. About llamafile llamafile is a new format introduced by Mozilla Ocho on Nov 20th 2023. It uses Cosmopolitan Libc to turn LLM weights into runnable llama.cpp binaries that run on the stock installs of six OSes for both ARM64 and AMD64. llamafile offers numerous advantages over GGML, such as better tokenisation, and support for special tokens. It is also supports metadata, and is designed to be extensible. Here is an incomplate list of clients and libraries that are known to support llamafile: llama.cpp. The source project for llamafile. Offers a CLI and a server option. text generation webui, the most widely used web UI, with many features and powerful extensions. Supports GPU acceleration. KoboldCpp, a ful…
We use cookies for essential functionality and analytics. You can accept or reject analytics cookies.Cookie policy