Llamacpp imatrix Quantizations of DarkIdol Llama 3.1 8B Instruct 1.2 Uncensored Using llama.cpp release b3496 for quantization. Original model: https://huggingface.co/aifeifei798/DarkIdol Llama 3.1 8B Instruct 1.2 Uncensored All quants made using imatrix option with dataset from here Run them in LM Studio Prompt format Download a file (not the whole branch) from below: Filename Quant type File Size Split Description DarkIdol Llama 3.1 8B Instruct 1.2 Uncensored f32.gguf f32 32.13GB false Full F32 weights. DarkIdol Llama 3.1 8B Instruct 1.2 Uncensored Q8 0.gguf Q8 0 8.54GB false Extremely high quality, generally unneeded but max available quant. DarkIdol Llama 3.1 8B Instruct 1.2 Uncensored Q6 K L.gguf Q6 K L 6.85GB false Uses Q8 0 for embed and output weights. Very high quality, near perfect, recommended . DarkIdol Llama 3.1 8B Instruct 1.2 Uncensored Q6 K.gguf Q6 K 6.60GB false Very high quality, near perfect, recommended . DarkIdol Llama 3.1 8B Instruct 1.2 Uncensored Q5 K L.gguf Q5 K L 6.06GB false Uses Q8 0 for embed and output weights. High quality, recommended . DarkIdol Llama 3.1 8B Instruct 1.2 Uncensored Q5 K M.gguf Q5 K M 5.73GB false High quality, recommended . DarkIdol…
We use cookies for essential functionality and analytics. You can accept or reject analytics cookies.Cookie policy