facebook/OPT 125m quantized using bitsandbytes 4 bit NF4 quantization. All license matters are set based on the underlying facebook/OPT 125m model. This model is work in progress, use it for testing https://github.com/huggingface/transformers/pull/26037 pull request only. known issue: safetensors deleted linked "quant map" / "nested quant map" items.
We use cookies for essential functionality and analytics. You can accept or reject analytics cookies.Cookie policy