This is TinyLlama/TinyLlama 1.1B Chat v1.0 quantized with AutoGPTQ in GPTQ 4 bit Marlin format. Quantize config:
We use cookies for essential functionality and analytics. You can accept or reject analytics cookies.Cookie policy