AWQ Quant of nvidia/Llama 3.1 Nemotron Nano 8B v1 AWQ quant of nvidia/Llama 3.1 Nemotron Nano 8B v1 using llm compressor for quantization. Downloading quants with huggingface cli Click to view download instructions Install hugginface cli: Download quant by targeting the specific quant revision (branch):
We use cookies for essential functionality and analytics. You can accept or reject analytics cookies.Cookie policy