Qwen3 Embedding 8B AWQ INT4 INT4 weight only quantization of Qwen/Qwen3 Embedding 8B . Qwen 3 Embedding 8B in INT4. About 5 GB on disk. Runs on an 8 GB consumer GPU. Property Value Base model Qwen/Qwen3 Embedding 8B Quantization INT4 weight only Approx. on disk size ~6.1 GB License Apache License, Version 2.0 Languages English Load (vLLM) Footprint ~6.1 GB on disk. Recommended VRAM: enough headroom for KV cache. License & attribution This artifact is a derivative work of Qwen/Qwen3 Embedding 8B , released by its original authors under the Apache License, Version 2.0 . This artifact is distributed under the same license. The full license text is included in LICENSE , and required attribution is in NOTICE . License text: https://www.apache.org/licenses/LICENSE 2.0 Source model: https://huggingface.co/Qwen/Qwen3 Embedding 8B
We use cookies for essential functionality and analytics. You can accept or reject analytics cookies.Cookie policy