This model is an int4 model with group size 128 and symmetric quantization of Qwen/Qwen2 0.5B Instruct generated by intel/auto round algorithm. ⚠️ Important: This model is used for internal testing with VLLM. Please do not delete or modify without approval.
We use cookies for essential functionality and analytics. You can accept or reject analytics cookies.Cookie policy