Qwen3.5 122B A10B AWQ Base model: Qwen/Qwen3.5 122B A10B This repo quantizes the model using data free quantization (no calibration dataset required). 【Dependencies / Installation】 As of 2026 02 25 , make sure your system has cuda12.8 installed. Then, create a fresh Python environment (e.g. python3.12 venv) and run: vLLM Official Guide 【vLLM Startup Command】 Note: When launching with TP=8, include enable expert parallel ; otherwise the expert tensors wouldn’t be evenly sharded across GPU devices. 【Logs】 【Model Files】 File Size Last Updated 77GiB 2026 02 25 【Model Download】 【Overview】 Qwen3.5 122B A10B [!Note] This repository contains model weights and configuration files for the post trained model in the Hugging Face Transformers format. These artifacts are compatible with Hugging Face Transformers, vLLM, SGLang, KTransformers, etc. Over recent months, we have intensified our focus on developing foundation models that deliver exceptional utility and performance. Qwen3.5 represents a significant leap forward, integrating breakthroughs in multimodal learning, architectural efficiency, reinforcement learning scale, and global accessibility to empower developers and enterprises with un…
We use cookies for essential functionality and analytics. You can accept or reject analytics cookies.Cookie policy