kaitchup/Qwen3.5-4B-GGUF-MoQSubscribe and Support GGUF models made with the method ("Mixture of Quantizations") proposed by Waleed Ahmad. They are currently the best GGUF versions of Qwen3.5 4B.

Qwen3.5-4B-GGUF-MoQ

PUBLIC

Mirrored

GGUF models made with the method ("Mixture of Quantizations") proposed by Waleed Ahmad.

License:apache-2.0

imported

huggingface

minio

gguf

base_model:Qwen/Qwen3.5-4B

base_model:quantized:Qwen/Qwen3.5-4B

license:apache-2.0

endpoints_compatible

region:us

imatrix

conversational

2downloads0likesLicense:apache-2.0

Model Card

Edit

Subscribe and Support

GGUF models made with the method ("Mixture of Quantizations") proposed by Waleed Ahmad.

They are currently the best GGUF versions of Qwen3.5-4B.

Qwen3.5 4B_ MoQ vs UD -- Accuracy (Subsets of LiveCodeBench, MMLU Pro, Math 500, and GPQA Diamond) Qwen3.5 4B_ MoQ vs UD -- Generated Tokens (Subsets of LiveCodeBench, MMLU Pro, Math 500, and GPQA Diamond)

Inference Providers

This model isn't deployed by any Inference Provider yet. Deploy this model →

GGUF details

Format

GGUF

Model size

4B params

9 quantization variants

MoQ-3.01.5 GB

MoQ-3.251.7 GB

MoQ-3.51.7 GB

MoQ-3.751.9 GB

MoQ-4.02 GB

MoQ-4.252.1 GB

MoQ-4.52.2 GB

MoQ-4.752.3 GB

+1 more variants

Source

Mirrored from an external registry.

Last synced 6/15/2026

Model tree for kaitchup/Qwen3.5-4B-GGUF-MoQ

Base model

Qwen/Qwen3.5-4B

Commit History

No commits available

We use cookies for essential functionality and analytics. You can accept or reject analytics cookies.Cookie policy