ggml-org/Qwen3.6-27B-MTP-GGUFQwen3.6 27B MTP GGUF Recommended way to run this model: Then, access http://localhost:8080 Requires the changes from: https://github.com/ggml org/llama.cpp/pull/22673

Qwen3.6-27B-MTP-GGUF

PUBLIC

Mirrored

imported

huggingface

minio

gguf

base_model:Qwen/Qwen3.6-27B

base_model:quantized:Qwen/Qwen3.6-27B

endpoints_compatible

region:us

conversational

2downloads0likes

Model Card

Edit

Qwen3.6-27B-MTP GGUF

Recommended way to run this model:

# max MTP draft of 2 tokens
llama-server -hf ggml-org/Qwen3.6-27B-MTP-GGUF --spec-type draft-mtp --spec-draft-n-max 2

# max MTP draft of 3 tokens
llama-server -hf ggml-org/Qwen3.6-27B-MTP-GGUF --spec-type draft-mtp --spec-draft-n-max 3

Then, access http://localhost:8080

Requires the changes from: https://github.com/ggml-org/llama.cpp/pull/22673

Inference Providers

This model isn't deployed by any Inference Provider yet. Deploy this model →

GGUF details

Format

GGUF

Model size

27B params

3 quantization variants

mmproj-Qwen3.6-27B-Q8_0600.1 MB

Qwen3.6-27B-MTP-Q8_027.1 GB

Qwen3.6-27B-MTP-BF1650.9 GB

Source

Mirrored from an external registry.

Last synced 8/3/2026

Model tree for ggml-org/Qwen3.6-27B-MTP-GGUF

Base model

Qwen/Qwen3.6-27B

Commit History

No commits available

We use cookies for essential functionality and analytics. You can accept or reject analytics cookies.Cookie policy