Qwen3 4B Qwen3.6 plus Reasoning Distilled GGUF : GGUF Benchmark : khazarai/Multi Domain Reasoning Benchmark Total Questions : 100 Model Score : : khazarai/Qwen3 4B Qwen3.6 plus Reasoning Distilled 75.64 Qwen/Qwen3 4B Thinking 2507 73.73 This is a reasoning distilled variant of Qwen3 4B Thinking, fine tuned using LoRA via Unsloth to replicate the advanced reasoning capabilities of the larger Qwen3.6 plus teacher model. The distillation process focuses on reducing the "rambling" and "uncertainty" often found in smaller models during complex tasks, replacing them with concise, structured, and actionable solution paths. Reasoning Comparison: Base vs. Distilled The primary improvement in this model is the qualitative leap in reasoning structure. Below is a summary of the differences observed when solving complex graph problems (e.g., Shortest Path with Edge Reversals): Base Model (Qwen3 4B Thinking) : Style: Stream of consciousness, exploratory, and verbose. Behavior: The model often talks to itself ("Hmm, interesting", "Wait, no"), struggles to interpret problem constraints correctly on the first try, and enters loops of self correction. It mimics a student trying to figure out the pro…
We use cookies for essential functionality and analytics. You can accept or reject analytics cookies.Cookie policy