Ornith 1.0 35B GPTQ Pro FOEM 4 bit g128 ns256 These models are built and maintained on rented GPU compute. If you want to show some appreciation, a follow on X or a coffee helps keep the releases coming. Follow @xreyrobert Buy me a coffee This is a GPTQ Pro 4 bit quantization of deepreinforce ai/Ornith 1.0 35B . It is a deployment artifact, not a new fine tune. The goal is to make the Ornith 35B MoE checkpoint practical for GPTQ compatible local and homelab serving while preserving the coding agent oriented behavior of the source model. The headline validation target for this release is text generation and agentic coding workload serving with vLLM + GPTQ Marlin. Vision paths and speculative decoding are not positioned as validated features for this release. Source And Credits Source model: deepreinforce ai/Ornith 1.0 35B Quantization tooling and reference recipe: modelcloud/gptqmodel groxaxo/GPTQ Pro groxaxo/Qwen3.6 27B GPTQ Pro 4bit Thanks to deepreinforce ai for the Ornith release, to modelcloud for GPTQModel, and to groxaxo for GPTQ Pro and the Qwen3.6 GPTQ Pro recipe family this run was aligned with. Artifact Summary Field Value : Source model deepreinforce ai/Ornith 1.0 35B Ar…
We use cookies for essential functionality and analytics. You can accept or reject analytics cookies.Cookie policy