Unlimited OCR — GGUF GGUF quantizations of baidu/Unlimited OCR , a 3B vision language OCR model that pushes DeepSeek OCR one step further (one shot, long horizon document parsing). This repo contains a full spread of K quants and i quants of the language model plus the vision projector (mmproj) needed for image input. ⚠️ Requires a DeepSeek OCR–aware llama.cpp build (PR 17400). Unlimited OCR uses the DeepSeek OCR architecture (a SAM+CLIP DeepEncoder vision tower with a DeepSeek V2 MoE text decoder). Support is not yet merged into upstream main — stock llama.cpp will not load these files. Build the PR branch (instructions below). Files Every run needs two files: one language model GGUF (pick a quant) plus the shared vision projector. The projector is fp16 and identical for all quants. File Quant Bits Size Notes Unlimited OCR BF16.gguf BF16 16 5.47 GiB Full precision conversion. The base every quant is made from; reference quality. Unlimited OCR Q8 0.gguf Q8 0 8 2.91 GiB Near lossless. Best quality short of BF16; recommended if you have the disk/RAM. Unlimited OCR Q6 K.gguf Q6 K 6 2.43 GiB Very high quality, essentially indistinguishable from Q8 0 for OCR. Unlimited OCR Q5 K M.gguf Q…
We use cookies for essential functionality and analytics. You can accept or reject analytics cookies.Cookie policy