This are the quantizations of the model LightOnOCR 2 1B bbox soup Try to use the best quality you can run. Quality order: BF16 F16 Q8 0 Q6 K Q5 K M IQ4 NL IQ4 XS Q4 K M For the mmproj, try to use the F32 version as it will produce the best results. Quality order: F32 BF16 F16
We use cookies for essential functionality and analytics. You can accept or reject analytics cookies.Cookie policy