noctrex/LightOnOCR-2-1B-bbox-soup-GGUFThis are the quantizations of the model LightOnOCR 2 1B bbox soup Try to use the best quality you can run. Quality order: BF16 F16 Q8 0 Q6 K Q5 K M IQ4 NL IQ4 XS Q4 K M For the mmproj, try to use the F32 version as it will produce the best results. Quality order: F32 BF16 F16

LightOnOCR-2-1B-bbox-soup-GGUF

PUBLIC

Mirrored

This are the quantizations of the model LightOnOCR-2-1B-bbox-soup

Tasks:image-to-text

imported

huggingface

gguf

image-to-text

base_model:lightonai/LightOnOCR-2-1B-bbox-soup

base_model:quantized:lightonai/LightOnOCR-2-1B-bbox-soup

endpoints_compatible

region:us

conversational

9.9Kdownloads1likes

Model Card

Edit

This are the quantizations of the model LightOnOCR-2-1B-bbox-soup

Try to use the best quality you can run.

Quality order: BF16 > F16 > Q8_0 > Q6_K > Q5_K_M > IQ4_NL > IQ4_XS > Q4_K_M

For the mmproj, try to use the F32 version as it will produce the best results.
Quality order: F32 > BF16 > F16

Inference ProvidersImage-to-Text

Drop an image or click to upload

This model isn't deployed by any Inference Provider yet. Deploy this model →

GGUF details

Format

GGUF

Model size

1B params

Tasks

image-to-text

Source

Mirrored from an external registry.

Last synced 7/29/2026

Model tree for noctrex/LightOnOCR-2-1B-bbox-soup-GGUF

Base model

lightonai/LightOnOCR-2-1B-bbox-soup

Commit History

No commits available

We use cookies for essential functionality and analytics. You can accept or reject analytics cookies.Cookie policy