mlx-community/gemma-4-12B-it-qat-mxfp8
Use with mlx
pip install -U mlx-vlm
python -m mlx_vlm.generate --model mlx-community/gemma-4-12B-it-qat-mxfp8 --max-tokens 100 --temperature 0.0 --prompt "Describe this image." --image <path_to_image>
We use cookies for essential functionality and analytics. You can accept or reject analytics cookies.Cookie policy
pip install -U mlx-vlm
python -m mlx_vlm.generate --model mlx-community/gemma-4-12B-it-qat-mxfp8 --max-tokens 100 --temperature 0.0 --prompt "Describe this image." --image <path_to_image>
Mirrored from an external registry.
Last synced 8/3/2026
No commits available