gemma-4-12B-it-nvfp4

NVFP4 quantized version of google/gemma-4-12B-it (12B params, unified multimodal model). Produced and maintained by vrfai.

Quantization Details

This model was quantized using NVIDIA ModelOpt with the following configurations:

Excluded from Quantization

The following modules are kept in full precision (BF16) to preserve accuracy:

• lm_head
• model.embed_vision*
• model.embed_audio*
• All self_attn layers (layers 0–47)

Quantization Script

The recipes and scripts used to quantize this model can be found in the following repository:

• VinRobotics/model-quantization-recipes