Ministral 3 14B Instruct 2512 AWQ INT4 Model Details Quantization Details Quantization Method: AWQ Bits: 4 Group Size: 32 Calibration Dataset: 5CD AI/LLaVA CoT o1 Instruct Quantization Tool: llm compressor Memory Usage Type Ministral 3 14B Instruct 2512 BF16 Ministral 3 14B Instruct 2512 AWQ 4bit : : : : : : Memory Size 51.9 GB 19.4 GB Evaluations Benchmarks Ministral 3 14B Instruct 2512 BF16 Ministral 3 14B Instruct 2512 AWQ 4bit : : : : : : Perplexity 1.51151 1.51843 Evaluation Context Length: 16384 Inference Prerequisite Basic Usage Additional Information Changelog v1.0.0 Initial quantized release Authors Name: Ton Cao Contacts: ton@cyan.kiwi Ministral 3 14B Instruct 2512 BF16 The largest model in the Ministral 3 family, Ministral 3 14B offers frontier capabilities and performance comparable to its larger Mistral Small 3.2 24B counterpart. A powerful and efficient language model with vision capabilities. This model is the instruct post trained version, fine tuned for instruction tasks, making it ideal for chat and instruction based use cases. The Ministral 3 family is designed for edge deployment, capable of running on a wide range of hardware. Ministral 3 14B can even be deploy…
We use cookies for essential functionality and analytics. You can accept or reject analytics cookies.Cookie policy