Model Overview Description: The NVIDIA DeepSeek V3 0324 FP4 model is the quantized version of DeepSeek AI's DeepSeek V3 0324 model, which is an auto regressive language model that uses an optimized transformer architecture. For more information, please check here. The NVIDIA DeepSeek V3 0324 FP4 model is quantized with TensorRT Model Optimizer. This model is ready for commercial/non commercial use. Third Party Community Consideration This model is not owned or developed by NVIDIA. This model has been developed and built to a third party’s requirements for this application and use case; see link to Non NVIDIA (DeepSeek V3 0324) Model Card. License/Terms of Use: MIT Deployment Geography: Global Use Case: Developers looking to take off the shelf pre quantized models for deployment in AI Agent systems, chatbots, RAG systems, and other AI powered applications. Release Date: Huggingface 06/06/2025 via https://huggingface.co/nvidia/DeepSeek R1 0528 FP4 Model Architecture: Architecture Type: Transformers Network Architecture: DeepSeek V3 0324 Input: Input Type(s): Text Input Format(s): String Input Parameters: 1D (One Dimensional): Sequences Other Properties Related to Input: Context lengt…
We use cookies for essential functionality and analytics. You can accept or reject analytics cookies.Cookie policy