Model Overview Description: The NVIDIA DeepSeek R1 FP4 model is the quantized version of the DeepSeek AI's DeepSeek R1 model, which is an auto regressive language model that uses an optimized transformer architecture. For more information, please check here. The NVIDIA DeepSeek R1 FP4 model is quantized with TensorRT Model Optimizer. This model is ready for commercial/non commercial use. Third Party Community Consideration This model is not owned or developed by NVIDIA. This model has been developed and built to a third party’s requirements for this application and use case; see link to Non NVIDIA (DeepSeek R1) Model Card. License/Terms of Use: MIT Model Architecture: Architecture Type: Transformers Network Architecture: DeepSeek R1 Input: Input Type(s): Text Input Format(s): String Input Parameters: One Dimensional(1D): Sequences Other Properties Related to Input: Context length up to 128K Output: Output Type(s): Text Output Format: String Output Parameters: 1D: Sequences Other Properties Related to Output: N/A Software Integration: Supported Runtime Engine(s): TensorRT LLM Supported Hardware Microarchitecture Compatibility: NVIDIA Blackwell Preferred Operating System(s): Linux Mo…
We use cookies for essential functionality and analytics. You can accept or reject analytics cookies.Cookie policy