Model Overview Description: The NVIDIA Llama 3.3 70B Instruct FP8 model is the quantized version of the Meta's Llama 3.3 70B Instruct model, which is an auto regressive language model that uses an optimized transformer architecture. For more information, please check here. The NVIDIA Llama 3.3 70B Instruct FP8 model is quantized with TensorRT Model Optimizer. This model is ready for commercial/non commercial use. Third Party Community Consideration This model is not owned or developed by NVIDIA. This model has been developed and built to a third party’s requirements for this application and use case; see link to Non NVIDIA (Meta Llama 3.3 70B Instruct) Model Card. License/Terms of Use: nvidia open model license llama3.3 Deployment Geography: Global Use Case: Developers looking to take off the shelf pre quantized models for deployment Release Date: Huggingface 05/09/2025 via https://huggingface.co/nvidia/Llama 3.3 70B Instruct FP8 Model Architecture: Architecture Type: Transformer Network Architecture: Llama3.3 Input: Input Type(s): Text Input Format(s): String Input Parameters: 1D (One Dimensional): Sequences Other Properties Related to Input: Context length up to 128K Output: Outp…
We use cookies for essential functionality and analytics. You can accept or reject analytics cookies.Cookie policy