distil whisper large v3 int8 ov Model creator: Distil whisper Original model: distil large v3 Description This is distil large v3 model converted to the OpenVINO™ IR (Intermediate Representation) format with weights compressed to INT8 by NNCF. Quantization Parameters Weight compression was performed using nncf.compress weights with the following parameters: mode: INT8 ASYM group size: 128 For more information on quantization, check the OpenVINO model optimization guide. Compatibility The provided OpenVINO™ IR model is compatible with: OpenVINO version 2025.2.0 and higher Optimum Intel 1.23.0 and higher Running Model Inference with Optimum Intel 1. Install packages required for using Optimum Intel integration with the OpenVINO backend: 2. Run model inference: Running Model Inference with OpenVINO GenAI 1. Install packages required for using OpenVINO GenAI. 2. Download model from HuggingFace Hub 3. Run model inference: More GenAI usage examples can be found in OpenVINO GenAI library docs and samples Limitations Check the original model card for original model card for limitations. Legal information The original model is distributed under mit license. More details can be found in orig…
We use cookies for essential functionality and analytics. You can accept or reject analytics cookies.Cookie policy