Phi 3.5 vision instruct int8 ov Model creator: Microsoft Original model: Phi 3.5 vision instruct Description This is microsoft/Phi 3.5 vision instruct model converted to the OpenVINO™ IR (Intermediate Representation) format with weights compressed to INT8 by NNCF. Quantization Parameters Weight compression was performed using nncf.compress weights with the following parameters: mode: INT8 ASYM Compatibility The provided OpenVINO™ IR model is compatible with: OpenVINO version 2025.0.0 and higher Optimum Intel 1.21.0 and higher Running Model Inference with Optimum Intel 1. Install packages required for using Optimum Intel integration with the OpenVINO backend: 2. Run model inference Limitations Check the original model card for limitations. Legal information The original model is distributed under MIT license. More details can be found in original model card.
We use cookies for essential functionality and analytics. You can accept or reject analytics cookies.Cookie policy