This model is the ONNX version of https://huggingface.co/SamLowe/roberta base go emotions. Full precision ONNX version onnx/model.onnx is the full precision ONNX version that has identical accuracy/metrics to the original Transformers model and has the same model size (499MB) is faster in inference than normal Transformers, particularly for smaller batch sizes in my tests about 2x to 3x as fast for a batch size of 1 on a 8 core 11th gen i7 CPU using ONNXRuntime Metrics Using a fixed threshold of 0.5 to convert the scores to binary predictions for each label: Accuracy: 0.474 Precision: 0.575 Recall: 0.396 F1: 0.450 See more details in the SamLowe/roberta base go emotions model card for the increases possible through selecting label specific thresholds to maximise F1 scores, or another metric. Quantized (INT8) ONNX version onnx/model quantized.onnx is the int8 quantized version that is one quarter the size (125MB) of the full precision model (above) but delivers almost all of the accuracy is faster in inference than both the full precision ONNX above, and the normal Transformers model about 2x as fast for a batch size of 1 on an 8 core 11th gen i7 CPU using ONNXRuntime vs the full pr…
We use cookies for essential functionality and analytics. You can accept or reject analytics cookies.Cookie policy