Llama Prompt Guard 2 86M onnx This repository provides a ONNX converted and quantized version of meta llama/Llama Prompt Guard 2 86M ๐ง Built With Meta LLaMA โ Foundation model powering the classifier meta llama/Llama Prompt Guard 2 22M meta llama/Llama Prompt Guard 2 86M ๐ค Hugging Face Transformers โ Model and tokenizer loading ONNX โ Model export and runtime format ONNX Runtime โ Efficient inference backend ๐ฅ Evaluation Dataset We use jackhhao/jailbreak classification for the evaluation (train+test) ๐งช Evaluation Results Model Accuracy Precision Recall F1 Score AUC ROC Llama Prompt Guard 2 22M 0.9564 0.9888 0.9249 0.9558 0.9234 Llama Prompt Guard 2 22M q 0.9579 0.9967 0.9204 0.9449 0.9180 Llama Prompt Guard 2 86M 0.9801 0.9984 0.9625 0.9801 0.9519 Llama Prompt Guard 2 86M q 0.8989 1.0000 0.8018 0.89 0.7452 ๐ค Usage ๐ GitHub Repository: You can find the full source code, CLI tools, and evaluation scripts in the official GitHub repository.
We use cookies for essential functionality and analytics. You can accept or reject analytics cookies.Cookie policy