MaziyarPanahi/calme 2.2 llama3 70b This model is a fine tune (DPO) of meta llama/Meta Llama 3 70B Instruct model. PS: This fine tuned model was previously known as MaziyarPanahi/Llama 3 70B Instruct DPO v0.2 . It was renamed to avoid any confusion with the original model. ⚡ Quantized GGUF All GGUF models are available here: MaziyarPanahi/calme 2.2 llama3 70b GGUF 🏆 Open LLM Leaderboard Evaluation Results Detailed results can be found here Metric Value : Avg. 37.98 IFEval (0 Shot) 82.08 BBH (3 Shot) 48.57 MATH Lvl 5 (4 Shot) 22.96 GPQA (0 shot) 12.19 MuSR (0 shot) 15.30 MMLU PRO (5 shot) 46.74 Metric Value : Avg. 78.96 AI2 Reasoning Challenge (25 Shot) 72.53 HellaSwag (10 Shot) 86.22 MMLU (5 Shot) 80.41 TruthfulQA (0 shot) 63.57 Winogrande (5 shot) 82.79 GSM8k (5 shot) 88.25 Top 10 models on the Leaderboard Prompt Template This model uses ChatML prompt template: How to use You can use this model by using MaziyarPanahi/calme 2.2 llama3 70b as the model name in Hugging Face's transformers library.
We use cookies for essential functionality and analytics. You can accept or reject analytics cookies.Cookie policy