Mixtral MOE 2x34B One of Best Model reviewed by reddit community Another review by reddit community Highest score Model ranked by Open LLM Leaderboard (2024 01 10) Average Score 76.66 This is my first English & Chinese MoE Model based on [jondurbin/bagel dpo 34b v0.2] [SUSTech/SUS Chat 34B] New Open LLM Leaderboard Evaluation Results Detailed results can be found here Metric Value : Avg. 27.42 IFEval (0 Shot) 45.38 BBH (3 Shot) 41.21 MATH Lvl 5 (4 Shot) 6.57 GPQA (0 shot) 11.74 MuSR (0 shot) 17.78 MMLU PRO (5 shot) 41.85 Old New Open LLM Leaderboard Evaluation Results Detailed results can be found here Metric Value : Avg. 76.66 AI2 Reasoning Challenge (25 Shot) 71.33 HellaSwag (10 Shot) 85.25 MMLU (5 Shot) 77.34 TruthfulQA (0 shot) 66.59 Winogrande (5 shot) 84.85 GSM8k (5 shot) 74.60 gpu code example CPU example Output Examples: Open LLM Leaderboard Evaluation Results Detailed results can be found here Metric Value : Avg. 27.42 IFEval (0 Shot) 45.38 BBH (3 Shot) 41.21 MATH Lvl 5 (4 Shot) 6.57 GPQA (0 shot) 11.74 MuSR (0 shot) 17.78 MMLU PRO (5 shot) 41.85
We use cookies for essential functionality and analytics. You can accept or reject analytics cookies.Cookie policy