UPDATE! GGUF Format is ready at cloudyu/Yi 34Bx2 MoE 60B GGUF Yi based MOE 2x34B with mixtral architecture Highest score Model ranked by Open LLM Leaderboard (2024 01 11) Average Score 76.72 This is an English & Chinese MoE Model , slightly different with cloudyu/Mixtral 34Bx2 MoE 60B, and also based on [jondurbin/bagel dpo 34b v0.2] [SUSTech/SUS Chat 34B] Open LLM Leaderboard Evaluation Results Detailed results can be found here Metric Value : Avg. 76.72 AI2 Reasoning Challenge (25 Shot) 71.08 HellaSwag (10 Shot) 85.23 MMLU (5 Shot) 77.47 TruthfulQA (0 shot) 66.19 Winogrande (5 shot) 84.85 GSM8k (5 shot) 75.51 gpu code example CPU example
We use cookies for essential functionality and analytics. You can accept or reject analytics cookies.Cookie policy