Mixolar 4x7b This model is a Mixure of Experts (MoE) made with mergekit (mixtral branch). It uses the following base models: kyujinpy/Sakura SOLAR Instruct jeonsworld/CarbonVillain en 10.7B v1 rishiraj/meow kyujinpy/Sakura SOLRCA Math Instruct DPO v2 🧩 Configuration 💻 Usage Open LLM Leaderboard Evaluation Results Detailed results can be found here Metric Value : Avg. 74.18 AI2 Reasoning Challenge (25 Shot) 71.08 HellaSwag (10 Shot) 88.44 MMLU (5 Shot) 66.29 TruthfulQA (0 shot) 71.81 Winogrande (5 shot) 83.58 GSM8k (5 shot) 63.91
We use cookies for essential functionality and analytics. You can accept or reject analytics cookies.Cookie policy