MixtureofMerges MoE 4x7b v5 MixtureofMerges MoE 4x7b v5 is a Mixure of Experts (MoE) made with the following models using LazyMergekit: paulml/OmniBeagleSquaredMBX v3 7B v2 mlabonne/AlphaMonarch 7B Kukedlc/Neural4gsm8k eren23/dpo binarized NeutrixOmnibe 7B 🧩 Configuration 💻 Usage Open LLM Leaderboard Evaluation Results Detailed results can be found here Metric Value : Avg. 76.02 AI2 Reasoning Challenge (25 Shot) 73.89 HellaSwag (10 Shot) 89.00 MMLU (5 Shot) 64.69 TruthfulQA (0 shot) 73.73 Winogrande (5 shot) 85.08 GSM8k (5 shot) 69.75
We use cookies for essential functionality and analytics. You can accept or reject analytics cookies.Cookie policy