MixtureofMerges MoE 4x7b v4 MixtureofMerges MoE 4x7b v4 is a Mixure of Experts (MoE) made with the following models using LazyMergekit: flemmingmiguel/MBX 7B v3 Kukedlc/NeuTrixOmniBe 7B model remix PetroGPT/WestSeverus 7B DPO vanillaOVO/supermario v4 🧩 Configuration 💻 Usage Open LLM Leaderboard Evaluation Results Detailed results can be found here Metric Value : Avg. 76.23 AI2 Reasoning Challenge (25 Shot) 72.53 HellaSwag (10 Shot) 88.85 MMLU (5 Shot) 64.53 TruthfulQA (0 shot) 75.30 Winogrande (5 shot) 84.85 GSM8k (5 shot) 71.34
We use cookies for essential functionality and analytics. You can accept or reject analytics cookies.Cookie policy