This is a Ties merge between the following models: https://huggingface.co/meta llama/Meta Llama 3 8B Instruct https://huggingface.co/Replete AI/Llama3 8B Instruct Replete Adapted The Coding, and Overall performance of this models seems to be better than both base models used in the merge. Benchmarks are coming in the future. Open LLM Leaderboard Evaluation Results Detailed results can be found here Metric Value : Avg. 16.32 IFEval (0 Shot) 53.88 BBH (3 Shot) 21.94 MATH Lvl 5 (4 Shot) 7.10 GPQA (0 shot) 2.57 MuSR (0 shot) 3.45 MMLU PRO (5 shot) 8.98
We use cookies for essential functionality and analytics. You can accept or reject analytics cookies.Cookie policy