L MChat Small This was a test of mine how small merges perform, because there are a lot of 7b merges and higher but not a lot of 2b merges. Merge Method This model was merged using the SLERP merge method. Models Merged The following models were included in the merge: rhysjones/phi 2 orange v2 Weyaxi/Einstein v4 phi2 Configuration The following YAML configuration was used to produce this model: Usage Use it with the ChatML format, you can also use the Inference API for this Model. Open LLM Leaderboard Evaluation Results Detailed results can be found here Metric Value : Avg. 63.14 AI2 Reasoning Challenge (25 Shot) 61.60 HellaSwag (10 Shot) 75.90 MMLU (5 Shot) 57.41 TruthfulQA (0 shot) 49.94 Winogrande (5 shot) 74.98 GSM8k (5 shot) 58.98
We use cookies for essential functionality and analytics. You can accept or reject analytics cookies.Cookie policy