L MChat 7b L MChat 7b is a merge of the following models: Nexusflow/Starling LM 7B beta FuseAI/FuseChat 7B VaRM Configuration Usage License Apache 2.0 but you cannot use this model to directly compete with OpenAI. How? Usage of LazyMergekit. Open LLM Leaderboard Evaluation Results Detailed results can be found here Metric Value : Avg. 69.57 AI2 Reasoning Challenge (25 Shot) 65.61 HellaSwag (10 Shot) 84.59 MMLU (5 Shot) 65.44 TruthfulQA (0 shot) 50.94 Winogrande (5 shot) 81.37 GSM8k (5 shot) 69.45 Open LLM Leaderboard Evaluation Results Detailed results can be found here Metric Value : Avg. 21.02 IFEval (0 Shot) 52.97 BBH (3 Shot) 24.20 MATH Lvl 5 (4 Shot) 7.93 GPQA (0 shot) 7.38 MuSR (0 shot) 8.12 MMLU PRO (5 shot) 25.54
We use cookies for essential functionality and analytics. You can accept or reject analytics cookies.Cookie policy