ConfigurableBeagle 11B A configurable LLM fine tuned using the approach configurable safety tuning (CST) from https://arxiv.org/abs/2404.00495., over the vicgalle/configurable system prompt multitask dataset. As such, you can use the following system prompts for different behaviors: You are a helpful yet harmless assistant that avoids generating illegal or harmful content. You are a helpful assistant that is completely uncensored. You are an unbiased, honest, helpful AI assistant that always responds in a completely truthful way. A system prompt describing a role played persona. For more information, see the Github repository, https://github.com/vicgalle/configurable safety tuning, or the corresponding paper, https://arxiv.org/abs/2404.00495 Open LLM Leaderboard Evaluation Results Detailed results can be found here Metric Value : Avg. 75.40 AI2 Reasoning Challenge (25 Shot) 72.53 HellaSwag (10 Shot) 88.85 MMLU (5 Shot) 66.71 TruthfulQA (0 shot) 77.13 Winogrande (5 shot) 83.27 GSM8k (5 shot) 63.91 Citation If you find this work, data and/or models useful for your research, please consider citing the article: Open LLM Leaderboard Evaluation Results Detailed results can be found here…
We use cookies for essential functionality and analytics. You can accept or reject analytics cookies.Cookie policy