👑 NeuralMonarch 7B NeuralMonarch 7B is a DPO fine tuned of mlabonne/Monarch 7B using the jondurbin/truthy dpo v0.1 and argilla/distilabel intel orca dpo pairs preference datasets. It is based on a merge of the following models using LazyMergekit: mlabonne/OmniTruthyBeagle 7B v0 mlabonne/NeuBeagle 7B mlabonne/NeuralOmniBeagle 7B Special thanks to Jon Durbin, Intel, and Argilla for the preference datasets. Try the demo : https://huggingface.co/spaces/mlabonne/NeuralMonarch 7B GGUF Chat 🔍 Applications This model uses a context window of 8k. I recommend using it with the Mistral Instruct chat template (works perfectly with LM Studio). Compared to other 7B models, it performs well in instruction following and reasoning tasks. For a chat/RP model with strong reasoning abilities, check out mlabonne/AlphaMonarch 7B. ⚡ Quantized models GGUF : https://huggingface.co/mlabonne/NeuralMonarch 7B GGUF 🏆 Evaluation Nous NeuralMonarch 7B is one of the best performing 7B models on Nous' benchmark suite (evaluation performed using LLM AutoEval). See the entire leaderboard here. Model Average AGIEval GPT4All TruthfulQA Bigbench : : : : : NeuralMonarch 7B 📄 62.73 45.31 76.99 78.35 50.28 AlphaMonarc…
We use cookies for essential functionality and analytics. You can accept or reject analytics cookies.Cookie policy