👑 AlphaMonarch 7B tl;dr: AlphaMonarch 7B is a new DPO merge that retains all the reasoning abilities of the very best merges and significantly improves its conversational abilities. Kind of the best of both worlds in a 7B model. 🎉 AlphaMonarch 7B is a DPO fine tuned of mlabonne/NeuralMonarch 7B using the argilla/OpenHermes2.5 dpo binarized alpha preference dataset. It is based on a merge of the following models using LazyMergekit: mlabonne/OmniTruthyBeagle 7B v0 mlabonne/NeuBeagle 7B mlabonne/NeuralOmniBeagle 7B Special thanks to Jon Durbin, Intel, Argilla, and Teknium for the preference datasets. Try the demo : https://huggingface.co/spaces/mlabonne/AlphaMonarch 7B 🔍 Applications This model uses a context window of 8k. I recommend using it with the Mistral Instruct chat template (works perfectly with LM Studio). If you use SillyTavern, you might want to tweak the inference parameters. Here's what LM Studio uses as a reference: temp 0.8, top k 40, top p 0.95, min p 0.05, repeat penalty 1.1. It is one of the very best 7B models in terms of instructing following and reasoning abilities and can be used for conversations, RP, and storytelling. Note that it tends to have a quite form…
We use cookies for essential functionality and analytics. You can accept or reject analytics cookies.Cookie policy