Dolphin 2.6 Mixtral 8x7b 🐬 Discord: https://discord.gg/cognitivecomputations https://erichartford.com/dolphin 25 mixtral 8x7b This model's training was sponsored by convai. This model is based on Mixtral 8x7b The base model has 32k context, I finetuned it with 16k. This Dolphin is really good at coding, I trained with a lot of coding data. It is very obedient but it is not DPO tuned so you still might need to encourage it in the system prompt as I show in the below examples. trust remote code is required. New in 2.6 Fixed a training configuration issue that improved the quality a lot Due to popular demand, added back samantha based empathy data Replaced synthia and pure dove with Capybara This model is uncensored. I have filtered the dataset to remove alignment and bias. This makes the model more compliant. You are advised to implement your own alignment layer before exposing the model as a service. It will be highly compliant to any requests, even unethical ones. Please read my blog post about uncensored models. https://erichartford.com/uncensored models You are responsible for any content you create using this model. Enjoy responsibly. Training It took 3 days to train 1.5 epochs…
We use cookies for essential functionality and analytics. You can accept or reject analytics cookies.Cookie policy