Dolphin 2.9.2 Mixtral 8x22b 🐬 Curated and trained by Eric Hartford, Lucas Atkins, and Fernando Fernandes, and Cognitive Computations Discord: https://discord.gg/cognitivecomputations New in 2.9.2 is SystemChat 2.0 a dataset designed to teach Dolphin to obey the system prompt, even over a long conversation. My appreciation for the sponsors of Dolphin 2.9.2: Crusoe Cloud provided excellent on demand 8xH100 node OnDemand provided inference sponsorship, enabling creation of SystemChat This model is based on Dolphin 2.9 Mixtral 8x22b, and is Apache 2.0 licensed. The base model has 64k context, and fine tuning was with 16k sequence length. It took 1 week on 8xH100 provided by Crusoe Cloud This model was trained FFT on 50% parameters (targeted with Laser Scanner by Fernando Fernandes, David Golchinfar, Lucas Atkins, and Eric Hartford), using ChatML prompt template format. example: Dolphin 2.9 has a variety of instruction, conversational, and coding skills. It also has initial agentic abilities and supports function calling. Dolphin is uncensored. I have filtered the dataset to remove alignment and bias. This makes the model more compliant. You are advised to implement your own alignment…
We use cookies for essential functionality and analytics. You can accept or reject analytics cookies.Cookie policy