Tess 2.0 Llama 3 70B Tess, short for Tesoro (Treasure in Italian), is a general purpose Large Language Model series. Tess 2.0 Llama 3 70B was trained on the meta llama/Meta Llama 3 70B base. Compute for Tess 2.0 Llama 3 70B was sponsored by KindoAI. Prompt Format Prompt format used for this fine tune is Llama 3 Training Methodology Tess 2.0 Llama 3 was trained on the (still curating) Tess 2.0 dataset. Tess 2.0 dataset and the training methodology follows LIMA (Less Is More) principles, and contains ~100K high quality code and general training samples. The dataset is highly uncensored, hence the model will almost always follow instructions. The model was only fine tuned for 2 epochs with a low learning rate to try and preserve its entropy as much as possible. Sample code to run inference Join My General AI Discord (NeuroLattice): https://discord.gg/Hz6GrwGFKD Limitations & Biases: While this model aims for accuracy, it can occasionally produce inaccurate or misleading results. Despite diligent efforts in refining the pretraining data, there remains a possibility for the generation of inappropriate, biased, or offensive content. Exercise caution and cross check information when neces…
We use cookies for essential functionality and analytics. You can accept or reject analytics cookies.Cookie policy