Salamandra Model Card This repository contains the model described in Salamandra Technical Report. Salamandra is a highly multilingual model pre trained from scratch that comes in three different sizes — 2B, 7B and 40B parameters — with their respective base and instruction tuned variants. This model card corresponds to the 7B instructed version. To visit the model cards of other Salamandra versions, please refer to the Model Index. The entire Salamandra family is released under a permissive Apache 2.0 license. Along with the open weights, all training scripts and configuration files are made publicly available in this GitHub repository. [!WARNING] DISCLAIMER: This model is a first proof of concept designed to demonstrate the instruction following capabilities of recently released base models. It has been optimized to engage in conversation but has NOT been aligned through RLHF to filter or avoid sensitive topics. As a result, it may generate harmful or inappropriate content. The team is actively working to enhance its performance through further instruction and alignment with RL techniques. Model Details Description Transformer based decoder only language model that has been pre t…
We use cookies for essential functionality and analytics. You can accept or reject analytics cookies.Cookie policy