Model Card for GaMS3 12B Instruct GaMS3 12B Instruct represents the next generation of the GaMS (Generative Model for Slovene) model. The model is based on Google's Gemma 3 family and continually pretrained on Slovene, English, and some portion of Croatian, Serbian, and Bosnian corpora. The supervised fine tuning phase was done on a combination of Slovene and English datasets. Acknowledgment The model was developed within the PoVeJMo research program (Adaptive Natural Language Processing with Large Language Models), particularly within the research project titled SloLLaMai Open access computationally efficient models for Slovenian. The program is funded within the Recovery and Resilience Plan by the Slovenian Research and Innovation Agency (ARIS) and NextGenerationEU. The authors also acknowledge the financial support from the Slovenian Research and Innovation Agency (research core funding No. P6 0411 Language Resources and Technologies for Slovene). This project is also funded by the European Union under Horizon Europe (101186647 – AI4DH). We thank everyone who contributed to data collection and preparation, which enabled us to train our model. Special thanks go to Nikola Ljubešić…
We use cookies for essential functionality and analytics. You can accept or reject analytics cookies.Cookie policy