Gemma 2 Llama Swallow Gemma 2 Llama Swallow series was built by continual pre training on the gemma 2 models. Gemma 2 Swallow enhanced the Japanese language capabilities of the original Gemma 2 while retaining the English language capabilities. We use approximately 200 billion tokens that were sampled from a large Japanese web corpus (Swallow Corpus Version 2), Japanese and English Wikipedia articles, and mathematical and coding contents, etc (see the Training Datasets section of the base model) for continual pre training. The instruction tuned models (it) were built by supervised fine tuning (SFT) on the synthetic data specially built for Japanese. See the Swallow Model Index section to find other model variants. Built with Gemma. Built with Llama. Release History May 19, 2025 : Released Gemma 2 Llama Swallow 2b pt v0.1, Gemma 2 Llama Swallow 9b pt v0.1, Gemma 2 Llama Swallow 27b pt v0.1, Gemma 2 Llama Swallow 2b it v0.1, Gemma 2 Llama Swallow 9b it v0.1, and Gemma 2 Llama Swallow 27b it v0.1. Swallow Model Index Model gemma 2 swallow v0.1 gemma 2 swallow it v0.1 2B 🤗 HuggingFace 🤗 HuggingFace 9B 🤗 HuggingFace 🤗 HuggingFace 27B 🤗 HuggingFace 🤗 HuggingFace The website https:/…
We use cookies for essential functionality and analytics. You can accept or reject analytics cookies.Cookie policy