Swallow Our Swallow model has undergone continual pre training from the Llama 2 family, primarily with the addition of Japanese language data. The tuned versions use supervised fine tuning (SFT). Links to other models can be found in the index. Model Release Updates We are excited to share the release schedule for our latest models: April 26, 2024 : Released version 0.1 of our enhanced instruction tuned models: Swallow 7b instruct v0.1, Swallow 13b instruct v0.1, and Swallow 70b instruct v0.1 as preview versions. March 2, 2024 : Released the Swallow 7b plus hf, a model trained with approximately twice as many Japanese tokens as Swallow 7b hf. February 4, 2024 : Released the Swallow 13b NVE hf. January 26, 2024 : Released the Swallow 7b NVE hf, Swallow 7b NVE instruct hf, Swallow 70b NVE hf, and Swallow 70b NVE instruct hf December 19, 2023 : Released the Swallow 7b hf, Swallow 7b instruct hf, Swallow 13b hf, Swallow 13b instruct hf, Swallow 70b hf, and Swallow 70b instruct hf. Swallow Model Index Model Swallow hf Swallow instruct hf Swallow instruct v0.1 7B Link Link Link 7B Plus Link N/A N/A 13B Link Link Link 70B Link Link Link Swallow Model Index NVE (No Vocabulary Expansion) Mo…
We use cookies for essential functionality and analytics. You can accept or reject analytics cookies.Cookie policy