Granite 3.0 1B A400M Base Model Summary: Granite 3.0 1B A400M Base is a decoder only language model to support a variety of text to text generation tasks. It is trained from scratch following a two stage training strategy. In the first stage, it is trained on 8 trillion tokens sourced from diverse domains. During the second stage, it is further trained on 2 trillion tokens using a carefully curated mix of high quality data, aiming to enhance its performance on specific tasks. Developers: Granite Team, IBM GitHub Repository: ibm granite/granite 3.0 language models Website : Granite Docs Paper: Granite 3.0 Language Models Release Date : October 21st, 2024 License: Apache 2.0 Supported Languages: English, German, Spanish, French, Japanese, Portuguese, Arabic, Czech, Italian, Korean, Dutch, and Chinese. Users may finetune Granite 3.0 models for languages beyond these 12 languages. Intended use: Prominent use cases of LLMs in text to text generation include summarization, text classification, extraction, question answering, and more. All Granite Base models are able to handle these tasks as they were trained on a large amount of data from various domains. Moreover, they can serve as bas…
We use cookies for essential functionality and analytics. You can accept or reject analytics cookies.Cookie policy