BigScience Large Open science Open access Multilingual Language Model Version 1.3 / 6 July 2022 Current Checkpoint: Training Iteration 95000 Link to paper: here Total seen tokens: 366B Model Details BLOOM is an autoregressive Large Language Model (LLM), trained to continue text from a prompt on vast amounts of text data using industrial scale computational resources. As such, it is able to output coherent text in 46 languages and 13 programming languages that is hardly distinguishable from text written by humans. BLOOM can also be instructed to perform text tasks it hasn't been explicitly trained for, by casting them as text generation tasks. Basics This section provides information about the model type, version, license, funders, release date, developers, and contact information. It is useful for anyone who wants to reference the model. Click to expand Developed by: BigScience (website) All collaborators are either volunteers or have an agreement with their employer. (Further breakdown of participants forthcoming.) Model Type: Transformer based Language Model Checkpoints format: transformers (Megatron DeepSpeed format available here) Version: 1.0.0 Languages: Multiple; see trainin…
We use cookies for essential functionality and analytics. You can accept or reject analytics cookies.Cookie policy