Model Summary PowerLM 3B is a 3B state of the art small language model trained with the Power learning rate scheduler. It is trained on a mix of open source and proprietary datasets. PowerLM 3B has shown promising results compared to other models in the size categories across various benchmarks, including natural language multi choices, code generation, and math reasoning. Paper: https://arxiv.org/abs/2408.13359 Usage Note: Requires installing HF transformers from source. Generation This is a simple example of how to use PowerLM 3b model.
We use cookies for essential functionality and analytics. You can accept or reject analytics cookies.Cookie policy