SantaCoder Play with the model on the SantaCoder Space Demo. Table of Contents 1. Model Summary 2. Use 3. Limitations 4. Training 5. License 6. Citation Model Summary This is the same model as SantaCoder but it can be loaded with transformers =4.28.1 to use the GPTBigCode architecture. We refer the reader to the SantaCoder model page for full documentation about this model Repository: bigcode/Megatron LM Project Website: bigcode project.org Paper: 🎅SantaCoder: Don't reach for the stars!🌟 Point of Contact: contact@bigcode project.org Languages: Python, Java, and JavaScript There are two versions (branches) of the model: main : Uses the gpt bigcode model. Requires the bigcode fork of transformers. main custom : Packaged with its modeling code. Requires transformers =4.27 . Alternatively, it can run on older versions by setting the configuration parameter activation function = "gelu pytorch tanh" . Use Intended use The model was trained on GitHub code. As such it is not an instruction model and commands like "Write a function that computes the square root." do not work well. You should phrase commands like they occur in source code such as comments (e.g. the following function compu…
We use cookies for essential functionality and analytics. You can accept or reject analytics cookies.Cookie policy