CodeQwen1.5 7B Chat Introduction CodeQwen1.5 is the Code Specific version of Qwen1.5. It is a transformer based decoder only language model pretrained on a large amount of data of codes. Strong code generation capabilities and competitve performance across a series of benchmarks; Supporting long context understanding and generation with the context length of 64K tokens; Supporting 92 coding languages Excellent performance in text to SQL, bug fix, etc. For more details, please refer to our blog post and GitHub repo. Model Details CodeQwen1.5 is based on Qwen1.5, a language model series including decoder language models of different model sizes. It is trained on 3 trillion tokens of data of codes, and it includes group query attention (GQA) for efficient inference. Requirements The code of Qwen1.5 has been in the latest Hugging face transformers and we advise you to install transformers =4.37.0 , or you might encounter the following error: Quickstart Here provides a code snippet with apply chat template to show you how to load the tokenizer and model and how to generate contents. Tips If you encounter code switching or other bad cases, we advise you to use our provided hyper paramete…
We use cookies for essential functionality and analytics. You can accept or reject analytics cookies.Cookie policy