Model Summary The language model Phi 1 is a Transformer with 1.3 billion parameters, specialized for basic Python coding. Its training involved a variety of data sources, including subsets of Python codes from The Stack v1.2, Q&A content from StackOverflow, competition code from code contests, and synthetic Python textbooks and exercises generated by gpt 3.5 turbo 0301. Even though the model and the datasets are relatively small compared to contemporary Large Language Models (LLMs), Phi 1 has demonstrated an impressive accuracy rate exceeding 50% on the simple Python coding benchmark, HumanEval. How to Use Phi 1 has been integrated in the transformers version 4.37.0, please ensure that you are using a version equal or higher than it. Intended Uses Given the nature of the training data, Phi 1 is best suited for prompts using the code format: Code Format: where the model generates the code after the comments. (Note: This is a legitimate and correct use of the else statement in Python loops.) Notes: Phi 1 is intended for code purposes. The model generated code should be treated as a starting point rather than a definitive solution for potential use cases. Users should be cautious when…
We use cookies for essential functionality and analytics. You can accept or reject analytics cookies.Cookie policy