Dataset Card for Alpaca Dataset Description Homepage: https://crfm.stanford.edu/2023/03/13/alpaca.html Repository: https://github.com/tatsu lab/stanford alpaca Paper: Leaderboard: Point of Contact: Rohan Taori Dataset Summary Alpaca is a dataset of 52,000 instructions and demonstrations generated by OpenAI's text davinci 003 engine. This instruction data can be used to conduct instruction tuning for language models and make the language model follow instruction better. The authors built on the data generation pipeline from Self Instruct framework and made the following modifications: The text davinci 003 engine to generate the instruction data instead of davinci . A new prompt was written that explicitly gave the requirement of instruction generation to text davinci 003 . Much more aggressive batch decoding was used, i.e., generating 20 instructions at once, which significantly reduced the cost of data generation. The data generation pipeline was simplified by discarding the difference between classification and non classification instructions. Only a single instance was generated for each instruction, instead of 2 to 3 instances as in Self Instruct. This produced an instruction fo…
We use cookies for essential functionality and analytics. You can accept or reject analytics cookies.Cookie policy