OpenMathInstruct 2 OpenMathInstruct 2 is a math instruction tuning dataset with 14M problem solution pairs generated using the Llama3.1 405B Instruct model. The training set problems of GSM8K and MATH are used for constructing the dataset in the following ways: Solution augmentation : Generating chain of thought solutions for training set problems in GSM8K and MATH. Problem Solution augmentation : Generating new problems, followed by solutions for these new problems. OpenMathInstruct 2 dataset contains the following fields: problem : Original problem from either the GSM8K or MATH training set or augmented problem from these training sets. generated solution : Synthetically generated solution. expected answer : For problems in the training set, it is the ground truth answer provided in the datasets. For augmented problems, it is the majority voting answer. problem source : Whether the problem is taken directly from GSM8K or MATH or is an augmented version derived from either dataset. We also release the 1M, 2M, and 5M, fair downsampled versions of the entire training set corresponding to points in the above scaling plot. These splits are referred to as train 1M , train 2M , and trai…
We use cookies for essential functionality and analytics. You can accept or reject analytics cookies.Cookie policy