English Grammar Checker This model is a fine tuned version of bert base uncased on the glue dataset. It achieves the following results on the evaluation set: Loss: 1.1117 Matthews Correlation: 0.5324 Model description More information needed Intended uses & limitations More information needed Training and evaluation data More information needed Training procedure Training hyperparameters The following hyperparameters were used during training: learning rate: 5e 05 train batch size: 8 eval batch size: 8 seed: 42 optimizer: Adam with betas=(0.9,0.999) and epsilon=1e 08 lr scheduler type: linear num epochs: 5 Training results Training Loss Epoch Step Validation Loss Matthews Correlation : : : : : : : : : : 0.527 1.0 1069 0.6183 0.3947 0.387 2.0 2138 0.5165 0.5156 0.2772 3.0 3207 0.6716 0.5211 0.176 4.0 4276 0.9270 0.5123 0.0975 5.0 5345 1.1117 0.5324 Framework versions Transformers 4.21.1 Pytorch 1.12.1+cu113 Datasets 2.4.0 Tokenizers 0.12.1
We use cookies for essential functionality and analytics. You can accept or reject analytics cookies.Cookie policy