distilbert imdb This model is a fine tuned version of distilbert base uncased on the imdb dataset (training notebook is here). It achieves the following results on the evaluation set: Loss: 0.1903 Accuracy: 0.928 Model description More information needed Intended uses & limitations More information needed Training and evaluation data More information needed Training procedure Training hyperparameters The following hyperparameters were used during training: learning rate: 5e 05 train batch size: 16 eval batch size: 16 seed: 42 optimizer: Adam with betas=(0.9,0.999) and epsilon=1e 08 lr scheduler type: linear num epochs: 1 Training results Training Loss Epoch Step Validation Loss Accuracy : : : : : : : : : : 0.2195 1.0 1563 0.1903 0.928 Framework versions Transformers 4.15.0 Pytorch 1.10.0+cu111 Datasets 1.17.0 Tokenizers 0.10.3
We use cookies for essential functionality and analytics. You can accept or reject analytics cookies.Cookie policy