sentiment polish gpt2 small This model was trained from polish gpt2 small on the polemo2 official dataset. It achieves the following results on the evaluation set: Loss: 0.4659 Accuracy: 0.9627 Model description Trained from polish gpt2 small Intended uses & limitations Sentiment analysis neutral/negative/positive/ambiguous How to use Transformers AutoModel Transformers Pipeline vLLM = 0.9.2 vLLM OpenAI serving (recommended) using curl: result: using python: Training and evaluation data Merged all rows from polemo2 official dataset. Train/test split: 80%/20% Datacollator: Training procedure GPU: RTX 3090 Training time: 2:53:05 Training hyperparameters The following hyperparameters were used during training: learning rate: 2e 05 train batch size: 4 eval batch size: 4 seed: 42 gradient accumulation steps: 8 total train batch size: 32 optimizer: Adam with betas=(0.9,0.999) and epsilon=1e 08 lr scheduler type: linear num epochs: 10 mixed precision training: Native AMP Training results Training Loss Epoch Step Validation Loss Accuracy : : : : : : : : : : 0.4049 1.0 3284 0.3351 0.8792 0.1885 2.0 6568 0.2625 0.9218 0.1182 3.0 9852 0.2583 0.9419 0.0825 4.0 13136 0.2886 0.9482 0.0586 5.0 16…
We use cookies for essential functionality and analytics. You can accept or reject analytics cookies.Cookie policy