mc danish This model is a fine tuned version of MediaCatch/xls r 300m danish mc on the Preprocessed Dataset dataset. It achieves the following results on the evaluation set: Loss: 0.1570 Wer: 0.0875 Model description More information needed Intended uses & limitations More information needed Training and evaluation data More information needed Training procedure Training hyperparameters The following hyperparameters were used during training: learning rate: 0.0001 train batch size: 3 eval batch size: 6 seed: 69 distributed type: multi GPU num devices: 4 gradient accumulation steps: 4 total train batch size: 48 total eval batch size: 24 optimizer: Use adamw torch fused with betas=(0.9,0.999) and epsilon=1e 08 and optimizer args=No additional optimizer arguments lr scheduler type: cosine lr scheduler warmup steps: 500 num epochs: 10.0 Training results Training Loss Epoch Step Validation Loss Wer : : : : : : : : : : No log 0 0 3.1518 0.1154 0.1233 0.0991 500 0.1684 0.1039 0.1122 0.1982 1000 0.1536 0.1059 0.109 0.2973 1500 0.1497 0.1032 0.1027 0.3965 2000 0.1471 0.1036 0.1082 0.4956 2500 0.1446 0.1053 0.105 0.5947 3000 0.1440 0.1059 0.0986 0.6938 3500 0.1436 0.1041 0.1037 0.7929 4000 0…
We use cookies for essential functionality and analytics. You can accept or reject analytics cookies.Cookie policy