facebook/wav2vec2 xls r 300m This model is a fine tuned version of facebook/wav2vec2 xls r 300m on the GOOGLE/FLEURS PS AF dataset. It achieves the following results on the evaluation set: Loss: 0.9162 Wer: 51.59 Cer: 19.72 Model description More information needed Intended uses & limitations More information needed Training and evaluation data More information needed Training procedure Training hyperparameters The following hyperparameters were used during training: learning rate: 7.5e 07 train batch size: 16 eval batch size: 16 seed: 42 gradient accumulation steps: 2 total train batch size: 32 optimizer: Adam with betas=(0.9,0.999) and epsilon=1e 08 lr scheduler type: linear lr scheduler warmup steps: 1000 training steps: 6000 mixed precision training: Native AMP Training results Training Loss Epoch Step Cer Validation Loss Wer : : : : : : : : : : : : 5.0767 6.33 500 1.0 4.8783 1.0 3.1156 12.66 1000 1.0 3.0990 1.0 1.3506 18.99 1500 0.2889 1.1056 0.7031 0.9997 25.32 2000 0.2301 0.9191 0.5944 0.7838 31.65 2500 0.2152 0.8952 0.5556 0.6665 37.97 3000 0.2017 0.8908 0.5252 0.6265 44.3 3500 0.1954 0.9063 0.5133 0.5935 50.63 4000 0.1969 0.9162 0.5156 0.5174 56.96 4500 0.1972 0.9287 0.514…
We use cookies for essential functionality and analytics. You can accept or reject analytics cookies.Cookie policy