Optimum Habana is the interface between the Hugging Face Transformers and Diffusers libraries and Habana's Gaudi processor (HPU). It provides a set of tools enabling easy and fast model loading, training and inference on single and multi HPU settings for different downstream tasks. Learn more about how to take advantage of the power of Habana HPUs to train and deploy Transformers and Diffusers models at hf.co/hardware/habana. Wav2Vec2 model HPU configuration This model only contains the GaudiConfig file for running the Wav2Vec2 model on Habana's Gaudi processors (HPU). This model contains no model weights, only a GaudiConfig. This enables to specify: use fused adam : whether to use Habana's custom AdamW implementation use fused clip norm : whether to use Habana's fused gradient norm clipping operator use torch autocast : whether to use Torch Autocast for managing mixed precision Usage The model is instantiated the same way as in the Transformers library. The only difference is that there are a few new training arguments specific to HPUs.\ It is strongly recommended to train this model doing bf16 mixed precision training for optimal performance and accuracy. Here is an audio classif…
We use cookies for essential functionality and analytics. You can accept or reject analytics cookies.Cookie policy