XLNet (large sized model) XLNet model pre trained on English language. It was introduced in the paper XLNet: Generalized Autoregressive Pretraining for Language Understanding by Yang et al. and first released in this repository. Disclaimer: The team releasing XLNet did not write a model card for this model so this model card has been written by the Hugging Face team. Model description XLNet is a new unsupervised language representation learning method based on a novel generalized permutation language modeling objective. Additionally, XLNet employs Transformer XL as the backbone model, exhibiting excellent performance for language tasks involving long context. Overall, XLNet achieves state of the art (SOTA) results on various downstream language tasks including question answering, natural language inference, sentiment analysis, and document ranking. Intended uses & limitations The model is mostly intended to be fine tuned on a downstream task. See the model hub to look for fine tuned versions on a task that interests you. Note that this model is primarily aimed at being fine tuned on tasks that use the whole sentence (potentially masked) to make decisions, such as sequence classific…
We use cookies for essential functionality and analytics. You can accept or reject analytics cookies.Cookie policy