Transfo xl wt103 Table of Contents Model Details Uses Risks, Limitations and Biases Training Evaluation Citation Information How to Get Started With the Model Model Details Model Description: The Transformer XL model is a causal (uni directional) transformer with relative positioning (sinusoïdal) embeddings which can reuse previously computed hidden states to attend to longer context (memory). This model also uses adaptive softmax inputs and outputs (tied). Developed by: Zihang Dai, Zhilin Yang, Yiming Yang1, Jaime Carbonell, Quoc V. Le, Ruslan Salakhutdinov Shared by: HuggingFace team Model Type: Text Generation Language(s): English License: [More information needed] Resources for more information: Research Paper GitHub Repo HuggingFace Documentation Uses Direct Use This model can be used for text generation. The authors provide additionally notes about the vocabulary used, in the associated paper: We envision interesting applications of Transformer XL in the fields of text generation, unsupervised feature learning, image and speech modeling. Misuse and Out of scope Use The model should not be used to intentionally create hostile or alienating environments for people. In addition,…
We use cookies for essential functionality and analytics. You can accept or reject analytics cookies.Cookie policy