ctrl Table of Contents 1. Model Details 2. Uses 3. Bias, Risks, and Limitations 4. Training 5. Evaluation 6. Environmental Impact 7. Technical Specifications 8. Citation 9. Model Card Authors 10. How To Get Started With the Model Model Details Model Description The CTRL model was proposed in CTRL: A Conditional Transformer Language Model for Controllable Generation by Nitish Shirish Keskar , Bryan McCann , Lav R. Varshney, Caiming Xiong and Richard Socher. It's a causal (unidirectional) transformer pre trained using language modeling on a very large corpus of ~140 GB of text data with the first token reserved as a control code (such as Links, Books, Wikipedia etc.). The model developers released a model card for CTRL, available here. In their model card, the developers write: The CTRL Language Model analyzed in this card generates text conditioned on control codes that specify domain, style, topics, dates, entities, relationships between entities, plot points, and task related behavior. Developed by: See associated paper from Salesforce Research Model type: Transformer based language model Language(s) (NLP): Primarily English, some German, Spanish, French License: BSD 3 Clause; als…
We use cookies for essential functionality and analytics. You can accept or reject analytics cookies.Cookie policy