Model Card for T5 Small Table of Contents 1. Model Details 2. Uses 3. Bias, Risks, and Limitations 4. Training Details 5. Evaluation 6. Environmental Impact 7. Citation 8. Model Card Authors 9. How To Get Started With the Model Model Details Model Description The developers of the Text To Text Transfer Transformer (T5) write: With T5, we propose reframing all NLP tasks into a unified text to text format where the input and output are always text strings, in contrast to BERT style models that can only output either a class label or a span of the input. Our text to text framework allows us to use the same model, loss function, and hyperparameters on any NLP task. T5 Small is the checkpoint with 60 million parameters. Developed by: Colin Raffel, Noam Shazeer, Adam Roberts, Katherine Lee, Sharan Narang, Michael Matena, Yanqi Zhou, Wei Li, Peter J. Liu. See associated paper and GitHub repo Model type: Language model Language(s) (NLP): English, French, Romanian, German License: Apache 2.0 Related Models: All T5 Checkpoints Resources for more information: Research paper Google's T5 Blog Post GitHub Repo Hugging Face T5 Docs Uses Direct Use and Downstream Use The developers write in a blog…
We use cookies for essential functionality and analytics. You can accept or reject analytics cookies.Cookie policy