bert medium squad2 distilled for Extractive QA Overview Language model: deepset/roberta base squad2 distilled Language: English Training data: SQuAD 2.0 training set Eval data: SQuAD 2.0 dev set Infrastructure : 1x V100 GPU Published : Apr 21st, 2021 Details Haystack version 1.x distillation feature was used for training. deepset/bert large uncased whole word masking squad2 was used as the teacher model. Hyperparameters Usage In Haystack Haystack is an AI orchestration framework to build customizable, production ready LLM applications. You can use this model in Haystack to do extractive question answering on documents. To load and run the model with Haystack: For a complete example with an extractive question answering pipeline that scales over many documents, check out the corresponding Haystack tutorial. In Transformers Performance Authors Timo Möller: timo.moeller [at] deepset.ai Julian Risch: julian.risch [at] deepset.ai Malte Pietsch: malte.pietsch [at] deepset.ai Michel Bartels: michel.bartels [at] deepset.ai About us deepset is the company behind the production ready open source AI framework Haystack. Some of our other work: Distilled roberta base squad2 (aka "tinyroberta sq…
We use cookies for essential functionality and analytics. You can accept or reject analytics cookies.Cookie policy