German ELECTRA base Released, Oct 2020, this is a German ELECTRA language model trained collaboratively by the makers of the original German BERT (aka "bert base german cased") and the dbmdz BERT (aka bert base german dbmdz cased). In our paper, we outline the steps taken to train our model. Our evaluation suggests that this model is somewhat undertrained. For best performance from a base sized model, we recommend deepset/gbert base Overview Paper: here Architecture: ELECTRA base (discriminator) Language: German Performance See also: deepset/gbert base deepset/gbert large deepset/gelectra base deepset/gelectra large deepset/gelectra base generator deepset/gelectra large generator Authors Branden Chan: branden.chan [at] deepset.ai Stefan Schweter: stefan [at] schweter.eu Timo Möller: timo.moeller [at] deepset.ai About us deepset is the company behind the production ready open source AI framework Haystack. Some of our other work: Distilled roberta base squad2 (aka "tinyroberta squad2") German BERT, GermanQuAD and GermanDPR, German embedding model deepset Cloud, deepset Studio Get in touch and join the Haystack community For more info on Haystack, visit our GitHub repo and Documentati…
We use cookies for essential functionality and analytics. You can accept or reject analytics cookies.Cookie policy