MobileBERT: a Compact Task Agnostic BERT for Resource Limited Devices MobileBERT is a thin version of BERT LARGE, while equipped with bottleneck structures and a carefully designed balance between self attentions and feed forward networks. This checkpoint is the original MobileBert Optimized Uncased English: uncased L 24 H 128 B 512 A 4 F 4 OPT checkpoint. How to use MobileBERT in transformers
We use cookies for essential functionality and analytics. You can accept or reject analytics cookies.Cookie policy