bert base uncased mrpc This model is a fine tuned version of bert base uncased on the GLUE MRPC dataset . The GLUE MRPC dataset, from The Microsoft Research Paraphrase Corpus (Dolan & Brockett, 2005) is a corpus of sentence pairs automatically extracted from online news sources, with human annotations for whether the sentences in the pair are semantically equivalent. It is a pretrained model on English language using a masked language modeling (MLM) objective. It was introduced in this paper BERT: Pre training of Deep Bidirectional Transformers for Language Understanding. This model, bert base uncased mrpc, is uncased: it does not make a difference between "english" and "English" . Masked language modeling predicts a masked token in a sequence, and the model can attend to tokens bidirectionally. This means the model has full access to the tokens on the left and right. Masked language modeling is great for tasks that require a good contextual understanding of an entire sequence. BERT is an example of a masked language model. For this model, you don’t need labels (also known as an unsupervised task) because the next word (MLM) is the label BERT base model (uncased) It provides: Maske…
We use cookies for essential functionality and analytics. You can accept or reject analytics cookies.Cookie policy