robbert 2022 dutch sentence transformers This is a sentence transformers model: It maps sentences & paragraphs to a 768 dimensional dense vector space and can be used for tasks like clustering or semantic search. This model is based on KU Leuven's RobBERT model. It has been finetuned on the Paraphrase dataset, which we (machine ) translated to Dutch. The Paraphrase dataset consists of multiple datasets that consist of duo's of similar texts, for example duplicate questions on a forum. We have released the translated data that we used to train this model on our Huggingface page. Usage (Sentence Transformers) Using this model becomes easy when you have sentence transformers installed: Then you can use the model like this: Usage (HuggingFace Transformers) Without sentence transformers, you can use the model like this: First, you pass your input through the transformer model, then you have to apply the right pooling operation on top of the contextualized word embeddings. Training The model was trained with the parameters: DataLoader : MultiDatasetDataLoader.MultiDatasetDataLoader of length 414262 with parameters: Loss : sentence transformers.losses.MultipleNegativesRankingLoss.Multiple…
We use cookies for essential functionality and analytics. You can accept or reject analytics cookies.Cookie policy