TAPAS base model fine tuned on Tabular Fact Checking (TabFact) This model has 2 versions which can be used. The latest version, which is the default one, corresponds to the tapas tabfact inter masklm base reset checkpoint of the original Github repository. This model was pre trained on MLM and an additional step which the authors call intermediate pre training, and then fine tuned on TabFact. It uses relative position embeddings by default (i.e. resetting the position index at every cell of the table). The other (non default) version which can be used is the one with absolute position embeddings: no reset , which corresponds to tapas tabfact inter masklm base Disclaimer: The team releasing TAPAS did not write a model card for this model so this model card has been written by the Hugging Face team and contributors. Model description TAPAS is a BERT like transformers model pretrained on a large corpus of English data from Wikipedia in a self supervised fashion. This means it was pretrained on the raw tables and associated texts only, with no humans labelling them in any way (which is why it can use lots of publicly available data) with an automatic process to generate inputs and labe…
We use cookies for essential functionality and analytics. You can accept or reject analytics cookies.Cookie policy