Model Card for DeBERTa v3 base tasksource nli NOTE Deprecated: use https://huggingface.co/tasksource/deberta small long nli for longer context and better accuracy. This is DeBERTa v3 base fine tuned with multi task learning on 600+ tasks of the tasksource collection. This checkpoint has strong zero shot validation performance on many tasks (e.g. 70% on WNLI), and can be used for: Zero shot entailment based classification for arbitrary labels [ZS]. Natural language inference [NLI] Hundreds of previous tasks with tasksource adapters [TA]. Further fine tuning on a new task or tasksource task (classification, token classification or multiple choice) [FT]. [ZS] Zero shot classification pipeline NLI training data of this model includes label nli, a NLI dataset specially constructed to improve this kind of zero shot classification. [NLI] Natural language inference pipeline [TA] Tasksource adapters: 1 line access to hundreds of tasks The list of tasks is available in model config.json. This is more efficient than ZS since it requires only one forward pass per example, but it is less flexible. [FT] Tasknet: 3 lines fine tuning Evaluation This model ranked 1st among all models with the micro…
We use cookies for essential functionality and analytics. You can accept or reject analytics cookies.Cookie policy