tner/deberta v3 large ontonotes5 This model is a fine tuned version of microsoft/deberta v3 large on the tner/ontonotes5 dataset. Model fine tuning is done via T NER's hyper parameter search (see the repository for more detail). It achieves the following results on the test set: F1 (micro): 0.9069623608411381 Precision (micro): 0.902100360312857 Recall (micro): 0.9118770542773386 F1 (macro): 0.834586960779896 Precision (macro): 0.8237351069457466 Recall (macro): 0.8475169311172334 The per entity breakdown of the F1 score on the test set are below: cardinal number: 0.853475935828877 date: 0.8815545959284392 event: 0.8030303030303031 facility: 0.7896678966789669 geopolitical area: 0.9650033867690223 group: 0.9337209302325581 language: 0.8372093023255814 law: 0.6756756756756757 location: 0.7624020887728459 money: 0.8818897637795275 ordinal number: 0.8635235732009926 organization: 0.914952751528627 percent: 0.9 person: 0.9609866599546942 product: 0.7901234567901234 quantity: 0.8161434977578474 time: 0.674364896073903 work of art: 0.7188405797101449 For F1 scores, the confidence interval is obtained by bootstrap as below: F1 (micro): 90%: [0.9019409960743083, 0.911751130722053] 95%: [0.…
We use cookies for essential functionality and analytics. You can accept or reject analytics cookies.Cookie policy