Silver Retriever Base (v1) Silver Retriever model encodes the Polish sentences or paragraphs into a 768 dimensional dense vector space and can be used for tasks like document retrieval or semantic search. It was initialized from the HerBERT base model and fine tuned on the PolQA and MAUPQA datasets for 15,000 steps with a batch size of 1,024. Please refer to the SilverRetriever: Advancing Neural Passage Retrieval for Polish Question Answering for more details. Evaluation Model Average [Acc] Average [NDCG] PolQA [Acc] PolQA [NDCG] Allegro FAQ [Acc] Allegro FAQ [NDCG] Legal Questions [Acc] Legal Questions [NDCG] : : : : : : : : : BM25 74.87 51.81 61.35 24.51 66.89 48.71 96.38 82.21 BM25 (lemma) 80.46 55.44 71.49 31.97 75.33 55.70 94.57 78.65 MiniLM L12 v2 62.62 39.21 37.24 11.93 71.67 51.25 78.97 54.44 LaBSE 64.89 39.47 46.23 15.53 67.11 46.71 81.34 56.16 mContriever Base 86.31 60.37 78.66 36.30 84.44 67.38 95.82 77.42 E5 Base 91.58 66.56 86.61 46.08 91.89 75.90 96.24 77.69 ST DistilRoBERTa 73.78 48.29 48.43 16.73 84.89 64.39 88.02 63.76 ST MPNet 76.66 49.99 56.80 21.55 86.00 65.44 87.19 62.99 HerBERT QA 84.23 54.36 75.84 32.52 85.78 63.58 91.09 66.99 Silver Retriever v1 92.45 66.72…
We use cookies for essential functionality and analytics. You can accept or reject analytics cookies.Cookie policy