KaLM Embedding KaLM Embedding is a series of embedding models adapted from auto regressive LLMs with superior training data. KaLM embedding multilingual mini is trained from Qwen/Qwen2 0.5B with massive weakly supervised pre training and supervised fine tuning data. 📑 Open source Plan [x] Model Checkpoint [x] KaLM embedding multilingual mini v1 [x] KaLM embedding multilingual mini instruct v1 [x] KaLM embedding multilingual mini instruct v1.5 [ ] KaLM embedding multilingual max v1 [x] Training and Evaluation Code: HITsz TMG/KaLM Embedding [x] Technical Report: KaLM Embedding: Superior Training Data Brings A Stronger Embedding Model [ ] Training Data Evaluation Model Name Model Size C MTEB(35) MTEB(56) avg : : : : : : : : : : multilingual e5 large 560M 58.81 61.5 60.16 bge m3 (dense) 560M 60.80 59.84 60.32 gte multilingual base (dense) 305M 62.72 61.40 62.06 KaLM embedding multilingual mini v1 494M 62.31 61.87 62.09 KaLM embedding multilingual mini instruct v1 494M 63.57 64.74 64.16 KaLM embedding multilingual mini instruct v1.5 494M 64.13 64.94 64.53 Requirements Since we have used the Qwen2 model, we advise you to install transformers =4.37.0 , or you might encounter the followin…
We use cookies for essential functionality and analytics. You can accept or reject analytics cookies.Cookie policy