Updates We released a Jasper and Stella model technology report and code.(2025.1) Report: https://arxiv.org/abs/2412.19048 Codes: https://github.com/NovaSearch Team/RAG Retrieval Introduction The models are trained based on Alibaba NLP/gte large en v1.5 and Alibaba NLP/gte Qwen2 1.5B instruct . Thanks for their contributions! We simplify usage of prompts, providing two prompts for most general tasks, one is for s2p, another one is for s2s. Prompt of s2p task(e.g. retrieve task): Prompt of s2s task(e.g. semantic textual similarity task): The models are finally trained by MRL, so they have multiple dimensions: 512, 768, 1024, 2048, 4096, 6144 and 8192. The higher the dimension, the better the performance. Generally speaking, 1024d is good enough. The MTEB score of 1024d is only 0.001 lower than 8192d. Model directory structure The model directory structure is very simple, it is a standard SentenceTransformer directory with a series of 2 Dense {dims} folders , where dims represents the final vector dimension. For example, the 2 Dense 256 folder stores Linear weights that convert vector dimensions to 256 dimensions. Please refer to the following chapters for specific instructions on ho…
We use cookies for essential functionality and analytics. You can accept or reject analytics cookies.Cookie policy