2B 32768 context length Llama2 on Malaysian text embedding task using contrastive loss Trained on truncated 8k context length, but infer able to scale up to 32k context length. README at https://github.com/mesolitica/llm embedding finetune WandB, https://wandb.ai/mesolitica/llama2 embedding 2b contrastive?workspace=user husein mesolitica WandB report, https://wandb.ai/mesolitica/llama2 embedding 600m contrastive/reports/Contrastive embedding loss Vmlldzo2MTM4ODE0 how to
We use cookies for essential functionality and analytics. You can accept or reject analytics cookies.Cookie policy