1B 32768 context length Llama2 on Malaysian text embedding task Trained on truncated 8k context length, but infer able to scale up to 32k context length. README at https://github.com/mesolitica/llama2 embedding finetune WandB, https://wandb.ai/mesolitica/llama2 embedding 1b?workspace=user husein mesolitica how to
We use cookies for essential functionality and analytics. You can accept or reject analytics cookies.Cookie policy