embeddinggemma 300m qat q8 0 GGUF Recommended way to run this model: Then the endpoint can be accessed at http://localhost:8080/embedding, for example using curl : Alternatively, the llama embedding command line tool can be used: embd normalize When a model uses pooling, or the pooling method is specified using pooling , the normalization can be controlled by the embd normalize parameter. The default value is 2 which means that the embeddings are normalized using the Euclidean norm (L2). Other options are: 1 No normalization 0 Max absolute 1 Taxicab 2 Euclidean/L2 \ 2 P Norm This can be passed in the request body to llama server , for example: And for llama embedding , by passing embd normalize , for example:
We use cookies for essential functionality and analytics. You can accept or reject analytics cookies.Cookie policy