city96/umt5-xxl-encoder-ggufThis is a GGUF conversion of Google's UMT5 xxl model, specifically the encoder part. The weights can be used with ./llama embedding or with the ComfyUI GGUF custom node together with image/video generation models. This is a non imatrix quant as llama.cpp doesn't support imatrix creation for T5 models at the time of writing. It's therefore recommended to use Q5 K M or larger for the best results, although smaller models may also still provide decent results in resource constrained scenarios.

umt5-xxl-encoder-gguf

PUBLIC

Mirrored

This is a GGUF conversion of Google's UMT5 xxl model, specifically the encoder part.

Libraries:ggufLicense:apache-2.0

imported

huggingface

minio

gguf

base_model:google/umt5-xxl

base_model:quantized:google/umt5-xxl

license:apache-2.0

endpoints_compatible

region:us

1downloads0likesggufLicense:apache-2.0

Model Card

Edit

This is a GGUF conversion of Google's UMT5 xxl model, specifically the encoder part.

The weights can be used with ./llama-embedding or with the ComfyUI-GGUF custom node together with image/video generation models.

This is a non imatrix quant as llama.cpp doesn't support imatrix creation for T5 models at the time of writing. It's therefore recommended to use Q5_K_M or larger for the best results, although smaller models may also still provide decent results in resource constrained scenarios.

Inference Providers

This model isn't deployed by any Inference Provider yet. Deploy this model →

GGUF details

Format

GGUF

Source

Mirrored from an external registry.

Last synced 7/28/2026

Model tree for city96/umt5-xxl-encoder-gguf

Base model

google/umt5-xxl

Files

main

1 file · 775 BHistory

Security scan in progress for 1 file.

main

1 file · 775 B

README.md775 B

We use cookies for essential functionality and analytics. You can accept or reject analytics cookies.Cookie policy