RemySkye/LFM2.5-8B-A1B-i1-GGUFLFM2.5 8B A1B i1 GGUF This repository contains GGUF format quantizations of the model LiquidAI/LFM2.5 8B A1B. These models were generated using llama.cpp with an importance matrix (imatrix) https://gist.github.com/bartowski1182/82ae9b520227f57d79ba04add13d0d0d Used this pull request to be able to quantize: https://github.com/ggml org/llama.cpp/pull/23826/ Should work with the latest llama.cpp NOTE Quantization below 4 bits may result in unacceptably low quality.

LFM2.5-8B-A1B-i1-GGUF

PUBLIC

Mirrored

This repository contains GGUF format quantizations of the model LiquidAI/LFM2.5-8B-A1B. These models were generated using llama.cpp with an importance matrix (imatrix) - https://gist.github.com/bartowski1182/82ae9b520227f57d79ba04add13d0d0d

Tasks:text-generationLicense:other

imported

huggingface

minio

gguf

liquid

lfm2.5

edge

llama

text-generation

base_model:LiquidAI/LFM2.5-8B-A1B

base_model:quantized:LiquidAI/LFM2.5-8B-A1B

0downloads0likesLicense:other

Model Card

Edit

LFM2.5-8B-A1B-i1-GGUF

Used this pull request to be able to quantize: https://github.com/ggml-org/llama.cpp/pull/23826/ Should work with the latest llama.cpp

NOTE

Quantization below 4 bits may result in unacceptably low quality.

GGUF details

Format

GGUF

Model size

8B params

Architecture

Llama

1 quantization variant

imatrix16.6 MB

Tasks

text-generation

Source

Mirrored from an external registry.

Last synced 6/22/2026

Model tree for RemySkye/LFM2.5-8B-A1B-i1-GGUF

Base model

LiquidAI/LFM2.5-8B-A1B

Commit History

No commits available

We use cookies for essential functionality and analytics. You can accept or reject analytics cookies.Cookie policy