ibm-granite/granite-4.0-h-small-FP8Granite 4.0 H Small (FP8) 📣 Update [10 07 2025]: Added a default system prompt to the chat template to guide the model towards more professional, accurate, and safe responses. [!NOTE] This repository contains the FP8 version of Granite 4.0 H Small . Please refer to the the original instruct model's model card for additional details: https://huggingface.co/ibm granite/granite 4.0 h small

granite-4.0-h-small-FP8

PUBLIC

Mirrored

📣 Update [10-07-2025]: Added a default system prompt to the chat template to guide the model towards more professional, accurate, and safe responses.

Tasks:text-generationLibraries:transformersLicense:apache-2.0

imported

huggingface

minio

transformers

safetensors

granitemoehybrid

text-generation

language

granite-4.0

gguf

conversational

base_model:ibm-granite/granite-4.0-h-small

base_model:quantized:ibm-granite/granite-4.0-h-small

license:apache-2.0

endpoints_compatible

compressed-tensors

deploy:azure

region:us

682downloads5likestransformersLicense:apache-2.0

Model Card

Edit

Granite 4.0 H-Small (FP8)

📣 Update [10-07-2025]: Added a default system prompt to the chat template to guide the model towards more professional, accurate, and safe responses.

[!NOTE] This repository contains the FP8 version of Granite-4.0-H-Small.

Please refer to the the original instruct model's model card for additional details: https://huggingface.co/ibm-granite/granite-4.0-h-small

Inference ProvidersText Generation

Your message…

This model isn't deployed by any Inference Provider yet. Deploy this model →

GGUF details

Format

GGUF

Tasks

text-generation

Source

Mirrored from an external registry.

Last synced 7/28/2026

Model tree for ibm-granite/granite-4.0-h-small-FP8

Base model

ibm-granite/granite-4.0-h-small

Commit History

No commits available

We use cookies for essential functionality and analytics. You can accept or reject analytics cookies.Cookie policy