Overview HyperCLOVAX SEED Text Instruct 0.5B is a Text to Text model with instruction following capabilities that excels in understanding Korean language and culture. Compared to external competitors of similar scale, it demonstrates improved mathematical performance and a substantial enhancement in Korean language capability. The HyperCLOVAX SEED Text Instruct 0.5B is currently the smallest model released by the HyperCLOVAX, representing a lightweight solution suitable for deployment in resource‑constrained environments such as edge devices. It supports a maximum context length of 4K and functions as a versatile small model applicable to a wide range of tasks. The total cost of a single training run for HyperCLOVAX SEED Text Instruct 0.5B was 4.358K A100 GPU hours (approximately USD 6.537K), which is 39 times lower than the cost of training the QWEN2.5‑0.5B‑instruct model. Basic Information Architecture : Transformer‑based (Dense Model) Parameters : 0.57 B (total); 0.45 B (excluding token embeddings, tied embeddings) Input/Output Format : Text / Text Maximum Context Length : 4 K tokens Knowledge Cutoff Date : Trained on data up to January 2025 Training and Data The training datase…
We use cookies for essential functionality and analytics. You can accept or reject analytics cookies.Cookie policy