Typhoon2.5 Qwen3 4B : Thai Large Language Model (Instruct) Typhoon2.5 Qwen3 4B is a instruct Thai 🇹🇭 large language model with 4 billion parameters, a 256k context length, and function calling capabilities. It is based on Qwen3 4B. By using this model, you agree to the OpenTyphoon Terms and Conditions and acknowledge the Privacy Notice: https://opentyphoon.ai/tac · https://opentyphoon.ai/privacy Performance Model Description Model type : A 4B instruct decoder only model based on Qwen3 architecture. Requirement : transformers 4.51.0 or newer. Primary Language(s) : Thai 🇹🇭 and English 🇬🇧 Context Length : 256K License : Apache 2.0 License Usage Example This code snippet shows how to use the Typhoon2.5 Qwen3 4B model for Thai or English text generation using the transformers library. It includes setting up the model and tokenizer, formatting chat messages in a system user style, and generating a response. Deploy as Server This section shows how to run Typhoon2.5 as an OpenAI compatible API server using vllm. Using Tools You can provide tools to the vLLM powered OpenAI compatible API for functionality. Sampling Parameters For this model, we encourage you to use a low temperature a…
We use cookies for essential functionality and analytics. You can accept or reject analytics cookies.Cookie policy