Qwen2.5 0.5B Instruct q4f16 1 MLC This is the Qwen2.5 0.5B Instruct model in MLC format q4f16 1 . The model can be used for projects MLC LLM and WebLLM. Example Usage Here are some examples of using this model in MLC LLM. Before running the examples, please install MLC LLM by following the installation documentation. Chat In command line, run REST Server In command line, run Python API Documentation For more information on MLC LLM project, please visit our documentation and GitHub repo.
We use cookies for essential functionality and analytics. You can accept or reject analytics cookies.Cookie policy