MiniCPM Repo MiniCPM Paper MiniCPM V Repo Join us in Discord and WeChat Introduction MiniCPM3 4B is the 3rd generation of MiniCPM series. The overall performance of MiniCPM3 4B surpasses Phi 3.5 mini Instruct and GPT 3.5 Turbo 0125, being comparable with many recent 7B~9B models. Compared to MiniCPM1.0/MiniCPM2.0, MiniCPM3 4B has a more powerful and versatile skill set to enable more general usage. MiniCPM3 4B supports function call, along with code interpreter. Please refer to Advanced Features for usage guidelines. MiniCPM3 4B has a 32k context window. Equipped with LLMxMapReduce, MiniCPM3 4B can handle infinite context theoretically, without requiring huge amount of memory. Usage Inference with Transformers Inference with vLLM For now, you need to install our forked version of vLLM. Evaluation Results Benchmark Qwen2 7B Instruct GLM 4 9B Chat Gemma2 9B it Llama3.1 8B Instruct GPT 3.5 Turbo 0125 Phi 3.5 mini Instruct(3.8B) MiniCPM3 4B English MMLU 70.5 72.4 72.6 69.4 69.2 68.4 67.2 BBH 64.9 76.3 65.2 67.8 70.3 68.6 70.2 MT Bench 8.41 8.35 7.88 8.28 8.17 8.60 8.41 IFEVAL (Prompt Strict Acc.) 51.0 64.5 71.9 71.5 58.8 49.4 68.4 Chinese CMMLU 80.9 71.5 59.5 55.8 54.5 46.9 73.3 CEVAL…
We use cookies for essential functionality and analytics. You can accept or reject analytics cookies.Cookie policy