GitHub Repo Technical Report Join Us 👋 Contact us in Discord and WeChat What's New [2025.06.06] MiniCPM4 series are released! This model achieves ultimate efficiency improvements while maintaining optimal performance at the same scale! It can achieve over 5x generation acceleration on typical end side chips! You can find technical report here.🔥🔥🔥 MiniCPM4 Series MiniCPM4 series are highly efficient large language models (LLMs) designed explicitly for end side devices, which achieves this efficiency through systematic innovation in four key dimensions: model architecture, training data, training algorithms, and inference systems. MiniCPM4 8B: The flagship of MiniCPM4, with 8B parameters, trained on 8T tokens. ( Note : In vLLM's chat API, add special tokens is False by default. This means important special tokens—such as the beginning of sequence (BOS) token—will not be added automatically. To ensure the input prompt is correctly formatted for the model, you should explicitly set extra body={"add special tokens": True} . Then you can use the chat interface by running the following code: Evaluation Results On two typical end side chips, Jetson AGX Orin and RTX 4090, MiniCPM4 demon…
We use cookies for essential functionality and analytics. You can accept or reject analytics cookies.Cookie policy