MiniCPM5-2B open-sourced with Day-0 vLLM support, tops sub-4B open models
vllm_project · x · 2026-09-07
OpenBMB has released MiniCPM5-2B, a dense 2B model built for on-device deployment on the standard LlamaForCausalLM architecture, with native 128K context and Day-0 support in vLLM v0.21.0.
Benchmarks: It ranks #1 among open-source models under 4B parameters on the Artificial Analysis Intelligence Index with a score of 23, scores 20 on the Agentic Index, and averages 53.9 across 34 benchmarks covering coding, math, long-context, tool use, and agentic tasks.
Highlights:
- A single checkpoint supports both Think / No-Think modes, toggled via the enablethinking chat-template flag, overridable per request
- Native XML-style tool calling with vLLM's minicpm5 parser
- Training data, recipes, and the RL stack are open-sourced alongside the weights
- Trivial to deploy: vllm serve openbmb/MiniCPM5-2B on a single GPU; smaller cards can shrink --max-model-len to free KV cache
Related event: OpenBMB Open-Sources MiniCPM5-2B, Topping Sub-4B Open Models(14 posts)→
More from coding & agent
- Resin lets an agent build standalone LLM inference engines; vLLM and SGLang optimize DeepSeek kernels differently — AccBalanced · 2026-10-27
- How I let my cloud Grok Bot code on my Mac mini via Tailscale, no public ports — talkaboutdesign · 2026-10-27
- Context layout is a cost decision: one memory edit can bust your entire agent prompt cache — dscape · 2026-10-27
- Alchemy adds effect/Workflow support across Durable Objects, Workflows and Lambda Durable Functions — samgoodwin89 · 2026-10-27
- Alchemy's Lambda Web Functions run plain Node web servers on Lambda, no OpenNext needed — samgoodwin89 · 2026-10-27
- Alchemy makes all ~2,850 AWS bindings work from any cloud, not just S3/Lambda/DynamoDB — samgoodwin89 · 2026-10-27