OpenBMB ships MiniCPM5-2B GPTQ for on-device long-context inference

openbmb · hf · 2026-09-07

OpenBMB released MiniCPM5-2B-GPTQ on Hugging Face, a quantized text-generation checkpoint built on the llama architecture. It emphasizes long-context support and tool calling, targeting on-device/edge deployment, with safetensors format and transformers compatibility.

Related event: OpenBMB Open-Sources MiniCPM5-2B, Topping Sub-4B Open Models(14 posts)→

Original post →

More from Models

Models channel →