Deploy MiniCPM-V 4.7 locally by pointing Claude at its Hugging Face page

NielsRogge · x · 2026-10-17

Niels Rogge shares the concrete workflow for running MiniCPM-V 4.7 locally: point Claude (or any coding agent) at the OpenBMB Hugging Face page and ask it to run the model with llama.cpp, then open llama.cpp's web UI to chat. The collection includes 35B-A3B and 1B sizes, each with DSpark draft heads, GGUF, and FP8/GPTQ/AWQ/int4 quantizations — GGUF variants already past 144k downloads in two days.

Related event: OpenBMB Releases MiniCPM-V 4.7: On-Device Multimodal MoE Taking on Qwen3.6(5 posts)→

Original post →

More from coding & agent

coding & agent channel →