Browser-native Coding Agent: MiniCPM5-2B 4-bit ONNX runs agent stack fully in-browser at 25 tps

karminski3 · x · 2026-09-15

A Hugging Face Space project, MiniCPM5-2B-WebGPU-Pi, packs a full coding agent into the browser: the Pi framework wraps the agent, driven by a sub-2GB 4-bit ONNX build of MiniCPM5-2B, so the entire stack — framework and inference — runs locally in the browser. No Docker, Node, or API keys needed; opening the page gives you a virtual terminal with file editing and tool calls.

The author benchmarked 25 tps on an RTX 3080 Ti and found the 2B model's tool calling surprisingly stable. Two novel ideas emerged:

The author is considering a side-model agent benchmark roundup if there's interest.

Related event: MiniCPM5-2B Runs a Full Coding Agent in the Browser via WebGPU(3 posts)→

Original post →

More from coding & agent

coding & agent channel →