MiniCPM-V 4.7 35B-A3B hits 17+ tokens/s on iPad with ~3GB memory
techNmak · x · 2026-10-16
A developer used OpenBMB's MiniCPM-V 4.7 35B-A3B to build a Neo-Brutalist portfolio UI, highlighting the model's practical on-device deployment: 35B total params with only 3B active, delivering 17+ tokens/s on iPad Pro M4 (16GB) and 13+ tokens/s on iPhone 17 Pro Max at 3GB memory. A 1B variant targets OCR/chart/math tasks. Both support 256K context and are fully open source.
More from Infra
- Rapid-MLX 0.16.2 brings NVIDIA Nemotron 3.5 up to 120B to Apple Silicon Macs — kuchaev · 2026-10-16
- Adobe ships NVIDIA RTX Spark optimizations: up to 2x faster creative apps and 5x Frame.io gains — shashib · 2026-10-16
- Meta's commitments jumped to $349B in a quarter as server memory prices tripled ahead of Oct 21 earnings — tengyanAI · 2026-10-16
- Meta releases Muse Spark Open, trained with vLLM-powered RL inference from day one — colinmcnamara · 2026-10-16
- a16z: bot 403 blocks double as Amazon cracks down on agentic commerce — a16z Newsletter · 2026-10-16
- Meta's open Muse Spark needs 493GB of memory — far beyond any consumer laptop — TejasKumar_ · 2026-10-16