OpenBMB ships MiniCPM-V 4.7: a 35B vision model at 13+ tok/s on an iPhone with ~3GB RAM
ondevicedev · reddit · 2026-10-13
OpenBMB released open-source on-device VLM MiniCPM-V 4.7 (35B-A3B MoE): reportedly 17+ tok/s on iPad Pro M4 (16GB) and 13+ tok/s on iPhone 17 Pro Max at 3GB memory. Its new LES (Lookahead Expert Scheduling) technique preloads MoE experts to cut inference stalls—claimed up to 5× speedup with identical outputs. Also: 34 multimodal benchmarks, 90.4 OCRBench with 16× visual compression, a 1B lightweight variant, Self-Replay Fine-Tuning for cheap customization, and support for Apple/Intel/AMD/Arm/Rockchip chips.
Related event: OpenBMB Open-Sources MiniCPM-V 4.7: 35B MoE Multimodal on Device(7 posts)→
More from Infra
- Celesto CI undercuts GitHub Actions 9x: 1000 jobs for $6.67 vs $60 — aniketmaurya · 2026-10-13
- Keurig coffee maker flooded Wi-Fi with 1TB in 10 days — owner says unit bug — gnukeith · 2026-10-13
- oQe Quantization Update Cuts Code KL Divergence by Up to 18% Across 69 Models — huggingface · 2026-10-13
- Rodolfo Rosini on 2040: cheap compute everywhere, devices jumping orders of magnitude — MikePFrank · 2026-10-13
- AI inference chips are a $225bn market: Vaire on why startups avoid silicon and its Nvidia-adjacent plan — MikePFrank · 2026-10-13
- Vaire CEO Explains Reversible Computing Chips That Recycle Energy Like a Tide Mill — MikePFrank · 2026-10-13