Inco Splash hits 144 tok/s running Qwen3.8-27B on an M5 Max, 3x faster than Ollama
TheMoonMidas · x · 2026-09-19
Inco released Splash, an open-source inference engine built specifically around Apple silicon, with the DFlash 2 draft model pre-integrated and runnable in two commands.
- Qwen3.8-27B now runs at 144 tok/s on an M5 Max MacBook Pro, up from 70 tok/s with DFlash 2 a month ago
- Claims up to 3x the decode speed of Ollama and 2x oMLX, nearly 4x when an agent fans out into sub-agents
- The engine is co-designed with the model rather than being a generic runtime
More from Infra
- S3-based databases cache in memory and NVMe, making disk vs S3 latency gap smaller than expected — mgill25 · 2026-11-04
- gpu-unlock project claims up to 2x FP16 tensor throughput for RTX 20/30/40 cards — paranoidray · 2026-11-04
- These 10 GPU optimization papers are why your model runs fast today — NandoDF · 2026-11-04
- One prompt to audit cross-region traffic: dev cut trans-Atlantic latency by moving a service — DanielLockyer · 2026-11-04
- SurrealDB 4 launches as multi-model ACID database for the agentic era — Scobleizer · 2026-11-04
- Fire at Taiwan Panasonic PCB materials plant may tighten CCL supply further — zephyr_z9 · 2026-11-04