Software moats won't survive RSI — ML infra's value is demand aggregation, says cHHillee
PatrickToulme · x · 2026-09-22
cHHillee tells PatrickToulme that if a moat is software, it isn't durable against RSI, though he doesn't think kernel-level MFU gains are a significant advantage. ML infra instead benefits from demand aggregation: the most efficient setup for a model like Kimi K3 might involve PD disaggregation plus wide EP, which only pays off when demand is pooled.
More from Infra
- Sentdex benchmarks openjev: 169ms on Dell GB10 vs 137ms on RTX 3090 — Sentdex · 2026-09-22
- PyroDash cuts inference cost 96% by having a 4B model call the big one only when needed — jiqizhixin · 2026-09-22
- Underdog's Husky Inference Engine Claims 4.5x Speedup Over MLX, 730 tok/s on MacBook — jimmykoppel · 2026-09-22
- Full-Parameter RL on TPUs: peano_ai Runs 310B MiMo-V2.6 Across 1,000+ TPUs — simonguozirui · 2026-09-22
- Cloudflare Python Workers go generally available after two-year preview — Simon Willison · 2026-09-22
- Fighting AI crawler traffic: beyond Turnstile, Cloudflare's AI Labyrinth as an option — fforres · 2026-09-22