YC's AI Office Hours: Wafer hits 379ms vs Cerebras 674ms, 44% lower latency
ycombinator · x · 2026-09-27
For YC's AI Office Hours — AI versions of its partners giving startup advice at conversational speed — Wafer ran GLM-5.2 at an average 379ms versus 674ms for Gemma 4 31B on Cerebras, 44% lower latency with a much larger model. After testing lightweight Gemma and OpenAI models, YC moved to a dedicated Wafer endpoint; Wafer agents tuned serving for request rate, cache usage, and prompt/response lengths. Users spent 2.5 minutes longer talking to the AI partners on Wafer.
More from Infra
- Running Qwen2.5-Coder-3B on Android: Jupyter + Pydantic Evals on-device eval pipeline — alex_b3b · 2026-11-11
- 22% of Nvidia revenue now books to Singapore, but only ~1% is local buyers — Gregory_C_Allen · 2026-11-11
- Huawei's Kirin 9050 NPU claims offline 30B MoE on smartphones, +140% perf — AIFlow_ML · 2026-11-11
- Stratechery: Intel vs AMD's diverging earnings and Intel's need for an old-new path — Stratechery · 2026-11-11
- a16z Podcast: Mike Volpi on What the 1990s Internet Boom Teaches Us About the AI Buildout — a16z Podcast · 2026-11-11
- Alibaba files to list chip-design unit T-Head in Hong Kong to fund AI push — pstAsiatech · 2026-11-11