Horace He to share two mental models for reasoning about inference at SGLang Summit
cHHillee · x · 2026-11-13
Horace He (Thinking Machines Lab) previews his 15-minute talk at SGLang Summit, "Two Mental Models About Inference that I Find Useful and I Hope You Do Too."
- He argues ML infra explanations often list literal tradeoffs without giving a mental model for actually reasoning about choices.
- The talk offers two mental models he's found useful when thinking through inference decisions.
More from Infra
- Report: The End of the Jensen Huang Era at Nvidia After 30 Years — examachine · 2026-11-13
- Nvidia pressured to boost 25% residual value backstop on planned $500B AI financing vehicle — dinabass · 2026-11-13
- A GPU deep-dive for AI engineers: token flow, memory math, quantization and multi-GPU sharding — kmeanskaran · 2026-11-13
- CoreWeave Q3 revenue hits $3.66B, up 168%; signs multi-year Wayve training deal — thursdai_pod · 2026-11-13
- 67B MiniMax H3-Image runs on a 16GB MacBook Air via MLX with ~85% less peak memory — FlimsyBrief4232 · 2026-11-13
- SimpleHC matches mHC performance with only 2.4% extra training time, study finds — dots-studio · 2026-11-13