Debate over model inference speed: real demand exists, but speed isn't everything

Former OpenAI policy head Miles Brundage argues there is significant unmet demand for faster model inference, while Herbie Bradley agrees but cautions that faster tasks make workflows harder to adapt, and that speed alone doesn't solve long-running agent tasks.

2026-10-01 ~ 2026-10-01 · 2 related posts