NY AI Dinner: Agents Now Drive Inference Optimization

Notes from a New York AI dinner reveal that most performance optimization at major inference providers like Together and Fireworks is now done by agents, with performance engineers spending their time managing agents and RSI loops, while human code review is no longer considered cost-effective.

2026-10-10 ~ 2026-10-10 · 2 related posts

• NYC AI dinner: inference providers' perf optimizations mostly done by agents, code review declining — IgorCarron · 2026-10-10
• Notes from an NYC AI dinner: agents find most inference perf wins, code review deemed unproductive — paulnovosad · 2026-10-10