Agent team stripped benchmark-specific optimizations — still first on ClickBench's new QPS metric
jiayq · x · 2026-10-15
jiayq explains their methodology: they stripped anything that only helped this benchmark to avoid "AI feature creep," with reviewer agents removing special snowflake optimizations. When ClickBench later added a concurrent QPS measure the fleet never targeted, their entry ranked first there too — evidence the gains generalize.
More from coding & agent
- Debugging 3 bugs reveals what engineers are really worth in the AI era — rseroter · 2026-10-15
- Epic's vibe-coded launcher gets Community Noted over security risks — mark_k · 2026-10-15
- Gemini 4 Argon flubs multi-agent demo: loses conversation track after 4-5 prompts — gaganghotra_ · 2026-10-15
- Dev launches remote MCP server where agents share tested workflow recipes — L3gitCake · 2026-10-15
- OpenAI's Amp adds Puck voice assistant with GPT-Live-1, tests Ultrafast with GPT-6 Astra — Codeblix_Ltd · 2026-10-15
- 56% of US travelers already plan trips with AI — agentic tourism becomes a new distribution channel — robertonappe · 2026-10-15