johnlindquist: 'Best tool for the job' is now 'benchmark everything, ship the winner'
johnlindquist · x · 2026-11-13
Developer johnlindquist quotes thdxr's thread on how plugin systems should work in a world of agents (plugins are mostly vibe-coded, today in JS but pulling in big runtimes, with Lua-like embedded languages an open question), and crystallizes a shift: we used to say 'the best tool for the job'; now it's 'benchmark and eval every single available option and implement whichever wins.' A snapshot of eval-driven decision-making replacing engineer intuition.
More from coding & agent
- MikeGC launches as open-source legal AI, taking on Harvey's paid Intake features — Scobleizer · 2026-11-13
- AI swaps gray boxes for ~4,000 buildings and 28,000 props inside Unreal Engine — chrisfirst · 2026-11-13
- UE 5.9's built-in AI assistant builds a city from gray boxes and saves the layout — chrisfirst · 2026-11-13
- AI-written lines plus ElevenLabs voice give this game a tough radio director — chrisfirst · 2026-11-13
- Profound cofounder/CTO on 'Fractal Speed': cutting delivery from two weeks to two hours — soleio · 2026-11-13
- Open-weight models are under 0.5% of T3 Code traffic — but that's customer data, not market data — Arindam_1729 · 2026-11-13