INT21: 2 engineers direct AI to build 20 inference engines in 2 weeks, up to 2.4× faster than SGLang
bingxu_ · x · 2026-10-03
Startup INT21 says two engineers directed AI to build 20 full inference engines in two weeks: text generation beat SGLang on all six models tested (up to 2.4× faster), audio generation up to 7.5× faster than vLLM. Its CEO told Business Insider that scarce CUDA talent is now being augmented by AI, as engineers shift from hand-writing kernels to directing AI. Bing Xu adds: agent evolution marks the beginning of the end of hand-written GPU kernels.
More from coding & agent
- FT: US tech outages blamed on rush to fix bugs found by AI — nordicinst · 2026-11-19
- Claude Code overtakes Cursor and Copilot in job-post mentions ahead of Anthropic IPO — antgoldbloom · 2026-11-19
- Dev submits PR adding periodic checkpoints to GKE sandboxes so agents don't lose progress — yoimnotkesku · 2026-11-19
- AWS adds private CA support to Bedrock AgentCore Identity for connecting agents to self-hosted IdPs — AWS ML Blog · 2026-11-19
- Orchestrator's Cloud Agents graduate from beta to general availability — julianweisser · 2026-11-19
- Zero users, 33 pages shipped: dev crowdsources audit for AI-agent trust schema — TheHamzaShahbaz · 2026-11-19