ForgeSystem: AI agents forge per-workload fused kernels, beating SGLang by 1.21x

aftahi_ai · x · 2026-11-20

A paper from ModelBest Inc. and Tsinghua proposes ForgeSystem, an architecture where AI agents produce demand-specific software artefacts instead of relying on general frameworks.

Core claim: most module boundaries in frameworks like PyTorch or Megatron exist for compatibility, not speed — a hidden tax every user pays. Hand-writing a fused stack per workload was never worth human effort, but agents flip that economics.

Key facts:

The authors' open question: if every workload can get its own fused stack, what happens to the general frameworks we all build on?

Related event: ModelBest and Tsinghua Unveil ForgeSystem: AI Agents Forge Load-Specific Systems(2 posts)→

Original post →

More from Infra

Infra channel →