ARGUS Enables Low-Overhead Tracing for 10,000-GPU Clusters with <2% Cost

stochasticchasm · x · 2026-08-02

Large-scale LLM training struggles with performance diagnosis: coarse monitors can't find root causes, while fine-grained profilers incur prohibitive 5%-30% overheads. The ARGUS system tackles this for 10,000+ GPU clusters by providing always-on, fine-grained tracing with under 2% overhead.

It decomposes observations into CPU call stacks, framework semantics, and GPU kernel execution, drastically compressing raw kernel events (from 10MB down to 2.7KB). Deployed in production for over six months, it effectively isolates anomalies like compute stragglers.

Related event: ARGUS Enables Low-Overhead Tracing for 10,000-GPU Clusters(2 posts)→

Original post →

More from Infra

Infra channel →