Graphsignal ships graphsignal-top, a live `top` for inference GPUs with kernel ranking
l0g1cs · reddit · 2026-10-12
The open-source Graphsignal profiler added graphsignal-top, a top-style live view for inference GPUs. Wrap vllm serve / sglang serve in graphsignal-run, run graphsignal-top, and see per-GPU util/memory/power/throttling, running & waiting requests, tok/s and TTFT/TPOT p50/p95, GPU time split (kernels/graphs/memcpy/sync), and every kernel ranked by time over the last 5s with readable names. In their Qwen3-32B test on 2x RTX PRO 6000 over PCIe (tp 2), NCCL all-reduce took a quarter of GPU time and half of wall time was host sync waiting on it. Supports remote hosts and single-frame --once output. Repo: github.com/graphsignal/graphsignal
More from Infra
- OpenAI chip head Richard Ho on Jalapeno: why Broadcom beat Nvidia and AMD as partner — richardjnieva · 2026-10-12
- SpaceX building $250M GigaBay at Starbase to build up to 1,000 Starships a year — DimaZeniuk · 2026-10-12
- Bittensor's TPN Labs ships first model TPN005, cutting base size ~40% with 32k context intact — const_reborn · 2026-10-12
- Lightning AI launches BYOC: run Studios on your own AWS, GCP, Azure or Slurm infra — LightningAI · 2026-10-12
- Microsoft to scale in-house Maia AI chips to multi-gigawatt inference by 2027 — The Decoder · 2026-10-12
- Microsoft plans huge deployment of its own AI chips to cut costs — pstAsiatech · 2026-10-12