Nested graphs merge 16 Inductor regions into 2 for the same 64 ops
cfregly · x · 2026-10-22
Comparing emitted Inductor code at depth 8, seed 0: without nested graphs it's 16 wrapper regions × 4 ATen ops; with them, 2 regions × 32 ops — both representing the same 64 operations over 1,048,576 FP32 elements. The chart shows how region merging cuts replay launches from 16 to 2 per call.
More from Infra
- NVIDIA unveils Vera Rubin full-stack agent hardware, claims post-trained Nemotron beats frontier models — mervenoyann · 2026-10-22
- Meme: all of modern digital infrastructure rests on one ASML machine — VoidAsuka · 2026-10-22
- OrbStack adds self-hosting for orbs, free for individuals and teams — jasonkneen · 2026-10-22
- Forward-only pretraining matches backprop: val 3.704 in 2.5 min on 8×H100, no autograd — tensorqt · 2026-10-22
- Locals: Open-Source Apple Silicon Engine Runs Local LLMs Up to 3x Faster — SumitGup · 2026-10-22
- DeepSeek's new funding draws hardware-heavy investors: CATL, SMIC, Geely among backers — teortaxesTex · 2026-10-22