NanoGPT speedrun record slashed to 39.9 seconds

MIT's Deven Pietrzak cut the NanoGPT speedrun record from 73.9 to 39.9 seconds on 8×H100 GPUs, a 46% improvement that exceeds all previous 45 records combined, via flop-level optimizations merged as PR #360.

2026-09-29 ~ 2026-09-29 · 4 related posts

1 near-duplicate retellings: ziv_ravid