FlashAttention 4 on GB300 Is So Fast It Annoys Performance Researchers
francoisfleuret · x · 2026-10-22
François Fleuret notes that FlashAttention 4's speed on an NVIDIA GB300 is "uncanny" — and very annoying for those in the business of making things faster, as little headroom remains.
More from Infra
- BIND9 hit by high-severity GSS-TSIG replay bug enabling potential RCE (CVSS 8.1) — basedjensen · 2026-10-22
- Who priority-parks background agents? An ops veteran on sharing one 16GB GPU between apps and agents — Powermadlux · 2026-10-22
- Gartner: AI data centers need $8.5T revenue by 2030 but will only make $3.6T — AIFlow_ML · 2026-10-22
- Comment: Larry Page worth $300B won't pay 5% of net worth for infrastructure he profited from — georgemillo · 2026-10-22
- Amazon reportedly buying $5B of Nvidia GB300 racks it can't yet power on — AIFlow_ML · 2026-10-22
- Ornith-1.5-122B MoE runs on a DGX Spark: 52 tok/s, 256K context recipe — lmoroney · 2026-10-22