Calculating MFU is the Subject of Spirited Disagreements in AI Compute
cHHillee · x · 2026-08-09
In a follow-up discussion, the author added that how you compute MFU (Model FLOPS Utilization) itself is also the subject of spirited disagreements. He mentioned he might write more someday on ways that MFU can be an ambiguous metric.
Related event: MFU Metric Sparks Controversy in AI Compute Efficiency(3 posts)→
More from Infra
- 3x DGX Spark cluster runs GLM-5.3-Flash locally behind a proxy, 1.75M tokens/day at 119W — Teknium · 2026-10-16
- Optuna creator Akiba: when 2 hyperparameters cost $20M, what's left for BO/HPO — Stefania_druga · 2026-10-16
- Amazon Proposes Per-Request Validated Evidence Caching for Production RAG — _reachsumit · 2026-10-16
- LinkedIn's TransX report: sequence transduction for recsys, +6.02% CTR in A/B tests — _reachsumit · 2026-10-16
- llama.cpp PR boosts CPU inference speed with merged AVX2 tiled accumulators — jacek2023 · 2026-10-16
- Zero's next-gen IVM engine runs in a single DO, live-querying a 100GiB R2 database — threepointone · 2026-10-16