Hand-written Blackwell GEMM in CuTe DSL hits 1401 TFLOP/s, about 97% of cuBLAS on B200
retr0jirachi · x · 2026-10-03
Developer KyrieBlunders shared a hand-written Blackwell GEMM kernel using CuTe DSL on a B200, boosting throughput from 164 to 1401 TFLOP/s — roughly 97% of cuBLAS performance, showing custom kernels can nearly match vendor libraries.
More from Infra
- Gridline launches one-API fine-tuning, distillation and batch inference for open models — Scobleizer · 2026-11-19
- Ascend output could hit ~20M chips next year; memory and packaging, not logic, are the bottleneck — teortaxesTex · 2026-11-19
- AMD Loom boosts Qwen3.5-4B prefill up to 2.6x on Radeon 890M laptops — jfowers_amd · 2026-11-19
- Dev submits PR adding periodic checkpoints to GKE sandboxes so agents don't lose progress — yoimnotkesku · 2026-11-19
- AWS Lambda Adds GPU Support via Managed Instances for Inference and Media Workloads — DavidWells · 2026-11-19
- Nvidia Allegedly Made GPUs Artificially Scarce to Keep Prices Sky-High — GaryMarcus · 2026-11-19