From 1D to 2D int8 kernels: a hands-on GPU internals learning path
goyal__pramod · x · 2026-09-05
The author tried extending an int8-quantized GPU kernel from 1D to 2D and was surprised by how big the jump is, while recommending his blog series on GPU internals — best read once you start understanding how GPUs actually operate.
More from Infra
- AMD, Cisco and Saudi Arabia's HUMAIN deploy MI335X GPUs, planning up to 250MW — Beth_Kindig · 2026-09-05
- Reef launches inference-native infra that serves self-improving agents without downtime — pliang279 · 2026-09-05
- Google DeepMind Publishes Free Book on Scaling LLMs Across TPUs and GPUs — goyal__pramod · 2026-09-05
- Prime Super Flash MoE: 1.2x BF16 and 1.6x MXFP8 speedups over upstream on B200 — retr0jirachi · 2026-09-05
- How to Estimate tokens/sec on Your Hardware: The VRAM Bandwidth Formula — Pyrolistical · 2026-09-05
- Google Cloud proposes Cloud Run sandboxes to fix coding agents' repair loop — rseroter · 2026-09-05