Numerical Instability in "Fancy" Matmul Optimization Methods
francoisfleuret · x · 2026-08-19
Notes that "fancy" matmul optimization methods like Strassen are numerically unstable. The intuitive take is that these methods accumulate more stuff in some variables, worsening the range.
Related event: Matmul optimization is bounded by data movement, not multiplication count(4 posts)→
More from Infra
- OpenAI uses ~20% compute for inference during training — eliebakouch · 2026-08-19
- Vercel KMS Lets You Sign JWTs Without Managing Private Keys — cramforce · 2026-08-19
- Ling-3.0-tiny Runs 128K Context on $249 8GB Orin Nano — Puzzleheaded_Base302 · 2026-08-19
- Apple's Foundation Model Framework: Hybrid AI Routing with Dynamic Profiles — Scobleizer · 2026-08-19
- Docling Graph turns documents into queryable knowledge graphs using Pydantic — techNmak · 2026-08-19
- CoreWeave hits $2.6B quarterly revenue in just 25 quarters, a milestone AWS took 40 to reach — FinanceYF5 · 2026-08-19