LLM writes 355-weight 4-digit multiplier without training — 40,000x smaller than SOTA

lateinteraction · x · 2026-11-07

Tula's Braden Hancock spotlights the new "weight space programming" paradigm kicked off by lateinteraction's lab blog: transformers struggle to learn 4-digit multiplication, but an LLM wrote a solution in just 355 weights (40,000x fewer than SOTA) with 100% accuracy, without any training.

Hancock notes matrix-multiplier-based long multiplication isn't surprising per se, but with billions invested in matrix-multiply-optimized hardware, converting software 1.0 (traditional code) into software 2.0 (weights as code, now directly authored by superior models rather than trained) could unlock 40,000x-class speedups elsewhere.

Related event: Weight-Space Programming Solves 4-Digit Multiplication With Just 355 Weights, No Training(2 posts)→

Original post →

More from coding & agent

coding & agent channel →