RAM-to-arithmetic cost ratio went from 1:1 to 1000:1 — time to make LLMs actually optimize code
CatAstro_Piyush · x · 2026-11-20
@bzogrammer notes most code is extremely inefficient: the constant-factor cost ratio of RAM loads vs arithmetic was about 1:1 50 years ago but is now 1000:1, while much algorithm and data structure design never caught up.
He argues RLVR is the main way LLMs improve today, and making code faster is both trivially easy to grade and directly yields faster, more efficient RL training. With the "hand-optimizing code is too much work" excuse gone thanks to LLMs, users should ask their models to actually optimize code — and expect them to get better at it over time.
More from AGI Musings
- NYT reporter's GTA VI review goes viral: AI may end this kind of game — gleech · 2026-11-20
- Personal Agents Get You Wrong: Five Memory Failure Modes and How to Audit Them — sujingshen · 2026-11-20
- Databricks CEO: we hit AGI last year by the old definition, then moved goalposts — VraserX · 2026-11-20
- China now leads AI video: ByteDance Seedance and MiniMax set the frontier pace — alexvoica · 2026-11-20
- Hard Fork on GTA VI and the AI Era; Anthropic Goes Public at $2 Trillion — Hard Fork (NYT) · 2026-11-20
- 'Next Einstein' Sabrina Paterski debates AI's hype and limits with an Oxford computer scientist — whoamisri · 2026-11-20