POSTECH paper: weight-space programming doesn't need Transformers — 680x smaller, 17x faster

CatAstro_Piyush · x · 2026-11-17

POSTECH researchers Hyunjong Ok and Jaeho Lee argue Transformers are the wrong default for weight-space programming. When an LLM writes network weights directly (no gradient training), an associative-memory architecture of 0/1 fact tables + rules — one fact per row — matches ARC accuracy with 680–1800x fewer parameters than the best Transformer the same LLM wrote, and runs up to 17x faster on GPU with a table-tuned memory design. Paper and code are public.

Original post →

More from Research

Research channel →