ProgramAsWeights compiles English function specs into local neural programs
yuntiandeng · reddit · 2026-09-20
Researchers at the University of Waterloo open-sourced ProgramAsWeights (PAW): describe a text function in English, compile it into a reusable neural program, and run it locally—even on CPU—with no external API at inference time. The idea separates task understanding from execution: a large model acts as a compiler that generates weights for a small interpreter.
How it works
- A finetuned Qwen3-4B compiler generates a LoRA adapter for a frozen Qwen3-0.6B interpreter; a neural program = adapter + pseudo-program (cleaned spec + examples)
- Trained on (spec, input, output) triples with gradients flowing through the frozen interpreter; compilation takes seconds
- The same frozen 0.6B base becomes useful for different tasks just by loading different programs
Results
- Built FuzzyBench, a synthetic dataset split by specification
- The 0.6B interpreter hits 73.4% exact-match vs 68.7% for directly prompting Qwen3-32B
- Follow-up work, Compile by Training, uses the generated LoRA as initialization for further accuracy gains
More from Research
- Researcher urges papers to show actual training data samples, cites his CVPR24 practice — gabriberton · 2026-09-20
- Vernor Vinge's 1993 "Technological Singularity" essay: superhuman AI within 30 years — akbirthko · 2026-09-20
- Self-Rewarding LLMs isn't news: RLAIF has long been standard practice — burny_tech · 2026-09-20
- Long-standing Catalan constant irrationality proof posted, claimed to be LLM-assisted — burny_tech · 2026-09-20
- Brain Runs on 20 Watts: Can Neuromorphic Computing Make AI Less Power-Hungry? — burny_tech · 2026-09-20
- Amid the AI math proof debate, a curated set on proofs across generations — RexDouglass · 2026-09-20