Program-as-Weights: 0.6B interpreter matches Qwen3-32B prompting with 1/50 the memory
yuntiandeng · x · 2026-09-16
Yuntian Deng's team released the open-source paper "Program-as-Weights: A Programming Paradigm for Fuzzy Functions."
- Idea: fuzzy tasks (log alerting, JSON repair, intent-based ranking) are usually outsourced to LLM APIs at the cost of locality, reproducibility, and price. PAW compiles a natural-language spec into a compact, locally executable neural artifact.
- Method: a 4B compiler trained on FuzzyBench (a released 10M-example dataset) emits parameter-efficient adapters for a frozen lightweight interpreter.
- Results: a 0.6B Qwen3 interpreter running PAW programs matches direct prompting of Qwen3-32B, using 1/50 the inference memory at 30 tokens/s on a MacBook M3.
- Paradigm shift: the foundation model becomes a tool builder—invoked once per function definition to produce a small reusable artifact whose subsequent calls are cheap and offline.
Paper and code are open source.
Related event: Yuntian Deng Open-Sources Program-as-Weights and NeuralOS Research(2 posts)→
More from Infra
- OpenRouter crosses 10 quadrillion annualized token run rate, doubling every 10.5 weeks — deedydas · 2026-11-02
- Palmer Luckey asks: can you use datacenter RAM for things prohibited by the operator's terms of service? — avaitopiper · 2026-11-02
- Disable MTP for 20-30% faster local LLM inference on limited RAM — InternalMode8159 · 2026-11-02
- Kioxia up 216% in a year but down 68% from its June 2026 peak — zephyr_z9 · 2026-11-02
- Intel plunges 29%, worst day since the 1970s, wiping $12B off US government stake — emmanuelvivier · 2026-11-02
- Researcher hoards nearly 1TB of DRAM, refuses to sell a stick to data centers — kevinnbass · 2026-11-02