Weight-space programming emerges as a new capability, 20x jump in latest models
Distinct-Question-16 · reddit · 2026-11-03
Citing Alex Krentsel's post: he reproduced the MIT blog's weight-space programming results and found it's a step-change emergent capability in only the newest frontier models.
His chart, benchmarked against a PPO RL network (500M steps) at 1×: GPT-5 through GPT-5.6-Sol show nearly no effect, while GPT-6.1-Sol jumps to 18× and GPT-6 Astra hits 22×; on Anthropic's side, Opus 4.5–5 stay near 1× while the latest Opus 5.5 reaches 20×. Effectiveness crosses an order of magnitude in just the last model generations.
More from Models
- Inference providers can't survive without DeepSeek-grade KV-cache engineering, argues thread — AccBalanced · 2026-11-03
- Fabricated citations collapse from 55% to 0%: new models nearly fix the hallucinated-reference failure — RexDouglass · 2026-11-03
- Apple hints at monetizing third-party AI apps for new revenue on earnings call — TechCrunch AI · 2026-11-03
- Writing Weights Index: Open-Source Models Struggle at Weight-Space Programming — eliebakouch · 2026-11-03
- Gemini 4 Argon ships, putting Google back in the frontier model race after a year-long lull — danshipper · 2026-11-03
- Hands-on audit punctures Astra's '0.016% weight programming' claim: it just disabled Qwen's thinking mode — teortaxesTex · 2026-11-03