GPT-6 edits Qwen weights directly: 0.016% changes yield up to 6x math gains
CSProfKGD · x · 2026-11-03
rikiyatakehi's team demonstrated "Weight-Space Programming": using GPT-6 Astra to directly edit Qwen3.5-0.8B weights to improve math.
- The frontier model changed only 0.016% of weights, with no gradients or training
- It fixed the 0.8B model's reasoning loops, improving math up to 6x and instruction following 3x
- Claim: frontier LLMs can now natively read and write neural network weights
More from Models
- Leaked DeepSeek V4.1-Flash report: 552B MoE, 1M context, KV cache cut to ~1/40 — teortaxesTex · 2026-11-03
- Observers say Dessa eerily matches Karpathy's "summoning ghosts" analogy; Jack calls it fast — analisereal · 2026-11-03
- Together at TC Disrupt: 'token maxing without cost maxing' via smaller models — togethercompute · 2026-11-03
- Dream-1 zero-shot robot test: 100 public episodes show real skills but poor instruction following — paigeinsf · 2026-11-03
- Speculation: DeepSeek to ship V4.1F or V4.2F before any Pro variant — teortaxesTex · 2026-11-03
- Follow-up: Astra's weight edits only worked on Qwen's visible flaw, not on Gemma 270m — teortaxesTex · 2026-11-03