GPT-6 Astra reportedly boosted Qwen's math score 7.9%→48.1% by editing 0.016% of weights
troll_khan · reddit · 2026-11-03
A Reddit post relays MIT researchers' claim that GPT-6 Astra improved a small Qwen model's MATH-500 score from 7.9% to 48.1% by directly editing just 0.016% of its weights, with no gradient-based training — the headline result of the "Sparks of Weight-Space Programming" blog. The edit reportedly fixed a reasoning-loop issue flagged in Qwen's own model card and generalized to instruction following (3x IFEval). Note: blog-only claim, not yet peer-reviewed.
Related event: MIT: LLM Edits 0.016% of Weights to Boost Small Model Math Sixfold(40 posts)→
More from Models
- Particle's model lands on data analytics Pareto frontier, beating Haiku 5.5 — ycombinator · 2026-11-03
- ML4 Goes Open-Weight: Frontier Code Agent and Cyber Capabilities, Far More Compact Than Preview — _AndrewZhao · 2026-11-03
- OpenRouter: heavy users now median 6 model families, 2x in a year — sarahookr · 2026-11-03
- Killed by Google eulogizes AI Overview — 'not yet,' replies a user — gaganghotra_ · 2026-11-03
- DeepSeek's 'super agent' sparks debate: is the meat proxy era over? — gdechichi · 2026-11-03
- Only 3% of humans beat Claude Opus 5.5 at predicting what people click — teortaxesTex · 2026-11-03