MIT researchers had an LLM edit another model's weights directly, lifting math score from 7.9% to 48.1%

winer666 · reddit · 2026-11-16

MIT researchers (Rikiya Takehi, Jayden Teoh, Alex Zhang, Omar Khattab) had GPT-6 Astra directly edit a small Qwen model's weights—no gradient descent, no training data. Astra found and removed the weight pattern causing repetitive loops, touching 0.016% of weights and lifting math score from 7.9% to 48.1%.

The framing is the real story: model repair as direct surgery—if it generalizes, debugging models could look like debugging code, and raises the question of how much capability is locked behind fixable quirks rather than missing knowledge.

Original post →

More from Models

Models channel →