Language Models Can Rewrite Their Own Weights: 27B Model Self-Improves Without Gradients

Jiajun Fan · hf · 2026-11-21

A multi-institution paper (UIUC, CMU, Princeton, Stanford, etc.) introduces self-rewriting: a language model improves itself by editing its own weights via reasoning alone — no gradients, no training.

Takeaway: improving a language model may come to take a conversation rather than a training run.

Related event: Language Models Can Rewrite Their Own Weights: 27B Model Self-Improves Without Gradients(2 posts)→

Original post →

More from Research

Research channel →