27B Model Rewrites Its Own Weights Without Training or Gradients, Paper Claims

udmrzn · x · 2026-11-18

A new arXiv paper by Jiajun Fan et al., Language Models Can Rewrite Their Own Weights, shows a 27B language model can diagnose its own errors and rewrite its weights — with no training or gradients — to improve on unseen tasks.

The authors argue this hints models could be permanently updated through inference alone, bypassing the usual context-stuffed memory or expensive fine-tuning loops. If reliable on a single GPU, it opens a new paradigm for continuous, localized model adaptation, especially for self-improving agents.

Related event: Language Models Can Rewrite Their Own Weights Without Training(3 posts)→

Original post →

More from Research

Research channel →