Survey: most self-improving agents only tune prompts and tools, rarely weights

maier_ak · x · 2026-09-22

A survey from Jürgen Schmidhuber's group finds most self-improving agents only tweak the fast scaffold — prompts, memory, tools — while keeping model weights frozen. Genuine weight updates are rare and risk collapse. Future work targets test-time adaptation and budget-aware improvement.

It also proposes logging self-improvement as checkpointed performance curves under a fixed update budget.

Related event: Schmidhuber-group survey: most self-improving agents tweak scaffolding, not weights(5 posts)→

Original post →

More from AGI Musings

AGI Musings channel →