Language models write neural network weights from scratch, matching gradient descent with 6x fewer subjects

IgorCarron · x · 2026-11-17

An EPFL paper on arXiv (Mixed Signals: Weight-Space Programming for EEG and ECG) shows "weight-space programming": frontier LLMs can read and edit a trained network's weights, and even write all weights from scratch given only the architecture, task, and a minimal set of training subjects.

Key results:

Limitations: LLMs struggle to improve already well-trained classifiers and can't reliably identify a network's trained task from weights alone. The takeaway: training is turning into thinking, especially valuable for data-scarce biosignal modeling.

Original post →

More from Research

Research channel →