iWSP: LLM agents hand-code transformer weights without backprop, beat deep brain-encoding models

burny_tech · x · 2026-11-21

A Microsoft Research-led team introduces Interpretable Weight-space Programming (iWSP), where an LLM agent iteratively builds interpretable models by explicitly programming weights and features in code — no backpropagation. The agent hypothesizes and refines human-readable computations across trials, mirroring a scientist's workflow, with LLM audits confirming interpretability. Validated on arithmetic and sentiment benchmarks, then applied to neural encoding across vision, language, and audition, where it outpredicts deep models in visual cortex while remaining interpretable. Authors include Jianfeng Gao and Nebojsa Jojic.

Related event: iWSP Lets LLM Agents Write Model Weights Directly, No Backprop Needed(2 posts)→

Original post →

More from coding & agent

coding & agent channel →