Auto Weight-Space Programming: Qwen3.5-4B learns to apply logit lens to its own neurons at 99.8%

udmrzn · x · 2026-11-16

A new alphaXiv blog by Atharva Naik, Emmy Liu, and Varun Gangal formalizes weight-space programming — reading or writing a model's weights directly as numbers — and sets the goal of auto-WSP: a model doing it to itself.

First toy result: Qwen3.5-4B learns to apply the logit lens to 128-number slices of its own unseen neurons, scoring 99.8% on a four-way test (chance 25%). Naming tokens outright, writing weights, circuit tracing, and behavior prediction are next steps.

Related event: Researchers Propose Weight-Space Programming for Model Self-Inspection(4 posts)→

Original post →

More from Research

Research channel →