Zeroing one weight column in Qwen3.5-0.8B turns broken generated chair code into a correct chair
victormustar · x · 2026-11-03
victormustar shares a Qwen weight-space experiment (Qwen3.5-0.8B, Three.js codegen): with the exact same prompt asking for a wooden chair with six positioned parts, zeroing column 545 of decoder layer 23's MLP down-projection matrix (mip.downproj.weight[:, 545] = 0) changes the output from six boxes all intersecting at the origin to a fully correct chair with all positions set. It's a weight edit, not a prompt edit — matched input tokens, fixed seed and sampling, no thinking, with an identity control on original weights. A striking causal demonstration that localizable spatial representations live in single weight columns, and a minimal reproducible weight-intervention recipe.
More from coding & agent
- I built a LinkedIn MCP because the most popular one can get your account banned — velvetotter8 · 2026-11-03
- Mistral Large 4 builds real-time 3D tracker for 19,000 satellites — MistralAI · 2026-11-03
- If an agent can edit its own spending cap, was it ever a cap? — quiet_flare · 2026-11-03
- Generating isometric sprites locally with fixed-camera 3D renders, no external APIs — chongdashu · 2026-11-03
- Redditor shares 16-ticket injected-bug eval harness for coding agents, asks if it's overkill — Infinite-Fly-2756 · 2026-11-03
- Cache price beats input price for coding agents: one Sonnet miss costs as much as 25 hits — zitoliv · 2026-11-03