Mechinterp finding: one direction in Qwen3-8B encodes fingertip pressure in a simulated hand
teortaxesTex · x · 2026-11-17
- repligate highlights the unusually prolific and high-quality mechinterp research from @Sauers and @euagaric, attributing it to Sauers' "naturalist" grounding—years of observing raw LLM behavior that most mechinterp researchers ignore—and an extreme willingness to ditch convention to chase phenomena.
- Cited finding from euagaric: while teaching Qwen3-8B to drive a simulated hand, they isolated a single direction inside the model carrying fingertip pressing force. Ablating it stops the hand from halting at a wall; adding it makes the hand stop early. Training created a new channel, distinct from the model's existing concept of "pressure."
Related event: Qwen3-8B Learns to Control Robot Arm, Growing a Dedicated Pressure Channel(2 posts)→
More from Research
- François Fleuret asks: is the gradient Japanese? It never refuses to give you a direction — francoisfleuret · 2026-11-22
- Hat Matrix Explained: How Much Leverage Does Each Data Point Have in Least Squares? — RobertTLange · 2026-11-22
- Energy-Based Reasoners: gradient descent on latent states for adaptive reasoning — kalyan_kpl · 2026-11-22
- Lean community certifies Riemann proof; honeypot fake keys expose breaches at three AI providers — LeviTurk · 2026-11-22
- Riemann hypothesis 'proven by Turkish mathematician using AI' claim mocked as the 'Organic Turk' — CatAstro_Piyush · 2026-11-22
- Andriy Burkov releases The Hundred-Page Language Models Book, hands-on with PyTorch — burkov · 2026-11-22