Steering vector researchers compare notes on model identity arithmetic and thrashing

Sauers_ · x · 2026-10-24

@voooooogel notes observing similar 'identity arithmetic' behavior with steering vectors and asks whether Sauers has seen models thrash in these setups; Sauers replies that 'they seem to thrash less' and says he's looking into it. A substantive exchange between researchers on model behavior under steering.

Related event: Researchers Demonstrate 'Military Dog' Identity Confusion from Adding Feature Vectors(2 posts)→

Original post →

More from Research

Research channel →