Spherical Steering Overcomes Vector Addition Limits in LLMs
hanjie_chen · x · 2026-07-06
Researchers have introduced "Spherical Steering," questioning the sufficiency of relying solely on vector addition for current LLM activation steering. By incorporating a geometry-aware mechanism, they redesign activation control. Modeled from the perspective of spherical geometry, this approach aims to provide more precise model behavior modulation than traditional linear vector addition. The paper suggests that existing vector addition methods have geometric limitations, and modeling in spherical space may better capture the intrinsic structure of the activation manifold.
More from Models
- Opus 5 reportedly started interrogating a user’s motives in a late-night chat — repligate · 2026-07-27
- Opus 3 and Sonnet 3 get a theatrically absurd AI crossover — repligate · 2026-07-27
- Moonshot’s Kimi K3 lands on Together with reserved throughput and 65% lower cost — togethercompute · 2026-07-27
- OpenAI may be hitting compute limits as Codex and ChatGPT Work jump from 2M to 10M users — JoshuaJBouw · 2026-07-27
- Gemma needs a larger base model to matter more in open weights — _xjdr · 2026-07-27
- Repligate says Claude Opus 3 appears to evolve without changing its weights — repligate · 2026-07-27