New Paper Models Transformer Layer Representations as Trajectory Geometry
A new arXiv paper treats the Transformer forward pass as a trajectory and measures its geometric shape, revealing a three-stage semantic convergence of representations across layers without needing probes.
2026-10-10 ~ 2026-10-11 · 2 related posts
- Paper notes: measuring forward pass "shape" reveals how transformer representations converge — its_vayishu · 2026-10-10
- Paper recasts transformer forward pass as trajectory geometry, finding semantic convergence and 3-phase structure — its_vayishu · 2026-10-11