Llama's hidden states form a 3D spiral mirroring the periodic table
burny_tech · x · 2026-10-29
A new study investigates how the open-source Llama series represents the periodic table of elements, finding a 3D spiral structure in hidden states that aligns with the table's conceptual organization — predicted atomic numbers arrange smoothly along a spiral in (r·cosθ, r·sinθ, r) space. Evidence that LLMs can reflect the geometric structure of scientific concepts learned purely from text.
More from Research
- Cohere Labs Presents 3 Papers at EMNLP 2026 ORACLE Workshop on Culture and Multilinguality — Cohere_Labs · 2026-10-29
- Cohere's Zero-Shot SLAM-ASR Spoken Language Understanding Paper Featured at EMNLP — Cohere_Labs · 2026-10-29
- AReA: training-free attention method pushes Qwen Image and Flux to 6K — linoy_tsaban · 2026-10-29
- Peeking inside Mamba: single neurons that fire before the word 'from' — burny_tech · 2026-10-29
- Apple hiring PhD interns to fix grounded video reasoning in Video LLMs — HildeKuehne · 2026-10-29
- MASEM (NeurIPS '26): diverse state sampling for goal-conditioned robot RL — KyleMorgenstein · 2026-10-29