The full attribution graph for 36+59: 88 nodes and 2,099 edges
JacobHHilton · x · 2026-10-17
Jacob Hilton shares the full "detailed attribution graph" behind Claude 3.5 Haiku computing 36+59: 88 nodes and 2,099 edges, with many unlabeled features. The image traces pathways from input tokens through add-function and lookup-table features to the output token 95. He marvels that we get any insight at all, while questioning whether this tangle counts as "understanding" how the model adds two numbers.
Related event: ARC's Jacob Hilton Sparks Debate: Interpretability Far From Solved(22 posts)→
More from Research
- Claude cracks 25-year-old ECDSA curve-origin mystery in under 30 minutes — Yuchenj_UW · 2026-10-17
- No accepted agent loop yet for Jev-style decision models plus LLM, Reddit thread finds — emersoftware · 2026-10-17
- Anthropic researchers: superposition isn't the blocker, interpretability is more tractable than assumed — akbirthko · 2026-10-17
- GEMMU benchmark exposes 3 pitfalls that made multimodal unlearning look better than it is — _vztu · 2026-10-17
- Parser-free code index for AI agents cuts grep bills 42% with 4x smaller tool outputs — microbass · 2026-10-17
- Quiz: how many trainable params does GPT-2 use just for embed and unembed? — Sauers_ · 2026-10-17