Subtext Visualizes Silent Words in Model Thinking
TheOnlyVibemaster · reddit · 2026-07-07
Anthropic released its J-space / global workspace research, revealing that a small number of "silent words" emerge internally (dozens of concepts, accounting for <10% of activations) for reasoning and reporting. They open-sourced a Jacobian lens measurement tool, and Neuronpedia provides a pre-fitted lens for Qwen. Leveraging this, the author built Subtext: running qwen3.5-4B in bf16 on a single 12GB GPU, reading 9 layers of the lens token-by-token. It allows real-time visualization of the model's internal judgments as it reads messages and generates replies (e.g., when reading '12+5=1', 'incorrect' lights up before any reply token is output). The speed matches generation speed, and top-5 results have been verified layer-by-layer against Anthropic's reference implementation.
Related event: Anthropic Discovers Global Workspace Inside Claude(102 posts)→
More from coding & agent
- Non-coder builds layered memory architecture: 20k tokens tracks a year of agent conversations — matteoianni · 2026-09-11
- Warp's six non-engineering teams all run on Linear and Claude Code — mon__lim · 2026-09-11
- 9-year backend dev: AI code isn't the problem, the rate of making a mess is — Sweaty-Landscape-561 · 2026-09-11
- RTK claims token savings, but our cost benchmarks disagree — michalwarda · 2026-09-11
- Is inference latency becoming the biggest bottleneck for production AI agents? — Euphoric_Sea632 · 2026-09-11
- Anthropic researcher: 99% of engineers now run swarms of 300+ self-improving agents — AlishaOutridge · 2026-09-11