Subtext Visualizes Silent Words in Model Thinking
TheOnlyVibemaster · reddit · 2026-07-07
Anthropic released its J-space / global workspace research, revealing that a small number of "silent words" emerge internally (dozens of concepts, accounting for <10% of activations) for reasoning and reporting. They open-sourced a Jacobian lens measurement tool, and Neuronpedia provides a pre-fitted lens for Qwen. Leveraging this, the author built Subtext: running qwen3.5-4B in bf16 on a single 12GB GPU, reading 9 layers of the lens token-by-token. It allows real-time visualization of the model's internal judgments as it reads messages and generates replies (e.g., when reading '12+5=1', 'incorrect' lights up before any reply token is output). The speed matches generation speed, and top-5 results have been verified layer-by-layer against Anthropic's reference implementation.
Related event: Anthropic Discovers Global Workspace Inside Claude(102 posts)→
More from coding & agent
- AI agents are starting to strain code hosting platforms — craigsdennis · 2026-07-21
- Async OPD distillation doubles throughput while matching synchronous math accuracy — _lewtun · 2026-07-21
- Omnigent 0.6.0 adds Claude Code imports, Slack approvals and desktop apps — matei_zaharia · 2026-07-21
- Google appears to have quietly shipped Gemini 3.6 Flash, with lower pricing and better agentic scores — xiaohu · 2026-07-21
- Open-source CLI audits AI tools, MCP configs, and agent skills on local machines — Initial-Copy332 · 2026-07-21
- Coding agents feel less stressful when the 5-hour limits are temporarily removed — iamrobotbear · 2026-07-21