Observing Open-Source Model Internal States via J-space
Murky-Sign37 · reddit · 2026-07-12
This post covers two main layers: Anthropic's discovery of J-space, an internal working space where Claude "thinks in silence," and the author's application of this analytical approach to open-source model Qwen3-8B via local experiments.
Key takeaways include:
- Meaning of J-space: It is not readable chain-of-thought, but a hidden conceptual space within activations. The model may pass through a series of intermediate internal states before outputting the final answer.
- Experimental method: The author used the open-source Jacobian lens (J-lens) to observe the internal states of Qwen3-8B, locally capturing "prose drift" prior to tool calls—such as a tendency to generate natural language prefixes instead of JSON.
- Engineering utility: This signal was integrated into an agent guard pipeline to halt, cancel, or preserve useful internal states, and the recovered samples were distilled into LoRA data.
- Supplementary materials: The post includes an 8-minute blackboard lecture video and a terminal demo to help understand the probe setup and guard loop implementation.
Related event: Anthropic Reveals Claude's Hidden Reasoning Space: J-space(16 posts)→
More from coding & agent
- He benchmarks new models by having them build their own copilot — $28 of compute — bucolucas · 2026-10-27
- Founder generates 46 app promo videos in 4 days with Claude, skipping $11,500 in UGC fees — PrajwalTomar_ · 2026-10-27
- Should agents be allowed to change plans mid-task? Reddit debates the drift boundary — wistfulcracker84 · 2026-10-27
- HeyGen + Canva MCP turns slide speaker notes into an avatar presentation video — HeyGen · 2026-10-27
- Local beats cloud: Qwen 3.8 FN handles private student data as well as frontier models — dr_lm · 2026-10-27
- Cloudflare Computer adds agent interruption recovery and approval pauses in v0.7.0 — irvinebroque · 2026-10-27