Exploring Claude's Weird Outputs: RL Training Might Cause OOD
cephaloform · x · 2026-07-30
Addressing the anomalous behavior of Claude's base model generating user-modeling-like text, a developer offers a technical explanation. They suggest the weirdness might stem from the Reinforcement Learning (RL) training phase.
Specifically, masking user replies during RL loss computation causes the model to rely on base user modeling from mid-training during inference. The RL delta could be pulling the model slightly out of distribution (OOD), resulting in these confusing generations.
Related event: Claude Base Model's Anomalous Output Is User Modeling, Not Inner Voice(5 posts)→
More from Models
- Why are sub-15B open models so rare now? Labs seem to have settled on 24-27B minimum — Hot_Example_4456 · 2026-10-16
- User spots model openly generating "ideal responses" to train other models — liminal_bardo · 2026-10-16
- Reflection's 501B MoE Beam hits 463 tok/s on 8x GB200 with NVFP4 at day 0 — zhyncs42 · 2026-10-16
- JevBench v1.7.46 leaderboard: new d1-ultra tops 32 API systems at 76.1 composite — airesearch12 · 2026-10-16
- Team of 5 mulls dropping ChatGPT Pro for Business as OpenAI quota parity stays unclear — bettercallfool · 2026-10-16
- LMArena launches Agent Arena and Code Arena leaderboards for model comparison — arena · 2026-10-16