RLHF's Token-Level Effects: Unconscious vs. Explicit Changes

A discussion dissects how RLHF changes tokens: most stay unchanged, some shift unconsciously via altered internal circuits, and some are explicit — with the broader view that all model 'mental motions' are essentially reward-expectation heuristics.

2026-09-01 ~ 2026-09-01 · 3 related posts

• Are model mental motions equivalent to unconscious reward expectations? — FioraStarlight · 2026-09-01
• On token layers and consciousness in RLHF — voooooogel · 2026-09-01
• RLHF impact on tokens: unconscious shifts vs conscious choices — voooooogel · 2026-09-01