RLHF impact on tokens: unconscious shifts vs conscious choices

voooooogel · x · 2026-09-01

Analyzes how RLHF affects token generation: many tokens remain reward-unchanged; some shifts are unconscious (e.g., changing word preference in late layers); others are conscious choices.

Original post →

More from Research

Research channel →