GPT Injects Jargon? Author Admits Adding Terms to Post-Training Data
charliermarsh · x · 2026-07-20
Developers observed GPT models fabricating obscure technical jargon (e.g., "cycle aware pinned buffer remapping") when analyzing codebases. Charlie Marsh clarified that if the model outputs such terms, it's not hallucination—he intentionally added them to the post-training dataset. This reveals how data injection during post-training directly influences the model's code generation style and vocabulary preferences.
More from Models
- Sol61 flunks instruction-following: skips mandated research even when explicitly told — lucasmeijer · 2026-10-26
- Kimi K3.1 Pro tops MathArena open models, closing frontier gap to about 6 months — teortaxesTex · 2026-10-26
- Ruff creator Charlie Marsh: frontier models find infinite bugs in any software — charliermarsh · 2026-10-26
- Dev testing one skill across Opus 5.5 and Sol 6.1 finds instruction following 'all over the map' — lucasmeijer · 2026-10-26
- supermemory unveils learner-1, claiming continual learning for any model — julianweisser · 2026-10-26
- Anthropic says Opus 5.5 cuts cost per task by ~40% vs Opus 5 — taufiqintech · 2026-10-26