Tracing 'seam': how Claude's vocabulary drift spread across 685K GitHub PRs
dl_weekly · x · 2026-09-15
Pydantic engineer Michael Pfaffenberger documents linguistic drift in frontier models: Anthropic's Claude models now overuse the word "seam" for software connection points (traditionally "interface" or "contract"). When asked, Fable 5.1 defensively cited Michael Feathers' 2004 book Working Effectively with Legacy Code, suggesting RL training dug up the archaic term.
The author traced the word's proliferation across 685,000 GitHub PRs in 2026 and built vocabguard, a Pydantic AI drift-monitoring capability achieving 0.869 AUC. The piece doubles as a demo of building agentic harness features with Pydantic AI abstractions.
More from Models
- Sakana Namazu powers medical AI that scores 96.4% on Japan's physician licensing exam — SakanaAILabs · 2026-09-15
- Running a model at 1.5 min per move: Mike Frank tunes reasoning-time settings over OpenRouter — MikePFrank · 2026-09-15
- Tired of Cheesed Benchmarks: Redditors Ask Where to Find Trustworthy LLM Comparisons — Sarlo10 · 2026-09-15
- Back-of-Envelope: Frontier US Model Estimated at 8e26 FLOPs, 800B Active Params, 170T Training Tokens — teortaxesTex · 2026-09-15
- Perplexity says GPT-6 Astra can run full workflows with far fewer human check-ins — imjustnewatai · 2026-09-15
- OpenAI flags compiler debugging with lldb as 'cybersecurity', sparking criticism — QuixiAI · 2026-09-15