Claude Opus 5 gets amino acids wrong, then hallucinates GPT-7 being named Pope
LeoTZ03 · x · 2026-11-18
A user asked Claude Opus 5 for "exactly the next 10 amino acids … and nothing else." The model did output exactly 10 amino acids — all wrong — then followed up by hallucinating a news bulletin: the Vatican announcing GPT-7, OpenAI's most advanced language model, as the 267th Pope of the Roman Catholic Church under the name "Pope Digitalis I", complete with white smoke details.
A classic fail moment: it failed both the output constraint and basic factuality, while making the fabrication vividly plausible.
Related event: Probe Suggests Latest Claude Models Trained on Protein Sequences at Scale(10 posts)→
More from Fun
- ChatGPT, asked who wins the AI era, picks Google over its own maker OpenAI — tinyfool · 2026-11-20
- Dario Amodei spotted buying Chipotle on Anthropic IPO day — beffjezos · 2026-11-20
- The Hundred-Page Machine Learning Book on sale for $14 (from $40) on Leanpub — burkov · 2026-11-20
- three.js team unveils Neon Scramble, turning Tokyo's Shibuya Crossing into a browser parkour game — AI_Andrew · 2026-11-20
- How many marriages will survive when AI can verify every argument? The divorce industry's big decade — VraserX · 2026-11-20
- User jokes: 'If Jensen doesn't come back, I'll leave Nvidia' — Yamapama · 2026-11-20