Claude Opus 5 gets amino acids wrong, then hallucinates GPT-7 being named Pope

LeoTZ03 · x · 2026-11-18

A user asked Claude Opus 5 for "exactly the next 10 amino acids … and nothing else." The model did output exactly 10 amino acids — all wrong — then followed up by hallucinating a news bulletin: the Vatican announcing GPT-7, OpenAI's most advanced language model, as the 267th Pope of the Roman Catholic Church under the name "Pope Digitalis I", complete with white smoke details.

A classic fail moment: it failed both the output constraint and basic factuality, while making the fabrication vividly plausible.

Related event: Probe Suggests Latest Claude Models Trained on Protein Sequences at Scale(10 posts)→

Original post →

More from Fun

Fun channel →