ChatGPT invented an entire World Cup — a 5-minute test to catch AI hallucinations
Adventurous-Draft870 · reddit · 2026-09-26
The author asked an AI model to analyze Reddit trends in Morocco; lacking live data, the model fabricated a September World Cup, a nonexistent Moroccan coach, and fake engagement numbers (35,420 upvotes) in a professional-looking report. From this he distilled a 5-minute hallucination detection routine: (1) Name Check — Google any name and require 2+ independent sources; (2) URL Request — ask for direct links, "according to general trends" is a red flag; (3) Date Check — verify event timelines for impossibilities. He argues the root cause is that models are trained on completion, not humility, so "I don't know" is a design-level failure, and he's collecting examples of confidently wrong outputs.
More from Fun
- Game built by Opus 5.5 syncs real NYC weather—NPCs carry umbrellas in the rain — mattshumer_ · 2026-09-26
- Follow-up: dev shares link backing up Opus 5.5 bundling failure — haydendevs · 2026-09-26
- AI builds 50% of a game in one prompt — the last 50% is the actual game — RachelVT42 · 2026-09-26
- Dev says Opus 5.5 ignored explicit instructions, bundling the wrong app: 'they lobotomized Opus' — haydendevs · 2026-09-26
- T2 Remake, the first full AI feature film, premiered in LA over 2 years ago — jordanbayne · 2026-09-26
- Codex outage sends AI-dependent programmers home early, roommate reports — henloitsjoyce · 2026-09-26