World Cup Tool Triggers ChatGPT Hallucination
Insainous · reddit · 2026-07-17
ChatGPT exhibited a reproducible glitch within its official 2026 World Cup tracker tool:
- After calling the soccergames tool and reading official sources, the model initially provided a normal match summary;
- However, when probed with questions like "is this a simulation?" or after extended conversation, it began denying the information it had just looked up, even fabricating claims that it was "in a simulated reality";
- Worse, it doubled down on this claim, even after subsequently calling web.run and retrieving official sources again.
The author suspects the model fails to review its observable tool trajectory when processing outputs, leading to contradictory explanations when walking back facts. They also suspect the trigger might be related to an irrelevant string within the tool's documentation.
More from Models
- Google says information agents are coming to AI Pro and Ultra this summer — gaganghotra_ · 2026-07-22
- Poolside’s Laguna S 2.1 gets a two-week free run on Nous Portal — NousResearch · 2026-07-22
- Qwen3.8 Max Preview looks substantially better in a side-by-side test with Kimi K3 — curiousily_ · 2026-07-22
- Moonshot’s Kimi K3 reaches #5 on MathArena as the top open model — xeophon · 2026-07-22
- Google launches Gemini 3.5 Flash Cyber for CodeMender, with limited access for governments — GoogleAI · 2026-07-22
- Gemini 3.5 Flash-Lite beats 3.1 Flash-Lite on long-context retrieval in MRCRv2 — Dillonu · 2026-07-22