User finds ChatGPT invents numbers and Gemini breaks format in simple data task
Exact-Wrangler-5163 · reddit · 2026-09-16
A Reddit user tried a simple 4-step workflow to have AI compute averaged game character stats, but both frontier models failed: Gemini kept changing the required output structure and skipping steps between batches, while ChatGPT outright invented numbers — collapsing armor Low 15.00 / High 20.50 into an impossible 57.74. The post highlights how hard it is to get models to strictly follow rule-based multi-step data workflows.
More from Fun
- GPT-6 agent talks a kid NPC into opening his fortress gate — imjustnewatai · 2026-09-16
- Video: What If Seinfeld's Kramer Had AI Back in 1991? — CSProfKGD · 2026-09-16
- "Jev can't generate text": the meme gets debunked with a screenshot — cocktailpeanut · 2026-09-16
- GPT 6 Reaches Little Lamplight in Playthrough, Hitting the Hardest Part Yet — imjustnewatai · 2026-09-16
- Infosec Account Gets GPUs From Walmart, Then Returns Them — SIGKITTEN · 2026-09-16
- Hallucinating the whole internet: Qwen 27B at 2,000 tok/s powers a zero-network offline browser — sierracatalina · 2026-09-16