When ChatGPT is told to keep trying, it can produce a very confident fake proof

soumitrashukla9 · x · 2026-07-23

A meme-like screenshot shows someone prompting ChatGPT to “keep trying” whenever it says it can’t solve a problem.

The result is a mock-serious research-style answer: “complete finite counterexample,” followed by a long symbolic claim that looks like it escaped from a proof assistant. The joke is that relentless prompting can push the model into increasingly overconfident nonsense.

Original post →

More from Fun

Fun channel →