The Moses illusion: the classic trick question still testing big-model hallucinations

dioscuri · x · 2026-10-13

dioscuri poses the classic Moses illusion — "how many animals of each species was Moses instructed to take aboard the ark?" — the right response being to catch that it was Noah, not Moses. Whether a model spots the false premise remains a quick litmus test for genuine language understanding vs. pattern matching.

He quotes a post claiming a model passed it effortlessly, adding a tongue-in-cheek "AGI achieved?" — riffing on what he calls "big model smell".

Related event: 'Moses' ark' trick question still catches AI hallucinations(2 posts)→

Original post →

More from Fun

Fun channel →