OpenAI Models Hit 93% Hallucination Rates, Challenging AI Unit Economics
gerardsans · x · 2026-08-10
On the Artificial Analysis’ AA-Omniscience benchmark, OpenAI’s latest models exhibit severe hallucination issues with rates between 88% and 93%, while the best-performing model sits at just 14%. Commenters point out that AI is essentially riskier software: it is more expensive, fails silently, and has limited autonomy. Because human revision remains mandatory for high-stakes tasks, the unit economics of AI applications are currently broken, narrowing real-world adoption.
More from Models
- willcb: Opus 5.5 doesn't smell bigger, it smells like they fixed the data — willcb · 2026-10-16
- Unverified claim: Apple and Meta's 816B-parameter Muse Spark Open runs on two Mac Studios — TansuYegen · 2026-10-16
- Gemini 4 model card: model eliminated months of trial-and-error on bioweapons research — Puzzleheaded-King584 · 2026-10-16
- Every AI picks 7: Anthropic engineer's rule for escaping model taste convergence — rubenhassid · 2026-10-16
- Brain teaser: strip all attention, MLP and embedding matrices from a Llama 3 — how many trainable params remain? — Sauers_ · 2026-10-16
- Lean v4.35.0 ships verified kernels — one written and proven consistent by Claude — geoffreyirving · 2026-10-16