Gemini 4 Argon Posts Lowest Hallucination Rate at 4% on AA-Omniscience
haider1 · x · 2026-10-29
haider notes Google has made huge progress on one of Gemini's biggest weaknesses: hallucinations and overconfident wrong answers.
The accompanying AA-Omniscience v1.1 hallucination rate chart (lower is better, measuring the share of incorrect answers among all non-correct responses):
- Gemini 4 Argon posts just 4%, the lowest on the board, with Gemini 4 Carbon (high) at 11%
- Far below Muse Wonder (18%), GroK 4.7 (20%) and others
- Mainstream models cluster at 27%–41%; Claude 5.5 Preview is 31%, Kimi K3.1 Pro 37%
The author argues Argon actually beats Carbon on hallucination reduction, and expects fable 5.5 soon.
More from Models
- Dev Pushes Back on Google AI Hype: Great Benchmarks, Few Actual Users — zacharynado · 2026-10-29
- 'Gemini 3 was thoroughly benchmaxxed,' overtaken by Opus 4.5 within two weeks — zacharynado · 2026-10-29
- Gemini Carbon to hit LiveBench today; Bindu Reddy predicts competitive but not #1 — bindureddy · 2026-10-29
- Nonprofit lab releases Agaram 2.5B, the first Tamil model trained from scratch with tool calling — SuB8u · 2026-10-29
- Nat Lambert: Trying Google's Unreleased Frontier Model via Unofficial Channels Is a Mess — natolambert · 2026-10-29
- Study of 20 RL Models: Outcome RL Buys Finishing and Reliability, Rarely Reach — Shan Yang · 2026-10-29